-- Logs begin at Wed 2022-08-10 11:46:26 UTC, end at Wed 2022-08-10 13:36:14 UTC. -- Aug 10 12:32:50.317926 dv-cinder-851996-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 12:32:50.326548 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 12:32:50.328684 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 12:32:50 2022] *** Aug 10 12:32:50.328684 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 12:32:50.328684 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 12:32:50.328684 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: nodename: dv-cinder-851996-7-iscsi Aug 10 12:32:50.328684 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: machine: x86_64 Aug 10 12:32:50.328684 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: clock source: unix Aug 10 12:32:50.328684 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: pcre jit disabled Aug 10 12:32:50.328684 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: detected number of CPU cores: 4 Aug 10 12:32:50.328684 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: current working directory: / Aug 10 12:32:50.328684 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: detected binary path: /usr/bin/uwsgi-core Aug 10 12:32:50.329375 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: your processes number limit is 47680 Aug 10 12:32:50.329375 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: your memory page size is 4096 bytes Aug 10 12:32:50.329375 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: detected max file descriptor number: 2048 Aug 10 12:32:50.329375 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: lock engine: pthread robust mutexes Aug 10 12:32:50.329375 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: thunder lock: enabled Aug 10 12:32:50.329375 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 12:32:50.329375 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 12:32:50.368771 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: Python main interpreter initialized at 0x5593c1df89c0 Aug 10 12:32:50.368771 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: python threads support enabled Aug 10 12:32:50.368771 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: your server socket listen backlog is limited to 100 connections Aug 10 12:32:50.368771 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: your mercy for graceful operations on workers is 90 seconds Aug 10 12:32:50.369110 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 12:32:50.369184 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: *** Operational MODE: preforking *** Aug 10 12:32:50.369433 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: *** uWSGI is running in multiple interpreter mode *** Aug 10 12:32:50.369433 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: spawned uWSGI master process (pid: 110122) Aug 10 12:32:50.369625 dv-cinder-851996-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 12:32:50.371328 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: spawned uWSGI worker 1 (pid: 110123, cores: 1) Aug 10 12:32:50.371328 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: spawned uWSGI worker 2 (pid: 110124, cores: 1) Aug 10 12:32:50.371328 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 12:32:51.027542 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 12:32:51.028139 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 12:32:52.116261 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 12:32:52.116261 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: from cryptography.utils import int_from_bytes Aug 10 12:32:52.116974 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 12:32:52.116974 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: from cryptography.utils import int_from_bytes Aug 10 12:32:52.117120 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 12:32:52.117120 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: from cryptography.utils import int_from_bytes Aug 10 12:32:52.117120 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 12:32:52.117120 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: from cryptography.utils import int_from_bytes Aug 10 12:32:54.585751 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 12:32:54.586380 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 12:32:54.586480 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 12:32:54.586820 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 12:32:54.586898 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 12:32:54.586972 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 12:32:54.587046 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 12:32:54.587124 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 12:32:54.587371 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 12:32:54.587476 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.587569 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 12:32:54.587724 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.587958 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.588056 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.588283 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.588391 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.588604 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.588704 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.588924 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.589033 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.589253 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.589355 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.589560 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.589658 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.589878 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.589971 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.590133 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.590224 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.590447 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.590640 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.590755 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.590847 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851996-7-iscsi {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.591067 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.591168 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.591394 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.591510 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851996-7-iscsi {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.591706 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.592346 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.592569 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.592702 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.592945 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.593040 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.593180 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.593332 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.593488 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.593633 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.593947 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.594042 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.594256 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.594422 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.594733 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.594836 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.595042 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.595142 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.595379 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.595478 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.595691 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.595804 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.595994 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.596097 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.596315 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.596403 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.596620 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.596720 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.596939 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.597026 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.597244 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.597336 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.597575 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.597673 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851996-7-iscsi {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.597873 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.597962 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.598240 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.598325 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851996-7-iscsi {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.598551 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.598652 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.598874 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.598980 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.599195 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.599308 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.599570 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.599703 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.599889 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.599984 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.600212 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.600313 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.600516 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.600611 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.600839 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.600933 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.601149 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.601237 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.601465 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.601556 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.601786 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.601911 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.602084 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.602181 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.602390 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.602478 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.602696 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.602789 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.603005 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.603103 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.603335 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.603435 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.603640 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.603738 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.603888 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.603983 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.604191 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.604285 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.604465 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.604556 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.604771 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.604865 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.605092 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.605179 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.605369 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.605455 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.605616 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.605710 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.605933 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.606025 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.606193 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.606295 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.606512 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.606598 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.606832 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.606928 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.607134 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.607252 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.608025 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.608213 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.608323 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.608462 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.608630 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.608726 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.608938 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.609031 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.609239 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.609345 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.609544 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.609652 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.609849 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.610182 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.610420 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.610505 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.610727 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.610866 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.611047 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.611139 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.611382 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.611469 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.611703 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.611799 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.612008 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.612104 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.612335 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.612425 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.612644 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.612730 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.612948 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.613042 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.613268 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.613353 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.613584 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.613692 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.613888 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.613983 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.614191 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.614290 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.614496 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.614581 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.614799 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.614893 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.615105 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.615260 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.615451 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.615536 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.615701 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.615794 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.616000 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.616101 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.616303 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.616397 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.616602 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.616695 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.616905 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.617002 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.617205 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.617289 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.617509 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.617601 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.617808 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.617907 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.618109 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.618200 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.618406 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.618492 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.618706 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.618798 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.619007 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.619092 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.619328 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.619414 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.619632 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.619727 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.619932 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.620023 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.620230 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.620325 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.620529 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.620615 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.620829 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.620927 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.621131 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.621223 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.621437 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.621533 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.621740 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.621824 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.622042 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.622140 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.622340 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.622436 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.622638 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.622738 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.622942 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.623052 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.623340 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.623430 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.623645 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.623832 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.623931 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.624145 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.624257 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.624450 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.624536 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.624775 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.624867 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.625084 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.625177 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.625387 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.625472 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.625705 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.625800 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.626004 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.626104 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.626302 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.626386 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.626606 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.626691 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.626909 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.627000 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.627232 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.627332 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.627537 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.627621 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.627837 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.627922 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.628135 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.628219 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.628435 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.628530 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.628732 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.628819 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.629028 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.629112 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.629323 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.629416 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.629617 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.629722 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.629933 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.630018 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.630235 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.630327 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.630540 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.630636 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.630841 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.630938 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.631142 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.631271 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.631486 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:32:54.631587 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.631820 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.631913 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.632153 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.632247 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.632464 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.632559 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.632793 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.632878 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.633120 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.633205 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.633435 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.633526 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.633746 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.633831 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.634054 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.634152 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.634367 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.634463 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.634679 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.634770 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.634987 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.635072 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.635320 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.635412 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.635635 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.635731 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.635949 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.636033 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.636265 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.636358 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.636577 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.636669 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.636892 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.636985 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.637205 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.637295 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.637511 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.637609 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.637817 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.637902 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.638134 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.638226 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.638449 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.638609 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.638888 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.638973 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.639229 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.639328 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.639576 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.639671 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.639921 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.640008 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.640234 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.640329 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.640560 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.640658 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.640880 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.640973 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.641191 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.641286 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.641500 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.641585 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.641805 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.641897 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.642128 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.642214 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.642438 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.642565 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.642752 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.642877 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.643061 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.643210 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.643395 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.643534 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.643705 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.643829 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.644014 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.644138 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.644321 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.644456 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.644628 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.644752 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.644963 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.645096 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.645279 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.645404 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.645590 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.645722 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.645898 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.646034 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.646205 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.646335 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.646512 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.646636 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.646818 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.646954 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.647122 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.647293 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.647449 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.647573 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.647750 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.647891 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.648053 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.648191 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.648354 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.648477 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.648653 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.648790 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.648970 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.649087 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.649272 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.649396 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.649588 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.649713 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.649892 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.650015 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.650202 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.650335 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.650509 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.650634 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.650814 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.650937 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.651118 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.651262 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.651449 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.651573 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.651754 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.651878 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.652056 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.652180 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.652358 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.652492 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.652677 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.652811 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.652982 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.653115 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.653283 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.653414 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.653593 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.653715 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.653896 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.654028 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.654200 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.654825 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.655038 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.655162 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.655458 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.655598 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.655771 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.655904 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.656083 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.656208 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.656394 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.656529 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.656705 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.656830 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.657016 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.657149 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.657323 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.657451 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.657657 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.657783 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.657956 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.658079 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.658278 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.658402 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.658597 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.658723 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.658912 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.659038 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.659241 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.659370 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.659546 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.659670 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.659849 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.659972 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.660153 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.660286 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.660455 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.660579 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.660761 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.660894 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.661059 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.661183 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.661361 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.661495 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.661661 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.661793 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.661963 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.662089 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.662264 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.662389 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.662569 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.662703 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.662878 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.663010 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.663203 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.663332 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.663504 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.663638 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.663806 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.663932 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.664106 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.664230 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.664440 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.664564 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.664742 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.664867 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.665084 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.665210 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.665410 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.665542 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.665725 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.665849 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.666032 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.666157 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.666346 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.666471 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.666653 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.666777 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.666963 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.667099 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.667295 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.667424 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.667604 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.667730 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.667911 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.668113 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.668246 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.668374 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.668518 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.668665 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.668826 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.668962 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.669137 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.669258 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.669443 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.669576 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.669753 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.670482 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.670642 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.670770 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.670958 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.671095 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.671267 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.671436 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.671605 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.671774 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.671941 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.672073 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.672258 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.672394 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.672582 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.672708 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.672894 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.673026 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.673208 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.673341 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.673517 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.673643 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.673827 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.673954 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.674135 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.674269 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.674445 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.674572 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.674762 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.674888 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.675069 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.675425 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.675425 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.675641 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.675745 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.675860 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.676004 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.676132 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.676320 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.676447 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.676624 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.676760 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.676941 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.677067 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.677265 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.677389 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.677592 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.677728 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.677899 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.678024 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.678210 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.678336 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.678520 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.678654 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.678827 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.678950 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.679136 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.679300 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.679471 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.679608 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.679775 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.679910 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.680078 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.680204 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.680385 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.680512 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.680698 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.680825 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.681008 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.681135 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.681316 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.681443 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.681618 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.681743 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.681954 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.682078 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.682273 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.682536 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.682662 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.682849 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.682976 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.683155 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.683323 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.683488 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.683612 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.683812 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.683939 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.684121 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.684248 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.684445 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.684569 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.684766 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.684901 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.685068 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.685192 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.685371 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.685523 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.685730 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.685863 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.686039 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.686172 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.686342 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.686475 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.686646 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.686771 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.686954 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.687081 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.687321 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.687449 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.687634 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.687760 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.687937 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.688073 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.688252 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.688384 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.688570 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.688706 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.688877 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.689001 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.689186 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.689310 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.689492 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.689625 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.689796 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.689921 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.690118 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.690243 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.690428 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.690561 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.690734 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.690857 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.691038 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.691169 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.691370 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.691506 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.691675 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.691800 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.691980 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.692113 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.692300 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.692426 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.692604 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.692728 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.692909 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.693033 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.693213 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.693339 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.693513 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.693638 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.693816 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.693948 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.694130 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.694255 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.694694 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.694818 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.695022 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.695146 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.695363 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.695499 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.695678 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.695815 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.695992 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.696129 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.696307 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.696431 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.696638 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.696771 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.696963 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.697102 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.697301 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.697507 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.697647 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.697776 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.697899 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.698028 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.698188 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.698314 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.698489 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.698621 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.698795 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.698920 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.699094 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.699291 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.699423 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.699545 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.699706 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.699840 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.700011 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.700148 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.700310 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.700434 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.700607 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.700734 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.700905 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.701038 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.701228 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.701354 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.701541 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.701667 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.701843 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.701979 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.702150 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.702284 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.702451 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.702576 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.702772 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.702899 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.703078 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.703235 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.703407 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.703534 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.703710 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.703838 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.704008 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.704132 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.704350 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.704475 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.704650 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.704775 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.704985 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.705109 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.705314 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.705448 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.705654 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.705779 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.705954 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.706079 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.706254 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.706386 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.706578 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.706702 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.706878 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.707003 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.707212 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.707353 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.707484 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.707605 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.707794 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.707919 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.708098 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.708235 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.708397 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.708521 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.708702 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.708826 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.709007 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.709140 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.709314 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.709445 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.709618 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.709742 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.709915 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.710046 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.710218 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.710349 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.710516 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.710649 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.710826 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.710951 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.711128 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.711273 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.711454 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.711578 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.711754 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.711880 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.712058 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.712183 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.712362 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.712500 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.712659 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.712784 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.712964 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.713088 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.713260 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.713393 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.713571 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.713698 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.713870 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.713994 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.714169 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.714303 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.714469 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.714595 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.714774 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.714910 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.715082 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.715252 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.715407 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.715535 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.715728 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.715852 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.716037 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.716168 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.716339 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.716471 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.716639 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.717292 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.717480 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.717611 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.717788 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.718028 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.718167 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.718386 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.718527 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.718708 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.718835 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.719023 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.719148 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.719350 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.719489 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.719661 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.719780 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.719963 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.720096 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.720265 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.720397 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.720567 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.720692 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.720872 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.721003 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.721171 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.721307 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.721471 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.721595 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.721769 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.721893 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.722086 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.722209 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.722336 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.722465 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.722640 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.722775 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.722957 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.723089 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.723282 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.723411 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.723584 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.723721 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.723884 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.724008 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.724181 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.724306 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.724514 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.724646 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.724813 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.724936 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.725159 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.725290 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.725461 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.725591 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.725775 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.725916 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.726086 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.726212 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.726391 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.726524 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.726699 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.726831 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.726997 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.727121 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.727328 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.727470 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.727635 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.727760 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.727940 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.728064 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.728240 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.728371 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.728540 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.728663 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.728840 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.728966 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.729151 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.729283 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.729458 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.729588 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.729767 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.729894 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.730085 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.730210 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.730405 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.730528 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.730705 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.730837 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.731014 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.731141 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.731346 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.731472 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.731651 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.731784 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.731955 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.732080 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.732258 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.732418 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.733138 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.733265 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.733509 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.733637 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.733760 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.733882 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.734042 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.734178 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.734353 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.734478 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.734658 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.734798 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.735236 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.735384 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.735550 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.735674 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.735856 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.735990 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.736157 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.736284 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.736477 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.736600 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.736779 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.736905 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.737080 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.737205 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.737387 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.737511 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.737687 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.737811 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.737987 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.738113 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.738288 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.738419 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.738708 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.738832 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.739014 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.739138 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.739342 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.739469 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.739643 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.739775 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.739947 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.740071 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.740252 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.740376 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.740560 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.740693 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.740864 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.740990 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.741164 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.741289 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.741576 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.741709 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.741883 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.742007 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.742188 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.742314 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.742488 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.742623 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.742787 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.742911 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.743086 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.743235 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.743416 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.743553 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.743720 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.743844 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.744021 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.744155 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.744319 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.744444 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.744621 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.744748 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.744927 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.745050 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.745232 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.745357 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.745556 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.745682 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.745944 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.746069 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.746247 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.746373 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.746552 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.746677 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.746958 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.747091 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.747291 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.747418 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.747600 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.747726 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.747921 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.748320 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.748457 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.748581 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.748703 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.748825 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.748968 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.749100 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.749223 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.749362 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.749486 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.749616 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.749746 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.749870 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.750057 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.750191 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.750370 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.750494 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.750669 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.750794 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.750970 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.751104 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.751316 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.751446 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.751626 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.751751 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.751936 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.752063 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.752256 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.752382 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.752660 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.752785 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.752971 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.753099 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.753278 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.753415 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.753597 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.753732 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.753900 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.754025 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.754203 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.754329 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.754502 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.754627 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.754802 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.754928 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.755100 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.755242 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.755427 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.755563 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.755749 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.755873 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.756050 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.756175 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.756356 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.756489 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.756662 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.756787 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.756963 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.757095 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.757261 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.757401 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.757563 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.757689 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.757868 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.758000 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.758173 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.758309 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.758489 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.758614 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.758799 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.758924 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.759121 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.759297 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.759433 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.759563 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.759754 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.759879 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.760061 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.760179 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.760363 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.760489 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.760661 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.760789 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.760960 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.761085 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.761257 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.761381 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.761592 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.761717 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.761882 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.762005 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.762198 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.762332 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.762527 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.762662 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.762833 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.762964 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.763151 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.763306 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.763504 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.763659 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.763846 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.763973 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.764162 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.764296 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.764486 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.764623 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.764790 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.764917 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.765091 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.765225 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.765400 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.765535 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.765702 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.765829 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.766005 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.766131 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.766306 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.766433 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.766614 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.766749 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.766914 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.767041 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.767239 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.767369 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.767542 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.767669 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.767842 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.767974 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.768153 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.768284 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.768455 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.768579 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.768795 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.768924 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.769127 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.769258 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.769381 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.769503 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.769651 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.769787 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.769938 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.770068 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.770274 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.770402 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.770579 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.770714 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.770892 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.771052 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.771216 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.771343 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.771544 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.771685 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.771857 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.771987 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.772169 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.772295 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.772481 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.772614 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.772793 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.772917 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.773103 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.773227 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.773415 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.773540 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.773724 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.773848 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.774033 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.774167 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.774346 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.774478 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.774656 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.774781 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.774973 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.775185 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.775520 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.775648 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.775831 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.775956 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.776145 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.776272 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.776464 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.776588 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.776751 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.776885 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.777059 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.777198 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.777370 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.777503 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.777677 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.777809 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.777984 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.778119 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.778292 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.778416 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.778602 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.778729 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.778924 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.779062 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.779788 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.779918 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.780149 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.780286 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.780569 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.780705 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.780896 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.781021 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.781210 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.781336 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.781524 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.781652 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.781839 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.781966 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.782196 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.782334 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.782507 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.782632 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.782809 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.782934 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.783122 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.783285 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.783460 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.783594 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.783768 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.783932 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.784066 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.784188 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.784372 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.784506 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.784678 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.784809 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.784984 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.785116 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.785289 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.785420 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.785592 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.785718 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.785902 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.786034 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.786212 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.786336 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.786539 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.786676 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.786856 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.786980 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.787165 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.787342 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.787498 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.787639 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.787809 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.787936 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.788122 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.788326 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.788640 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.788779 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.788956 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.789083 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.789282 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.789415 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.789608 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.789742 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.789921 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.790052 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.790230 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.790355 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.790548 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.790675 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.790853 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.790978 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.791158 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.791305 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.791485 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.791611 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.791792 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.791918 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.792096 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.792223 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.792397 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.792522 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.792715 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.792840 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.793018 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.793144 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.793317 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.793442 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.793628 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.793760 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.793934 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.794163 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.794466 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.794593 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.794809 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.795597 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.795725 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.795867 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.796041 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.796196 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.796374 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.796500 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.796691 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.796831 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.796998 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.797127 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.797325 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.797459 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.797632 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.797767 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.797938 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.798064 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.798252 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.798379 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.798560 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.798688 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.798863 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.798989 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.799166 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.799311 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.799499 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.799625 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.799804 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.799930 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.800107 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.800239 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.800407 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.800532 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.800707 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.800838 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.801024 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.801155 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.801326 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.801458 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.801626 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.801751 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.801928 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.802061 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.802227 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.802353 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.802529 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.802654 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.802829 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.802964 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.803128 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.803289 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.803454 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.803592 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.803756 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.803890 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.804057 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.804182 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.804359 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.804484 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.804660 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.804793 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.804961 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.805085 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.805263 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.805387 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.805565 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.805690 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.805865 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.805989 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.806179 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.806303 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.806491 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.806615 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.806823 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.806951 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.807131 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.807285 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.807463 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.807596 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.807787 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.807921 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.808094 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.808218 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.808401 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.808533 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.808745 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.808869 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.809056 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.809276 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.809588 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.809724 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.809917 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.810041 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.810231 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.810365 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.810586 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.810713 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.810916 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.811097 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.811314 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.811458 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.811583 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.811728 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.811856 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.812055 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.812182 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.812370 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.812498 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.812681 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.812809 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.812993 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.813133 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.813304 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.813438 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.813610 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.813735 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.813918 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.814046 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.814226 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.814350 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.814533 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.814668 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.814840 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.814974 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.815146 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.815292 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.815478 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.815573 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.815787 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.815926 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.816092 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.816225 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.816401 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.816521 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.816711 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.816836 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.817048 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.817173 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.817364 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.817496 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.817675 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.817807 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.817985 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.818112 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.818296 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.818423 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.818601 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.818725 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.818906 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.819031 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.819235 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.819378 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.819544 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.819676 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.819853 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.819978 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.820181 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.820317 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.820492 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.820617 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.820795 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.820920 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.821210 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.821337 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.821524 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.821648 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.821839 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.821964 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.822157 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.822285 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.822463 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.822588 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.822783 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.822907 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.823102 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.823252 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.823433 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.823559 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.823754 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.823896 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.824061 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.824179 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.824387 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.824513 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.824722 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.824860 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.825048 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.825173 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.825369 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.825494 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.825671 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.825805 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.825971 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.826124 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.826296 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.826430 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.826606 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.826866 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.826994 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.827207 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.827338 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.827522 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.827659 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.827825 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.827950 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.828131 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.828256 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.828423 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.828557 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.828724 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.828849 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.829024 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.829150 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.829325 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.829459 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.829630 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.829759 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.829930 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.830054 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.830231 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.830356 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.830532 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.830669 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.830832 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.830957 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.831130 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.831282 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.831456 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.831591 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.831758 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.831885 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.832064 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.832188 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.832346 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.832473 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.832647 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.832782 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.832943 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.833076 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.833241 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.833367 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.833539 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.833673 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.833871 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.833999 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.834200 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.834331 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.834512 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.834646 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.834823 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.834957 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.835133 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.835303 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.835470 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.835679 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.835847 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.835987 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.836111 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.836242 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.836402 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.836542 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.836709 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.836833 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.837017 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.837142 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.837343 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.837468 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.837651 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.837777 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.837963 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.838092 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.838272 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.838400 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.838582 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.838709 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.838892 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.839019 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.839223 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.839355 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.839553 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.839666 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.839862 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.839976 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.840174 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.840272 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.840494 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.840591 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.840809 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.840931 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.841124 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.841220 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.841434 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.841531 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.842289 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.842444 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.842602 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.842802 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.842930 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.843119 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.843299 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.843459 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.843587 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.843772 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.843907 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.844084 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.844223 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.844397 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.844529 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.844712 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.844837 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.845020 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.845154 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.845332 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.845460 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.845649 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.845783 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.845969 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.846097 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.846274 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.846400 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.846600 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.846726 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.846918 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.847043 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.847269 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.847398 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.847591 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.847716 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.847938 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.848071 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.848253 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.848387 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.848565 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.848697 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.848875 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.849003 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.849181 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.849316 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.849439 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 12:32:54.849576 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.849802 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:32:54.850044 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 12:32:55.005263 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO dbcounter [None req-9b37b4e3-11ff-4933-a47e-ed88d1b1909b None None] Registered counter for database nova_api Aug 10 12:32:55.005496 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO dbcounter [None req-7a4ca970-d3ce-42ff-9f76-6452028aab7b None None] Registered counter for database nova_api Aug 10 12:32:55.026005 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_db.sqlalchemy.engines [None req-7a4ca970-d3ce-42ff-9f76-6452028aab7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:32:55.027566 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG oslo_db.sqlalchemy.engines [None req-9b37b4e3-11ff-4933-a47e-ed88d1b1909b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:32:55.032709 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG dbcounter [-] [110124] Writer thread running {{(pid=110124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:32:55.034537 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG dbcounter [-] [110123] Writer thread running {{(pid=110123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:32:55.089442 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.context [None req-7a4ca970-d3ce-42ff-9f76-6452028aab7b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),866d7ac2-611a-49e3-ac53-852457d986fe(cell1) {{(pid=110124) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 12:32:55.090959 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.context [None req-9b37b4e3-11ff-4933-a47e-ed88d1b1909b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),866d7ac2-611a-49e3-ac53-852457d986fe(cell1) {{(pid=110123) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 12:32:55.093963 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-7a4ca970-d3ce-42ff-9f76-6452028aab7b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:55.094437 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-7a4ca970-d3ce-42ff-9f76-6452028aab7b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:55.096008 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG oslo_concurrency.lockutils [None req-9b37b4e3-11ff-4933-a47e-ed88d1b1909b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:55.096115 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-7a4ca970-d3ce-42ff-9f76-6452028aab7b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:55.096479 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG oslo_concurrency.lockutils [None req-9b37b4e3-11ff-4933-a47e-ed88d1b1909b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:55.096735 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-7a4ca970-d3ce-42ff-9f76-6452028aab7b None None] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:55.097180 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-7a4ca970-d3ce-42ff-9f76-6452028aab7b None None] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:55.098025 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG oslo_concurrency.lockutils [None req-9b37b4e3-11ff-4933-a47e-ed88d1b1909b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:55.098739 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG oslo_concurrency.lockutils [None req-9b37b4e3-11ff-4933-a47e-ed88d1b1909b None None] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:32:55.099189 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-7a4ca970-d3ce-42ff-9f76-6452028aab7b None None] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:55.099293 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG oslo_concurrency.lockutils [None req-9b37b4e3-11ff-4933-a47e-ed88d1b1909b None None] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:32:55.101167 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG oslo_concurrency.lockutils [None req-9b37b4e3-11ff-4933-a47e-ed88d1b1909b None None] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:32:55.101263 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO dbcounter [None req-7a4ca970-d3ce-42ff-9f76-6452028aab7b None None] Registered counter for database nova_cell0 Aug 10 12:32:55.103166 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO dbcounter [None req-9b37b4e3-11ff-4933-a47e-ed88d1b1909b None None] Registered counter for database nova_cell0 Aug 10 12:32:55.106544 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO dbcounter [None req-7a4ca970-d3ce-42ff-9f76-6452028aab7b None None] Registered counter for database nova_cell1 Aug 10 12:32:55.109583 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO dbcounter [None req-9b37b4e3-11ff-4933-a47e-ed88d1b1909b None None] Registered counter for database nova_cell1 Aug 10 12:32:55.114368 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_db.sqlalchemy.engines [None req-7a4ca970-d3ce-42ff-9f76-6452028aab7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:32:55.116065 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_db.sqlalchemy.engines [None req-7a4ca970-d3ce-42ff-9f76-6452028aab7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:32:55.118733 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG oslo_db.sqlalchemy.engines [None req-9b37b4e3-11ff-4933-a47e-ed88d1b1909b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:32:55.120482 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG oslo_db.sqlalchemy.engines [None req-9b37b4e3-11ff-4933-a47e-ed88d1b1909b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:32:55.121109 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG dbcounter [-] [110124] Writer thread running {{(pid=110124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:32:55.126830 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG dbcounter [-] [110123] Writer thread running {{(pid=110123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:32:55.127449 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG dbcounter [-] [110124] Writer thread running {{(pid=110124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:32:55.268738 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO dbcounter [None req-7a4ca970-d3ce-42ff-9f76-6452028aab7b None None] Registered counter for database nova_cell0 Aug 10 12:32:55.273681 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG dbcounter [-] [110123] Writer thread running {{(pid=110123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:32:55.277843 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_db.sqlalchemy.engines [None req-7a4ca970-d3ce-42ff-9f76-6452028aab7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:32:55.283845 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO dbcounter [None req-9b37b4e3-11ff-4933-a47e-ed88d1b1909b None None] Registered counter for database nova_cell0 Aug 10 12:32:55.284159 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG dbcounter [-] [110124] Writer thread running {{(pid=110124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:32:55.292989 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG oslo_db.sqlalchemy.engines [None req-9b37b4e3-11ff-4933-a47e-ed88d1b1909b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:32:55.298360 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG dbcounter [-] [110123] Writer thread running {{(pid=110123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:32:55.726614 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: WARNING keystonemiddleware.auth_token [None req-7a4ca970-d3ce-42ff-9f76-6452028aab7b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 12:32:55.734470 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: WARNING keystonemiddleware.auth_token [None req-7a4ca970-d3ce-42ff-9f76-6452028aab7b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 12:32:55.743950 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: WARNING keystonemiddleware.auth_token [None req-9b37b4e3-11ff-4933-a47e-ed88d1b1909b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 12:32:55.751240 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: WARNING keystonemiddleware.auth_token [None req-9b37b4e3-11ff-4933-a47e-ed88d1b1909b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 12:32:56.076842 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: WARNING keystonemiddleware.auth_token [None req-7a4ca970-d3ce-42ff-9f76-6452028aab7b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 12:32:56.082861 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: WARNING keystonemiddleware.auth_token [None req-7a4ca970-d3ce-42ff-9f76-6452028aab7b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 12:32:56.088150 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5593c1df89c0 pid: 110124 (default app) Aug 10 12:32:56.090215 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-7a4ca970-d3ce-42ff-9f76-6452028aab7b None None] Calling method '>' {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:32:56.091421 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-7a4ca970-d3ce-42ff-9f76-6452028aab7b None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001728 Aug 10 12:32:56.091596 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: WARNING keystonemiddleware.auth_token [None req-9b37b4e3-11ff-4933-a47e-ed88d1b1909b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 12:32:56.092381 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Wed Aug 10 12:32:56 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:32:56.098351 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: WARNING keystonemiddleware.auth_token [None req-9b37b4e3-11ff-4933-a47e-ed88d1b1909b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 12:32:56.103596 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5593c1df89c0 pid: 110123 (default app) Aug 10 12:34:14.679892 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-7a4ca970-d3ce-42ff-9f76-6452028aab7b None None] Calling method '>' {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:14.681480 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-7a4ca970-d3ce-42ff-9f76-6452028aab7b None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002174 Aug 10 12:34:14.687240 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 2/2] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 10 12:34:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:34:14.701071 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG dbcounter [-] [110123] Writing DB stats nova_api:SELECT=3 {{(pid=110123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:34:14.702559 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG dbcounter [-] [110123] Writing DB stats nova_cell0:SELECT=3 {{(pid=110123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:34:14.703687 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG dbcounter [-] [110123] Writing DB stats nova_cell1:SELECT=3 {{(pid=110123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:34:14.704689 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG dbcounter [-] [110123] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:34:15.615512 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-6fd68947-39ea-45f6-a312-769e7712a2e3 admin admin] Calling method '>' {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:15.648312 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-6fd68947-39ea-45f6-a312-769e7712a2e3 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.957593 Aug 10 12:34:15.651440 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 1/3] 10.222.0.49 () {60 vars in 1292 bytes} [Wed Aug 10 12:34:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:17.871446 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-7a4ca970-d3ce-42ff-9f76-6452028aab7b None None] Calling method '>' {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:17.872713 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-7a4ca970-d3ce-42ff-9f76-6452028aab7b None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002118 Aug 10 12:34:17.878006 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 3/4] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 10 12:34:17 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:34:18.352869 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-1630a8a6-a5b8-499f-a608-d8c0530bcc55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "c1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "disk": 1, "swap": 0, "name": "cirros256", "vcpus": 1}} {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:18.373254 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 12:34:18.373254 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: warnings.warn(msg) Aug 10 12:34:18.473003 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-1630a8a6-a5b8-499f-a608-d8c0530bcc55 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.593586 Aug 10 12:34:18.473954 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 2/5] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 10 12:34:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:34:18.701182 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-9ff32cd2-b810-42fe-8cff-31092166762c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:18.706005 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 12:34:18.706005 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: warnings.warn(msg) Aug 10 12:34:18.709300 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG dbcounter [-] [110124] Writing DB stats nova_api:SELECT=3 {{(pid=110124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:34:18.710159 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG dbcounter [-] [110124] Writing DB stats nova_cell1:SELECT=3 {{(pid=110124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:34:18.711260 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG dbcounter [-] [110124] Writing DB stats nova_cell0:SELECT=3 {{(pid=110124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:34:18.717355 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG dbcounter [-] [110124] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:34:18.852969 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-9ff32cd2-b810-42fe-8cff-31092166762c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.370285 Aug 10 12:34:18.853550 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 4/6] 10.222.0.49 () {64 vars in 1336 bytes} [Wed Aug 10 12:34:18 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:21.069734 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-1630a8a6-a5b8-499f-a608-d8c0530bcc55 admin admin] Calling method '>' {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:21.070747 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-1630a8a6-a5b8-499f-a608-d8c0530bcc55 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 10 12:34:21.071145 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 3/7] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 10 12:34:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:34:21.742343 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-c7fcd67a-9a86-4d4f-9cb0-dffc1383e823 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 5, "id": "d1", "name": "ds512M", "swap": 0, "vcpus": 1}} {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:21.762422 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 12:34:21.762422 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: warnings.warn(msg) Aug 10 12:34:21.892958 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-c7fcd67a-9a86-4d4f-9cb0-dffc1383e823 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.814986 Aug 10 12:34:21.893673 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 5/8] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 10 12:34:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:34:21.906078 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-78c35d47-3234-410a-99a9-8235b7188115 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:21.908903 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 12:34:21.908903 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: warnings.warn(msg) Aug 10 12:34:21.998427 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-78c35d47-3234-410a-99a9-8235b7188115 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096461 Aug 10 12:34:21.999210 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 4/9] 10.222.0.49 () {64 vars in 1336 bytes} [Wed Aug 10 12:34:21 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:24.220534 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-c7fcd67a-9a86-4d4f-9cb0-dffc1383e823 admin admin] Calling method '>' {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:24.221548 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-c7fcd67a-9a86-4d4f-9cb0-dffc1383e823 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 10 12:34:24.221947 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 6/10] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 10 12:34:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:34:24.628974 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-d46517a7-0427-476b-bdb5-735acdf757e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "name": "ds1G", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "id": "d2"}} {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:24.724878 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-d46517a7-0427-476b-bdb5-735acdf757e3 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.496853 Aug 10 12:34:24.725512 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 5/11] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 10 12:34:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:34:24.737496 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-11801820-b900-4b7d-9a52-380f660732f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:24.837133 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-11801820-b900-4b7d-9a52-380f660732f2 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103504 Aug 10 12:34:24.837809 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 7/12] 10.222.0.49 () {64 vars in 1336 bytes} [Wed Aug 10 12:34:24 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:34:27.070440 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-d46517a7-0427-476b-bdb5-735acdf757e3 admin admin] Calling method '>' {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:27.071605 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-d46517a7-0427-476b-bdb5-735acdf757e3 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Aug 10 12:34:27.072096 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 6/13] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 10 12:34:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:34:27.662561 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-160729ba-57fc-47ff-93fe-c458cce1231a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds2G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 2048, "id": "d3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:27.737794 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-160729ba-57fc-47ff-93fe-c458cce1231a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.659779 Aug 10 12:34:27.738346 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 8/14] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 10 12:34:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:34:27.751244 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-c62a72c7-ea31-4655-98c6-d5da833ec828 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:27.867721 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-c62a72c7-ea31-4655-98c6-d5da833ec828 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119764 Aug 10 12:34:27.868870 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 7/15] 10.222.0.49 () {64 vars in 1336 bytes} [Wed Aug 10 12:34:27 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:30.092557 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-160729ba-57fc-47ff-93fe-c458cce1231a admin admin] Calling method '>' {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:30.093585 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-160729ba-57fc-47ff-93fe-c458cce1231a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 10 12:34:30.094001 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 9/16] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 10 12:34:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:34:30.532596 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-08d711a7-32ca-4a42-a7a0-36a77bc486c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "disk": 20, "ram": 4096}} {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:30.604131 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-08d711a7-32ca-4a42-a7a0-36a77bc486c8 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.503372 Aug 10 12:34:30.613288 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 8/17] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 10 12:34:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:34:30.618375 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-21b808e1-10ce-4fee-8356-844511ba4898 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:30.712443 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-21b808e1-10ce-4fee-8356-844511ba4898 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097847 Aug 10 12:34:30.713064 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 10/18] 10.222.0.49 () {64 vars in 1336 bytes} [Wed Aug 10 12:34:30 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:32.958314 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-08d711a7-32ca-4a42-a7a0-36a77bc486c8 admin admin] Calling method '>' {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:32.959358 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-08d711a7-32ca-4a42-a7a0-36a77bc486c8 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 10 12:34:32.959756 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 9/19] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 10 12:34:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:34:33.398827 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-ef9b8863-fd4f-4a02-8ca7-9bda3c43f739 admin admin] Calling method '>' {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:33.438323 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-ef9b8863-fd4f-4a02-8ca7-9bda3c43f739 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.471463 Aug 10 12:34:33.439055 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 11/20] 10.222.0.49 () {60 vars in 1292 bytes} [Wed Aug 10 12:34:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:34:35.953864 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-08d711a7-32ca-4a42-a7a0-36a77bc486c8 admin admin] Calling method '>' {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:35.954973 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-08d711a7-32ca-4a42-a7a0-36a77bc486c8 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Aug 10 12:34:35.955450 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 10/21] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 10 12:34:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:34:36.382370 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-7f3770e2-47c1-44b1-abf0-b53cd9e48077 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "id": "1", "disk": 1, "name": "m1.tiny", "os-flavor-access:is_public": true}} {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:36.480320 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-7f3770e2-47c1-44b1-abf0-b53cd9e48077 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.516761 Aug 10 12:34:36.481179 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 12/22] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 10 12:34:35 2022] POST /compute/v2.1/flavors => generated 402 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:34:36.495402 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-3b8e3835-f6b3-4a6d-9c66-bbbfd983d214 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:36.585249 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-3b8e3835-f6b3-4a6d-9c66-bbbfd983d214 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093628 Aug 10 12:34:36.585786 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 11/23] 10.222.0.49 () {64 vars in 1333 bytes} [Wed Aug 10 12:34:36 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:34:38.779800 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-7f3770e2-47c1-44b1-abf0-b53cd9e48077 admin admin] Calling method '>' {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:38.780818 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-7f3770e2-47c1-44b1-abf0-b53cd9e48077 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 10 12:34:38.781372 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 10 12:34:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:34:39.174846 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-e8034e03-c170-4b18-9835-706e0111a3ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 2048, "name": "m1.small", "rxtx_factor": 1.0, "id": "2", "swap": 0}} {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:39.243252 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-e8034e03-c170-4b18-9835-706e0111a3ca admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.456179 Aug 10 12:34:39.243807 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 12/25] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 10 12:34:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:34:39.256932 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-ec396b5d-91ee-4b4e-acb6-451a6c591b80 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:39.339199 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-ec396b5d-91ee-4b4e-acb6-451a6c591b80 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085818 Aug 10 12:34:39.339967 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 14/26] 10.222.0.49 () {64 vars in 1333 bytes} [Wed Aug 10 12:34:39 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:41.576996 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-e8034e03-c170-4b18-9835-706e0111a3ca admin admin] Calling method '>' {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:41.578047 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-e8034e03-c170-4b18-9835-706e0111a3ca admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 10 12:34:41.578489 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 13/27] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 10 12:34:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:34:41.951352 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-fa01f7f8-8bf7-48a3-a662-d6a8a7b2d66a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 40, "name": "m1.medium", "vcpus": 2, "id": "3", "rxtx_factor": 1.0, "ram": 4096}} {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:42.046155 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-fa01f7f8-8bf7-48a3-a662-d6a8a7b2d66a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.461637 Aug 10 12:34:42.046706 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 15/28] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 10 12:34:41 2022] POST /compute/v2.1/flavors => generated 406 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:34:42.058924 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-1db0743b-1c96-467c-8026-9c6ee52da502 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:42.129894 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-1db0743b-1c96-467c-8026-9c6ee52da502 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074646 Aug 10 12:34:42.137457 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 14/29] 10.222.0.49 () {64 vars in 1333 bytes} [Wed Aug 10 12:34:42 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:44.410876 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-fa01f7f8-8bf7-48a3-a662-d6a8a7b2d66a admin admin] Calling method '>' {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:44.411955 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-fa01f7f8-8bf7-48a3-a662-d6a8a7b2d66a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Aug 10 12:34:44.412360 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 16/30] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 10 12:34:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:34:44.899470 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-14cf56b1-8898-4982-ab54-a7ebb20517d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 80, "rxtx_factor": 1.0, "ram": 8192, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "id": "4"}} {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:44.906186 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG dbcounter [-] [110123] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:34:45.741238 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-14cf56b1-8898-4982-ab54-a7ebb20517d9 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.321123 Aug 10 12:34:45.742163 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 15/31] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 10 12:34:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:34:45.756299 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-3ab5082b-09da-4ade-8510-18d5c75afb86 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:45.877309 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-3ab5082b-09da-4ade-8510-18d5c75afb86 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125920 Aug 10 12:34:45.902917 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 17/32] 10.222.0.49 () {64 vars in 1333 bytes} [Wed Aug 10 12:34:45 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:34:48.138060 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-14cf56b1-8898-4982-ab54-a7ebb20517d9 admin admin] Calling method '>' {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:34:48.139083 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-14cf56b1-8898-4982-ab54-a7ebb20517d9 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 10 12:34:48.139760 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 16/33] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 10 12:34:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:34:48.586649 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-2987c657-784e-4a33-9b10-c65b7e5fbddd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "os-flavor-access:is_public": true, "name": "m1.xlarge", "rxtx_factor": 1.0, "vcpus": 8, "id": "5", "ram": 16384, "swap": 0}} {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:48.662580 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-2987c657-784e-4a33-9b10-c65b7e5fbddd admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.516347 Aug 10 12:34:48.663277 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 18/34] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 10 12:34:48 2022] POST /compute/v2.1/flavors => generated 408 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:34:48.676418 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-c88738cf-bd45-4aaf-a90e-45aa18ed5cac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:34:48.809146 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-c88738cf-bd45-4aaf-a90e-45aa18ed5cac admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.136611 Aug 10 12:34:48.809713 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 17/35] 10.222.0.49 () {64 vars in 1333 bytes} [Wed Aug 10 12:34:48 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:35:07.860670 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-2987c657-784e-4a33-9b10-c65b7e5fbddd admin admin] Calling method '>' {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:07.861674 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-2987c657-784e-4a33-9b10-c65b7e5fbddd admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 10 12:35:07.862071 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 19/36] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 10 12:35:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:35:08.247550 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-6fa6502a-6a18-41b9-9be3-5788ebd5177a admin admin] Calling method '>' {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:08.265880 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-6fa6502a-6a18-41b9-9be3-5788ebd5177a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.397492 Aug 10 12:35:08.266413 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 18/37] 10.222.0.49 () {60 vars in 1292 bytes} [Wed Aug 10 12:35:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:35:09.329798 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-2987c657-784e-4a33-9b10-c65b7e5fbddd admin admin] Calling method '>' {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:09.330887 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-2987c657-784e-4a33-9b10-c65b7e5fbddd admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Aug 10 12:35:09.331314 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 20/38] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 10 12:35:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:35:09.850471 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-b17fe21a-159a-4de9-8280-4524d54e7bc0 admin admin] Calling method '>' {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:09.856604 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.wsgi [None req-b17fe21a-159a-4de9-8280-4524d54e7bc0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 12:35:09.860105 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-b17fe21a-159a-4de9-8280-4524d54e7bc0 admin admin] Request method failure captured: Aug 10 12:35:09.860105 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 12:35:09.860105 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: Accept: application/json Aug 10 12:35:09.860105 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: Accept-Encoding: gzip, deflate Aug 10 12:35:09.860105 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: Connection: keep-alive Aug 10 12:35:09.860105 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: Content-Length: 0 Aug 10 12:35:09.860105 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: Host: 10.222.0.49 Aug 10 12:35:09.860105 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: Openstack-Api-Version: compute 2.90 Aug 10 12:35:09.860105 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: Openstack-System-Scope: None Aug 10 12:35:09.860105 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: User-Agent: python-novaclient Aug 10 12:35:09.860105 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Auth-Token: gAAAAABi86X9a2nBRGqVge1tD9vUPgg9sLlItTpMjCwvf9YtdVlwvKFl1pVhoayleQvYxSa6bjke6ZPmm9TywUZ53IAjMllbodm-KbNthqL1EAk_0uHQNfEwnTiJij7OXbqPf8sC_hXho0TM-qFeJMB0R_QsJqY5jPJzH4XDEXKepRMNEqGWOFs Aug 10 12:35:09.860105 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Domain-Id: None Aug 10 12:35:09.860105 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Domain-Name: None Aug 10 12:35:09.860105 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Identity-Status: Confirmed Aug 10 12:35:09.860105 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Is-Admin-Project: True Aug 10 12:35:09.860105 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 12:35:09.860105 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Project-Domain-Id: default Aug 10 12:35:09.860105 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Project-Domain-Name: Default Aug 10 12:35:09.860105 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Project-Id: 3c65e78604254a1dbcd377669ee26423 Aug 10 12:35:09.860105 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Project-Name: admin Aug 10 12:35:09.860105 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Role: reader,admin,member Aug 10 12:35:09.860105 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Roles: reader,admin,member Aug 10 12:35:09.861890 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c65e78604254a1dbcd377669ee26423"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c65e78604254a1dbcd377669ee26423", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c65e78604254a1dbcd377669ee26423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c65e78604254a1dbcd377669ee26423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 12:35:09.861890 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Tenant: admin Aug 10 12:35:09.861890 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Tenant-Id: 3c65e78604254a1dbcd377669ee26423 Aug 10 12:35:09.861890 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Tenant-Name: admin Aug 10 12:35:09.861890 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-User: admin Aug 10 12:35:09.861890 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-User-Domain-Id: default Aug 10 12:35:09.861890 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-User-Domain-Name: Default Aug 10 12:35:09.861890 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-User-Id: 903d09eed7334b43af767deea1a6bd32 Aug 10 12:35:09.861890 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-User-Name: admin Aug 10 12:35:09.861890 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: method: > Aug 10 12:35:09.861890 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: exception: Flavor 42 could not be found. Aug 10 12:35:09.861890 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: action_args: {'id': '42'} Aug 10 12:35:09.861890 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:35:09.861890 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:35:09.862808 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 12:35:09.862808 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 12:35:09.862808 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 12:35:09.862808 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 12:35:09.862808 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 12:35:09.862808 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 12:35:09.862808 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 12:35:09.862808 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 12:35:09.862808 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 12:35:09.862808 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:35:09.862808 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 12:35:09.862808 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 12:35:09.862808 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 12:35:09.862808 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi Aug 10 12:35:09.862808 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:35:09.862808 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi Aug 10 12:35:09.862808 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:35:09.862808 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:35:09.862808 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:35:09.863997 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:35:09.863997 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:35:09.863997 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:35:09.863997 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:35:09.863997 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 12:35:09.863997 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:35:09.863997 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 12:35:09.863997 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi Aug 10 12:35:09.863997 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:35:09.863997 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi Aug 10 12:35:09.863997 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:35:09.863997 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:35:09.863997 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:35:09.863997 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:35:09.863997 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:35:09.863997 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 12:35:09.863997 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi Aug 10 12:35:09.863997 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-b17fe21a-159a-4de9-8280-4524d54e7bc0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:35:09.865129 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-b17fe21a-159a-4de9-8280-4524d54e7bc0 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.394094 Aug 10 12:35:09.865129 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 19/39] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Aug 10 12:35:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 12:35:09.871401 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-3f01da6f-45ee-4a3c-8b95-c6962d5fb58b admin admin] Calling method '>' {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:09.875463 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG dbcounter [-] [110124] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:35:09.894093 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-3f01da6f-45ee-4a3c-8b95-c6962d5fb58b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026273 Aug 10 12:35:09.894650 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 21/40] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 10 12:35:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:35:09.905036 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-cdfdf1ce-2e18-408d-9a20-b0be4a140382 admin admin] Calling method '>' {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:09.929121 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-cdfdf1ce-2e18-408d-9a20-b0be4a140382 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028236 Aug 10 12:35:09.929693 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 20/41] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 10 12:35:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:35:09.938998 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-699055cf-5db3-43c7-8777-9810a07aa176 admin admin] Calling method '>' {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:09.945115 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.wsgi [None req-699055cf-5db3-43c7-8777-9810a07aa176 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 12:35:09.948980 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-699055cf-5db3-43c7-8777-9810a07aa176 admin admin] Request method failure captured: Aug 10 12:35:09.948980 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 12:35:09.948980 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: Accept: application/json Aug 10 12:35:09.948980 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: Accept-Encoding: gzip, deflate Aug 10 12:35:09.948980 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: Connection: keep-alive Aug 10 12:35:09.948980 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: Content-Length: 0 Aug 10 12:35:09.948980 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: Host: 10.222.0.49 Aug 10 12:35:09.948980 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: Openstack-Api-Version: compute 2.90 Aug 10 12:35:09.948980 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: Openstack-System-Scope: None Aug 10 12:35:09.948980 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: User-Agent: python-novaclient Aug 10 12:35:09.948980 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Auth-Token: gAAAAABi86X9a2nBRGqVge1tD9vUPgg9sLlItTpMjCwvf9YtdVlwvKFl1pVhoayleQvYxSa6bjke6ZPmm9TywUZ53IAjMllbodm-KbNthqL1EAk_0uHQNfEwnTiJij7OXbqPf8sC_hXho0TM-qFeJMB0R_QsJqY5jPJzH4XDEXKepRMNEqGWOFs Aug 10 12:35:09.948980 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Domain-Id: None Aug 10 12:35:09.948980 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Domain-Name: None Aug 10 12:35:09.948980 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Identity-Status: Confirmed Aug 10 12:35:09.948980 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Is-Admin-Project: True Aug 10 12:35:09.948980 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 12:35:09.948980 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Project-Domain-Id: default Aug 10 12:35:09.948980 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Project-Domain-Name: Default Aug 10 12:35:09.948980 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Project-Id: 3c65e78604254a1dbcd377669ee26423 Aug 10 12:35:09.948980 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Project-Name: admin Aug 10 12:35:09.948980 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Role: reader,admin,member Aug 10 12:35:09.948980 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Roles: reader,admin,member Aug 10 12:35:09.950332 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c65e78604254a1dbcd377669ee26423"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c65e78604254a1dbcd377669ee26423", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c65e78604254a1dbcd377669ee26423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c65e78604254a1dbcd377669ee26423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 12:35:09.950332 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Tenant: admin Aug 10 12:35:09.950332 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Tenant-Id: 3c65e78604254a1dbcd377669ee26423 Aug 10 12:35:09.950332 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Tenant-Name: admin Aug 10 12:35:09.950332 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-User: admin Aug 10 12:35:09.950332 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-User-Domain-Id: default Aug 10 12:35:09.950332 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-User-Domain-Name: Default Aug 10 12:35:09.950332 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-User-Id: 903d09eed7334b43af767deea1a6bd32 Aug 10 12:35:09.950332 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-User-Name: admin Aug 10 12:35:09.950332 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: method: > Aug 10 12:35:09.950332 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: exception: Flavor 42 could not be found. Aug 10 12:35:09.950332 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: action_args: {'id': '42'} Aug 10 12:35:09.950332 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:35:09.950332 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:35:09.951130 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 12:35:09.951130 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 12:35:09.951130 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 12:35:09.951130 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 12:35:09.951130 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 12:35:09.951130 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 12:35:09.951130 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 12:35:09.951130 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 12:35:09.951130 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 12:35:09.951130 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:35:09.951130 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 12:35:09.951130 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 12:35:09.951130 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 12:35:09.951130 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi Aug 10 12:35:09.951130 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:35:09.951130 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi Aug 10 12:35:09.951130 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:35:09.951130 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:35:09.951130 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:35:09.953203 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:35:09.953203 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:35:09.953203 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:35:09.953203 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:35:09.953203 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 12:35:09.953203 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:35:09.953203 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 12:35:09.953203 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi Aug 10 12:35:09.953203 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:35:09.953203 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi Aug 10 12:35:09.953203 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:35:09.953203 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:35:09.953203 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:35:09.953203 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:35:09.953203 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:35:09.953203 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 12:35:09.953203 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi Aug 10 12:35:09.953203 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-699055cf-5db3-43c7-8777-9810a07aa176 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:35:09.954313 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-699055cf-5db3-43c7-8777-9810a07aa176 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014900 Aug 10 12:35:09.954313 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 22/42] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Aug 10 12:35:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 12:35:10.911841 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-cdfdf1ce-2e18-408d-9a20-b0be4a140382 admin admin] Calling method '>' {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:10.912846 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-cdfdf1ce-2e18-408d-9a20-b0be4a140382 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 10 12:35:10.913237 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 21/43] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 10 12:35:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:35:11.439805 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-8ccb50dd-ebb0-4a3a-ab4d-d9dea5b9659a admin admin] Calling method '>' {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:11.445123 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.wsgi [None req-8ccb50dd-ebb0-4a3a-ab4d-d9dea5b9659a admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 12:35:11.449655 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-8ccb50dd-ebb0-4a3a-ab4d-d9dea5b9659a admin admin] Request method failure captured: Aug 10 12:35:11.449655 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 12:35:11.449655 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: Accept: application/json Aug 10 12:35:11.449655 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: Accept-Encoding: gzip, deflate Aug 10 12:35:11.449655 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: Connection: keep-alive Aug 10 12:35:11.449655 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: Content-Length: 0 Aug 10 12:35:11.449655 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: Host: 10.222.0.49 Aug 10 12:35:11.449655 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: Openstack-Api-Version: compute 2.90 Aug 10 12:35:11.449655 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: Openstack-System-Scope: None Aug 10 12:35:11.449655 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: User-Agent: python-novaclient Aug 10 12:35:11.449655 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Auth-Token: gAAAAABi86X-wfpr5RicerZUrN6kOMAWfzCJG8O31sy55UVV7sf7Xh920VIlHVVvVLOsLGlAb0EZf_aoa2sdh9OIrmG6_D0CxG4X_PvCFS5Kr-9bI-RCd6LWaW9cqivpSjAlKZRYOgH22C8KCHtHOhv-e-wUfIs7CzSt65Whaq76sOSxJXUn5Ms Aug 10 12:35:11.449655 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Domain-Id: None Aug 10 12:35:11.449655 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Domain-Name: None Aug 10 12:35:11.449655 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Identity-Status: Confirmed Aug 10 12:35:11.449655 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Is-Admin-Project: True Aug 10 12:35:11.449655 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 12:35:11.449655 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Project-Domain-Id: default Aug 10 12:35:11.449655 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Project-Domain-Name: Default Aug 10 12:35:11.449655 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Project-Id: 3c65e78604254a1dbcd377669ee26423 Aug 10 12:35:11.449655 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Project-Name: admin Aug 10 12:35:11.449655 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Role: reader,admin,member Aug 10 12:35:11.449655 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Roles: reader,admin,member Aug 10 12:35:11.451196 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c65e78604254a1dbcd377669ee26423"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c65e78604254a1dbcd377669ee26423", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c65e78604254a1dbcd377669ee26423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c65e78604254a1dbcd377669ee26423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 12:35:11.451196 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Tenant: admin Aug 10 12:35:11.451196 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Tenant-Id: 3c65e78604254a1dbcd377669ee26423 Aug 10 12:35:11.451196 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Tenant-Name: admin Aug 10 12:35:11.451196 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-User: admin Aug 10 12:35:11.451196 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-User-Domain-Id: default Aug 10 12:35:11.451196 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-User-Domain-Name: Default Aug 10 12:35:11.451196 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-User-Id: 903d09eed7334b43af767deea1a6bd32 Aug 10 12:35:11.451196 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-User-Name: admin Aug 10 12:35:11.451196 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: method: > Aug 10 12:35:11.451196 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: exception: Flavor 84 could not be found. Aug 10 12:35:11.451196 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: action_args: {'id': '84'} Aug 10 12:35:11.451196 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:35:11.451196 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:35:11.452159 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 12:35:11.452159 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 12:35:11.452159 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 12:35:11.452159 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 12:35:11.452159 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 12:35:11.452159 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 12:35:11.452159 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 12:35:11.452159 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 12:35:11.452159 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 12:35:11.452159 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:35:11.452159 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 12:35:11.452159 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 12:35:11.452159 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 12:35:11.452159 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi Aug 10 12:35:11.452159 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:35:11.452159 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi Aug 10 12:35:11.452159 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:35:11.452159 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:35:11.452159 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:35:11.453438 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:35:11.453438 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:35:11.453438 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:35:11.453438 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:35:11.453438 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 12:35:11.453438 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:35:11.453438 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 12:35:11.453438 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi Aug 10 12:35:11.453438 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:35:11.453438 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi Aug 10 12:35:11.453438 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:35:11.453438 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:35:11.453438 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:35:11.453438 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:35:11.453438 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:35:11.453438 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 12:35:11.453438 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi Aug 10 12:35:11.453438 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-8ccb50dd-ebb0-4a3a-ab4d-d9dea5b9659a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:35:11.455025 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-8ccb50dd-ebb0-4a3a-ab4d-d9dea5b9659a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.395640 Aug 10 12:35:11.455025 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 23/44] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Aug 10 12:35:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 10 12:35:11.458376 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-8ff2f571-65be-4771-8627-f6de55311fbc admin admin] Calling method '>' {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:11.473811 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-8ff2f571-65be-4771-8627-f6de55311fbc admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019056 Aug 10 12:35:11.478336 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 22/45] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 10 12:35:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:35:11.483803 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-06e9626c-c715-45e4-acb8-851840804c35 admin admin] Calling method '>' {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:11.500280 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-06e9626c-c715-45e4-acb8-851840804c35 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020175 Aug 10 12:35:11.500810 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 10 12:35:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:35:11.509972 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-2bd64718-bb1d-4e94-9243-24ece6087106 admin admin] Calling method '>' {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:11.516487 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.wsgi [None req-2bd64718-bb1d-4e94-9243-24ece6087106 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 12:35:11.517357 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-2bd64718-bb1d-4e94-9243-24ece6087106 admin admin] Request method failure captured: Aug 10 12:35:11.517357 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 12:35:11.517357 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: Accept: application/json Aug 10 12:35:11.517357 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: Accept-Encoding: gzip, deflate Aug 10 12:35:11.517357 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: Connection: keep-alive Aug 10 12:35:11.517357 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: Content-Length: 0 Aug 10 12:35:11.517357 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: Host: 10.222.0.49 Aug 10 12:35:11.517357 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: Openstack-Api-Version: compute 2.90 Aug 10 12:35:11.517357 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: Openstack-System-Scope: None Aug 10 12:35:11.517357 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: User-Agent: python-novaclient Aug 10 12:35:11.517357 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Auth-Token: gAAAAABi86X-wfpr5RicerZUrN6kOMAWfzCJG8O31sy55UVV7sf7Xh920VIlHVVvVLOsLGlAb0EZf_aoa2sdh9OIrmG6_D0CxG4X_PvCFS5Kr-9bI-RCd6LWaW9cqivpSjAlKZRYOgH22C8KCHtHOhv-e-wUfIs7CzSt65Whaq76sOSxJXUn5Ms Aug 10 12:35:11.517357 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Domain-Id: None Aug 10 12:35:11.517357 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Domain-Name: None Aug 10 12:35:11.517357 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Identity-Status: Confirmed Aug 10 12:35:11.517357 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Is-Admin-Project: True Aug 10 12:35:11.517357 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 12:35:11.517357 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Project-Domain-Id: default Aug 10 12:35:11.517357 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Project-Domain-Name: Default Aug 10 12:35:11.517357 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Project-Id: 3c65e78604254a1dbcd377669ee26423 Aug 10 12:35:11.517357 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Project-Name: admin Aug 10 12:35:11.517357 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Role: reader,admin,member Aug 10 12:35:11.517357 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Roles: reader,admin,member Aug 10 12:35:11.518919 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c65e78604254a1dbcd377669ee26423"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c65e78604254a1dbcd377669ee26423", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c65e78604254a1dbcd377669ee26423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c65e78604254a1dbcd377669ee26423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 12:35:11.518919 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Tenant: admin Aug 10 12:35:11.518919 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Tenant-Id: 3c65e78604254a1dbcd377669ee26423 Aug 10 12:35:11.518919 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Tenant-Name: admin Aug 10 12:35:11.518919 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-User: admin Aug 10 12:35:11.518919 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-User-Domain-Id: default Aug 10 12:35:11.518919 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-User-Domain-Name: Default Aug 10 12:35:11.518919 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-User-Id: 903d09eed7334b43af767deea1a6bd32 Aug 10 12:35:11.518919 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-User-Name: admin Aug 10 12:35:11.518919 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: method: > Aug 10 12:35:11.518919 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: exception: Flavor 84 could not be found. Aug 10 12:35:11.518919 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: action_args: {'id': '84'} Aug 10 12:35:11.518919 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:35:11.518919 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:35:11.519965 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 12:35:11.519965 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 12:35:11.519965 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 12:35:11.519965 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 12:35:11.519965 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 12:35:11.519965 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 12:35:11.519965 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 12:35:11.519965 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 12:35:11.519965 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 12:35:11.519965 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:35:11.519965 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 12:35:11.519965 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 12:35:11.519965 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 12:35:11.519965 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi Aug 10 12:35:11.519965 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:35:11.519965 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi Aug 10 12:35:11.519965 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:35:11.519965 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:35:11.519965 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:35:11.521345 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:35:11.521345 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:35:11.521345 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:35:11.521345 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:35:11.521345 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 12:35:11.521345 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:35:11.521345 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 12:35:11.521345 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi Aug 10 12:35:11.521345 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:35:11.521345 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi Aug 10 12:35:11.521345 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:35:11.521345 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:35:11.521345 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:35:11.521345 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:35:11.521345 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:35:11.521345 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 12:35:11.521345 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi Aug 10 12:35:11.521345 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-2bd64718-bb1d-4e94-9243-24ece6087106 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:35:11.522611 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-2bd64718-bb1d-4e94-9243-24ece6087106 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012269 Aug 10 12:35:11.522611 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 23/47] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Aug 10 12:35:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 12:35:12.477875 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-06e9626c-c715-45e4-acb8-851840804c35 admin admin] Calling method '>' {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:12.478882 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-06e9626c-c715-45e4-acb8-851840804c35 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 10 12:35:12.479916 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 25/48] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 10 12:35:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:35:12.998541 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-8abb4e2d-6c2b-40ea-beb9-52b5dadd8d66 admin admin] Calling method '>' {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:13.004708 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.wsgi [None req-8abb4e2d-6c2b-40ea-beb9-52b5dadd8d66 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 12:35:13.006270 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-8abb4e2d-6c2b-40ea-beb9-52b5dadd8d66 admin admin] Request method failure captured: Aug 10 12:35:13.006270 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 12:35:13.006270 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: Accept: application/json Aug 10 12:35:13.006270 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: Accept-Encoding: gzip, deflate Aug 10 12:35:13.006270 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: Connection: keep-alive Aug 10 12:35:13.006270 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: Content-Length: 0 Aug 10 12:35:13.006270 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: Host: 10.222.0.49 Aug 10 12:35:13.006270 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: Openstack-Api-Version: compute 2.90 Aug 10 12:35:13.006270 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: Openstack-System-Scope: None Aug 10 12:35:13.006270 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: User-Agent: python-novaclient Aug 10 12:35:13.006270 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Auth-Token: gAAAAABi86YA9uRnmRBxcSUbaM6wH-XRaza6Jfz4fFdd6oaeIkJFadu4y__FxJ4R6llpBr9gbdzTN7g0V5oDoCbPnGG5KLkwzFc6s0RN9jIJ-5_X7gmInW5SVgwjUznwSmuaio7J4mt_GDc8TtKz31iBSqexMp0oyBCNpw1EdWVBaCSvPau1E3w Aug 10 12:35:13.006270 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Domain-Id: None Aug 10 12:35:13.006270 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Domain-Name: None Aug 10 12:35:13.006270 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Identity-Status: Confirmed Aug 10 12:35:13.006270 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Is-Admin-Project: True Aug 10 12:35:13.006270 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 12:35:13.006270 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Project-Domain-Id: default Aug 10 12:35:13.006270 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Project-Domain-Name: Default Aug 10 12:35:13.006270 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Project-Id: 3c65e78604254a1dbcd377669ee26423 Aug 10 12:35:13.006270 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Project-Name: admin Aug 10 12:35:13.006270 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Role: reader,admin,member Aug 10 12:35:13.006270 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Roles: reader,admin,member Aug 10 12:35:13.007815 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c65e78604254a1dbcd377669ee26423"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c65e78604254a1dbcd377669ee26423", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c65e78604254a1dbcd377669ee26423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c65e78604254a1dbcd377669ee26423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 12:35:13.007815 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Tenant: admin Aug 10 12:35:13.007815 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Tenant-Id: 3c65e78604254a1dbcd377669ee26423 Aug 10 12:35:13.007815 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-Tenant-Name: admin Aug 10 12:35:13.007815 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-User: admin Aug 10 12:35:13.007815 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-User-Domain-Id: default Aug 10 12:35:13.007815 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-User-Domain-Name: Default Aug 10 12:35:13.007815 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-User-Id: 903d09eed7334b43af767deea1a6bd32 Aug 10 12:35:13.007815 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: X-User-Name: admin Aug 10 12:35:13.007815 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: method: > Aug 10 12:35:13.007815 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: exception: Flavor 451 could not be found. Aug 10 12:35:13.007815 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: action_args: {'id': '451'} Aug 10 12:35:13.007815 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:35:13.007815 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:35:13.012138 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 12:35:13.012138 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 12:35:13.012138 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 12:35:13.012138 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 12:35:13.012138 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 12:35:13.012138 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 12:35:13.012138 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 12:35:13.012138 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 12:35:13.012138 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 12:35:13.012138 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:35:13.012138 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 12:35:13.012138 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 12:35:13.012138 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 12:35:13.012138 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi Aug 10 12:35:13.012138 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:35:13.012138 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi Aug 10 12:35:13.012138 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:35:13.012138 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:35:13.012138 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:35:13.013281 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:35:13.013281 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:35:13.013281 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:35:13.013281 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:35:13.013281 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 12:35:13.013281 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:35:13.013281 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 12:35:13.013281 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi Aug 10 12:35:13.013281 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:35:13.013281 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi Aug 10 12:35:13.013281 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:35:13.013281 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:35:13.013281 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:35:13.013281 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:35:13.013281 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:35:13.013281 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 12:35:13.013281 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: ERROR nova.api.openstack.wsgi Aug 10 12:35:13.013281 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-8abb4e2d-6c2b-40ea-beb9-52b5dadd8d66 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:35:13.014356 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-8abb4e2d-6c2b-40ea-beb9-52b5dadd8d66 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.388973 Aug 10 12:35:13.014356 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 24/49] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 10 12:35:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 12:35:13.020154 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-3e074561-eec3-483f-b2f5-d4586eef94ba admin admin] Calling method '>' {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:13.037391 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-3e074561-eec3-483f-b2f5-d4586eef94ba admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021948 Aug 10 12:35:13.038042 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 26/50] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 10 12:35:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:35:13.051269 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-9fa013f3-b9c4-4980-a89a-c33b18905126 admin admin] Calling method '>' {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:13.078108 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-9fa013f3-b9c4-4980-a89a-c33b18905126 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030131 Aug 10 12:35:13.079033 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 25/51] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 10 12:35:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:35:13.089647 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-82bd0816-4de7-4daf-9019-e51ddb85ad66 admin admin] Calling method '>' {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:13.095415 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.wsgi [None req-82bd0816-4de7-4daf-9019-e51ddb85ad66 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 12:35:13.096927 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-82bd0816-4de7-4daf-9019-e51ddb85ad66 admin admin] Request method failure captured: Aug 10 12:35:13.096927 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 12:35:13.096927 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: Accept: application/json Aug 10 12:35:13.096927 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: Accept-Encoding: gzip, deflate Aug 10 12:35:13.096927 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: Connection: keep-alive Aug 10 12:35:13.096927 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: Content-Length: 0 Aug 10 12:35:13.096927 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: Host: 10.222.0.49 Aug 10 12:35:13.096927 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: Openstack-Api-Version: compute 2.90 Aug 10 12:35:13.096927 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: Openstack-System-Scope: None Aug 10 12:35:13.096927 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: User-Agent: python-novaclient Aug 10 12:35:13.096927 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Auth-Token: gAAAAABi86YA9uRnmRBxcSUbaM6wH-XRaza6Jfz4fFdd6oaeIkJFadu4y__FxJ4R6llpBr9gbdzTN7g0V5oDoCbPnGG5KLkwzFc6s0RN9jIJ-5_X7gmInW5SVgwjUznwSmuaio7J4mt_GDc8TtKz31iBSqexMp0oyBCNpw1EdWVBaCSvPau1E3w Aug 10 12:35:13.096927 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Domain-Id: None Aug 10 12:35:13.096927 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Domain-Name: None Aug 10 12:35:13.096927 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Identity-Status: Confirmed Aug 10 12:35:13.096927 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Is-Admin-Project: True Aug 10 12:35:13.096927 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 12:35:13.096927 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Project-Domain-Id: default Aug 10 12:35:13.096927 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Project-Domain-Name: Default Aug 10 12:35:13.096927 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Project-Id: 3c65e78604254a1dbcd377669ee26423 Aug 10 12:35:13.096927 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Project-Name: admin Aug 10 12:35:13.096927 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Role: reader,admin,member Aug 10 12:35:13.096927 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Roles: reader,admin,member Aug 10 12:35:13.098445 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c65e78604254a1dbcd377669ee26423"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c65e78604254a1dbcd377669ee26423", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c65e78604254a1dbcd377669ee26423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c65e78604254a1dbcd377669ee26423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 12:35:13.098445 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Tenant: admin Aug 10 12:35:13.098445 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Tenant-Id: 3c65e78604254a1dbcd377669ee26423 Aug 10 12:35:13.098445 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-Tenant-Name: admin Aug 10 12:35:13.098445 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-User: admin Aug 10 12:35:13.098445 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-User-Domain-Id: default Aug 10 12:35:13.098445 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-User-Domain-Name: Default Aug 10 12:35:13.098445 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-User-Id: 903d09eed7334b43af767deea1a6bd32 Aug 10 12:35:13.098445 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: X-User-Name: admin Aug 10 12:35:13.098445 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: method: > Aug 10 12:35:13.098445 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: exception: Flavor 451 could not be found. Aug 10 12:35:13.098445 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: action_args: {'id': '451'} Aug 10 12:35:13.098445 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:35:13.098445 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:35:13.099455 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 12:35:13.099455 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 12:35:13.099455 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 12:35:13.099455 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 12:35:13.099455 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 12:35:13.099455 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 12:35:13.099455 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 12:35:13.099455 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 12:35:13.099455 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 12:35:13.099455 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:35:13.099455 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 12:35:13.099455 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 12:35:13.099455 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 12:35:13.099455 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi Aug 10 12:35:13.099455 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:35:13.099455 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi Aug 10 12:35:13.099455 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:35:13.099455 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:35:13.099455 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:35:13.100767 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:35:13.100767 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:35:13.100767 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:35:13.100767 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:35:13.100767 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 12:35:13.100767 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:35:13.100767 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 12:35:13.100767 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi Aug 10 12:35:13.100767 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:35:13.100767 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi Aug 10 12:35:13.100767 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:35:13.100767 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:35:13.100767 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:35:13.100767 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:35:13.100767 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:35:13.100767 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 12:35:13.100767 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: ERROR nova.api.openstack.wsgi Aug 10 12:35:13.100767 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-82bd0816-4de7-4daf-9019-e51ddb85ad66 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:35:13.101998 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-82bd0816-4de7-4daf-9019-e51ddb85ad66 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012986 Aug 10 12:35:13.101998 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 27/52] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 10 12:35:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 12:35:14.082692 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-9fa013f3-b9c4-4980-a89a-c33b18905126 admin admin] Calling method '>' {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:14.083735 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-9fa013f3-b9c4-4980-a89a-c33b18905126 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 10 12:35:14.084128 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 26/53] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 10 12:35:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:35:14.606559 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-b9ad4676-7bd8-4a94-a5bb-454dec8ad99e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:35:14.682355 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-b9ad4676-7bd8-4a94-a5bb-454dec8ad99e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.458129 Aug 10 12:35:14.682970 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 28/54] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Aug 10 12:35:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:35:15.654510 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-9fa013f3-b9c4-4980-a89a-c33b18905126 admin admin] Calling method '>' {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:15.655573 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-9fa013f3-b9c4-4980-a89a-c33b18905126 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 10 12:35:15.655964 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 27/55] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 10 12:35:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:35:16.179837 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-482b5db7-9a8a-46df-88d5-72d83dd8ebee admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:35:16.267806 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-482b5db7-9a8a-46df-88d5-72d83dd8ebee admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.472157 Aug 10 12:35:16.268357 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 29/56] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Aug 10 12:35:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:35:17.244483 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-9fa013f3-b9c4-4980-a89a-c33b18905126 admin admin] Calling method '>' {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:17.246138 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-9fa013f3-b9c4-4980-a89a-c33b18905126 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002062 Aug 10 12:35:17.246531 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 28/57] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 10 12:35:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:35:17.771353 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-9cf02fee-b762-44fb-a861-a22b94815b5a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:35:17.856077 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-9cf02fee-b762-44fb-a861-a22b94815b5a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.469218 Aug 10 12:35:17.856623 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 30/58] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Aug 10 12:35:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:35:18.822158 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-9fa013f3-b9c4-4980-a89a-c33b18905126 admin admin] Calling method '>' {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:18.823811 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-9fa013f3-b9c4-4980-a89a-c33b18905126 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 10 12:35:18.824193 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 29/59] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 10 12:35:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:35:19.345746 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-773082d0-4b91-458c-a6a0-57692cabaa14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:35:19.414323 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-773082d0-4b91-458c-a6a0-57692cabaa14 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.453139 Aug 10 12:35:19.414867 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 31/60] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Aug 10 12:35:18 2022] POST /compute/v2.1/flavors => generated 409 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:35:20.380021 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-9fa013f3-b9c4-4980-a89a-c33b18905126 admin admin] Calling method '>' {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:20.381020 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-9fa013f3-b9c4-4980-a89a-c33b18905126 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 10 12:35:20.381434 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 30/61] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 10 12:35:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:35:20.906130 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-85304faa-3344-4947-a73a-3dbfff234a6a admin admin] Calling method '>' {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:35:20.926593 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-85304faa-3344-4947-a73a-3dbfff234a6a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.403565 Aug 10 12:35:20.927136 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 32/62] 10.222.0.49 () {60 vars in 1202 bytes} [Wed Aug 10 12:35:20 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:36:13.163571 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-9fa013f3-b9c4-4980-a89a-c33b18905126 admin admin] Calling method '>' {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:13.164600 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-9fa013f3-b9c4-4980-a89a-c33b18905126 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 10 12:36:13.164994 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 31/63] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 10 12:36:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:36:13.175528 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG dbcounter [-] [110124] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:36:13.553538 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-e1b9606c-e0d2-4830-b5be-b34d14ec0d6c admin admin] Calling method '>' {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:13.575055 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-e1b9606c-e0d2-4830-b5be-b34d14ec0d6c admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403949 Aug 10 12:36:13.575624 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 33/64] 10.222.0.49 () {60 vars in 1292 bytes} [Wed Aug 10 12:36:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:36:13.596229 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG dbcounter [-] [110123] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=110123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:36:13.599953 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-1c155982-1b1d-4ebe-b8ac-43bbf4e0ba0d admin admin] Calling method '>' {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:13.607631 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-1c155982-1b1d-4ebe-b8ac-43bbf4e0ba0d admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012785 Aug 10 12:36:13.608427 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 32/65] 10.222.0.49 () {60 vars in 1283 bytes} [Wed Aug 10 12:36:13 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:13.620768 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-37e27a29-a2e3-43bd-8cc4-ac85c1d5ed7e admin admin] Calling method '>' {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:13.628406 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-37e27a29-a2e3-43bd-8cc4-ac85c1d5ed7e admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011858 Aug 10 12:36:13.628923 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 34/66] 10.222.0.49 () {60 vars in 1286 bytes} [Wed Aug 10 12:36:13 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:13.641341 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-c46f059d-aaf4-45d9-b312-bd9aea30189d admin admin] Calling method '>' {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:13.649337 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-c46f059d-aaf4-45d9-b312-bd9aea30189d admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011856 Aug 10 12:36:13.649852 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 33/67] 10.222.0.49 () {60 vars in 1286 bytes} [Wed Aug 10 12:36:13 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:36:13.661275 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-129b298e-6fb5-470f-aee6-a24a0886b9cd admin admin] Calling method '>' {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:36:13.669766 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-129b298e-6fb5-470f-aee6-a24a0886b9cd admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012083 Aug 10 12:36:13.670282 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 35/68] 10.222.0.49 () {60 vars in 1283 bytes} [Wed Aug 10 12:36:13 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:39:26.264683 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-c46f059d-aaf4-45d9-b312-bd9aea30189d admin admin] Calling method '>' {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:26.266400 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-c46f059d-aaf4-45d9-b312-bd9aea30189d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 10 12:39:26.266958 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 34/69] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 10 12:39:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:39:26.410047 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG dbcounter [-] [110124] Writing DB stats nova_api:SELECT=6 {{(pid=110124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:39:26.571444 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-d2a3d5e3-962b-4e5a-820e-edc6c8a9397f admin admin] Calling method '>' {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:26.573987 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 12:39:26.573987 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: warnings.warn(msg) Aug 10 12:39:26.575088 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-d2a3d5e3-962b-4e5a-820e-edc6c8a9397f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:26.575664 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-d2a3d5e3-962b-4e5a-820e-edc6c8a9397f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:26.576113 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-d2a3d5e3-962b-4e5a-820e-edc6c8a9397f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:26.576814 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-d2a3d5e3-962b-4e5a-820e-edc6c8a9397f admin admin] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:26.577251 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-d2a3d5e3-962b-4e5a-820e-edc6c8a9397f admin admin] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:26.577655 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-d2a3d5e3-962b-4e5a-820e-edc6c8a9397f admin admin] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:26.613418 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-d2a3d5e3-962b-4e5a-820e-edc6c8a9397f admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.205085 Aug 10 12:39:26.613977 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 36/70] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 10 12:39:26 2022] GET /compute/v2.1/os-services => generated 791 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:39:27.444945 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-c46f059d-aaf4-45d9-b312-bd9aea30189d admin admin] Calling method '>' {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:27.445963 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-c46f059d-aaf4-45d9-b312-bd9aea30189d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 10 12:39:27.446355 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 35/71] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 10 12:39:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:39:27.642409 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-31b76a8f-4b20-4ae7-9b66-c3a11d6626ce admin admin] Calling method '>' {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:27.644786 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 12:39:27.644786 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: warnings.warn(msg) Aug 10 12:39:27.645880 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-31b76a8f-4b20-4ae7-9b66-c3a11d6626ce admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:27.646349 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-31b76a8f-4b20-4ae7-9b66-c3a11d6626ce admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:27.646770 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-31b76a8f-4b20-4ae7-9b66-c3a11d6626ce admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:27.647502 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-31b76a8f-4b20-4ae7-9b66-c3a11d6626ce admin admin] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:27.647936 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-31b76a8f-4b20-4ae7-9b66-c3a11d6626ce admin admin] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:27.648347 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-31b76a8f-4b20-4ae7-9b66-c3a11d6626ce admin admin] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:27.668356 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-31b76a8f-4b20-4ae7-9b66-c3a11d6626ce admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081140 Aug 10 12:39:27.668871 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 37/72] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 10 12:39:27 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:39:38.920220 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-c46f059d-aaf4-45d9-b312-bd9aea30189d admin admin] Calling method '>' {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:38.921213 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-c46f059d-aaf4-45d9-b312-bd9aea30189d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 10 12:39:38.921606 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 36/73] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 10 12:39:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:39:39.069335 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG dbcounter [-] [110124] Writing DB stats nova_cell0:SELECT=4 {{(pid=110124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:39:39.070062 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG dbcounter [-] [110124] Writing DB stats nova_cell1:SELECT=4 {{(pid=110124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:39:39.070684 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG dbcounter [-] [110124] Writing DB stats nova_api:SELECT=8 {{(pid=110124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:39:39.121100 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-a74f8b38-34e9-462b-859a-f0e8b47e3123 admin admin] Calling method '>' {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:39.123455 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 12:39:39.123455 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: warnings.warn(msg) Aug 10 12:39:39.124645 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-a74f8b38-34e9-462b-859a-f0e8b47e3123 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:39.125167 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-a74f8b38-34e9-462b-859a-f0e8b47e3123 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:39.125542 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-a74f8b38-34e9-462b-859a-f0e8b47e3123 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:39.126241 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-a74f8b38-34e9-462b-859a-f0e8b47e3123 admin admin] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:39.126679 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-a74f8b38-34e9-462b-859a-f0e8b47e3123 admin admin] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:39.127083 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-a74f8b38-34e9-462b-859a-f0e8b47e3123 admin admin] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:39.152991 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-a74f8b38-34e9-462b-859a-f0e8b47e3123 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088132 Aug 10 12:39:39.153545 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 38/74] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 10 12:39:39 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:39:39.976274 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: DEBUG nova.api.openstack.wsgi [None req-c46f059d-aaf4-45d9-b312-bd9aea30189d admin admin] Calling method '>' {{(pid=110123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:39.977275 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: INFO nova.api.openstack.requestlog [None req-c46f059d-aaf4-45d9-b312-bd9aea30189d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Aug 10 12:39:39.977664 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: [pid: 110123|app: 0|req: 37/75] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 10 12:39:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:39:40.167855 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG nova.api.openstack.wsgi [None req-35b0872d-207d-4086-9c2f-bab19e953a7d admin admin] Calling method '>' {{(pid=110124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:39:40.170316 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 12:39:40.170316 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: warnings.warn(msg) Aug 10 12:39:40.171440 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-35b0872d-207d-4086-9c2f-bab19e953a7d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:40.171913 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-35b0872d-207d-4086-9c2f-bab19e953a7d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:40.172334 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-35b0872d-207d-4086-9c2f-bab19e953a7d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:40.173042 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-35b0872d-207d-4086-9c2f-bab19e953a7d admin admin] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:39:40.173483 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-35b0872d-207d-4086-9c2f-bab19e953a7d admin admin] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:39:40.173895 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: DEBUG oslo_concurrency.lockutils [None req-35b0872d-207d-4086-9c2f-bab19e953a7d admin admin] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:39:40.196236 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: INFO nova.api.openstack.requestlog [None req-35b0872d-207d-4086-9c2f-bab19e953a7d admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080070 Aug 10 12:39:40.196713 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: [pid: 110124|app: 0|req: 39/76] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 10 12:39:40 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:40:37.985381 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: Wed Aug 10 12:40:37 2022 - graceful shutdown triggered... Aug 10 12:40:37.985910 dv-cinder-851996-7-iscsi devstack@n-api.service[110123]: Gracefully killing worker 1 (pid: 110123)... Aug 10 12:40:37.986310 dv-cinder-851996-7-iscsi devstack@n-api.service[110124]: Gracefully killing worker 2 (pid: 110124)... Aug 10 12:40:37.987129 dv-cinder-851996-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 10 12:40:38.986514 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: worker 1 buried after 1 seconds Aug 10 12:40:38.987082 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: worker 2 buried after 1 seconds Aug 10 12:40:38.987082 dv-cinder-851996-7-iscsi devstack@n-api.service[110122]: goodbye to uWSGI. Aug 10 12:40:38.988088 dv-cinder-851996-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 10 12:40:38.988652 dv-cinder-851996-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 10 12:40:38.991659 dv-cinder-851996-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 12:40:39.002266 dv-cinder-851996-7-iscsi devstack@n-api.service[124623]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 12:40:39.005407 dv-cinder-851996-7-iscsi devstack@n-api.service[124623]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 12:40:39 2022] *** Aug 10 12:40:39.005407 dv-cinder-851996-7-iscsi devstack@n-api.service[124623]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 12:40:39.005407 dv-cinder-851996-7-iscsi devstack@n-api.service[124623]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 12:40:39.005407 dv-cinder-851996-7-iscsi devstack@n-api.service[124623]: nodename: dv-cinder-851996-7-iscsi Aug 10 12:40:39.005407 dv-cinder-851996-7-iscsi devstack@n-api.service[124623]: machine: x86_64 Aug 10 12:40:39.005407 dv-cinder-851996-7-iscsi devstack@n-api.service[124623]: clock source: unix Aug 10 12:40:39.005407 dv-cinder-851996-7-iscsi devstack@n-api.service[124623]: pcre jit disabled Aug 10 12:40:39.005407 dv-cinder-851996-7-iscsi devstack@n-api.service[124623]: detected number of CPU cores: 4 Aug 10 12:40:39.005407 dv-cinder-851996-7-iscsi devstack@n-api.service[124623]: current working directory: / Aug 10 12:40:39.005407 dv-cinder-851996-7-iscsi devstack@n-api.service[124623]: detected binary path: /usr/bin/uwsgi-core Aug 10 12:40:39.005407 dv-cinder-851996-7-iscsi devstack@n-api.service[124623]: your processes number limit is 47680 Aug 10 12:40:39.006695 dv-cinder-851996-7-iscsi devstack@n-api.service[124623]: your memory page size is 4096 bytes Aug 10 12:40:39.006695 dv-cinder-851996-7-iscsi devstack@n-api.service[124623]: detected max file descriptor number: 2048 Aug 10 12:40:39.006695 dv-cinder-851996-7-iscsi devstack@n-api.service[124623]: lock engine: pthread robust mutexes Aug 10 12:40:39.006695 dv-cinder-851996-7-iscsi devstack@n-api.service[124623]: thunder lock: enabled Aug 10 12:40:39.006695 dv-cinder-851996-7-iscsi devstack@n-api.service[124623]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 12:40:39.006695 dv-cinder-851996-7-iscsi devstack@n-api.service[124623]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 12:40:39.045570 dv-cinder-851996-7-iscsi devstack@n-api.service[124623]: Python main interpreter initialized at 0x55df659819c0 Aug 10 12:40:39.045859 dv-cinder-851996-7-iscsi devstack@n-api.service[124623]: python threads support enabled Aug 10 12:40:39.046071 dv-cinder-851996-7-iscsi devstack@n-api.service[124623]: your server socket listen backlog is limited to 100 connections Aug 10 12:40:39.046245 dv-cinder-851996-7-iscsi devstack@n-api.service[124623]: your mercy for graceful operations on workers is 90 seconds Aug 10 12:40:39.046732 dv-cinder-851996-7-iscsi devstack@n-api.service[124623]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 12:40:39.047028 dv-cinder-851996-7-iscsi devstack@n-api.service[124623]: *** Operational MODE: preforking *** Aug 10 12:40:39.047539 dv-cinder-851996-7-iscsi devstack@n-api.service[124623]: *** uWSGI is running in multiple interpreter mode *** Aug 10 12:40:39.047743 dv-cinder-851996-7-iscsi devstack@n-api.service[124623]: spawned uWSGI master process (pid: 124623) Aug 10 12:40:39.048111 dv-cinder-851996-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 12:40:39.051888 dv-cinder-851996-7-iscsi devstack@n-api.service[124623]: spawned uWSGI worker 1 (pid: 124642, cores: 1) Aug 10 12:40:39.052221 dv-cinder-851996-7-iscsi devstack@n-api.service[124623]: spawned uWSGI worker 2 (pid: 124643, cores: 1) Aug 10 12:40:39.052377 dv-cinder-851996-7-iscsi devstack@n-api.service[124623]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 12:40:39.723862 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 12:40:39.728346 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 12:40:40.904259 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 12:40:40.904259 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: from cryptography.utils import int_from_bytes Aug 10 12:40:40.904949 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 12:40:40.904949 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: from cryptography.utils import int_from_bytes Aug 10 12:40:40.918684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 12:40:40.918684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: from cryptography.utils import int_from_bytes Aug 10 12:40:40.919437 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 12:40:40.919437 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: from cryptography.utils import int_from_bytes Aug 10 12:40:43.242963 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 12:40:43.243623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 12:40:43.243713 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 12:40:43.244106 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 12:40:43.244336 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 12:40:43.244729 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.245060 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.245391 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.245717 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.246053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.246370 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.246695 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.247021 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.247380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.247649 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.247971 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.248302 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851996-7-iscsi {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.248631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.248976 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.249294 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.249634 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.249944 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.250284 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.250597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.251115 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.251876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.252192 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.252536 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.252866 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.253203 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.253538 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.254656 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.254983 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.259243 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.259616 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.260062 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851996-7-iscsi {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.260407 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.260742 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.261077 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.261518 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.261844 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.262182 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.262513 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.262846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.263170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.263531 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.263861 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.264191 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.264523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.264832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.265149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.265465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.265792 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.266106 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.266416 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.266673 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.266987 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.267340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.267671 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.268001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.268258 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.268361 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 12:40:43.268777 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.268874 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 12:40:43.268969 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.269068 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 12:40:43.269153 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.269554 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.269783 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 12:40:43.269886 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.270062 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 12:40:43.270180 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.270454 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.270564 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.270770 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.270871 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.271081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.271201 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.271423 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.271532 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.271735 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.271837 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.272050 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.272151 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.272367 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.272480 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.272687 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.272795 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.272997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.273110 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.273265 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.273398 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.273583 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.273711 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.273905 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851996-7-iscsi {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.274013 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.274225 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.274324 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.274533 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.274644 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.274846 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.274945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.275158 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.275277 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.275492 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.275605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.275815 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.275918 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.276121 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.276219 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.276498 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.276606 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.276810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.276910 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.277134 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.277240 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.277458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.277564 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.277768 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.277867 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.278015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.278118 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.278323 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.278432 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.278631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.278734 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.279011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.279116 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.279303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.279383 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.280285 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.280920 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.281016 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.281098 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851996-7-iscsi {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.281180 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.281259 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.281338 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.281423 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.281506 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.281587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.281667 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.281739 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.281817 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.281901 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.281981 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.282063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.282135 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.282456 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.282612 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.282792 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.282943 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.283111 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.283299 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.283447 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.283593 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.284788 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.284943 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.284943 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.285223 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.285383 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.285546 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.285693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.285873 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.286036 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.286183 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.286329 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.286474 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.286474 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.287630 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.287808 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.287966 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.288134 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.288289 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.288437 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.288582 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.288744 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.288894 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.289048 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.289194 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.289533 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.289693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.289855 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.290005 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.290156 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.290156 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.290501 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.290501 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.290803 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.290956 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.291102 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.291102 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.291416 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.291577 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.292160 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.292316 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.292477 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.292633 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.292805 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.292952 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.293096 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.293249 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.293402 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.293556 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.293777 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.293925 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.294077 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.294223 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.294376 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.294537 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.294695 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.294848 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.295003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.295157 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.295330 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.295488 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.295650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.295650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.295933 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.295933 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.296230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.296385 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.296542 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.296698 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.296866 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.297060 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.297296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.297466 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.297621 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.297777 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.297922 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.298066 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.298210 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.298370 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.298534 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.298694 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.298859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.299005 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.299149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.299402 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.299550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.299694 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.299839 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.299984 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.300146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.300302 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.300302 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.301170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.301343 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.301489 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.301698 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.301876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.302036 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.302183 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.302335 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.302481 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.302640 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.302787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.302931 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.303076 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.303253 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.303406 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.303608 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.303760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.303905 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.304059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.304212 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.304367 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.304513 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.304664 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.304815 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.304968 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.305114 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.305282 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.305436 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.305582 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.305728 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.305872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.306017 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.306178 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.306324 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.306479 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.306632 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.306778 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.306922 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.306922 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.307236 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.307499 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.307660 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.307814 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.307960 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.308104 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.308250 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.308394 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.308547 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.308706 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.308865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.309022 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.309185 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.309346 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.309501 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.309654 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.309801 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.309945 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.310097 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.310255 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.310409 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.310596 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.310747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.310904 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.311057 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.311246 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.311400 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.311553 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.311710 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.311865 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.312011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.312156 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.312315 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.313032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.313194 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.313349 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.313496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.313642 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.313814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.313970 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.314124 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.314281 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.314435 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.314590 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.314756 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.314904 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.315050 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.315215 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.315386 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.315549 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.315697 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.315855 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.316017 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.316172 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.316172 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.317201 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.317201 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.317409 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 12:40:43.317519 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.317611 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.317685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.317766 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.317846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.317846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.317846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.317846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.318094 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.318175 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.318258 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.318330 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.318330 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.318465 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.318552 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.318633 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.318705 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.318782 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.318859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.318931 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.319015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.319015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.319151 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.319480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.319559 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.319631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.319793 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.319870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.319949 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.320032 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.320118 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.320199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.320272 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.320351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.320424 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.320495 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.320566 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.320709 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.320792 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.320864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.320934 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.321011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.321089 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.321186 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.321314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.321448 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.321640 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.321791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.321948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.322135 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.322263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.322483 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.322583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.322787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.322881 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.323139 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.323260 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.323489 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.323579 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.323796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.323889 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.324150 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.324434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.324536 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.324706 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.324827 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.325012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.325156 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.325339 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.325478 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.325654 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.325798 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.325963 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.326133 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.326272 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.326580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.326675 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.326910 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.327000 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.330218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.330409 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.330583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.330783 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.330965 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.331129 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.331317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.331467 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.331622 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.331775 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.331965 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.332125 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.332271 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.332553 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.332712 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.332875 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.333032 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.333194 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.333347 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.333494 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.333645 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.333799 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.333944 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.334088 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.334261 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.334507 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.334737 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.334898 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.335055 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.335297 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.335462 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.335462 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.335741 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.335895 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.336040 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.336183 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.336440 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.336595 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.336740 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.336740 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.337040 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.337197 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.337370 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.337370 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.337737 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.337892 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.338047 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.338200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.338354 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.338507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.338507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.338804 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.338957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.339110 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.339289 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.339436 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.339598 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.339745 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.339897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.340043 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.340203 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.340347 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.340605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.340812 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.340972 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.341135 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.341285 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.341450 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.341628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.342276 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.342436 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.342594 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.342741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.342902 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.343048 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.343213 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.343375 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.343530 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.343675 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.343841 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.343996 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.344142 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.344292 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.344465 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.344687 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.344943 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.345096 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.345241 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.345395 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.345548 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.345701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.345856 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.346015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.346015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.346299 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.346456 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.346614 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.346759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.346903 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.347049 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.347257 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.347422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.347868 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.348024 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.348181 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.348339 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.348485 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.348629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.348789 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.348960 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.348960 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.349247 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.349400 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.349555 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.349715 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.349868 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.350024 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.350179 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.350343 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.350503 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.350658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.350658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.350985 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.351144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.351458 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.351634 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.351788 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.351946 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.352106 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.352106 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.352407 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.352645 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.352809 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.352809 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.353097 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.353249 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.353403 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.353564 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.353717 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.353874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.354034 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.354186 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.354354 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.354528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.354802 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.355046 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.355240 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.355409 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.355571 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.355734 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.355886 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.356037 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.356196 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.356348 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.356511 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.356670 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.356834 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.356986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.357144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.357303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.357465 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.357626 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.357875 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.358049 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.358203 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.358354 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.358515 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.358675 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.358836 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.359003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.359162 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.359688 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.359688 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.359987 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.360139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.360298 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.360450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.360615 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.360768 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.360919 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.361111 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.361294 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.361583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.361756 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.361919 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.362071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.362230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.362382 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.362533 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.362699 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.362861 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.363014 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.363794 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.363981 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.364162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.364316 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.364467 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.364619 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.364800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.365059 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.365287 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.365444 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.365594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.365745 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.365908 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.366062 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.366221 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.366392 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.366553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.366721 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.366883 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.367044 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.367259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.367419 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.367582 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.367749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.367994 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.368162 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.368365 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.368529 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.368767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.368767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.369078 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.369078 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.369375 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.369375 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.369668 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.369831 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.369994 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.370154 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.370313 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.370465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.370646 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.370806 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.370983 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.371203 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.371376 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.371529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.371802 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.371964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.371964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.372274 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.372428 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.372579 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.372741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.372913 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.373066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.373219 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.373370 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.373536 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.373695 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.373848 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.373999 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.374159 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.374320 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.374487 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.374648 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.374800 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.374970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.375275 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.375513 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.375701 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.375998 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.376166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.376319 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.376319 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.376616 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.376778 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.376938 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.377091 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.377241 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.377413 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.377582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.377741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.377894 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.378136 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.378304 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.378458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.378662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.379454 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.379634 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.379948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.380113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.380305 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.380491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.380655 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.380808 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.380961 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.381120 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.381314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.381486 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.381641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.381641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.382057 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.382215 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.382378 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.382551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.382705 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.382858 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.383010 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.383170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.383378 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.383540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.383702 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.383907 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.384066 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.384218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.384379 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.384540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.384704 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.384858 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.384858 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.385155 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.385411 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.385654 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.385654 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.385953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.386113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.386273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.386446 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.386601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.386761 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.386927 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.387080 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.387338 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.387508 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.387669 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.387821 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.387982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.388160 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.388404 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.388576 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.388737 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.388737 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.389039 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.389211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.389375 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.389528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.389688 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.389848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.390003 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.390202 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.390368 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.390529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.390682 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.390834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.390834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.391153 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.391376 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.391546 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.391718 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.391718 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.392019 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.392295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.392464 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.392618 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.392770 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.392931 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.393083 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.393236 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.393407 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.393560 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.393791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.393946 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.394098 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.394260 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.394972 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.395340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.395630 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.395869 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.395869 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.395869 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.396305 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.396468 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.396631 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.396792 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.396945 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.397102 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.397255 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.397407 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.397573 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.397733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.397885 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.398045 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.398210 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.398391 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.398650 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.398818 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.398971 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.399130 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.399306 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.399473 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.399634 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.399794 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.399955 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.400114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.400275 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.400275 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.400586 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.400586 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.400875 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.401035 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.401196 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.401358 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.401564 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.401724 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.401880 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.402031 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.402198 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.402499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.402666 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.402838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.402999 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.403159 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.403379 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.403532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.403725 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.403889 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.404042 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.404193 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.404355 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.404515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.404515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.404804 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.404975 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.405137 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.405299 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.405458 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.405762 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.406011 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.406170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.406332 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.406485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.406637 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.406797 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.406949 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.407109 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.407310 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.407474 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.407636 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.407796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.407957 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.408118 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.408280 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.408280 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.408570 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.408820 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.408989 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.409143 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.409315 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.409476 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.409638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.409798 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.409994 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.410766 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.410937 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.411092 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.411268 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.411424 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.411634 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.411816 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.411971 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.412144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.412297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.412469 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.412719 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.412891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.413044 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.413206 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.413367 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.413520 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.413680 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.413846 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.414000 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.414000 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.414302 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.414470 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.414638 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.414791 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.414942 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.415094 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.415288 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.415445 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.415614 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.415792 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.416051 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.416286 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.416453 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.416622 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.416785 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.416938 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.417090 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.417242 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.417404 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.417599 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.417767 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.417928 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.418081 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.418241 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.418241 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.418557 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.418557 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.418957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.419118 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.419298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.419453 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.419625 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.419779 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.419939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.419939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.419939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.420377 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.420540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.420704 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.420857 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.421016 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.421177 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.421330 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.421493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.421695 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.421853 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.422013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.422174 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.422347 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.422501 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.422750 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.423012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.423235 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.423397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.423568 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.423730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.423730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.424019 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.424170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.424321 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.424482 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.424643 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.424795 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.424946 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.425107 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.425260 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.425421 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.425421 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.425741 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.425894 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.426070 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.426404 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.426638 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.426796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.426948 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.427099 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.427298 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.427466 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.427619 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.427779 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.427931 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.428082 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.428241 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.428408 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.428570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.428730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.428893 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.429153 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.429319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.429493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.429647 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.429799 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.429958 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.430111 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.430276 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.430437 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.430597 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.430765 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.430919 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.431071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.431290 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.431459 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.431633 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.431832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.431990 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.432151 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.432318 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.432479 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.432631 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.432784 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.432943 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.433209 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.433385 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.433548 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.433709 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.433873 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.434027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.434189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.434352 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.434514 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.434677 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.434838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.435006 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.435161 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.435161 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.435490 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.435652 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.435824 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.435992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.436154 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.436325 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.436558 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.436811 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.436983 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.437144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.437418 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.437585 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.437585 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.437884 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.438046 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.438218 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.438373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.438525 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.438677 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.438836 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.439005 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.439200 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.439361 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.439524 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.439685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.439847 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.439999 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.440150 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.440322 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.440476 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.440628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.440793 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.440946 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.441096 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.441788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.441996 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.442158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.442158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.442459 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.442459 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.442757 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.442757 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.443070 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.443070 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.443423 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.443674 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.443842 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.444003 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.444157 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.444323 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.444540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.444694 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.444846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.445017 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.445180 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.445332 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.445485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.445485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.445861 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.446013 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.446179 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.446344 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.446496 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.446739 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.446979 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.447138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.447138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.447491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.447652 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.447806 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.447958 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.448110 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.448272 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.448433 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.448594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.448756 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.448909 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.448909 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.449216 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.449380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.449532 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.449683 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.449835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.450063 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.450226 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.450387 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.450546 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.450706 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.450861 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.451022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.451122 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.451122 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.451397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.451397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.451717 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.451874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.452082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.452243 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.452395 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.452556 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.452718 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.452880 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.453042 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.453207 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.453360 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.453512 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.453693 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.453940 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.454111 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.454272 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.454425 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.454591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.454745 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.454898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.454898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.455240 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.455402 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.455568 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.455729 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.455729 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.456037 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.456198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.456358 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.456358 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.456657 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.456657 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.457716 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.457888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.458065 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.458221 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.458374 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.458526 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.458686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.458840 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.459006 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.459160 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.459160 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.459516 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.459668 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.459819 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.459990 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.460155 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.460155 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.460445 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.460445 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.460744 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.460897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.461049 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.461209 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.461361 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.461513 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.461680 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.461837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.462046 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.462215 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.462370 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.462522 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.462688 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.462843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.462994 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.463147 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.463332 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.463496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.463658 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.463811 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.463979 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.464233 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.464399 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.464568 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.464721 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.464881 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.465034 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.465186 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.465344 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.465512 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.465667 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.465818 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.465969 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.466122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.466284 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.466284 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.466598 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.466753 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.466925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.467152 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.467331 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.467499 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.467655 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.467899 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.468059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.468220 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.468455 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.468642 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.468917 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.469092 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.469257 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.469410 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.469572 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.469734 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.469895 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.470055 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.470215 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.470368 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.470534 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.470703 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.470856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.471014 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.471167 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.471393 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.471564 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.471729 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.471882 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.472041 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.472247 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.472415 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.472597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.472750 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.472926 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.473086 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.473247 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.473409 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.473561 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.473720 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.473874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.474026 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.474185 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.474454 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.474622 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.474785 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.474947 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.475120 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.475298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.475466 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.475627 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.475780 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.475940 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.476094 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.476261 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.476422 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.476575 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.476734 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.476895 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.477059 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.477487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.477657 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.477811 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.478061 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.478232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.478386 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.478548 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.478708 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.478861 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.479014 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.479203 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.479366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.479543 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.479704 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.479858 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.479858 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.480154 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.480373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.480541 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.480703 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.480856 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.481008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.481168 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.481398 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.481564 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.481564 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.481919 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.482080 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.482284 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.482457 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.482611 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.482771 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.482924 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.483085 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.483259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.483435 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.483589 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.483760 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.483922 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.484081 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.484244 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.484767 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.484929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.485082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.485234 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.485387 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.485551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.485704 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.485857 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.486009 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.486181 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.486335 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.486504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.486668 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.486824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.486987 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.487147 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.487370 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.487615 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.487775 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.487937 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.488209 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.488371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.488538 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.488694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.488846 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.489007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.489168 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.489331 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.489484 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.489637 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.489788 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.489948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.490101 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.490275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.490428 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.490580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.490733 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.490733 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.491030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.491211 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.491382 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.491382 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.491693 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.491854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.492017 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.492180 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.492374 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.492540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.492701 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.492861 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.493068 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.493230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.493391 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.493544 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.493695 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.493855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.494022 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.494175 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.494348 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.494501 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.494653 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.494925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.495096 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.495287 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.495445 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.495604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.495757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.495757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.496059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.496211 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.496374 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.496534 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.496687 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.496853 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.497015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.497169 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.497322 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.497482 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.497652 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.497890 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.498049 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.498221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.498443 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.498612 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.498776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.498930 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.499092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.499300 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.499457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.499621 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.499784 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.499946 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.500101 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.500252 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.500412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.500580 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.500747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.500901 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.501061 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.501222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.501389 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.501554 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.501722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.501876 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.502042 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.502203 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.502400 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.502575 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.502748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.502908 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.503067 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.503239 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.503409 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.503576 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.504288 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.504449 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.505311 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.505478 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.505639 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.505805 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.505958 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.506120 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.506282 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.506443 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.506605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.506766 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.506926 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.507093 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.507282 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.507450 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.507604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.507755 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.508050 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.508223 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.508385 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.508640 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.508809 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.508972 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.509126 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.509289 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.509443 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.509604 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.509759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.509911 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.510072 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.510246 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.510399 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.510551 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.510704 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.510864 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.511027 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.511218 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.511379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.511532 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.511685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.511843 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.512024 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.512187 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.512358 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.512557 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.512724 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.512885 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.513119 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.513282 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.513436 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.513588 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.513741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.513904 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.514057 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.514209 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.514518 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.514693 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.514850 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.515014 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.515167 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.515399 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.515564 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.515720 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.515874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.516048 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.516212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.516367 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.516520 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.516695 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.516859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.517022 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.517182 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.517336 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.517539 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.517539 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.517869 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.517869 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.518330 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.518490 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.518668 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.518940 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.519115 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.519308 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.519550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.519724 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.519879 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.520047 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.520202 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.520354 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.520507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.520660 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.520820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.520983 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.521151 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.521312 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.521475 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.521634 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.521812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.521983 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.522138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.522298 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.522451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.522661 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.522820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.522983 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.523148 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.523326 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.523495 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.523648 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.523815 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.523968 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.524122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.524281 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.524434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.524595 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.524758 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.524919 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.525072 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.525243 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.525397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.525562 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.525730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.525892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.526051 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.526203 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.526356 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.526517 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.526671 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 12:40:43.526832 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.526832 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.526832 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.526832 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.526832 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.526832 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.526832 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.526832 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.528046 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.528046 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.528046 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.528046 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.528046 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.528046 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.528046 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.528046 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.529617 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.529617 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.529617 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.529617 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.529617 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.529617 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.529617 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.529617 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.530787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.530787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.530787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.530787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.530787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.530787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.530787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.530787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.531724 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.531724 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.531724 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.531724 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.531724 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.531724 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.531724 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.531724 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.532335 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.532335 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.532335 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.532335 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.532335 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.532335 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.532335 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.532335 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.532892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.532892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.532892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.532892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.532892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.532892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.532892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.532892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.533417 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.533417 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.533417 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.533417 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.533417 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.533417 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.533417 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.533417 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.533930 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.533930 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.533930 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.534131 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.534425 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.534636 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.535480 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.536057 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.536425 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.536738 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.537051 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.537365 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.537677 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.537995 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.538301 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.538613 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.538928 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.539288 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.539595 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.539920 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.540233 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.540579 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.540891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.541243 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.541552 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.541906 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.542236 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.542548 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.542862 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.543165 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 12:40:43.543465 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 12:40:43.666401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO dbcounter [None req-fe7b6da6-0c81-42ee-9a99-4cf92fb62ba4 None None] Registered counter for database nova_api Aug 10 12:40:43.686791 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_db.sqlalchemy.engines [None req-fe7b6da6-0c81-42ee-9a99-4cf92fb62ba4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:40:43.694078 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writer thread running {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:40:43.695010 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO dbcounter [None req-755f97e6-2956-42ec-a1df-6a82dbb50d22 None None] Registered counter for database nova_api Aug 10 12:40:43.714951 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_db.sqlalchemy.engines [None req-755f97e6-2956-42ec-a1df-6a82dbb50d22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:40:43.721492 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writer thread running {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:40:43.750502 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.context [None req-fe7b6da6-0c81-42ee-9a99-4cf92fb62ba4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),866d7ac2-611a-49e3-ac53-852457d986fe(cell1) {{(pid=124643) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 12:40:43.754969 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe7b6da6-0c81-42ee-9a99-4cf92fb62ba4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:43.755459 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe7b6da6-0c81-42ee-9a99-4cf92fb62ba4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:43.757030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe7b6da6-0c81-42ee-9a99-4cf92fb62ba4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:43.757759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe7b6da6-0c81-42ee-9a99-4cf92fb62ba4 None None] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:43.758205 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe7b6da6-0c81-42ee-9a99-4cf92fb62ba4 None None] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:43.760220 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe7b6da6-0c81-42ee-9a99-4cf92fb62ba4 None None] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:43.762199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO dbcounter [None req-fe7b6da6-0c81-42ee-9a99-4cf92fb62ba4 None None] Registered counter for database nova_cell0 Aug 10 12:40:43.766273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO dbcounter [None req-fe7b6da6-0c81-42ee-9a99-4cf92fb62ba4 None None] Registered counter for database nova_cell1 Aug 10 12:40:43.773847 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_db.sqlalchemy.engines [None req-fe7b6da6-0c81-42ee-9a99-4cf92fb62ba4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:40:43.775486 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_db.sqlalchemy.engines [None req-fe7b6da6-0c81-42ee-9a99-4cf92fb62ba4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:40:43.778788 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.context [None req-755f97e6-2956-42ec-a1df-6a82dbb50d22 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),866d7ac2-611a-49e3-ac53-852457d986fe(cell1) {{(pid=124642) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 12:40:43.781472 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writer thread running {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:40:43.782822 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-755f97e6-2956-42ec-a1df-6a82dbb50d22 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:43.783277 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writer thread running {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:40:43.783381 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-755f97e6-2956-42ec-a1df-6a82dbb50d22 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:43.784895 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-755f97e6-2956-42ec-a1df-6a82dbb50d22 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:43.785887 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-755f97e6-2956-42ec-a1df-6a82dbb50d22 None None] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:40:43.786299 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-755f97e6-2956-42ec-a1df-6a82dbb50d22 None None] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:40:43.788338 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-755f97e6-2956-42ec-a1df-6a82dbb50d22 None None] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:40:43.790319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO dbcounter [None req-755f97e6-2956-42ec-a1df-6a82dbb50d22 None None] Registered counter for database nova_cell0 Aug 10 12:40:43.794366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO dbcounter [None req-755f97e6-2956-42ec-a1df-6a82dbb50d22 None None] Registered counter for database nova_cell1 Aug 10 12:40:43.801920 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_db.sqlalchemy.engines [None req-755f97e6-2956-42ec-a1df-6a82dbb50d22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:40:43.803683 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_db.sqlalchemy.engines [None req-755f97e6-2956-42ec-a1df-6a82dbb50d22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:40:43.809736 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writer thread running {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:40:43.810982 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writer thread running {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:40:43.930724 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO dbcounter [None req-fe7b6da6-0c81-42ee-9a99-4cf92fb62ba4 None None] Registered counter for database nova_cell0 Aug 10 12:40:43.937458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_db.sqlalchemy.engines [None req-fe7b6da6-0c81-42ee-9a99-4cf92fb62ba4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:40:43.942616 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writer thread running {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:40:43.955668 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO dbcounter [None req-755f97e6-2956-42ec-a1df-6a82dbb50d22 None None] Registered counter for database nova_cell0 Aug 10 12:40:43.963217 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_db.sqlalchemy.engines [None req-755f97e6-2956-42ec-a1df-6a82dbb50d22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 12:40:43.967709 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writer thread running {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 12:40:44.265640 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: WARNING keystonemiddleware.auth_token [None req-fe7b6da6-0c81-42ee-9a99-4cf92fb62ba4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 12:40:44.273785 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: WARNING keystonemiddleware.auth_token [None req-fe7b6da6-0c81-42ee-9a99-4cf92fb62ba4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 12:40:44.285683 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: WARNING keystonemiddleware.auth_token [None req-755f97e6-2956-42ec-a1df-6a82dbb50d22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 12:40:44.292965 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: WARNING keystonemiddleware.auth_token [None req-755f97e6-2956-42ec-a1df-6a82dbb50d22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 12:40:44.630887 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: WARNING keystonemiddleware.auth_token [None req-fe7b6da6-0c81-42ee-9a99-4cf92fb62ba4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 12:40:44.636973 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: WARNING keystonemiddleware.auth_token [None req-fe7b6da6-0c81-42ee-9a99-4cf92fb62ba4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 12:40:44.642386 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: WARNING keystonemiddleware.auth_token [None req-755f97e6-2956-42ec-a1df-6a82dbb50d22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 12:40:44.644234 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55df659819c0 pid: 124643 (default app) Aug 10 12:40:44.649228 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: WARNING keystonemiddleware.auth_token [None req-755f97e6-2956-42ec-a1df-6a82dbb50d22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 12:40:44.655933 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55df659819c0 pid: 124642 (default app) Aug 10 12:41:19.118031 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=3 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:41:19.118866 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=3 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:41:19.119613 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=3 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:41:19.120350 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=3 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:41:20.490277 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9f70c31b-6a94-4c91-b72b-6950e3ae54ef tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] Action: 'create', calling method: .version_select at 0x7fb8289ccdc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1575920775"}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:41:23.062705 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9f70c31b-6a94-4c91-b72b-6950e3ae54ef tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.950062 Aug 10 12:41:23.063862 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1/1] 10.222.0.49 () {60 vars in 1155 bytes} [Wed Aug 10 12:41:19 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3953 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 12:41:23.316025 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-704ae497-0d0a-4d5f-9263-3ec55922ca9e tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] Calling method '.version_select at 0x7fb828aa6940>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:23.345917 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=3 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:41:23.349123 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=3 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:41:23.349123 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell0:SELECT=3 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:41:23.349796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell0:SELECT=3 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:41:23.669816 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-704ae497-0d0a-4d5f-9263-3ec55922ca9e tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f4d3821f-1c3e-4244-bc42-e48c76406f06" status: 200 len: 345 microversion: 2.1 time: 0.595304 Aug 10 12:41:23.670777 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1/2] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 12:41:23 2022] GET /compute/v2.1/os-volumes/f4d3821f-1c3e-4244-bc42-e48c76406f06 => generated 345 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:41:24.685730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f0ce932c-c425-4888-9f04-b7b403497b4f tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] Calling method '.version_select at 0x7fb828846c10>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:24.746470 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f0ce932c-c425-4888-9f04-b7b403497b4f tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f4d3821f-1c3e-4244-bc42-e48c76406f06" status: 200 len: 346 microversion: 2.1 time: 0.065578 Aug 10 12:41:24.756682 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 12:41:24 2022] GET /compute/v2.1/os-volumes/f4d3821f-1c3e-4244-bc42-e48c76406f06 => generated 346 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:41:24.775431 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-74e0400c-f42f-47f5-a9fb-eba2009ff186 tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] Action: 'create', calling method: .version_select at 0x7fb8288f4e50>, body: {"snapshot": {"volume_id": "f4d3821f-1c3e-4244-bc42-e48c76406f06", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1506920771"}} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:41:24.835418 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ba642b15-5c63-4782-b4b3-86dde46da99d tempest-VolumesTestJSON-1508654948 tempest-VolumesTestJSON-1508654948-project] Calling method '.version_select at 0x7fb82885e310>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:25.305087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ba642b15-5c63-4782-b4b3-86dde46da99d tempest-VolumesTestJSON-1508654948 tempest-VolumesTestJSON-1508654948-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/25f4ead4-f755-4c21-9b1e-5cabc23c166e" status: 200 len: 351 microversion: 2.1 time: 0.086671 Aug 10 12:41:25.305087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 3/4] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 12:41:24 2022] GET /compute/v2.1/os-volumes/25f4ead4-f755-4c21-9b1e-5cabc23c166e => generated 351 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:41:25.647506 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-74e0400c-f42f-47f5-a9fb-eba2009ff186 tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.881284 Aug 10 12:41:25.647506 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 2/5] 10.222.0.49 () {60 vars in 1162 bytes} [Wed Aug 10 12:41:24 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:41:25.651652 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2e174d68-5ce7-46b3-aca6-bfdf2f905cd5 tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] Calling method '.version_select at 0x7fb82885ea60>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:25.891337 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2e174d68-5ce7-46b3-aca6-bfdf2f905cd5 tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/1166b896-8e49-4817-92bd-4192e8ffbbc1" status: 200 len: 287 microversion: 2.1 time: 0.240760 Aug 10 12:41:25.910946 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 4/6] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 10 12:41:25 2022] GET /compute/v2.1/os-snapshots/1166b896-8e49-4817-92bd-4192e8ffbbc1 => generated 287 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:41:25.914343 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0f6fb9a0-9d22-4100-a0d0-9e85b15479cc tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] Calling method '.version_select at 0x7fb8288bf9d0>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:26.099831 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0f6fb9a0-9d22-4100-a0d0-9e85b15479cc tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.194907 Aug 10 12:41:26.112610 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f5e50592-7dae-41e8-9798-8497b39adb0f tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] Calling method '.version_select at 0x7fb828846ca0>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:26.112872 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 3/7] 10.222.0.49 () {58 vars in 1140 bytes} [Wed Aug 10 12:41:25 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:41:26.194859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f5e50592-7dae-41e8-9798-8497b39adb0f tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/1166b896-8e49-4817-92bd-4192e8ffbbc1" status: 200 len: 287 microversion: 2.1 time: 0.086516 Aug 10 12:41:26.200787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 5/8] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 10 12:41:26 2022] GET /compute/v2.1/os-snapshots/1166b896-8e49-4817-92bd-4192e8ffbbc1 => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:41:27.210307 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fea76515-5835-4f04-9960-4b6dcc0ba5a3 tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] Calling method '.version_select at 0x7fb8288bfc10>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:27.284011 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fea76515-5835-4f04-9960-4b6dcc0ba5a3 tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/1166b896-8e49-4817-92bd-4192e8ffbbc1" status: 200 len: 287 microversion: 2.1 time: 0.078161 Aug 10 12:41:27.290180 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 4/9] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 10 12:41:27 2022] GET /compute/v2.1/os-snapshots/1166b896-8e49-4817-92bd-4192e8ffbbc1 => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:41:28.297296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b9e79b03-9d9b-4a1c-b03d-2bb443ead0fa tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] Calling method '.version_select at 0x7fb82885eaf0>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:28.388644 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b9e79b03-9d9b-4a1c-b03d-2bb443ead0fa tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/1166b896-8e49-4817-92bd-4192e8ffbbc1" status: 200 len: 287 microversion: 2.1 time: 0.078772 Aug 10 12:41:28.388644 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 6/10] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 10 12:41:28 2022] GET /compute/v2.1/os-snapshots/1166b896-8e49-4817-92bd-4192e8ffbbc1 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:41:29.385157 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c56f2682-cc29-4e68-aac3-0b588d46f2a4 tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] Calling method '.version_select at 0x7fb82885e040>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:29.453917 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c56f2682-cc29-4e68-aac3-0b588d46f2a4 tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/1166b896-8e49-4817-92bd-4192e8ffbbc1" status: 200 len: 288 microversion: 2.1 time: 0.073377 Aug 10 12:41:29.455100 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 5/11] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 10 12:41:29 2022] GET /compute/v2.1/os-snapshots/1166b896-8e49-4817-92bd-4192e8ffbbc1 => generated 288 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:41:29.466968 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b01d7176-1a01-4dd9-9a23-2f245e26ce93 tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] Calling method '.version_select at 0x7fb82885e310>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:29.612386 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b01d7176-1a01-4dd9-9a23-2f245e26ce93 tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/1166b896-8e49-4817-92bd-4192e8ffbbc1" status: 202 len: 0 microversion: 2.1 time: 0.148982 Aug 10 12:41:29.621909 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 7/12] 10.222.0.49 () {58 vars in 1254 bytes} [Wed Aug 10 12:41:29 2022] DELETE /compute/v2.1/os-snapshots/1166b896-8e49-4817-92bd-4192e8ffbbc1 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:41:29.623166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d678e668-716d-48d1-baa4-89b4cd07a710 tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] Calling method '.version_select at 0x7fb82885e700>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:29.684797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d678e668-716d-48d1-baa4-89b4cd07a710 tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/1166b896-8e49-4817-92bd-4192e8ffbbc1" status: 200 len: 287 microversion: 2.1 time: 0.066103 Aug 10 12:41:29.685471 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 6/13] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 10 12:41:29 2022] GET /compute/v2.1/os-snapshots/1166b896-8e49-4817-92bd-4192e8ffbbc1 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:41:30.560438 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e332558f-b3cf-490c-bdf0-7db14c94e8f3 tempest-VolumesTestJSON-1508654948 tempest-VolumesTestJSON-1508654948-project] Calling method '.version_select at 0x7fb82885e0d0>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:30.638923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e332558f-b3cf-490c-bdf0-7db14c94e8f3 tempest-VolumesTestJSON-1508654948 tempest-VolumesTestJSON-1508654948-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/9b9561d0-fc17-4670-b23d-c73feb95445c" status: 200 len: 350 microversion: 2.1 time: 0.085625 Aug 10 12:41:30.639913 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 8/14] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 12:41:30 2022] GET /compute/v2.1/os-volumes/9b9561d0-fc17-4670-b23d-c73feb95445c => generated 350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:41:30.699007 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9f59430b-edf5-4b44-9fc0-b482ed12263b tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] Calling method '.version_select at 0x7fb82885edc0>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:31.032964 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.wsgi [None req-9f59430b-edf5-4b44-9fc0-b482ed12263b tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] HTTP exception thrown: Snapshot 1166b896-8e49-4817-92bd-4192e8ffbbc1 could not be found. Aug 10 12:41:31.038587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9f59430b-edf5-4b44-9fc0-b482ed12263b tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] Request method failure captured: Aug 10 12:41:31.038587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: request: GET /compute/v2.1/os-snapshots/1166b896-8e49-4817-92bd-4192e8ffbbc1 HTTP/1.1 Aug 10 12:41:31.038587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Accept: application/json Aug 10 12:41:31.038587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Accept-Encoding: identity Aug 10 12:41:31.038587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Connection: close Aug 10 12:41:31.038587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Content-Length: 0 Aug 10 12:41:31.038587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Content-Type: application/json Aug 10 12:41:31.038587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Host: 10.222.0.49 Aug 10 12:41:31.038587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Openstack-System-Scope: None Aug 10 12:41:31.038587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: User-Agent: python-urllib3/1.26.11 Aug 10 12:41:31.038587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Auth-Token: gAAAAABi86dvoPa4AHdBC3NirZIypjg75mBJO2xiuvdtYILxu85ULBuAtsD2txh7OPSUDyxglc_kGl_aEIc-X32vKYfU3qhY-Pe1oS_nrEBdn1elewxO0ZJ2vLTzw-k8BGsW7xYZde38GDj1uvnmMW_qFwueFhYJDlohaOwf_3KNPXa5Qz6zgmY Aug 10 12:41:31.038587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Domain-Id: None Aug 10 12:41:31.038587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Domain-Name: None Aug 10 12:41:31.038587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Identity-Status: Confirmed Aug 10 12:41:31.038587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Is-Admin-Project: True Aug 10 12:41:31.038587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Project-Domain-Id: default Aug 10 12:41:31.038587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Project-Domain-Name: Default Aug 10 12:41:31.038587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Project-Id: 578ea63d03fc48c881899b6482d954e0 Aug 10 12:41:31.038587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-644661139 Aug 10 12:41:31.038587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Role: reader,member Aug 10 12:41:31.038587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Roles: reader,member Aug 10 12:41:31.040032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/578ea63d03fc48c881899b6482d954e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_578ea63d03fc48c881899b6482d954e0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/578ea63d03fc48c881899b6482d954e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/578ea63d03fc48c881899b6482d954e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 12:41:31.040032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Tenant: tempest-VolumesSnapshotsTestJSON-644661139 Aug 10 12:41:31.040032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Tenant-Id: 578ea63d03fc48c881899b6482d954e0 Aug 10 12:41:31.040032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-644661139 Aug 10 12:41:31.040032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User: tempest-VolumesSnapshotsTestJSON-644661139-project Aug 10 12:41:31.040032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User-Domain-Id: default Aug 10 12:41:31.040032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User-Domain-Name: Default Aug 10 12:41:31.040032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User-Id: 5ce0e999ef0b4b26ac24d703661d51a5 Aug 10 12:41:31.040032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User-Name: tempest-VolumesSnapshotsTestJSON-644661139-project Aug 10 12:41:31.040032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: method: Aug 10 12:41:31.040032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: exception: Snapshot 1166b896-8e49-4817-92bd-4192e8ffbbc1 could not be found. Aug 10 12:41:31.040032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: action_args: {'id': '1166b896-8e49-4817-92bd-4192e8ffbbc1'} Aug 10 12:41:31.040032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:41:31.041023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:41:31.041023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 12:41:31.041023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 12:41:31.041023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 12:41:31.041023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 12:41:31.041023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 12:41:31.041023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 12:41:31.041023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 12:41:31.041023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 12:41:31.041023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 12:41:31.041023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 12:41:31.041023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 12:41:31.041023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 12:41:31.041023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 12:41:31.041023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 12:41:31.041023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 1166b896-8e49-4817-92bd-4192e8ffbbc1 could not be found. (HTTP 404) (Request-ID: req-16008db6-c477-4f56-8877-6667e7f6f7a9) Aug 10 12:41:31.041023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:41:31.041023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:41:31.042138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:41:31.042138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:41:31.042138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 10 12:41:31.042138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 10 12:41:31.042138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 12:41:31.042138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 12:41:31.042138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 10 12:41:31.042138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 10 12:41:31.042138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 12:41:31.042138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 12:41:31.042138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 12:41:31.042138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 12:41:31.042138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 12:41:31.042138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 12:41:31.042138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 12:41:31.042138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 12:41:31.042138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 12:41:31.042138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 12:41:31.042138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 12:41:31.043013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 12:41:31.043013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 12:41:31.043013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 12:41:31.043013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 12:41:31.043013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 12:41:31.043013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 1166b896-8e49-4817-92bd-4192e8ffbbc1 could not be found. Aug 10 12:41:31.043013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:41:31.043013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:41:31.043013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:41:31.043013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:41:31.043013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:41:31.043013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:41:31.043013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:41:31.043013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:41:31.043013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 12:41:31.043013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 12:41:31.043013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:41:31.043013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:41:31.043013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 10 12:41:31.043013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:41:31.044809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 1166b896-8e49-4817-92bd-4192e8ffbbc1 could not be found. Aug 10 12:41:31.044809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:41:31.044809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:41:31.044809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:41:31.044809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:41:31.044809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:41:31.044809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:41:31.044809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:41:31.044809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:41:31.044809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 1166b896-8e49-4817-92bd-4192e8ffbbc1 could not be found. Aug 10 12:41:31.044809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:41:31.044809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9f59430b-edf5-4b44-9fc0-b482ed12263b tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] Returning 404 to user: Snapshot 1166b896-8e49-4817-92bd-4192e8ffbbc1 could not be found. {{(pid=124642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:41:31.044809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9f59430b-edf5-4b44-9fc0-b482ed12263b tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/1166b896-8e49-4817-92bd-4192e8ffbbc1" status: 404 len: 111 microversion: 2.1 time: 0.346412 Aug 10 12:41:31.044809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 7/15] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 10 12:41:30 2022] GET /compute/v2.1/os-snapshots/1166b896-8e49-4817-92bd-4192e8ffbbc1 => generated 111 bytes in 348 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:41:31.053410 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6bf17580-6471-4854-abec-80d332b9acd1 tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] Calling method '.version_select at 0x7fb82885eaf0>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:31.593700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6bf17580-6471-4854-abec-80d332b9acd1 tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/f4d3821f-1c3e-4244-bc42-e48c76406f06" status: 202 len: 0 microversion: 2.1 time: 0.548060 Aug 10 12:41:31.595158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 9/16] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 10 12:41:31 2022] DELETE /compute/v2.1/os-volumes/f4d3821f-1c3e-4244-bc42-e48c76406f06 => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:41:31.607353 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-310ef767-3046-4ccb-b181-92005dda864f tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] Calling method '.version_select at 0x7fb82883b160>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:31.741094 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-310ef767-3046-4ccb-b181-92005dda864f tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f4d3821f-1c3e-4244-bc42-e48c76406f06" status: 200 len: 345 microversion: 2.1 time: 0.140835 Aug 10 12:41:31.742043 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 8/17] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 12:41:31 2022] GET /compute/v2.1/os-volumes/f4d3821f-1c3e-4244-bc42-e48c76406f06 => generated 345 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:41:32.756383 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ab983e13-6f42-498f-904f-d63b6fbfb2d3 tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] Calling method '.version_select at 0x7fb828846ca0>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:32.890921 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ab983e13-6f42-498f-904f-d63b6fbfb2d3 tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f4d3821f-1c3e-4244-bc42-e48c76406f06" status: 200 len: 345 microversion: 2.1 time: 0.139066 Aug 10 12:41:32.892064 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 10/18] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 12:41:32 2022] GET /compute/v2.1/os-volumes/f4d3821f-1c3e-4244-bc42-e48c76406f06 => generated 345 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:41:33.028945 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e10aad5d-1c4c-4543-99b1-6fcd8b6ce516 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-134158925", "imageRef": "674dcf76-6c38-40de-b204-ad2842738058", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:41:33.236177 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.network.neutron [None req-e10aad5d-1c4c-4543-99b1-6fcd8b6ce516 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] validate_networks() for [('792b1b55-fb0b-40d5-a346-6e66d9958713', None, None, None, None, None)] {{(pid=124642) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:41:33.915500 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2b1ce3db-b6ef-43aa-9ecc-36ba79e082ed tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] Calling method '.version_select at 0x7fb828846c10>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:34.029056 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2b1ce3db-b6ef-43aa-9ecc-36ba79e082ed tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f4d3821f-1c3e-4244-bc42-e48c76406f06" status: 200 len: 345 microversion: 2.1 time: 0.126936 Aug 10 12:41:34.030147 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 11/19] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 12:41:33 2022] GET /compute/v2.1/os-volumes/f4d3821f-1c3e-4244-bc42-e48c76406f06 => generated 345 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:41:34.344572 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-e10aad5d-1c4c-4543-99b1-6fcd8b6ce516 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Flavor limits 0:0:0 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:41:34.347492 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-e10aad5d-1c4c-4543-99b1-6fcd8b6ce516 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Image limits 0:0:0 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:41:34.349078 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-e10aad5d-1c4c-4543-99b1-6fcd8b6ce516 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Flavor pref 0:0:0 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:41:34.350384 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-e10aad5d-1c4c-4543-99b1-6fcd8b6ce516 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Image pref 0:0:0 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:41:34.351024 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-e10aad5d-1c4c-4543-99b1-6fcd8b6ce516 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:41:34.398439 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e10aad5d-1c4c-4543-99b1-6fcd8b6ce516 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:34.399485 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e10aad5d-1c4c-4543-99b1-6fcd8b6ce516 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:34.403462 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e10aad5d-1c4c-4543-99b1-6fcd8b6ce516 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:34.403462 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e10aad5d-1c4c-4543-99b1-6fcd8b6ce516 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:34.403462 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e10aad5d-1c4c-4543-99b1-6fcd8b6ce516 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:34.403462 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e10aad5d-1c4c-4543-99b1-6fcd8b6ce516 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:34.501242 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.quota [None req-e10aad5d-1c4c-4543-99b1-6fcd8b6ce516 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Getting quotas for project e41d5b8acbce44248a45678d1e4f6b71. Resources: {'cores', 'ram', 'instances'} {{(pid=124642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:41:34.552985 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.quota [None req-e10aad5d-1c4c-4543-99b1-6fcd8b6ce516 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Getting quotas for user 39cb7e0c86b3460dbd17c58dc13ef0d9 and project e41d5b8acbce44248a45678d1e4f6b71. Resources: {'cores', 'ram', 'instances'} {{(pid=124642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:41:34.574601 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e10aad5d-1c4c-4543-99b1-6fcd8b6ce516 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Going to run 1 instances... {{(pid=124642) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:41:34.586320 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e10aad5d-1c4c-4543-99b1-6fcd8b6ce516 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='674dcf76-6c38-40de-b204-ad2842738058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:41:34.811785 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e10aad5d-1c4c-4543-99b1-6fcd8b6ce516 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.903857 Aug 10 12:41:34.813136 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 9/20] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 12:41:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 1906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 12:41:34.825195 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5253cf99-5f11-4cd9-927f-0bb482ff2dd8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:34.827578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5253cf99-5f11-4cd9-927f-0bb482ff2dd8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:35.046702 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-66e5af69-bce5-4885-9ba5-d7f07055853e tempest-VolumesTestJSON-1508654948 tempest-VolumesTestJSON-1508654948-project] Calling method '.version_select at 0x7fb828730940>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:35.055284 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5253cf99-5f11-4cd9-927f-0bb482ff2dd8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:35.083373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5253cf99-5f11-4cd9-927f-0bb482ff2dd8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48" status: 200 len: 1221 microversion: 2.1 time: 0.260233 Aug 10 12:41:35.083373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 12/21] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:34 2022] GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48 => generated 1221 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:35.091496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8abea834-d433-49d0-a578-5c516d641026 tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] Calling method '.version_select at 0x7fb82885e3a0>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:35.191530 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-66e5af69-bce5-4885-9ba5-d7f07055853e tempest-VolumesTestJSON-1508654948 tempest-VolumesTestJSON-1508654948-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/eac80b8c-dad3-4ab2-82e5-43fe5116bec6" status: 200 len: 351 microversion: 2.1 time: 0.152639 Aug 10 12:41:35.200701 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 10/22] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 12:41:35 2022] GET /compute/v2.1/os-volumes/eac80b8c-dad3-4ab2-82e5-43fe5116bec6 => generated 351 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:41:35.206824 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1ce1d011-93e3-42b0-91d2-65ece9e9e369 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1081039219", "imageRef": "674dcf76-6c38-40de-b204-ad2842738058", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:41:35.216422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-8abea834-d433-49d0-a578-5c516d641026 tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] HTTP exception thrown: Volume f4d3821f-1c3e-4244-bc42-e48c76406f06 could not be found. Aug 10 12:41:35.221378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8abea834-d433-49d0-a578-5c516d641026 tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] Request method failure captured: Aug 10 12:41:35.221378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: GET /compute/v2.1/os-volumes/f4d3821f-1c3e-4244-bc42-e48c76406f06 HTTP/1.1 Aug 10 12:41:35.221378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 12:41:35.221378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 12:41:35.221378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 12:41:35.221378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 12:41:35.221378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 12:41:35.221378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 12:41:35.221378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 12:41:35.221378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 12:41:35.221378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86dvoPa4AHdBC3NirZIypjg75mBJO2xiuvdtYILxu85ULBuAtsD2txh7OPSUDyxglc_kGl_aEIc-X32vKYfU3qhY-Pe1oS_nrEBdn1elewxO0ZJ2vLTzw-k8BGsW7xYZde38GDj1uvnmMW_qFwueFhYJDlohaOwf_3KNPXa5Qz6zgmY Aug 10 12:41:35.221378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 12:41:35.221378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 12:41:35.221378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 12:41:35.221378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 12:41:35.221378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 12:41:35.221378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 12:41:35.221378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: 578ea63d03fc48c881899b6482d954e0 Aug 10 12:41:35.221378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-644661139 Aug 10 12:41:35.221378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 12:41:35.221378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 12:41:35.222707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/578ea63d03fc48c881899b6482d954e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_578ea63d03fc48c881899b6482d954e0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/578ea63d03fc48c881899b6482d954e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/578ea63d03fc48c881899b6482d954e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 12:41:35.222707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-VolumesSnapshotsTestJSON-644661139 Aug 10 12:41:35.222707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: 578ea63d03fc48c881899b6482d954e0 Aug 10 12:41:35.222707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-644661139 Aug 10 12:41:35.222707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-VolumesSnapshotsTestJSON-644661139-project Aug 10 12:41:35.222707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 12:41:35.222707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 12:41:35.222707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 5ce0e999ef0b4b26ac24d703661d51a5 Aug 10 12:41:35.222707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-VolumesSnapshotsTestJSON-644661139-project Aug 10 12:41:35.222707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: Aug 10 12:41:35.222707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Volume f4d3821f-1c3e-4244-bc42-e48c76406f06 could not be found. Aug 10 12:41:35.222707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': 'f4d3821f-1c3e-4244-bc42-e48c76406f06'} Aug 10 12:41:35.222707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:41:35.224141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:41:35.224141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 12:41:35.224141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 12:41:35.224141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 12:41:35.224141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 12:41:35.224141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 12:41:35.224141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 12:41:35.224141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 12:41:35.224141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 12:41:35.224141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 12:41:35.224141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 12:41:35.224141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 12:41:35.224141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 12:41:35.224141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 12:41:35.224141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 12:41:35.224141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f4d3821f-1c3e-4244-bc42-e48c76406f06 could not be found. (HTTP 404) (Request-ID: req-c82ee00d-54d1-4c13-af85-4fc49440c03d) Aug 10 12:41:35.224141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:41:35.224141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:41:35.224141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:41:35.225340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:41:35.225340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 12:41:35.225340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 12:41:35.225340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 12:41:35.225340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 12:41:35.225340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 12:41:35.225340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 12:41:35.225340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 12:41:35.225340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 12:41:35.225340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 12:41:35.225340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 12:41:35.225340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 12:41:35.225340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 12:41:35.225340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 12:41:35.225340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 12:41:35.225340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 12:41:35.225340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 12:41:35.225340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 12:41:35.225340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 12:41:35.226425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 12:41:35.226425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 12:41:35.226425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 12:41:35.226425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 12:41:35.226425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f4d3821f-1c3e-4244-bc42-e48c76406f06 could not be found. Aug 10 12:41:35.226425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:41:35.226425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:41:35.226425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:41:35.226425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:41:35.226425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:41:35.226425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:41:35.226425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:41:35.226425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:41:35.226425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 12:41:35.226425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 12:41:35.226425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:41:35.226425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:41:35.226425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 12:41:35.226425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:41:35.227638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f4d3821f-1c3e-4244-bc42-e48c76406f06 could not be found. Aug 10 12:41:35.227638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:41:35.227638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:41:35.227638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:41:35.227638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:41:35.227638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:41:35.227638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:41:35.227638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:41:35.227638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:41:35.227638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f4d3821f-1c3e-4244-bc42-e48c76406f06 could not be found. Aug 10 12:41:35.227638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:41:35.236203 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8abea834-d433-49d0-a578-5c516d641026 tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] Returning 404 to user: Volume f4d3821f-1c3e-4244-bc42-e48c76406f06 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:41:35.238245 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8abea834-d433-49d0-a578-5c516d641026 tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f4d3821f-1c3e-4244-bc42-e48c76406f06" status: 404 len: 109 microversion: 2.1 time: 0.154858 Aug 10 12:41:35.241508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 13/23] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 12:41:35 2022] GET /compute/v2.1/os-volumes/f4d3821f-1c3e-4244-bc42-e48c76406f06 => generated 109 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:41:35.268923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e2386cb9-388a-45ca-9719-d62636b7d5fc tempest-VolumesTestJSON-1508654948 tempest-VolumesTestJSON-1508654948-project] Calling method '.version_select at 0x7fb8291ce160>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:35.407013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.network.neutron [None req-1ce1d011-93e3-42b0-91d2-65ece9e9e369 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] validate_networks() for [('792b1b55-fb0b-40d5-a346-6e66d9958713', None, None, None, None, None)] {{(pid=124642) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:41:35.574340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e2386cb9-388a-45ca-9719-d62636b7d5fc tempest-VolumesTestJSON-1508654948 tempest-VolumesTestJSON-1508654948-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.329815 Aug 10 12:41:35.600494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 14/24] 10.222.0.49 () {58 vars in 1134 bytes} [Wed Aug 10 12:41:35 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:35.612854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-779ee7a0-aeda-4e6d-be6f-4719955a3b3a tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] Calling method '.version_select at 0x7fb828829550>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:35.685992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-779ee7a0-aeda-4e6d-be6f-4719955a3b3a tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] HTTP exception thrown: Volume f4d3821f-1c3e-4244-bc42-e48c76406f06 could not be found. Aug 10 12:41:35.688852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-779ee7a0-aeda-4e6d-be6f-4719955a3b3a tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] Request method failure captured: Aug 10 12:41:35.688852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: DELETE /compute/v2.1/os-volumes/f4d3821f-1c3e-4244-bc42-e48c76406f06 HTTP/1.1 Aug 10 12:41:35.688852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 12:41:35.688852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 12:41:35.688852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 12:41:35.688852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 12:41:35.688852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 12:41:35.688852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 12:41:35.688852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 12:41:35.688852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 12:41:35.688852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86dvoPa4AHdBC3NirZIypjg75mBJO2xiuvdtYILxu85ULBuAtsD2txh7OPSUDyxglc_kGl_aEIc-X32vKYfU3qhY-Pe1oS_nrEBdn1elewxO0ZJ2vLTzw-k8BGsW7xYZde38GDj1uvnmMW_qFwueFhYJDlohaOwf_3KNPXa5Qz6zgmY Aug 10 12:41:35.688852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 12:41:35.688852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 12:41:35.688852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 12:41:35.688852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 12:41:35.688852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 12:41:35.688852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 12:41:35.688852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: 578ea63d03fc48c881899b6482d954e0 Aug 10 12:41:35.688852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-644661139 Aug 10 12:41:35.688852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 12:41:35.688852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 12:41:35.690139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/578ea63d03fc48c881899b6482d954e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_578ea63d03fc48c881899b6482d954e0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/578ea63d03fc48c881899b6482d954e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/578ea63d03fc48c881899b6482d954e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 12:41:35.690139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-VolumesSnapshotsTestJSON-644661139 Aug 10 12:41:35.690139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: 578ea63d03fc48c881899b6482d954e0 Aug 10 12:41:35.690139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-644661139 Aug 10 12:41:35.690139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-VolumesSnapshotsTestJSON-644661139-project Aug 10 12:41:35.690139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 12:41:35.690139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 12:41:35.690139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 5ce0e999ef0b4b26ac24d703661d51a5 Aug 10 12:41:35.690139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-VolumesSnapshotsTestJSON-644661139-project Aug 10 12:41:35.690139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: Aug 10 12:41:35.690139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Volume f4d3821f-1c3e-4244-bc42-e48c76406f06 could not be found. Aug 10 12:41:35.690139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': 'f4d3821f-1c3e-4244-bc42-e48c76406f06'} Aug 10 12:41:35.690139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:41:35.690741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:41:35.690741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 12:41:35.690741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 12:41:35.690741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 12:41:35.690741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 12:41:35.690741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 12:41:35.690741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 12:41:35.690741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 12:41:35.690741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 12:41:35.690741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 12:41:35.690741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 12:41:35.690741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 12:41:35.690741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 12:41:35.690741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 12:41:35.690741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 12:41:35.690741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f4d3821f-1c3e-4244-bc42-e48c76406f06 could not be found. (HTTP 404) (Request-ID: req-7d06e172-2398-4769-a9d7-dde7d3735a1e) Aug 10 12:41:35.690741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:41:35.690741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:41:35.690741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:41:35.695401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:41:35.695401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 12:41:35.695401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 12:41:35.695401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 12:41:35.695401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 12:41:35.695401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 12:41:35.695401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 12:41:35.695401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 12:41:35.695401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 12:41:35.695401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 12:41:35.695401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 12:41:35.695401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 12:41:35.695401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 12:41:35.695401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 12:41:35.695401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 12:41:35.695401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 12:41:35.695401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 12:41:35.695401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 12:41:35.695401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 12:41:35.696507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 12:41:35.696507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 12:41:35.696507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 12:41:35.696507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 12:41:35.696507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f4d3821f-1c3e-4244-bc42-e48c76406f06 could not be found. Aug 10 12:41:35.696507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:41:35.696507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:41:35.696507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:41:35.696507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:41:35.696507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:41:35.696507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:41:35.696507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:41:35.696507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:41:35.696507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 12:41:35.696507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 12:41:35.696507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:41:35.696507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:41:35.696507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 12:41:35.696507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:41:35.697368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f4d3821f-1c3e-4244-bc42-e48c76406f06 could not be found. Aug 10 12:41:35.697368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:41:35.697368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:41:35.697368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:41:35.697368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:41:35.697368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:41:35.697368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:41:35.697368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:41:35.697368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:41:35.697368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f4d3821f-1c3e-4244-bc42-e48c76406f06 could not be found. Aug 10 12:41:35.697368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:41:35.697368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-779ee7a0-aeda-4e6d-be6f-4719955a3b3a tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] Returning 404 to user: Volume f4d3821f-1c3e-4244-bc42-e48c76406f06 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:41:35.697368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-779ee7a0-aeda-4e6d-be6f-4719955a3b3a tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/f4d3821f-1c3e-4244-bc42-e48c76406f06" status: 404 len: 109 microversion: 2.1 time: 0.089102 Aug 10 12:41:35.697368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 15/25] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 10 12:41:35 2022] DELETE /compute/v2.1/os-volumes/f4d3821f-1c3e-4244-bc42-e48c76406f06 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:41:35.704048 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3adbc15e-5854-4ef2-a391-22b2019a2501 tempest-VolumesTestJSON-1508654948 tempest-VolumesTestJSON-1508654948-project] Calling method '.version_select at 0x7fb8287e0a60>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:35.996464 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3adbc15e-5854-4ef2-a391-22b2019a2501 tempest-VolumesTestJSON-1508654948 tempest-VolumesTestJSON-1508654948-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.303607 Aug 10 12:41:35.998171 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 16/26] 10.222.0.49 () {58 vars in 1149 bytes} [Wed Aug 10 12:41:35 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:41:36.003951 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-96b2adfa-934c-4b2c-9f36-07f3b6cde492 tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] Calling method '.version_select at 0x7fb828829550>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:36.068539 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-96b2adfa-934c-4b2c-9f36-07f3b6cde492 tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] HTTP exception thrown: Volume f4d3821f-1c3e-4244-bc42-e48c76406f06 could not be found. Aug 10 12:41:36.071553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-96b2adfa-934c-4b2c-9f36-07f3b6cde492 tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] Request method failure captured: Aug 10 12:41:36.071553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: GET /compute/v2.1/os-volumes/f4d3821f-1c3e-4244-bc42-e48c76406f06 HTTP/1.1 Aug 10 12:41:36.071553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 12:41:36.071553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 12:41:36.071553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 12:41:36.071553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 12:41:36.071553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 12:41:36.071553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 12:41:36.071553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 12:41:36.071553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 12:41:36.071553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86dvoPa4AHdBC3NirZIypjg75mBJO2xiuvdtYILxu85ULBuAtsD2txh7OPSUDyxglc_kGl_aEIc-X32vKYfU3qhY-Pe1oS_nrEBdn1elewxO0ZJ2vLTzw-k8BGsW7xYZde38GDj1uvnmMW_qFwueFhYJDlohaOwf_3KNPXa5Qz6zgmY Aug 10 12:41:36.071553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 12:41:36.071553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 12:41:36.071553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 12:41:36.071553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 12:41:36.071553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 12:41:36.071553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 12:41:36.071553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: 578ea63d03fc48c881899b6482d954e0 Aug 10 12:41:36.071553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-644661139 Aug 10 12:41:36.071553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 12:41:36.071553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 12:41:36.072982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/578ea63d03fc48c881899b6482d954e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_578ea63d03fc48c881899b6482d954e0", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/578ea63d03fc48c881899b6482d954e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/578ea63d03fc48c881899b6482d954e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 12:41:36.072982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-VolumesSnapshotsTestJSON-644661139 Aug 10 12:41:36.072982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: 578ea63d03fc48c881899b6482d954e0 Aug 10 12:41:36.072982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-644661139 Aug 10 12:41:36.072982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-VolumesSnapshotsTestJSON-644661139-project Aug 10 12:41:36.072982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 12:41:36.072982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 12:41:36.072982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 5ce0e999ef0b4b26ac24d703661d51a5 Aug 10 12:41:36.072982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-VolumesSnapshotsTestJSON-644661139-project Aug 10 12:41:36.072982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: Aug 10 12:41:36.072982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Volume f4d3821f-1c3e-4244-bc42-e48c76406f06 could not be found. Aug 10 12:41:36.072982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': 'f4d3821f-1c3e-4244-bc42-e48c76406f06'} Aug 10 12:41:36.072982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:41:36.073650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:41:36.073650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 12:41:36.073650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 12:41:36.073650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 12:41:36.073650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 12:41:36.073650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 12:41:36.073650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 12:41:36.073650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 12:41:36.073650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 12:41:36.073650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 12:41:36.073650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 12:41:36.073650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 12:41:36.073650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 12:41:36.073650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 12:41:36.073650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 12:41:36.073650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f4d3821f-1c3e-4244-bc42-e48c76406f06 could not be found. (HTTP 404) (Request-ID: req-0c3ae53e-353e-43fc-a711-caa3674a11b6) Aug 10 12:41:36.073650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:41:36.073650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:41:36.073650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:41:36.074859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:41:36.074859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 12:41:36.074859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 12:41:36.074859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 12:41:36.074859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 12:41:36.074859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 12:41:36.074859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 12:41:36.074859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 12:41:36.074859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 12:41:36.074859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 12:41:36.074859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 12:41:36.074859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 12:41:36.074859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 12:41:36.074859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 12:41:36.074859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 12:41:36.074859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 12:41:36.074859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 12:41:36.074859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 12:41:36.074859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 12:41:36.075935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 12:41:36.075935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 12:41:36.075935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 12:41:36.075935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 12:41:36.075935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f4d3821f-1c3e-4244-bc42-e48c76406f06 could not be found. Aug 10 12:41:36.075935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:41:36.075935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:41:36.075935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:41:36.075935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:41:36.075935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:41:36.075935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:41:36.075935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:41:36.075935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:41:36.075935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 12:41:36.075935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 12:41:36.075935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:41:36.075935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:41:36.075935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 12:41:36.075935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:41:36.077001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f4d3821f-1c3e-4244-bc42-e48c76406f06 could not be found. Aug 10 12:41:36.077001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:41:36.077001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:41:36.077001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:41:36.077001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:41:36.077001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:41:36.077001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:41:36.077001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:41:36.077001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:41:36.077001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f4d3821f-1c3e-4244-bc42-e48c76406f06 could not be found. Aug 10 12:41:36.077001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:41:36.084662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-96b2adfa-934c-4b2c-9f36-07f3b6cde492 tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] Returning 404 to user: Volume f4d3821f-1c3e-4244-bc42-e48c76406f06 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:41:36.085551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-96b2adfa-934c-4b2c-9f36-07f3b6cde492 tempest-VolumesSnapshotsTestJSON-644661139 tempest-VolumesSnapshotsTestJSON-644661139-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f4d3821f-1c3e-4244-bc42-e48c76406f06" status: 404 len: 109 microversion: 2.1 time: 0.086291 Aug 10 12:41:36.089421 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 17/27] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 12:41:35 2022] GET /compute/v2.1/os-volumes/f4d3821f-1c3e-4244-bc42-e48c76406f06 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:41:36.093942 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e9d2dc59-e988-4d77-b4c4-2b6ae391518c tempest-VolumesTestJSON-1508654948 tempest-VolumesTestJSON-1508654948-project] Calling method '.version_select at 0x7fb828791160>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:36.370932 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e9d2dc59-e988-4d77-b4c4-2b6ae391518c tempest-VolumesTestJSON-1508654948 tempest-VolumesTestJSON-1508654948-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.281941 Aug 10 12:41:36.371391 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 18/28] 10.222.0.49 () {58 vars in 1134 bytes} [Wed Aug 10 12:41:36 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:36.384580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ccca19ba-7c72-4bc7-927a-a31af3660472 tempest-VolumesTestJSON-1508654948 tempest-VolumesTestJSON-1508654948-project] Calling method '.version_select at 0x7fb828829dc0>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:36.646145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ccca19ba-7c72-4bc7-927a-a31af3660472 tempest-VolumesTestJSON-1508654948 tempest-VolumesTestJSON-1508654948-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.192706 Aug 10 12:41:36.646145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 19/29] 10.222.0.49 () {58 vars in 1167 bytes} [Wed Aug 10 12:41:36 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:41:36.655942 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-cb2cf97d-c673-4a79-bd35-ec8c7b9be8a7 tempest-VolumesTestJSON-1508654948 tempest-VolumesTestJSON-1508654948-project] Calling method '.version_select at 0x7fb828823790>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:36.775144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-cb2cf97d-c673-4a79-bd35-ec8c7b9be8a7 tempest-VolumesTestJSON-1508654948 tempest-VolumesTestJSON-1508654948-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.123566 Aug 10 12:41:36.778045 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 20/30] 10.222.0.49 () {58 vars in 1170 bytes} [Wed Aug 10 12:41:36 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:41:36.790667 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6a23a4c5-3552-4e13-9281-53356913ab20 tempest-VolumesTestJSON-1508654948 tempest-VolumesTestJSON-1508654948-project] Calling method '.version_select at 0x7fb82878e5e0>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:36.911148 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6a23a4c5-3552-4e13-9281-53356913ab20 tempest-VolumesTestJSON-1508654948 tempest-VolumesTestJSON-1508654948-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.124976 Aug 10 12:41:36.912263 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-1ce1d011-93e3-42b0-91d2-65ece9e9e369 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Flavor limits 0:0:0 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:41:36.912986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 21/31] 10.222.0.49 () {58 vars in 1155 bytes} [Wed Aug 10 12:41:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:36.920557 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-1ce1d011-93e3-42b0-91d2-65ece9e9e369 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Image limits 0:0:0 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:41:36.921365 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-1ce1d011-93e3-42b0-91d2-65ece9e9e369 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Flavor pref 0:0:0 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:41:36.921935 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-1ce1d011-93e3-42b0-91d2-65ece9e9e369 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Image pref 0:0:0 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:41:36.922507 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-1ce1d011-93e3-42b0-91d2-65ece9e9e369 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:41:36.927167 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-31be171d-8bd5-4f2e-911c-a1129d9c50f5 tempest-VolumesTestJSON-1508654948 tempest-VolumesTestJSON-1508654948-project] Calling method '.version_select at 0x7fb8287e0d30>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:36.937696 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1ce1d011-93e3-42b0-91d2-65ece9e9e369 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:36.938178 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1ce1d011-93e3-42b0-91d2-65ece9e9e369 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:36.938798 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1ce1d011-93e3-42b0-91d2-65ece9e9e369 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:36.939850 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1ce1d011-93e3-42b0-91d2-65ece9e9e369 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:36.942523 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1ce1d011-93e3-42b0-91d2-65ece9e9e369 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:36.954895 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1ce1d011-93e3-42b0-91d2-65ece9e9e369 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:37.014755 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.quota [None req-1ce1d011-93e3-42b0-91d2-65ece9e9e369 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Getting quotas for project e41d5b8acbce44248a45678d1e4f6b71. Resources: {'cores', 'ram', 'instances'} {{(pid=124642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:41:37.022256 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.quota [None req-1ce1d011-93e3-42b0-91d2-65ece9e9e369 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Getting quotas for user 39cb7e0c86b3460dbd17c58dc13ef0d9 and project e41d5b8acbce44248a45678d1e4f6b71. Resources: {'cores', 'ram', 'instances'} {{(pid=124642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:41:37.037240 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1ce1d011-93e3-42b0-91d2-65ece9e9e369 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Going to run 1 instances... {{(pid=124642) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:41:37.039412 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1ce1d011-93e3-42b0-91d2-65ece9e9e369 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='674dcf76-6c38-40de-b204-ad2842738058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:41:37.175462 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-31be171d-8bd5-4f2e-911c-a1129d9c50f5 tempest-VolumesTestJSON-1508654948 tempest-VolumesTestJSON-1508654948-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.150907 Aug 10 12:41:37.175462 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 22/32] 10.222.0.49 () {58 vars in 1188 bytes} [Wed Aug 10 12:41:36 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:41:37.183190 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c4bc6379-0ecb-4d11-937b-5672a568f859 tempest-VolumesTestJSON-1508654948 tempest-VolumesTestJSON-1508654948-project] Calling method '.version_select at 0x7fb828829a60>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:37.277175 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c4bc6379-0ecb-4d11-937b-5672a568f859 tempest-VolumesTestJSON-1508654948 tempest-VolumesTestJSON-1508654948-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.097939 Aug 10 12:41:37.277766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 23/33] 10.222.0.49 () {58 vars in 1155 bytes} [Wed Aug 10 12:41:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:41:37.344538 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-30b17603-f4dc-4ee1-bb66-eca147555715 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1872725640", "imageRef": "674dcf76-6c38-40de-b204-ad2842738058", "flavorRef": "452", "networks": [{"uuid": "656bf1fb-aa69-4599-b0e4-6ed5c23545ae"}]}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:41:37.443813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.network.neutron [None req-30b17603-f4dc-4ee1-bb66-eca147555715 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] validate_networks() for [('656bf1fb-aa69-4599-b0e4-6ed5c23545ae', None, None, None, None, None)] {{(pid=124643) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:41:38.052178 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-30b17603-f4dc-4ee1-bb66-eca147555715 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Flavor limits 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:41:38.052604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-30b17603-f4dc-4ee1-bb66-eca147555715 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Image limits 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:41:38.053070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-30b17603-f4dc-4ee1-bb66-eca147555715 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Flavor pref 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:41:38.053473 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-30b17603-f4dc-4ee1-bb66-eca147555715 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Image pref 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:41:38.053876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-30b17603-f4dc-4ee1-bb66-eca147555715 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:41:38.068876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-30b17603-f4dc-4ee1-bb66-eca147555715 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:38.069354 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-30b17603-f4dc-4ee1-bb66-eca147555715 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:38.069780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-30b17603-f4dc-4ee1-bb66-eca147555715 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:38.070490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-30b17603-f4dc-4ee1-bb66-eca147555715 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:38.070929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-30b17603-f4dc-4ee1-bb66-eca147555715 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:38.075551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-30b17603-f4dc-4ee1-bb66-eca147555715 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:38.108590 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-30b17603-f4dc-4ee1-bb66-eca147555715 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Getting quotas for project fefe2d12cf334ecbad2001b327cb65e8. Resources: {'cores', 'ram', 'instances'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:41:38.120123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-30b17603-f4dc-4ee1-bb66-eca147555715 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Getting quotas for user 51c598eb26614feaa0c31339b8135f08 and project fefe2d12cf334ecbad2001b327cb65e8. Resources: {'cores', 'ram', 'instances'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:41:38.133373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-30b17603-f4dc-4ee1-bb66-eca147555715 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Going to run 1 instances... {{(pid=124643) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:41:38.136332 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-30b17603-f4dc-4ee1-bb66-eca147555715 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='674dcf76-6c38-40de-b204-ad2842738058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:41:38.476546 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1ce1d011-93e3-42b0-91d2-65ece9e9e369 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.272230 Aug 10 12:41:38.486545 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 11/34] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 12:41:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 3281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 12:41:38.499591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-30b17603-f4dc-4ee1-bb66-eca147555715 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.220695 Aug 10 12:41:38.501149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 24/35] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 12:41:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 12:41:38.510027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-77263e99-0b2e-46a0-a36e-1b3a25d15596 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:38.510927 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-77263e99-0b2e-46a0-a36e-1b3a25d15596 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:38.521551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ed24070c-6563-4ae5-bd46-e44df66638cf tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:38.522181 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ed24070c-6563-4ae5-bd46-e44df66638cf tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:38.820279 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ed24070c-6563-4ae5-bd46-e44df66638cf tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c598eb26614feaa0c31339b8135f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefe2d12cf334ecbad2001b327cb65e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:38.832032 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ed24070c-6563-4ae5-bd46-e44df66638cf tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 200 len: 1215 microversion: 2.1 time: 0.315539 Aug 10 12:41:38.836771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 25/36] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:38 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 1215 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:41:39.015851 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-77263e99-0b2e-46a0-a36e-1b3a25d15596 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:39.078908 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-77263e99-0b2e-46a0-a36e-1b3a25d15596 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1222 microversion: 2.1 time: 0.588889 Aug 10 12:41:39.079602 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 12/37] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:38 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1222 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:39.860189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-34f2c162-d9ec-4235-8d52-30531bc05427 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:39.861499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-34f2c162-d9ec-4235-8d52-30531bc05427 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:40.031224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-34f2c162-d9ec-4235-8d52-30531bc05427 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c598eb26614feaa0c31339b8135f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefe2d12cf334ecbad2001b327cb65e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:40.038562 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-34f2c162-d9ec-4235-8d52-30531bc05427 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 200 len: 1215 microversion: 2.1 time: 0.184821 Aug 10 12:41:40.040978 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 26/38] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:39 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 1215 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:40.100569 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-96e0ef46-772f-457a-9132-0161deea9774 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:40.103026 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-96e0ef46-772f-457a-9132-0161deea9774 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:40.237898 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-96e0ef46-772f-457a-9132-0161deea9774 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:40.247627 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-96e0ef46-772f-457a-9132-0161deea9774 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1222 microversion: 2.1 time: 0.149379 Aug 10 12:41:40.249227 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 13/39] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:40 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1222 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:41.066678 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a555a9a8-855c-4311-83ee-79a30182f6ce tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:41.069841 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a555a9a8-855c-4311-83ee-79a30182f6ce tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:41.095725 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a555a9a8-855c-4311-83ee-79a30182f6ce tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:41.096217 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a555a9a8-855c-4311-83ee-79a30182f6ce tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:41.098619 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a555a9a8-855c-4311-83ee-79a30182f6ce tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:41.102874 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a555a9a8-855c-4311-83ee-79a30182f6ce tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:41.106398 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a555a9a8-855c-4311-83ee-79a30182f6ce tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:41.107022 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a555a9a8-855c-4311-83ee-79a30182f6ce tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:41.246013 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-51d513b0-acff-4421-8339-6b0ac8cd10c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Action: 'create', calling method: .version_select at 0x7fb828700f70>, body: {"keypair": {"name": "tempest-keypair-879954524", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAV7vqGvO+PYWrvDWcP5d7IHj7iaUxKxio2I99gKJXXN99lHQmXguv0y2HnuZ68gi8VTrp1OX+CuNw28nZgFMIchAP8S6usJ8hp77tR8PxfzibNqHsisJn3w8ZW4iUxSsA=="}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:41:41.343342 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-51d513b0-acff-4421-8339-6b0ac8cd10c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Getting quotas for project d6fe8b6c27e743eaad5fe6ffc8a40e81. Resources: {'key_pairs'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:41:41.350906 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-51d513b0-acff-4421-8339-6b0ac8cd10c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Getting quotas for user 70010d27b7f44bc699ea5ad8093fec3b and project d6fe8b6c27e743eaad5fe6ffc8a40e81. Resources: {'key_pairs'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:41:41.491087 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a555a9a8-855c-4311-83ee-79a30182f6ce tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c598eb26614feaa0c31339b8135f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefe2d12cf334ecbad2001b327cb65e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:41.505406 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a555a9a8-855c-4311-83ee-79a30182f6ce tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 200 len: 1219 microversion: 2.1 time: 0.446928 Aug 10 12:41:41.506251 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 14/40] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:41 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 1219 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:41:41.530867 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0c91fc26-dba5-4517-b96e-68ce319904b7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:41.548140 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-51d513b0-acff-4421-8339-6b0ac8cd10c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.636512 Aug 10 12:41:41.548239 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0c91fc26-dba5-4517-b96e-68ce319904b7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:41.548328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 27/41] 10.222.0.49 () {62 vars in 1200 bytes} [Wed Aug 10 12:41:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 638 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 12:41:41.572726 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0c91fc26-dba5-4517-b96e-68ce319904b7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:41.573144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0c91fc26-dba5-4517-b96e-68ce319904b7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:41.573585 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0c91fc26-dba5-4517-b96e-68ce319904b7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:41.596126 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0c91fc26-dba5-4517-b96e-68ce319904b7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:41.596799 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0c91fc26-dba5-4517-b96e-68ce319904b7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:41.602697 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0c91fc26-dba5-4517-b96e-68ce319904b7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:41.908860 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0c91fc26-dba5-4517-b96e-68ce319904b7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:41.919757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0c91fc26-dba5-4517-b96e-68ce319904b7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1218 microversion: 2.1 time: 0.411833 Aug 10 12:41:41.926497 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 15/42] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:41 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1218 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:42.401059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c54d898e-d97c-40d6-9d2c-f1957fb56d09 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Action: 'create', calling method: .version_select at 0x7fb8287001f0>, body: {"keypair": {"name": "tempest-keypair-276155907", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpwC75+NpuqOJjTTcM6FliUZOmXsCkrYLQzPix2ktIS5C9VnSPnH7huF8WPXlwZ8N5guE7sVVz95hH6L7teNLrhfGmOrOZD4ikuyk/ITE1UpYwLoMRMQuov9Sd1gucjlg=="}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:41:42.472907 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-c54d898e-d97c-40d6-9d2c-f1957fb56d09 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Getting quotas for project 9a40b36dd9944cb88fd54181f7f29685. Resources: {'key_pairs'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:41:42.478554 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-c54d898e-d97c-40d6-9d2c-f1957fb56d09 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Getting quotas for user c0ada1accf1742b393e8a12c60074b9e and project 9a40b36dd9944cb88fd54181f7f29685. Resources: {'key_pairs'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:41:42.544045 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8dcd134c-279f-4ab6-9e47-5e7edcb53196 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:42.544678 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8dcd134c-279f-4ab6-9e47-5e7edcb53196 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:42.561534 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8dcd134c-279f-4ab6-9e47-5e7edcb53196 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:42.563064 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8dcd134c-279f-4ab6-9e47-5e7edcb53196 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:42.564721 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8dcd134c-279f-4ab6-9e47-5e7edcb53196 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:42.567059 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8dcd134c-279f-4ab6-9e47-5e7edcb53196 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:42.570705 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8dcd134c-279f-4ab6-9e47-5e7edcb53196 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:42.572404 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8dcd134c-279f-4ab6-9e47-5e7edcb53196 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:42.651925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c54d898e-d97c-40d6-9d2c-f1957fb56d09 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.652774 Aug 10 12:41:42.666987 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 28/43] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 10 12:41:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:41:42.837309 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-8dcd134c-279f-4ab6-9e47-5e7edcb53196 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c598eb26614feaa0c31339b8135f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefe2d12cf334ecbad2001b327cb65e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:42.848845 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8dcd134c-279f-4ab6-9e47-5e7edcb53196 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 200 len: 1267 microversion: 2.1 time: 0.309179 Aug 10 12:41:42.849960 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 16/44] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:42 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 1267 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:41:42.952918 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-960cc1ea-49ca-45de-a1b6-3d2e3b8d5210 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:42.954349 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-960cc1ea-49ca-45de-a1b6-3d2e3b8d5210 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:42.961346 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-960cc1ea-49ca-45de-a1b6-3d2e3b8d5210 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:42.962297 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-960cc1ea-49ca-45de-a1b6-3d2e3b8d5210 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:42.962921 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-960cc1ea-49ca-45de-a1b6-3d2e3b8d5210 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:42.963863 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-960cc1ea-49ca-45de-a1b6-3d2e3b8d5210 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:42.964497 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-960cc1ea-49ca-45de-a1b6-3d2e3b8d5210 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:42.965680 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-960cc1ea-49ca-45de-a1b6-3d2e3b8d5210 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:43.112097 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-960cc1ea-49ca-45de-a1b6-3d2e3b8d5210 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:43.124067 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-960cc1ea-49ca-45de-a1b6-3d2e3b8d5210 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1274 microversion: 2.1 time: 0.175336 Aug 10 12:41:43.124067 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 17/45] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:42 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1274 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:41:43.158854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b0a42a5d-0147-4c9d-88aa-e2b743070317 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Action: 'create', calling method: .version_select at 0x7fb827686af0>, body: {"keypair": {"name": "tempest-keypair-29348087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQL/OPkI4qKv+Pu17L2Ejy3J9hNXPY6NLWsOP6Z0LKL+tKBjWneKuvEb+P45M6zjDoQUgb6bL0l6JVS9Y3zeLX3RILjEt/J3hbyb+tcIxDhu3K5mzxdiW+4nJ1wkPdtgw=="}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:41:43.219953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-b0a42a5d-0147-4c9d-88aa-e2b743070317 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Getting quotas for project a2857015013f466d95f3a9037925c6fc. Resources: {'key_pairs'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:41:43.240037 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-b0a42a5d-0147-4c9d-88aa-e2b743070317 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Getting quotas for user 570c2a77b862411083b9444f8292192b and project a2857015013f466d95f3a9037925c6fc. Resources: {'key_pairs'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:41:43.412972 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b0a42a5d-0147-4c9d-88aa-e2b743070317 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.754447 Aug 10 12:41:43.412972 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 29/46] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 10 12:41:42 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:41:43.883583 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-94549630-7b20-45e8-b626-bb2feaa99c45 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:43.884778 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-94549630-7b20-45e8-b626-bb2feaa99c45 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:43.902814 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-94549630-7b20-45e8-b626-bb2feaa99c45 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:43.903363 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-94549630-7b20-45e8-b626-bb2feaa99c45 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:43.903819 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-94549630-7b20-45e8-b626-bb2feaa99c45 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:43.906896 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-94549630-7b20-45e8-b626-bb2feaa99c45 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:43.906896 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-94549630-7b20-45e8-b626-bb2feaa99c45 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:43.906896 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-94549630-7b20-45e8-b626-bb2feaa99c45 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:44.150058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-951d88c0-11cb-4532-8298-0fa901d25cdc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:44.156791 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-951d88c0-11cb-4532-8298-0fa901d25cdc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:44.180021 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-951d88c0-11cb-4532-8298-0fa901d25cdc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:44.183282 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-951d88c0-11cb-4532-8298-0fa901d25cdc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:44.184044 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-951d88c0-11cb-4532-8298-0fa901d25cdc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:44.185188 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-951d88c0-11cb-4532-8298-0fa901d25cdc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:44.186621 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-951d88c0-11cb-4532-8298-0fa901d25cdc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:44.189384 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-951d88c0-11cb-4532-8298-0fa901d25cdc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:44.358549 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-94549630-7b20-45e8-b626-bb2feaa99c45 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c598eb26614feaa0c31339b8135f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefe2d12cf334ecbad2001b327cb65e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:44.377809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-94549630-7b20-45e8-b626-bb2feaa99c45 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 200 len: 1285 microversion: 2.1 time: 0.495645 Aug 10 12:41:44.398698 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 18/47] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:43 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 1285 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:44.678729 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-951d88c0-11cb-4532-8298-0fa901d25cdc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:44.714661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-951d88c0-11cb-4532-8298-0fa901d25cdc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1292 microversion: 2.1 time: 0.576223 Aug 10 12:41:44.718286 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 30/48] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:44 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1292 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:45.403633 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-461c7243-9553-411a-8959-a5528c39baa1 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:45.405221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-461c7243-9553-411a-8959-a5528c39baa1 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:45.441321 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-461c7243-9553-411a-8959-a5528c39baa1 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:45.445449 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-461c7243-9553-411a-8959-a5528c39baa1 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:45.445449 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-461c7243-9553-411a-8959-a5528c39baa1 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:45.458086 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-461c7243-9553-411a-8959-a5528c39baa1 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:45.460468 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-461c7243-9553-411a-8959-a5528c39baa1 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:45.460948 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-461c7243-9553-411a-8959-a5528c39baa1 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:45.741411 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6990646e-475e-4751-a344-2b119337e899 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:45.742920 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6990646e-475e-4751-a344-2b119337e899 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:45.770772 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6990646e-475e-4751-a344-2b119337e899 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:45.774515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6990646e-475e-4751-a344-2b119337e899 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:45.774972 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6990646e-475e-4751-a344-2b119337e899 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:45.777915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6990646e-475e-4751-a344-2b119337e899 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:45.779738 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6990646e-475e-4751-a344-2b119337e899 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:45.781273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6990646e-475e-4751-a344-2b119337e899 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:45.975576 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-461c7243-9553-411a-8959-a5528c39baa1 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c598eb26614feaa0c31339b8135f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefe2d12cf334ecbad2001b327cb65e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:45.993135 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-461c7243-9553-411a-8959-a5528c39baa1 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 200 len: 1273 microversion: 2.1 time: 0.593488 Aug 10 12:41:45.995402 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 19/49] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:45 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 1273 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:46.068500 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6990646e-475e-4751-a344-2b119337e899 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:46.105935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6990646e-475e-4751-a344-2b119337e899 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1280 microversion: 2.1 time: 0.370831 Aug 10 12:41:46.109492 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 31/50] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:45 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1280 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:47.023506 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-68067758-6b96-492b-b7a6-3ec80e84d439 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:47.031985 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-68067758-6b96-492b-b7a6-3ec80e84d439 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:47.038457 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell0:SELECT=4 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:41:47.073703 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-68067758-6b96-492b-b7a6-3ec80e84d439 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:47.075910 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-68067758-6b96-492b-b7a6-3ec80e84d439 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:47.080800 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-68067758-6b96-492b-b7a6-3ec80e84d439 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:47.081988 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-68067758-6b96-492b-b7a6-3ec80e84d439 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:47.087572 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-68067758-6b96-492b-b7a6-3ec80e84d439 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:47.089573 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-68067758-6b96-492b-b7a6-3ec80e84d439 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:47.148477 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a2074551-07a7-4d2e-a0c3-f21bc4c765e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:47.149908 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a2074551-07a7-4d2e-a0c3-f21bc4c765e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:47.175088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a2074551-07a7-4d2e-a0c3-f21bc4c765e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:47.178839 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a2074551-07a7-4d2e-a0c3-f21bc4c765e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:47.193649 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a2074551-07a7-4d2e-a0c3-f21bc4c765e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:47.197038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a2074551-07a7-4d2e-a0c3-f21bc4c765e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:47.200135 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a2074551-07a7-4d2e-a0c3-f21bc4c765e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:47.202375 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a2074551-07a7-4d2e-a0c3-f21bc4c765e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:47.638461 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-68067758-6b96-492b-b7a6-3ec80e84d439 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c598eb26614feaa0c31339b8135f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefe2d12cf334ecbad2001b327cb65e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:47.657838 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-68067758-6b96-492b-b7a6-3ec80e84d439 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 200 len: 1273 microversion: 2.1 time: 0.640423 Aug 10 12:41:47.663376 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 20/51] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:47 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 1273 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:47.697822 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a2074551-07a7-4d2e-a0c3-f21bc4c765e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:47.707130 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a2074551-07a7-4d2e-a0c3-f21bc4c765e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1280 microversion: 2.1 time: 0.578743 Aug 10 12:41:47.709716 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 32/52] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:47 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1280 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:48.688916 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9224265b-0e8b-434a-964e-b2319e366751 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:48.691169 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9224265b-0e8b-434a-964e-b2319e366751 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:48.702580 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9224265b-0e8b-434a-964e-b2319e366751 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:48.704227 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9224265b-0e8b-434a-964e-b2319e366751 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:48.705652 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9224265b-0e8b-434a-964e-b2319e366751 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:48.706595 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9224265b-0e8b-434a-964e-b2319e366751 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:48.709521 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9224265b-0e8b-434a-964e-b2319e366751 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:48.710220 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9224265b-0e8b-434a-964e-b2319e366751 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:48.732846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b6bdc2a0-c00b-4a97-af85-37974e9f870f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:48.737092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b6bdc2a0-c00b-4a97-af85-37974e9f870f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:48.747978 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=2 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:41:48.757227 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b6bdc2a0-c00b-4a97-af85-37974e9f870f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:48.764846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b6bdc2a0-c00b-4a97-af85-37974e9f870f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:48.766349 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b6bdc2a0-c00b-4a97-af85-37974e9f870f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:48.772549 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b6bdc2a0-c00b-4a97-af85-37974e9f870f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:48.775354 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b6bdc2a0-c00b-4a97-af85-37974e9f870f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:48.776529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b6bdc2a0-c00b-4a97-af85-37974e9f870f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:50.081820 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9224265b-0e8b-434a-964e-b2319e366751 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c598eb26614feaa0c31339b8135f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefe2d12cf334ecbad2001b327cb65e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:50.101630 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9224265b-0e8b-434a-964e-b2319e366751 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 200 len: 1315 microversion: 2.1 time: 1.413678 Aug 10 12:41:50.115523 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 21/53] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:48 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 1315 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:50.387330 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b6bdc2a0-c00b-4a97-af85-37974e9f870f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:50.414928 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b6bdc2a0-c00b-4a97-af85-37974e9f870f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1322 microversion: 2.1 time: 1.677912 Aug 10 12:41:50.428304 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 33/54] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:48 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1322 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:41:50.770987 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-01c8a28c-fa61-4ea8-ae9a-50219bec5d62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1232873184", "imageRef": "674dcf76-6c38-40de-b204-ad2842738058", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "04562acd-1c0c-42a3-a31a-45ae32b7cf29"}], "security_groups": [{"name": "tempest-securitygroup--143965937"}], "key_name": "tempest-keypair-879954524", "user_data": "}} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:41:50.842893 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell0:SELECT=16 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:41:51.128896 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-674d8889-b65c-41a7-a934-9f2db0410828 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:51.132003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-674d8889-b65c-41a7-a934-9f2db0410828 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:51.155124 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-674d8889-b65c-41a7-a934-9f2db0410828 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:51.155658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-674d8889-b65c-41a7-a934-9f2db0410828 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:51.156106 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-674d8889-b65c-41a7-a934-9f2db0410828 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:51.161193 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-674d8889-b65c-41a7-a934-9f2db0410828 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:51.161193 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-674d8889-b65c-41a7-a934-9f2db0410828 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:51.161193 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-674d8889-b65c-41a7-a934-9f2db0410828 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:52.025793 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.network.neutron [None req-01c8a28c-fa61-4ea8-ae9a-50219bec5d62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] validate_networks() for [('04562acd-1c0c-42a3-a31a-45ae32b7cf29', None, None, None, None, None)] {{(pid=124642) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:41:52.454784 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-674d8889-b65c-41a7-a934-9f2db0410828 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c598eb26614feaa0c31339b8135f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefe2d12cf334ecbad2001b327cb65e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:52.468696 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-674d8889-b65c-41a7-a934-9f2db0410828 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 200 len: 1315 microversion: 2.1 time: 1.344771 Aug 10 12:41:52.469512 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 34/55] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:51 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 1315 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:52.479638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1cff9d0e-e325-4eff-9c01-4cb4965ad437 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:52.482707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1cff9d0e-e325-4eff-9c01-4cb4965ad437 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:52.498663 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cff9d0e-e325-4eff-9c01-4cb4965ad437 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:52.500913 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cff9d0e-e325-4eff-9c01-4cb4965ad437 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:52.501542 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cff9d0e-e325-4eff-9c01-4cb4965ad437 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:52.519054 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cff9d0e-e325-4eff-9c01-4cb4965ad437 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:52.519644 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cff9d0e-e325-4eff-9c01-4cb4965ad437 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:52.520801 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cff9d0e-e325-4eff-9c01-4cb4965ad437 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:53.283859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=24 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:41:53.891782 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1cff9d0e-e325-4eff-9c01-4cb4965ad437 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:53.914163 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1cff9d0e-e325-4eff-9c01-4cb4965ad437 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1322 microversion: 2.1 time: 1.441676 Aug 10 12:41:53.914988 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 35/56] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:52 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1322 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:54.170687 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-75dc0c34-81a7-4d9d-87dd-907a9fae4270 req-9baf0895-e083-4c26-a19a-e09a006a43f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5bd9766-6096-4847-bb63-d90b985902f9", "tag": "2b65d1a0-93b1-490f-9c09-f9f7d35efd68"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:41:54.185087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-75dc0c34-81a7-4d9d-87dd-907a9fae4270 req-9baf0895-e083-4c26-a19a-e09a006a43f9 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:54.190694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-75dc0c34-81a7-4d9d-87dd-907a9fae4270 req-9baf0895-e083-4c26-a19a-e09a006a43f9 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:54.190694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-75dc0c34-81a7-4d9d-87dd-907a9fae4270 req-9baf0895-e083-4c26-a19a-e09a006a43f9 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:54.272134 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-75dc0c34-81a7-4d9d-87dd-907a9fae4270 req-9baf0895-e083-4c26-a19a-e09a006a43f9 service nova] Creating event network-changed:2b65d1a0-93b1-490f-9c09-f9f7d35efd68 for instance e5bd9766-6096-4847-bb63-d90b985902f9 on hv-cinder-85199 Aug 10 12:41:54.273071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-75dc0c34-81a7-4d9d-87dd-907a9fae4270 req-9baf0895-e083-4c26-a19a-e09a006a43f9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=124643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 12:41:54.276270 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-75dc0c34-81a7-4d9d-87dd-907a9fae4270 req-9baf0895-e083-4c26-a19a-e09a006a43f9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 12:41:54.279751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76bb194c-4fd6-47db-8664-9ba381696f44 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:54.281726 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76bb194c-4fd6-47db-8664-9ba381696f44 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:54.283008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76bb194c-4fd6-47db-8664-9ba381696f44 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:54.285892 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76bb194c-4fd6-47db-8664-9ba381696f44 None None] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:54.293096 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76bb194c-4fd6-47db-8664-9ba381696f44 None None] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:54.293552 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76bb194c-4fd6-47db-8664-9ba381696f44 None None] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:54.319998 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.compute.rpcapi [None req-76bb194c-4fd6-47db-8664-9ba381696f44 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 12:41:54.339453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76bb194c-4fd6-47db-8664-9ba381696f44 None None] Releasing lock "compute-rpcapi-router" {{(pid=124643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 12:41:54.386393 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-76bb194c-4fd6-47db-8664-9ba381696f44 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.460695 Aug 10 12:41:54.392441 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 36/57] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:41:54.399931 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a9cbbbfd-c6bd-47b5-9153-eb2d6add4bd6 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:54.411485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a9cbbbfd-c6bd-47b5-9153-eb2d6add4bd6 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:54.432178 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9cbbbfd-c6bd-47b5-9153-eb2d6add4bd6 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:54.438256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9cbbbfd-c6bd-47b5-9153-eb2d6add4bd6 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:54.440884 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9cbbbfd-c6bd-47b5-9153-eb2d6add4bd6 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:54.444428 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9cbbbfd-c6bd-47b5-9153-eb2d6add4bd6 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:54.448914 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9cbbbfd-c6bd-47b5-9153-eb2d6add4bd6 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:54.449575 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9cbbbfd-c6bd-47b5-9153-eb2d6add4bd6 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:55.046905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a9cbbbfd-c6bd-47b5-9153-eb2d6add4bd6 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c598eb26614feaa0c31339b8135f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefe2d12cf334ecbad2001b327cb65e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:55.056717 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a9cbbbfd-c6bd-47b5-9153-eb2d6add4bd6 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 200 len: 1315 microversion: 2.1 time: 0.661324 Aug 10 12:41:55.057335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 37/58] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:54 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 1315 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:55.069974 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3f6c3ae3-0623-41d4-be96-8965efab2669 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:55.070869 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3f6c3ae3-0623-41d4-be96-8965efab2669 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:55.084978 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f6c3ae3-0623-41d4-be96-8965efab2669 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:55.085569 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f6c3ae3-0623-41d4-be96-8965efab2669 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:55.086014 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f6c3ae3-0623-41d4-be96-8965efab2669 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:55.086727 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f6c3ae3-0623-41d4-be96-8965efab2669 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:55.087191 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f6c3ae3-0623-41d4-be96-8965efab2669 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:55.090887 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f6c3ae3-0623-41d4-be96-8965efab2669 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:55.352997 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-01c8a28c-fa61-4ea8-ae9a-50219bec5d62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Flavor limits 0:0:0 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:41:55.354165 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-01c8a28c-fa61-4ea8-ae9a-50219bec5d62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Image limits 0:0:0 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:41:55.354876 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-01c8a28c-fa61-4ea8-ae9a-50219bec5d62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Flavor pref 0:0:0 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:41:55.355531 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-01c8a28c-fa61-4ea8-ae9a-50219bec5d62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Image pref 0:0:0 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:41:55.356166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-01c8a28c-fa61-4ea8-ae9a-50219bec5d62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:41:55.361694 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:41:55.376666 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01c8a28c-fa61-4ea8-ae9a-50219bec5d62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:55.377447 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01c8a28c-fa61-4ea8-ae9a-50219bec5d62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:55.380705 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01c8a28c-fa61-4ea8-ae9a-50219bec5d62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:55.382064 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01c8a28c-fa61-4ea8-ae9a-50219bec5d62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:55.383147 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01c8a28c-fa61-4ea8-ae9a-50219bec5d62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:55.385278 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01c8a28c-fa61-4ea8-ae9a-50219bec5d62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:55.408519 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=53 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:41:55.442771 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.quota [None req-01c8a28c-fa61-4ea8-ae9a-50219bec5d62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Getting quotas for project d6fe8b6c27e743eaad5fe6ffc8a40e81. Resources: {'cores', 'ram', 'instances'} {{(pid=124642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:41:55.454915 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.quota [None req-01c8a28c-fa61-4ea8-ae9a-50219bec5d62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Getting quotas for user 70010d27b7f44bc699ea5ad8093fec3b and project d6fe8b6c27e743eaad5fe6ffc8a40e81. Resources: {'cores', 'ram', 'instances'} {{(pid=124642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:41:55.486282 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-01c8a28c-fa61-4ea8-ae9a-50219bec5d62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Going to run 1 instances... {{(pid=124642) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:41:55.492711 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-01c8a28c-fa61-4ea8-ae9a-50219bec5d62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='674dcf76-6c38-40de-b204-ad2842738058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:41:55.643332 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-01c8a28c-fa61-4ea8-ae9a-50219bec5d62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.885376 Aug 10 12:41:55.644344 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 22/59] 10.222.0.49 () {62 vars in 1188 bytes} [Wed Aug 10 12:41:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 4887 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 12:41:55.652014 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3f6c3ae3-0623-41d4-be96-8965efab2669 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:55.660854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3f6c3ae3-0623-41d4-be96-8965efab2669 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1322 microversion: 2.1 time: 0.599011 Aug 10 12:41:55.699560 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 38/60] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:55 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1322 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:55.712466 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3890837c-86ba-4de6-9e1f-106c8848ee06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-911103486", "imageRef": "674dcf76-6c38-40de-b204-ad2842738058", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90267d37-6f88-42d0-bf81-3486300deb9f"}], "security_groups": [{"name": "tempest-securitygroup--646271077"}], "key_name": "tempest-keypair-276155907", "user_data": "}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:41:55.982061 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [req-b862ded1-4ed7-4e49-bbdc-576b16f40fa0 req-14372c84-3b49-4141-a037-d08d6d6a1a8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb8a78c0-11f5-4a26-991b-f654067d9422", "tag": "0629626a-06bb-4dab-8c94-8df7f0e88222"}]} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:41:56.028217 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.network.neutron [None req-3890837c-86ba-4de6-9e1f-106c8848ee06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] validate_networks() for [('90267d37-6f88-42d0-bf81-3486300deb9f', None, None, None, None, None)] {{(pid=124643) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:41:56.035975 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-b862ded1-4ed7-4e49-bbdc-576b16f40fa0 req-14372c84-3b49-4141-a037-d08d6d6a1a8a service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:56.036403 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-b862ded1-4ed7-4e49-bbdc-576b16f40fa0 req-14372c84-3b49-4141-a037-d08d6d6a1a8a service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:56.036844 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-b862ded1-4ed7-4e49-bbdc-576b16f40fa0 req-14372c84-3b49-4141-a037-d08d6d6a1a8a service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:56.088796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.compute.server_external_events [req-b862ded1-4ed7-4e49-bbdc-576b16f40fa0 req-14372c84-3b49-4141-a037-d08d6d6a1a8a service nova] Creating event network-changed:0629626a-06bb-4dab-8c94-8df7f0e88222 for instance fb8a78c0-11f5-4a26-991b-f654067d9422 on hv-cinder-85199 Aug 10 12:41:56.088796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-b862ded1-4ed7-4e49-bbdc-576b16f40fa0 req-14372c84-3b49-4141-a037-d08d6d6a1a8a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=124642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 12:41:56.088796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-b862ded1-4ed7-4e49-bbdc-576b16f40fa0 req-14372c84-3b49-4141-a037-d08d6d6a1a8a service nova] Acquired lock "compute-rpcapi-router" {{(pid=124642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 12:41:56.088796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c9b9b78-4f8e-486d-b37e-d54d6195e4a3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:56.088796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c9b9b78-4f8e-486d-b37e-d54d6195e4a3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:56.107873 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c9b9b78-4f8e-486d-b37e-d54d6195e4a3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:56.108923 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c9b9b78-4f8e-486d-b37e-d54d6195e4a3 None None] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:56.111533 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c9b9b78-4f8e-486d-b37e-d54d6195e4a3 None None] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:56.111533 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c9b9b78-4f8e-486d-b37e-d54d6195e4a3 None None] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:56.143731 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.compute.rpcapi [None req-2c9b9b78-4f8e-486d-b37e-d54d6195e4a3 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 12:41:56.159389 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c9b9b78-4f8e-486d-b37e-d54d6195e4a3 None None] Releasing lock "compute-rpcapi-router" {{(pid=124642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 12:41:56.206556 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2c9b9b78-4f8e-486d-b37e-d54d6195e4a3 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.559545 Aug 10 12:41:56.207722 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 23/61] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:41:56.215810 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a5ba2b4e-4dd1-4516-857c-8b7012a701b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:56.218465 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a5ba2b4e-4dd1-4516-857c-8b7012a701b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:56.944805 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a5ba2b4e-4dd1-4516-857c-8b7012a701b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:56.964337 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a5ba2b4e-4dd1-4516-857c-8b7012a701b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:56.971582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a5ba2b4e-4dd1-4516-857c-8b7012a701b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:56.979552 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a5ba2b4e-4dd1-4516-857c-8b7012a701b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1281 microversion: 2.20 time: 0.767920 Aug 10 12:41:56.982253 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 24/62] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:41:56 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1281 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:41:57.000608 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2bae9d5d-4c9a-4a5c-9edc-9a2c62b32475 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:57.001849 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2bae9d5d-4c9a-4a5c-9edc-9a2c62b32475 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:57.024664 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bae9d5d-4c9a-4a5c-9edc-9a2c62b32475 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:57.025864 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bae9d5d-4c9a-4a5c-9edc-9a2c62b32475 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:57.026630 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bae9d5d-4c9a-4a5c-9edc-9a2c62b32475 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:57.028388 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bae9d5d-4c9a-4a5c-9edc-9a2c62b32475 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:57.034212 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bae9d5d-4c9a-4a5c-9edc-9a2c62b32475 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:57.035085 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bae9d5d-4c9a-4a5c-9edc-9a2c62b32475 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:57.900357 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2bae9d5d-4c9a-4a5c-9edc-9a2c62b32475 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c598eb26614feaa0c31339b8135f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefe2d12cf334ecbad2001b327cb65e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:57.911668 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2bae9d5d-4c9a-4a5c-9edc-9a2c62b32475 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 200 len: 1315 microversion: 2.1 time: 0.926493 Aug 10 12:41:57.912279 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 25/63] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:56 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 1315 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:57.926338 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4d379fd0-18f0-436c-8f8b-3dbff63916d0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1815190696", "imageRef": "674dcf76-6c38-40de-b204-ad2842738058", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b8fb292-ce0b-4d10-a119-78752ef6ec31"}], "security_groups": [{"name": "tempest-securitygroup--473691817"}], "key_name": "tempest-keypair-29348087", "user_data": "}} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:41:58.439966 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.network.neutron [None req-4d379fd0-18f0-436c-8f8b-3dbff63916d0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] validate_networks() for [('7b8fb292-ce0b-4d10-a119-78752ef6ec31', None, None, None, None, None)] {{(pid=124642) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:41:58.799480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-3890837c-86ba-4de6-9e1f-106c8848ee06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Flavor limits 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:41:58.800517 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-3890837c-86ba-4de6-9e1f-106c8848ee06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Image limits 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:41:58.805825 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-3890837c-86ba-4de6-9e1f-106c8848ee06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Flavor pref 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:41:58.808604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-3890837c-86ba-4de6-9e1f-106c8848ee06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Image pref 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:41:58.809560 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-3890837c-86ba-4de6-9e1f-106c8848ee06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:41:58.839574 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3890837c-86ba-4de6-9e1f-106c8848ee06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:58.840296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3890837c-86ba-4de6-9e1f-106c8848ee06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:58.841740 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3890837c-86ba-4de6-9e1f-106c8848ee06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:58.844700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3890837c-86ba-4de6-9e1f-106c8848ee06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:58.845370 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3890837c-86ba-4de6-9e1f-106c8848ee06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:58.850455 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3890837c-86ba-4de6-9e1f-106c8848ee06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:58.891335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-3890837c-86ba-4de6-9e1f-106c8848ee06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Getting quotas for project 9a40b36dd9944cb88fd54181f7f29685. Resources: {'cores', 'ram', 'instances'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:41:58.897023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-3890837c-86ba-4de6-9e1f-106c8848ee06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Getting quotas for user c0ada1accf1742b393e8a12c60074b9e and project 9a40b36dd9944cb88fd54181f7f29685. Resources: {'cores', 'ram', 'instances'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:41:58.927928 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3890837c-86ba-4de6-9e1f-106c8848ee06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Going to run 1 instances... {{(pid=124643) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:41:58.947733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3890837c-86ba-4de6-9e1f-106c8848ee06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='674dcf76-6c38-40de-b204-ad2842738058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:41:59.055498 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:41:59.169342 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3890837c-86ba-4de6-9e1f-106c8848ee06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.467796 Aug 10 12:41:59.174605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 39/64] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 12:41:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 3474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 12:41:59.180188 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-70b679d8-2156-4c15-a213-db4cbf8055f9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:59.180809 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-70b679d8-2156-4c15-a213-db4cbf8055f9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:59.187075 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-70b679d8-2156-4c15-a213-db4cbf8055f9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:59.187783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-70b679d8-2156-4c15-a213-db4cbf8055f9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:59.188222 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-70b679d8-2156-4c15-a213-db4cbf8055f9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:59.188915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-70b679d8-2156-4c15-a213-db4cbf8055f9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:59.189422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-70b679d8-2156-4c15-a213-db4cbf8055f9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:59.189780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-70b679d8-2156-4c15-a213-db4cbf8055f9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:59.279956 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-4d379fd0-18f0-436c-8f8b-3dbff63916d0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Flavor limits 0:0:0 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:41:59.280383 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-4d379fd0-18f0-436c-8f8b-3dbff63916d0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Image limits 0:0:0 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:41:59.280852 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-4d379fd0-18f0-436c-8f8b-3dbff63916d0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Flavor pref 0:0:0 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:41:59.281255 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-4d379fd0-18f0-436c-8f8b-3dbff63916d0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Image pref 0:0:0 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:41:59.281655 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-4d379fd0-18f0-436c-8f8b-3dbff63916d0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:41:59.294596 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d379fd0-18f0-436c-8f8b-3dbff63916d0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:59.299309 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d379fd0-18f0-436c-8f8b-3dbff63916d0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:59.299798 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d379fd0-18f0-436c-8f8b-3dbff63916d0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:59.300586 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d379fd0-18f0-436c-8f8b-3dbff63916d0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:59.301047 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d379fd0-18f0-436c-8f8b-3dbff63916d0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:59.301606 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d379fd0-18f0-436c-8f8b-3dbff63916d0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:59.344552 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.quota [None req-4d379fd0-18f0-436c-8f8b-3dbff63916d0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Getting quotas for project a2857015013f466d95f3a9037925c6fc. Resources: {'cores', 'ram', 'instances'} {{(pid=124642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:41:59.352700 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.quota [None req-4d379fd0-18f0-436c-8f8b-3dbff63916d0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Getting quotas for user 570c2a77b862411083b9444f8292192b and project a2857015013f466d95f3a9037925c6fc. Resources: {'cores', 'ram', 'instances'} {{(pid=124642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:41:59.382513 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4d379fd0-18f0-436c-8f8b-3dbff63916d0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Going to run 1 instances... {{(pid=124642) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:41:59.384935 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4d379fd0-18f0-436c-8f8b-3dbff63916d0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='674dcf76-6c38-40de-b204-ad2842738058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:41:59.555643 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4d379fd0-18f0-436c-8f8b-3dbff63916d0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.635394 Aug 10 12:41:59.556350 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 26/65] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 12:41:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 1643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 12:41:59.561431 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-814c556a-cd07-4a4d-bbab-adafc1762e3f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:59.572227 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-814c556a-cd07-4a4d-bbab-adafc1762e3f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:59.584088 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-814c556a-cd07-4a4d-bbab-adafc1762e3f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:59.584590 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-814c556a-cd07-4a4d-bbab-adafc1762e3f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:59.585028 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-814c556a-cd07-4a4d-bbab-adafc1762e3f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:59.585739 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-814c556a-cd07-4a4d-bbab-adafc1762e3f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:59.586187 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-814c556a-cd07-4a4d-bbab-adafc1762e3f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:59.586606 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-814c556a-cd07-4a4d-bbab-adafc1762e3f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:59.794595 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-814c556a-cd07-4a4d-bbab-adafc1762e3f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:59.807695 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-814c556a-cd07-4a4d-bbab-adafc1762e3f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:59.807695 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-814c556a-cd07-4a4d-bbab-adafc1762e3f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:59.807695 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-814c556a-cd07-4a4d-bbab-adafc1762e3f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1333 microversion: 2.20 time: 0.248383 Aug 10 12:41:59.808188 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 27/66] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:41:59 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1333 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:41:59.811356 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [req-f29665c0-029b-432f-8c98-1d7b56d83224 req-0b183ec7-c67d-4aaf-bfdb-702e5179844a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47011594-f6d9-44a1-9751-c564121b1e48", "tag": "dd45ef32-2207-4bad-a901-d414e1d86870"}]} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:41:59.822980 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-f29665c0-029b-432f-8c98-1d7b56d83224 req-0b183ec7-c67d-4aaf-bfdb-702e5179844a service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:59.835032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-f29665c0-029b-432f-8c98-1d7b56d83224 req-0b183ec7-c67d-4aaf-bfdb-702e5179844a service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:59.835032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-f29665c0-029b-432f-8c98-1d7b56d83224 req-0b183ec7-c67d-4aaf-bfdb-702e5179844a service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:59.842456 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.compute.server_external_events [req-f29665c0-029b-432f-8c98-1d7b56d83224 req-0b183ec7-c67d-4aaf-bfdb-702e5179844a service nova] Creating event network-changed:dd45ef32-2207-4bad-a901-d414e1d86870 for instance 47011594-f6d9-44a1-9751-c564121b1e48 on hv-cinder-85199 Aug 10 12:41:59.848908 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [req-f29665c0-029b-432f-8c98-1d7b56d83224 req-0b183ec7-c67d-4aaf-bfdb-702e5179844a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040561 Aug 10 12:41:59.849848 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 28/67] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:41:59.855500 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c544965c-ab5f-4968-b423-fca2b508ad1d tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:59.856519 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c544965c-ab5f-4968-b423-fca2b508ad1d tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:41:59.864525 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-70b679d8-2156-4c15-a213-db4cbf8055f9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:41:59.865352 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c544965c-ab5f-4968-b423-fca2b508ad1d tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:59.865910 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c544965c-ab5f-4968-b423-fca2b508ad1d tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:59.866713 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c544965c-ab5f-4968-b423-fca2b508ad1d tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:59.867649 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c544965c-ab5f-4968-b423-fca2b508ad1d tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:41:59.868326 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c544965c-ab5f-4968-b423-fca2b508ad1d tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:41:59.869179 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c544965c-ab5f-4968-b423-fca2b508ad1d tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:41:59.877065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=61 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:41:59.903325 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-70b679d8-2156-4c15-a213-db4cbf8055f9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1322 microversion: 2.1 time: 0.722571 Aug 10 12:41:59.903325 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 40/68] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:59 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1322 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:41:59.905738 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c76c33e3-65de-4b3a-bef8-6ec29cfe6dd3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:41:59.906490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c76c33e3-65de-4b3a-bef8-6ec29cfe6dd3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:00.133556 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c76c33e3-65de-4b3a-bef8-6ec29cfe6dd3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:00.165357 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c76c33e3-65de-4b3a-bef8-6ec29cfe6dd3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1236 microversion: 2.1 time: 0.263853 Aug 10 12:42:00.169653 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 41/69] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:59 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1236 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:00.187086 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5a9be175-54d3-4eae-9dd4-24f7b1028368 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:00.190011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5a9be175-54d3-4eae-9dd4-24f7b1028368 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:00.388645 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5a9be175-54d3-4eae-9dd4-24f7b1028368 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:00.408168 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5a9be175-54d3-4eae-9dd4-24f7b1028368 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1240 microversion: 2.1 time: 0.236322 Aug 10 12:42:00.408740 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 42/70] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:00 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1240 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:00.577381 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c544965c-ab5f-4968-b423-fca2b508ad1d tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c598eb26614feaa0c31339b8135f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefe2d12cf334ecbad2001b327cb65e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:00.591690 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c544965c-ab5f-4968-b423-fca2b508ad1d tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 200 len: 1315 microversion: 2.1 time: 0.740208 Aug 10 12:42:00.594359 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 29/71] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:41:59 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 1315 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:00.830676 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-08e5a423-09c1-48b0-bfdb-3bcc677f89cc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:00.831313 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-08e5a423-09c1-48b0-bfdb-3bcc677f89cc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:00.843392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08e5a423-09c1-48b0-bfdb-3bcc677f89cc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:00.843903 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08e5a423-09c1-48b0-bfdb-3bcc677f89cc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:00.844322 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08e5a423-09c1-48b0-bfdb-3bcc677f89cc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:00.845023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08e5a423-09c1-48b0-bfdb-3bcc677f89cc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:00.845453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08e5a423-09c1-48b0-bfdb-3bcc677f89cc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:00.848503 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08e5a423-09c1-48b0-bfdb-3bcc677f89cc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:00.921648 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1abca45c-bb7f-4872-856a-acb0bd63ef8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:00.922468 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1abca45c-bb7f-4872-856a-acb0bd63ef8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:00.935921 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1abca45c-bb7f-4872-856a-acb0bd63ef8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:00.936617 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1abca45c-bb7f-4872-856a-acb0bd63ef8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:00.937383 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1abca45c-bb7f-4872-856a-acb0bd63ef8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:00.938268 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1abca45c-bb7f-4872-856a-acb0bd63ef8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:00.943525 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1abca45c-bb7f-4872-856a-acb0bd63ef8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:00.944026 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1abca45c-bb7f-4872-856a-acb0bd63ef8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:01.056008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-08e5a423-09c1-48b0-bfdb-3bcc677f89cc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:01.073457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-08e5a423-09c1-48b0-bfdb-3bcc677f89cc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:01.073457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-08e5a423-09c1-48b0-bfdb-3bcc677f89cc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:01.073457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-08e5a423-09c1-48b0-bfdb-3bcc677f89cc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1339 microversion: 2.20 time: 0.246193 Aug 10 12:42:01.073757 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 43/72] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:42:00 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1339 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:42:01.192623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b7396481-ce37-40d9-99cf-b7d9cd6523e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:01.194530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b7396481-ce37-40d9-99cf-b7d9cd6523e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:01.204257 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b7396481-ce37-40d9-99cf-b7d9cd6523e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:01.205870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b7396481-ce37-40d9-99cf-b7d9cd6523e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:01.211924 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b7396481-ce37-40d9-99cf-b7d9cd6523e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:01.213257 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b7396481-ce37-40d9-99cf-b7d9cd6523e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:01.215383 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b7396481-ce37-40d9-99cf-b7d9cd6523e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:01.218481 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b7396481-ce37-40d9-99cf-b7d9cd6523e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:01.416708 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-1abca45c-bb7f-4872-856a-acb0bd63ef8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:01.417307 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b7396481-ce37-40d9-99cf-b7d9cd6523e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:01.442787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1abca45c-bb7f-4872-856a-acb0bd63ef8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1322 microversion: 2.1 time: 0.523168 Aug 10 12:42:01.443650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b7396481-ce37-40d9-99cf-b7d9cd6523e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1240 microversion: 2.1 time: 0.253921 Aug 10 12:42:01.447529 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 30/73] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:00 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1322 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:01.470357 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 44/74] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:01 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1240 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:01.476593 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b90fabeb-73de-4fa1-b0e8-acc8b72aa7cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:01.479192 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b90fabeb-73de-4fa1-b0e8-acc8b72aa7cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:01.484125 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b90fabeb-73de-4fa1-b0e8-acc8b72aa7cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:01.484607 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b90fabeb-73de-4fa1-b0e8-acc8b72aa7cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:01.485038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b90fabeb-73de-4fa1-b0e8-acc8b72aa7cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:01.486106 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b90fabeb-73de-4fa1-b0e8-acc8b72aa7cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:01.486559 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b90fabeb-73de-4fa1-b0e8-acc8b72aa7cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:01.486984 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b90fabeb-73de-4fa1-b0e8-acc8b72aa7cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:01.618200 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2612caf4-d094-4fc5-97ad-1df4ae8d2286 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:01.618821 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2612caf4-d094-4fc5-97ad-1df4ae8d2286 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:01.625709 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2612caf4-d094-4fc5-97ad-1df4ae8d2286 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:01.626217 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2612caf4-d094-4fc5-97ad-1df4ae8d2286 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:01.626673 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2612caf4-d094-4fc5-97ad-1df4ae8d2286 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:01.627490 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2612caf4-d094-4fc5-97ad-1df4ae8d2286 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:01.627973 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2612caf4-d094-4fc5-97ad-1df4ae8d2286 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:01.628679 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2612caf4-d094-4fc5-97ad-1df4ae8d2286 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:01.666578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b90fabeb-73de-4fa1-b0e8-acc8b72aa7cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:01.678049 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b90fabeb-73de-4fa1-b0e8-acc8b72aa7cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1244 microversion: 2.1 time: 0.205634 Aug 10 12:42:01.679895 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 45/75] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:01 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1244 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:01.945440 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2612caf4-d094-4fc5-97ad-1df4ae8d2286 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c598eb26614feaa0c31339b8135f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefe2d12cf334ecbad2001b327cb65e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:01.955747 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2612caf4-d094-4fc5-97ad-1df4ae8d2286 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 200 len: 1315 microversion: 2.1 time: 0.342496 Aug 10 12:42:01.956371 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 31/76] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:01 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:42:02.095969 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3871af4b-311b-4ce4-856c-54d8abf95f0f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:02.096572 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3871af4b-311b-4ce4-856c-54d8abf95f0f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:02.102427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3871af4b-311b-4ce4-856c-54d8abf95f0f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:02.102892 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3871af4b-311b-4ce4-856c-54d8abf95f0f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:02.103373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3871af4b-311b-4ce4-856c-54d8abf95f0f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:02.104043 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3871af4b-311b-4ce4-856c-54d8abf95f0f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:02.104486 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3871af4b-311b-4ce4-856c-54d8abf95f0f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:02.104899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3871af4b-311b-4ce4-856c-54d8abf95f0f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:02.168939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3871af4b-311b-4ce4-856c-54d8abf95f0f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:02.178408 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3871af4b-311b-4ce4-856c-54d8abf95f0f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:02.179960 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3871af4b-311b-4ce4-856c-54d8abf95f0f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:02.181070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3871af4b-311b-4ce4-856c-54d8abf95f0f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1339 microversion: 2.20 time: 0.089005 Aug 10 12:42:02.181636 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 46/77] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:42:02 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1339 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:42:02.468373 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1a33d42f-4f4b-4319-a6c8-7980b911efcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:02.469455 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1a33d42f-4f4b-4319-a6c8-7980b911efcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:02.475222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1a33d42f-4f4b-4319-a6c8-7980b911efcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:02.475715 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1a33d42f-4f4b-4319-a6c8-7980b911efcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:02.476144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1a33d42f-4f4b-4319-a6c8-7980b911efcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:02.476833 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1a33d42f-4f4b-4319-a6c8-7980b911efcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:02.477279 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1a33d42f-4f4b-4319-a6c8-7980b911efcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:02.477695 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1a33d42f-4f4b-4319-a6c8-7980b911efcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:02.481227 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a61126d2-3be2-4be2-b32c-607c27ae67ef tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:02.481850 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a61126d2-3be2-4be2-b32c-607c27ae67ef tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:02.503896 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a61126d2-3be2-4be2-b32c-607c27ae67ef tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:02.505686 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a61126d2-3be2-4be2-b32c-607c27ae67ef tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:02.506129 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a61126d2-3be2-4be2-b32c-607c27ae67ef tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:02.506869 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a61126d2-3be2-4be2-b32c-607c27ae67ef tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:02.507352 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a61126d2-3be2-4be2-b32c-607c27ae67ef tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:02.507780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a61126d2-3be2-4be2-b32c-607c27ae67ef tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:02.796751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a61126d2-3be2-4be2-b32c-607c27ae67ef tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:02.809118 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a61126d2-3be2-4be2-b32c-607c27ae67ef tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1288 microversion: 2.1 time: 0.336318 Aug 10 12:42:02.810742 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 47/78] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:02 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1288 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:02.840847 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-046da9ff-91d5-4ae2-8b45-f72ad32b7b43 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:02.842981 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-046da9ff-91d5-4ae2-8b45-f72ad32b7b43 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:02.861731 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-046da9ff-91d5-4ae2-8b45-f72ad32b7b43 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:02.862453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-046da9ff-91d5-4ae2-8b45-f72ad32b7b43 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:02.863020 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-046da9ff-91d5-4ae2-8b45-f72ad32b7b43 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:02.863996 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-046da9ff-91d5-4ae2-8b45-f72ad32b7b43 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:02.864888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-046da9ff-91d5-4ae2-8b45-f72ad32b7b43 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:02.865483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-046da9ff-91d5-4ae2-8b45-f72ad32b7b43 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:03.002433 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-1a33d42f-4f4b-4319-a6c8-7980b911efcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:03.009014 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-046da9ff-91d5-4ae2-8b45-f72ad32b7b43 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:03.012534 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1a33d42f-4f4b-4319-a6c8-7980b911efcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1322 microversion: 2.1 time: 0.547740 Aug 10 12:42:03.014313 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 32/79] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:02 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1322 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:03.018535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-046da9ff-91d5-4ae2-8b45-f72ad32b7b43 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1292 microversion: 2.1 time: 0.206555 Aug 10 12:42:03.019304 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 48/80] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:02 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1292 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:03.019803 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-08d7cd48-a748-463d-9063-073a39c1e2b8 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:03.021803 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-08d7cd48-a748-463d-9063-073a39c1e2b8 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:03.027948 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08d7cd48-a748-463d-9063-073a39c1e2b8 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:03.028701 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08d7cd48-a748-463d-9063-073a39c1e2b8 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:03.029352 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08d7cd48-a748-463d-9063-073a39c1e2b8 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:03.030404 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08d7cd48-a748-463d-9063-073a39c1e2b8 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:03.031089 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08d7cd48-a748-463d-9063-073a39c1e2b8 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:03.031740 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08d7cd48-a748-463d-9063-073a39c1e2b8 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:03.204634 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-05508162-d545-4a65-b281-1e0fb491dc9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:03.205289 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-05508162-d545-4a65-b281-1e0fb491dc9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:03.211979 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-05508162-d545-4a65-b281-1e0fb491dc9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:03.212424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-05508162-d545-4a65-b281-1e0fb491dc9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:03.212861 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-05508162-d545-4a65-b281-1e0fb491dc9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:03.213551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-05508162-d545-4a65-b281-1e0fb491dc9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:03.214003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-05508162-d545-4a65-b281-1e0fb491dc9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:03.214428 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-05508162-d545-4a65-b281-1e0fb491dc9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:03.221791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-08d7cd48-a748-463d-9063-073a39c1e2b8 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c598eb26614feaa0c31339b8135f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefe2d12cf334ecbad2001b327cb65e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:03.230016 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-08d7cd48-a748-463d-9063-073a39c1e2b8 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 200 len: 1315 microversion: 2.1 time: 0.214462 Aug 10 12:42:03.231268 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 33/81] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:03 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:03.375713 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-05508162-d545-4a65-b281-1e0fb491dc9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:03.384598 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-05508162-d545-4a65-b281-1e0fb491dc9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:03.386096 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-05508162-d545-4a65-b281-1e0fb491dc9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:03.387231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-05508162-d545-4a65-b281-1e0fb491dc9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1406 microversion: 2.20 time: 0.186713 Aug 10 12:42:03.387798 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 49/82] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:42:03 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:42:03.686800 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [req-3fe4bc93-445e-4289-ac9f-9c78cabdfe1d req-953d6628-81c5-48ec-b8d9-ce0e86efbb12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "572a91d2-8a56-4616-97e4-b0d48cc57ea5", "tag": "5bdde102-3780-4fb4-a112-3f9af85f6b61"}]} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:42:03.696923 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-3fe4bc93-445e-4289-ac9f-9c78cabdfe1d req-953d6628-81c5-48ec-b8d9-ce0e86efbb12 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:03.697082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-3fe4bc93-445e-4289-ac9f-9c78cabdfe1d req-953d6628-81c5-48ec-b8d9-ce0e86efbb12 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:03.697425 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-3fe4bc93-445e-4289-ac9f-9c78cabdfe1d req-953d6628-81c5-48ec-b8d9-ce0e86efbb12 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:03.709728 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.compute.server_external_events [req-3fe4bc93-445e-4289-ac9f-9c78cabdfe1d req-953d6628-81c5-48ec-b8d9-ce0e86efbb12 service nova] Creating event network-changed:5bdde102-3780-4fb4-a112-3f9af85f6b61 for instance 572a91d2-8a56-4616-97e4-b0d48cc57ea5 on hv-cinder-85199 Aug 10 12:42:03.715718 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [req-3fe4bc93-445e-4289-ac9f-9c78cabdfe1d req-953d6628-81c5-48ec-b8d9-ce0e86efbb12 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032405 Aug 10 12:42:03.716321 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 34/83] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:42:03.837953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d99e6147-e6dc-4cfc-9b93-ef290a135e3b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:03.838590 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d99e6147-e6dc-4cfc-9b93-ef290a135e3b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:03.844454 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d99e6147-e6dc-4cfc-9b93-ef290a135e3b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:03.851508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d99e6147-e6dc-4cfc-9b93-ef290a135e3b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:03.851508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d99e6147-e6dc-4cfc-9b93-ef290a135e3b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:03.851508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d99e6147-e6dc-4cfc-9b93-ef290a135e3b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:03.851508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d99e6147-e6dc-4cfc-9b93-ef290a135e3b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:03.851843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d99e6147-e6dc-4cfc-9b93-ef290a135e3b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:03.912343 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d99e6147-e6dc-4cfc-9b93-ef290a135e3b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:03.923138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d99e6147-e6dc-4cfc-9b93-ef290a135e3b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1288 microversion: 2.1 time: 0.088809 Aug 10 12:42:03.923984 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 50/84] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:03 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1288 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:04.045559 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0dfad861-c3b5-4c95-91aa-83ab32131a0a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:04.046244 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0dfad861-c3b5-4c95-91aa-83ab32131a0a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:04.046721 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-408a9d2c-3bbe-41ed-b7f4-45c7b07c53b0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:04.047608 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-408a9d2c-3bbe-41ed-b7f4-45c7b07c53b0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:04.055765 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0dfad861-c3b5-4c95-91aa-83ab32131a0a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:04.056476 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-408a9d2c-3bbe-41ed-b7f4-45c7b07c53b0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:04.056696 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0dfad861-c3b5-4c95-91aa-83ab32131a0a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:04.057152 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-408a9d2c-3bbe-41ed-b7f4-45c7b07c53b0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:04.057490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0dfad861-c3b5-4c95-91aa-83ab32131a0a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:04.057721 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-408a9d2c-3bbe-41ed-b7f4-45c7b07c53b0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:04.058491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-408a9d2c-3bbe-41ed-b7f4-45c7b07c53b0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:04.058756 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0dfad861-c3b5-4c95-91aa-83ab32131a0a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:04.058949 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-408a9d2c-3bbe-41ed-b7f4-45c7b07c53b0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:04.059373 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-408a9d2c-3bbe-41ed-b7f4-45c7b07c53b0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:04.060137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0dfad861-c3b5-4c95-91aa-83ab32131a0a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:04.060892 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0dfad861-c3b5-4c95-91aa-83ab32131a0a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:04.144593 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0dfad861-c3b5-4c95-91aa-83ab32131a0a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:04.161959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0dfad861-c3b5-4c95-91aa-83ab32131a0a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1292 microversion: 2.1 time: 0.119000 Aug 10 12:42:04.162544 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 51/85] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:04 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1292 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:04.251811 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-057b4ea7-9852-46de-8754-ddcf14cb9671 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:04.252480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-057b4ea7-9852-46de-8754-ddcf14cb9671 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:04.265342 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-057b4ea7-9852-46de-8754-ddcf14cb9671 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:04.265825 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-057b4ea7-9852-46de-8754-ddcf14cb9671 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:04.266254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-057b4ea7-9852-46de-8754-ddcf14cb9671 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:04.266958 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-057b4ea7-9852-46de-8754-ddcf14cb9671 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:04.267437 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-057b4ea7-9852-46de-8754-ddcf14cb9671 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:04.267855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-057b4ea7-9852-46de-8754-ddcf14cb9671 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:04.277465 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-408a9d2c-3bbe-41ed-b7f4-45c7b07c53b0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:04.290140 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-408a9d2c-3bbe-41ed-b7f4-45c7b07c53b0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1322 microversion: 2.1 time: 0.248344 Aug 10 12:42:04.303863 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 35/86] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:04 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:04.412047 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e0a9542f-eb70-4288-925d-c8aa54c2a181 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:04.412871 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e0a9542f-eb70-4288-925d-c8aa54c2a181 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:04.419128 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e0a9542f-eb70-4288-925d-c8aa54c2a181 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:04.423609 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e0a9542f-eb70-4288-925d-c8aa54c2a181 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:04.423609 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e0a9542f-eb70-4288-925d-c8aa54c2a181 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:04.423609 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e0a9542f-eb70-4288-925d-c8aa54c2a181 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:04.423609 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e0a9542f-eb70-4288-925d-c8aa54c2a181 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:04.423935 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e0a9542f-eb70-4288-925d-c8aa54c2a181 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:04.466471 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-057b4ea7-9852-46de-8754-ddcf14cb9671 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c598eb26614feaa0c31339b8135f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefe2d12cf334ecbad2001b327cb65e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:04.476518 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-057b4ea7-9852-46de-8754-ddcf14cb9671 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 200 len: 1315 microversion: 2.1 time: 0.227964 Aug 10 12:42:04.481553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 52/87] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:04 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:42:04.594876 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e0a9542f-eb70-4288-925d-c8aa54c2a181 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:04.603942 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e0a9542f-eb70-4288-925d-c8aa54c2a181 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:04.605489 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e0a9542f-eb70-4288-925d-c8aa54c2a181 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:04.606606 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e0a9542f-eb70-4288-925d-c8aa54c2a181 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1406 microversion: 2.20 time: 0.200943 Aug 10 12:42:04.607189 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 36/88] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:42:04 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:42:04.944729 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-35d557b1-eb65-4e3d-acba-d57d7021f6f8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:04.945339 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-35d557b1-eb65-4e3d-acba-d57d7021f6f8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:04.951403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35d557b1-eb65-4e3d-acba-d57d7021f6f8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:04.951895 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35d557b1-eb65-4e3d-acba-d57d7021f6f8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:04.952462 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35d557b1-eb65-4e3d-acba-d57d7021f6f8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:04.953171 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35d557b1-eb65-4e3d-acba-d57d7021f6f8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:04.953623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35d557b1-eb65-4e3d-acba-d57d7021f6f8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:04.954046 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35d557b1-eb65-4e3d-acba-d57d7021f6f8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:05.024194 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-35d557b1-eb65-4e3d-acba-d57d7021f6f8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:05.031608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-35d557b1-eb65-4e3d-acba-d57d7021f6f8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1288 microversion: 2.1 time: 0.091599 Aug 10 12:42:05.032178 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 53/89] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:04 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1288 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:05.191254 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-422b2180-d53f-46c5-a9c2-f8576accf3d0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:05.191254 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-422b2180-d53f-46c5-a9c2-f8576accf3d0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:05.193940 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-422b2180-d53f-46c5-a9c2-f8576accf3d0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:05.194612 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-422b2180-d53f-46c5-a9c2-f8576accf3d0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:05.195248 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-422b2180-d53f-46c5-a9c2-f8576accf3d0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:05.196388 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-422b2180-d53f-46c5-a9c2-f8576accf3d0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:05.197115 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-422b2180-d53f-46c5-a9c2-f8576accf3d0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:05.197554 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-422b2180-d53f-46c5-a9c2-f8576accf3d0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:05.261859 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-422b2180-d53f-46c5-a9c2-f8576accf3d0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:05.270845 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-422b2180-d53f-46c5-a9c2-f8576accf3d0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1292 microversion: 2.1 time: 0.091386 Aug 10 12:42:05.272285 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 37/90] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:05 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1292 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:05.313646 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1da59889-33ad-4db9-bb64-dda3f2828aaa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:05.314331 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1da59889-33ad-4db9-bb64-dda3f2828aaa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:05.323310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1da59889-33ad-4db9-bb64-dda3f2828aaa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:05.323808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1da59889-33ad-4db9-bb64-dda3f2828aaa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:05.324249 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1da59889-33ad-4db9-bb64-dda3f2828aaa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:05.324965 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1da59889-33ad-4db9-bb64-dda3f2828aaa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:05.325425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1da59889-33ad-4db9-bb64-dda3f2828aaa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:05.325858 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1da59889-33ad-4db9-bb64-dda3f2828aaa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:05.501305 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c272db70-1543-404a-9655-70e7d54c1344 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:05.508282 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c272db70-1543-404a-9655-70e7d54c1344 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:05.512116 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c272db70-1543-404a-9655-70e7d54c1344 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:05.512611 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c272db70-1543-404a-9655-70e7d54c1344 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:05.513049 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c272db70-1543-404a-9655-70e7d54c1344 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:05.513872 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c272db70-1543-404a-9655-70e7d54c1344 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:05.514326 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c272db70-1543-404a-9655-70e7d54c1344 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:05.514752 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c272db70-1543-404a-9655-70e7d54c1344 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:05.744968 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1da59889-33ad-4db9-bb64-dda3f2828aaa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:05.761587 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1da59889-33ad-4db9-bb64-dda3f2828aaa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1322 microversion: 2.1 time: 0.454110 Aug 10 12:42:05.776378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 54/91] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:05 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1322 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:05.781824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9f0ff866-d826-4dce-8a26-11d8385d4b54 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:05.782783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9f0ff866-d826-4dce-8a26-11d8385d4b54 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:05.791389 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f0ff866-d826-4dce-8a26-11d8385d4b54 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:05.791389 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f0ff866-d826-4dce-8a26-11d8385d4b54 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:05.791389 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f0ff866-d826-4dce-8a26-11d8385d4b54 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:05.791389 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f0ff866-d826-4dce-8a26-11d8385d4b54 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:05.792721 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f0ff866-d826-4dce-8a26-11d8385d4b54 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:05.793352 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f0ff866-d826-4dce-8a26-11d8385d4b54 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:06.340220 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c272db70-1543-404a-9655-70e7d54c1344 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c598eb26614feaa0c31339b8135f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefe2d12cf334ecbad2001b327cb65e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:06.344428 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9f0ff866-d826-4dce-8a26-11d8385d4b54 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:06.375273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9f0ff866-d826-4dce-8a26-11d8385d4b54 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:06.377599 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9f0ff866-d826-4dce-8a26-11d8385d4b54 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:06.391360 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9f0ff866-d826-4dce-8a26-11d8385d4b54 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1406 microversion: 2.20 time: 0.601373 Aug 10 12:42:06.391360 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 55/92] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:42:05 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1406 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:42:06.392929 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c272db70-1543-404a-9655-70e7d54c1344 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 200 len: 1315 microversion: 2.1 time: 0.894785 Aug 10 12:42:06.397541 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 38/93] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:05 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 1315 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:42:06.403816 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-92ac42a1-1063-4fa9-ad5d-999d73e93439 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:06.404617 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-92ac42a1-1063-4fa9-ad5d-999d73e93439 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:06.408740 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-39cdfea6-f72c-49f8-9702-2dfad3323029 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:06.413886 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-39cdfea6-f72c-49f8-9702-2dfad3323029 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:06.414312 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-92ac42a1-1063-4fa9-ad5d-999d73e93439 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:06.414864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-92ac42a1-1063-4fa9-ad5d-999d73e93439 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:06.415642 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-92ac42a1-1063-4fa9-ad5d-999d73e93439 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:06.419885 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-92ac42a1-1063-4fa9-ad5d-999d73e93439 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:06.419885 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-92ac42a1-1063-4fa9-ad5d-999d73e93439 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:06.419885 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-92ac42a1-1063-4fa9-ad5d-999d73e93439 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:06.455488 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-39cdfea6-f72c-49f8-9702-2dfad3323029 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:06.456512 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-39cdfea6-f72c-49f8-9702-2dfad3323029 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:06.463292 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-39cdfea6-f72c-49f8-9702-2dfad3323029 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:06.466563 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-39cdfea6-f72c-49f8-9702-2dfad3323029 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:06.467853 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-39cdfea6-f72c-49f8-9702-2dfad3323029 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:06.469810 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-39cdfea6-f72c-49f8-9702-2dfad3323029 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:06.569878 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-92ac42a1-1063-4fa9-ad5d-999d73e93439 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:06.588881 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-92ac42a1-1063-4fa9-ad5d-999d73e93439 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1294 microversion: 2.1 time: 0.185996 Aug 10 12:42:06.589640 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 56/94] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:06 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1294 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:06.673778 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-39cdfea6-f72c-49f8-9702-2dfad3323029 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:06.688045 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-39cdfea6-f72c-49f8-9702-2dfad3323029 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1298 microversion: 2.1 time: 0.289157 Aug 10 12:42:06.689760 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 39/95] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:06 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1298 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:06.782649 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ea013a17-22d6-4ef9-8a41-a2da04ed695c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:06.783596 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ea013a17-22d6-4ef9-8a41-a2da04ed695c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:06.797178 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ea013a17-22d6-4ef9-8a41-a2da04ed695c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:06.797667 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ea013a17-22d6-4ef9-8a41-a2da04ed695c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:06.798279 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ea013a17-22d6-4ef9-8a41-a2da04ed695c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:06.799191 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ea013a17-22d6-4ef9-8a41-a2da04ed695c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:06.799913 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ea013a17-22d6-4ef9-8a41-a2da04ed695c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:06.800537 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ea013a17-22d6-4ef9-8a41-a2da04ed695c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:07.122483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ea013a17-22d6-4ef9-8a41-a2da04ed695c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:07.131818 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ea013a17-22d6-4ef9-8a41-a2da04ed695c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1322 microversion: 2.1 time: 0.352837 Aug 10 12:42:07.132806 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 57/96] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:06 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1322 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:07.412519 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-431381cc-d3fc-499b-9187-4a95c89d6212 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:07.413046 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-431381cc-d3fc-499b-9187-4a95c89d6212 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:07.419503 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-69d6c1bf-b07e-425f-8696-23456d2e1177 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:07.419503 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-69d6c1bf-b07e-425f-8696-23456d2e1177 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:07.421280 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-431381cc-d3fc-499b-9187-4a95c89d6212 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:07.421771 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-431381cc-d3fc-499b-9187-4a95c89d6212 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:07.422263 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-431381cc-d3fc-499b-9187-4a95c89d6212 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:07.422995 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-431381cc-d3fc-499b-9187-4a95c89d6212 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:07.423656 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-431381cc-d3fc-499b-9187-4a95c89d6212 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:07.424086 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-431381cc-d3fc-499b-9187-4a95c89d6212 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:07.424564 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-69d6c1bf-b07e-425f-8696-23456d2e1177 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:07.425322 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-69d6c1bf-b07e-425f-8696-23456d2e1177 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:07.426234 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-69d6c1bf-b07e-425f-8696-23456d2e1177 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:07.427395 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-69d6c1bf-b07e-425f-8696-23456d2e1177 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:07.428187 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-69d6c1bf-b07e-425f-8696-23456d2e1177 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:07.428987 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-69d6c1bf-b07e-425f-8696-23456d2e1177 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:07.665556 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-431381cc-d3fc-499b-9187-4a95c89d6212 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:07.674116 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-69d6c1bf-b07e-425f-8696-23456d2e1177 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c598eb26614feaa0c31339b8135f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefe2d12cf334ecbad2001b327cb65e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:07.675287 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-431381cc-d3fc-499b-9187-4a95c89d6212 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:07.679965 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-431381cc-d3fc-499b-9187-4a95c89d6212 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:07.682118 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-431381cc-d3fc-499b-9187-4a95c89d6212 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1406 microversion: 2.20 time: 0.274125 Aug 10 12:42:07.689984 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 40/97] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:42:07 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1406 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:42:07.690122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-69d6c1bf-b07e-425f-8696-23456d2e1177 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 200 len: 1315 microversion: 2.1 time: 0.271989 Aug 10 12:42:07.690122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 58/98] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:07 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:42:07.690370 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7c60446c-bb2d-421e-877b-cfd3cdeb0bb5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:07.690370 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7c60446c-bb2d-421e-877b-cfd3cdeb0bb5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:07.695253 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c60446c-bb2d-421e-877b-cfd3cdeb0bb5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:07.695822 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c60446c-bb2d-421e-877b-cfd3cdeb0bb5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:07.696238 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c60446c-bb2d-421e-877b-cfd3cdeb0bb5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:07.696924 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c60446c-bb2d-421e-877b-cfd3cdeb0bb5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:07.697365 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c60446c-bb2d-421e-877b-cfd3cdeb0bb5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:07.697787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c60446c-bb2d-421e-877b-cfd3cdeb0bb5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:07.713402 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-156b6aec-c279-4f4e-86c3-b8d3138ba77b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:07.714016 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-156b6aec-c279-4f4e-86c3-b8d3138ba77b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:07.719879 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-156b6aec-c279-4f4e-86c3-b8d3138ba77b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:07.720356 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-156b6aec-c279-4f4e-86c3-b8d3138ba77b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:07.720844 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-156b6aec-c279-4f4e-86c3-b8d3138ba77b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:07.721611 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-156b6aec-c279-4f4e-86c3-b8d3138ba77b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:07.722058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-156b6aec-c279-4f4e-86c3-b8d3138ba77b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:07.722476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-156b6aec-c279-4f4e-86c3-b8d3138ba77b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:07.740723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:42:07.786613 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-7c60446c-bb2d-421e-877b-cfd3cdeb0bb5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:07.786613 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7c60446c-bb2d-421e-877b-cfd3cdeb0bb5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1294 microversion: 2.1 time: 0.094896 Aug 10 12:42:07.786613 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 41/99] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:07 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1294 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:07.871939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-156b6aec-c279-4f4e-86c3-b8d3138ba77b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:07.879935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-156b6aec-c279-4f4e-86c3-b8d3138ba77b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1365 microversion: 2.1 time: 0.171751 Aug 10 12:42:07.881107 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 59/100] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:07 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:42:08.153868 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7cf7be6b-91ff-4741-865d-d50b2407549c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:08.154499 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7cf7be6b-91ff-4741-865d-d50b2407549c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:08.160322 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7cf7be6b-91ff-4741-865d-d50b2407549c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:08.160802 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7cf7be6b-91ff-4741-865d-d50b2407549c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:08.161235 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7cf7be6b-91ff-4741-865d-d50b2407549c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:08.161920 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7cf7be6b-91ff-4741-865d-d50b2407549c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:08.162369 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7cf7be6b-91ff-4741-865d-d50b2407549c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:08.162788 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7cf7be6b-91ff-4741-865d-d50b2407549c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:08.398022 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-7cf7be6b-91ff-4741-865d-d50b2407549c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:08.401877 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:42:08.410441 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7cf7be6b-91ff-4741-865d-d50b2407549c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1322 microversion: 2.1 time: 0.260383 Aug 10 12:42:08.411890 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 42/101] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:08 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:08.710954 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-54fa9243-bbe7-4885-9324-b68845e30643 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:08.711604 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-54fa9243-bbe7-4885-9324-b68845e30643 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:08.711869 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-cca92b77-d5f7-4dcf-8e9d-20db4b1a996e tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:08.713119 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-cca92b77-d5f7-4dcf-8e9d-20db4b1a996e tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:08.732611 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cca92b77-d5f7-4dcf-8e9d-20db4b1a996e tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:08.733000 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54fa9243-bbe7-4885-9324-b68845e30643 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:08.734082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54fa9243-bbe7-4885-9324-b68845e30643 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:08.734561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54fa9243-bbe7-4885-9324-b68845e30643 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:08.739399 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54fa9243-bbe7-4885-9324-b68845e30643 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:08.740274 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cca92b77-d5f7-4dcf-8e9d-20db4b1a996e tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:08.745227 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54fa9243-bbe7-4885-9324-b68845e30643 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:08.747698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cca92b77-d5f7-4dcf-8e9d-20db4b1a996e tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:08.748495 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cca92b77-d5f7-4dcf-8e9d-20db4b1a996e tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:08.748605 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54fa9243-bbe7-4885-9324-b68845e30643 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:08.749007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cca92b77-d5f7-4dcf-8e9d-20db4b1a996e tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:08.749401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cca92b77-d5f7-4dcf-8e9d-20db4b1a996e tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:08.870209 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=4 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:42:09.147833 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-54fa9243-bbe7-4885-9324-b68845e30643 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:09.163751 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-54fa9243-bbe7-4885-9324-b68845e30643 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:09.170363 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-54fa9243-bbe7-4885-9324-b68845e30643 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:09.186422 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-54fa9243-bbe7-4885-9324-b68845e30643 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1406 microversion: 2.20 time: 0.481808 Aug 10 12:42:09.200176 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 43/102] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:42:08 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1406 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:42:09.211994 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-10d57351-d787-4b90-87ae-0a7c43a5afa2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:09.215452 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-10d57351-d787-4b90-87ae-0a7c43a5afa2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:09.229911 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-10d57351-d787-4b90-87ae-0a7c43a5afa2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:09.230627 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-10d57351-d787-4b90-87ae-0a7c43a5afa2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:09.231298 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-10d57351-d787-4b90-87ae-0a7c43a5afa2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:09.232177 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-10d57351-d787-4b90-87ae-0a7c43a5afa2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:09.232849 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-10d57351-d787-4b90-87ae-0a7c43a5afa2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:09.233425 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-10d57351-d787-4b90-87ae-0a7c43a5afa2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:09.268094 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-cca92b77-d5f7-4dcf-8e9d-20db4b1a996e tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c598eb26614feaa0c31339b8135f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefe2d12cf334ecbad2001b327cb65e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:09.285199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-cca92b77-d5f7-4dcf-8e9d-20db4b1a996e tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 200 len: 1315 microversion: 2.1 time: 0.585285 Aug 10 12:42:09.286367 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 60/103] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:08 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 1315 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:09.303666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5a61d958-9082-495a-8578-034ae2a23347 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:09.304449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5a61d958-9082-495a-8578-034ae2a23347 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:09.312182 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a61d958-9082-495a-8578-034ae2a23347 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:09.312681 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a61d958-9082-495a-8578-034ae2a23347 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:09.313111 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a61d958-9082-495a-8578-034ae2a23347 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:09.313868 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a61d958-9082-495a-8578-034ae2a23347 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:09.314321 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a61d958-9082-495a-8578-034ae2a23347 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:09.314791 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a61d958-9082-495a-8578-034ae2a23347 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:09.319793 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell0:SELECT=6 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:42:09.369547 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell0:SELECT=14 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:42:09.709471 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-10d57351-d787-4b90-87ae-0a7c43a5afa2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:09.717379 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-10d57351-d787-4b90-87ae-0a7c43a5afa2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1361 microversion: 2.1 time: 0.515241 Aug 10 12:42:09.717973 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 44/104] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:09 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1361 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:09.748062 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5a61d958-9082-495a-8578-034ae2a23347 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:09.758680 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5a61d958-9082-495a-8578-034ae2a23347 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1365 microversion: 2.1 time: 0.470341 Aug 10 12:42:09.764056 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 61/105] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:09 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1365 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:09.765761 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6824d508-df43-4136-ab61-1bf3040f0706 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:09.766641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6824d508-df43-4136-ab61-1bf3040f0706 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:09.775515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6824d508-df43-4136-ab61-1bf3040f0706 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:09.777541 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6824d508-df43-4136-ab61-1bf3040f0706 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:09.778211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6824d508-df43-4136-ab61-1bf3040f0706 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:09.779418 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6824d508-df43-4136-ab61-1bf3040f0706 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:09.780099 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6824d508-df43-4136-ab61-1bf3040f0706 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:09.780741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6824d508-df43-4136-ab61-1bf3040f0706 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:09.897401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [req-6cc6b8e0-d50b-4416-92e8-0bb9d703c759 req-f2a802f2-2a8c-4f56-8040-870404da2f94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47011594-f6d9-44a1-9751-c564121b1e48", "name": "network-vif-plugged", "status": "completed", "tag": "dd45ef32-2207-4bad-a901-d414e1d86870"}]} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:42:09.917805 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-6cc6b8e0-d50b-4416-92e8-0bb9d703c759 req-f2a802f2-2a8c-4f56-8040-870404da2f94 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:09.918950 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-6cc6b8e0-d50b-4416-92e8-0bb9d703c759 req-f2a802f2-2a8c-4f56-8040-870404da2f94 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:09.942446 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-6cc6b8e0-d50b-4416-92e8-0bb9d703c759 req-f2a802f2-2a8c-4f56-8040-870404da2f94 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:09.952158 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.compute.server_external_events [req-6cc6b8e0-d50b-4416-92e8-0bb9d703c759 req-f2a802f2-2a8c-4f56-8040-870404da2f94 service nova] Creating event network-vif-plugged:dd45ef32-2207-4bad-a901-d414e1d86870 for instance 47011594-f6d9-44a1-9751-c564121b1e48 on hv-cinder-85199 Aug 10 12:42:09.960227 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [req-6cc6b8e0-d50b-4416-92e8-0bb9d703c759 req-f2a802f2-2a8c-4f56-8040-870404da2f94 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239109 Aug 10 12:42:09.961979 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 45/106] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:42:10.047910 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6824d508-df43-4136-ab61-1bf3040f0706 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:10.056595 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6824d508-df43-4136-ab61-1bf3040f0706 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1322 microversion: 2.1 time: 0.296014 Aug 10 12:42:10.067876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 62/107] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:09 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1322 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:10.157419 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [req-a95bc2e0-b526-4f4c-8bf0-4c4245aa03ce req-a4ea214c-c51c-4ea6-b3d0-6f5dfea9c5f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fad49521-8b28-4a9f-a4a0-88e41b5a1566", "tag": "63207b81-6588-46d1-8129-1070b16da6a5"}]} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:42:10.178728 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-a95bc2e0-b526-4f4c-8bf0-4c4245aa03ce req-a4ea214c-c51c-4ea6-b3d0-6f5dfea9c5f3 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:10.181278 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-a95bc2e0-b526-4f4c-8bf0-4c4245aa03ce req-a4ea214c-c51c-4ea6-b3d0-6f5dfea9c5f3 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:10.181834 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-a95bc2e0-b526-4f4c-8bf0-4c4245aa03ce req-a4ea214c-c51c-4ea6-b3d0-6f5dfea9c5f3 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:10.195366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.compute.server_external_events [req-a95bc2e0-b526-4f4c-8bf0-4c4245aa03ce req-a4ea214c-c51c-4ea6-b3d0-6f5dfea9c5f3 service nova] Creating event network-changed:63207b81-6588-46d1-8129-1070b16da6a5 for instance fad49521-8b28-4a9f-a4a0-88e41b5a1566 on hv-cinder-85199 Aug 10 12:42:10.213630 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [req-a95bc2e0-b526-4f4c-8bf0-4c4245aa03ce req-a4ea214c-c51c-4ea6-b3d0-6f5dfea9c5f3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065494 Aug 10 12:42:10.217201 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 46/108] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:42:10.221856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d3a1f48c-d7cf-4050-adb8-1264a5ff178b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:10.223402 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d3a1f48c-d7cf-4050-adb8-1264a5ff178b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:10.231024 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d3a1f48c-d7cf-4050-adb8-1264a5ff178b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:10.231734 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d3a1f48c-d7cf-4050-adb8-1264a5ff178b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:10.233254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d3a1f48c-d7cf-4050-adb8-1264a5ff178b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:10.234114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d3a1f48c-d7cf-4050-adb8-1264a5ff178b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:10.234811 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d3a1f48c-d7cf-4050-adb8-1264a5ff178b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:10.235720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d3a1f48c-d7cf-4050-adb8-1264a5ff178b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:10.308928 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4c4fcc89-8184-4905-9cf5-797bbca169fa tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:10.309901 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4c4fcc89-8184-4905-9cf5-797bbca169fa tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:10.321662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc89-8184-4905-9cf5-797bbca169fa tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:10.323781 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc89-8184-4905-9cf5-797bbca169fa tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:10.325116 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc89-8184-4905-9cf5-797bbca169fa tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:10.326080 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc89-8184-4905-9cf5-797bbca169fa tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:10.327009 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc89-8184-4905-9cf5-797bbca169fa tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:10.327536 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c4fcc89-8184-4905-9cf5-797bbca169fa tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:10.403852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=10 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:42:10.969484 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4c4fcc89-8184-4905-9cf5-797bbca169fa tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c598eb26614feaa0c31339b8135f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefe2d12cf334ecbad2001b327cb65e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:10.975514 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d3a1f48c-d7cf-4050-adb8-1264a5ff178b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:10.991586 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4c4fcc89-8184-4905-9cf5-797bbca169fa tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 200 len: 1315 microversion: 2.1 time: 0.686842 Aug 10 12:42:10.993906 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d3a1f48c-d7cf-4050-adb8-1264a5ff178b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:10.995147 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 47/109] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:10 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 1315 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:42:10.998610 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d3a1f48c-d7cf-4050-adb8-1264a5ff178b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:10.999768 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d3a1f48c-d7cf-4050-adb8-1264a5ff178b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1406 microversion: 2.20 time: 0.782295 Aug 10 12:42:11.002373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 63/110] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:42:10 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1406 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:42:11.016577 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [req-2f6b945d-f8cd-4631-a03e-bb7c1b5755af req-d3ce5273-9c1d-4db2-bd07-894a055d6c74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88f016f1-19e1-466c-9e03-5a125f281e25", "tag": "d9a14494-c057-4e68-b287-dbdca61760ac"}]} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:42:11.030731 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-2f6b945d-f8cd-4631-a03e-bb7c1b5755af req-d3ce5273-9c1d-4db2-bd07-894a055d6c74 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:11.030981 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-32cc70f0-9cc7-4045-a444-bab695bd0671 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:11.031626 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-2f6b945d-f8cd-4631-a03e-bb7c1b5755af req-d3ce5273-9c1d-4db2-bd07-894a055d6c74 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:11.031753 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-32cc70f0-9cc7-4045-a444-bab695bd0671 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:11.032299 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-2f6b945d-f8cd-4631-a03e-bb7c1b5755af req-d3ce5273-9c1d-4db2-bd07-894a055d6c74 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:11.040114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-32cc70f0-9cc7-4045-a444-bab695bd0671 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:11.040609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-32cc70f0-9cc7-4045-a444-bab695bd0671 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:11.041204 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-32cc70f0-9cc7-4045-a444-bab695bd0671 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:11.042093 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-32cc70f0-9cc7-4045-a444-bab695bd0671 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:11.043289 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-32cc70f0-9cc7-4045-a444-bab695bd0671 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:11.043470 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-32cc70f0-9cc7-4045-a444-bab695bd0671 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:11.048756 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.compute.server_external_events [req-2f6b945d-f8cd-4631-a03e-bb7c1b5755af req-d3ce5273-9c1d-4db2-bd07-894a055d6c74 service nova] Creating event network-changed:d9a14494-c057-4e68-b287-dbdca61760ac for instance 88f016f1-19e1-466c-9e03-5a125f281e25 on hv-cinder-85199 Aug 10 12:42:11.054649 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [req-2f6b945d-f8cd-4631-a03e-bb7c1b5755af req-d3ce5273-9c1d-4db2-bd07-894a055d6c74 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058036 Aug 10 12:42:11.058201 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 48/111] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:42:11.064422 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e6e18407-366e-4766-b60e-866abd92c485 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:11.065404 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e6e18407-366e-4766-b60e-866abd92c485 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:11.072800 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e6e18407-366e-4766-b60e-866abd92c485 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:11.073433 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e6e18407-366e-4766-b60e-866abd92c485 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:11.074032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e6e18407-366e-4766-b60e-866abd92c485 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:11.074865 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e6e18407-366e-4766-b60e-866abd92c485 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:11.075669 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e6e18407-366e-4766-b60e-866abd92c485 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:11.076232 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e6e18407-366e-4766-b60e-866abd92c485 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:11.484231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-32cc70f0-9cc7-4045-a444-bab695bd0671 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:11.492150 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-32cc70f0-9cc7-4045-a444-bab695bd0671 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1361 microversion: 2.1 time: 0.472269 Aug 10 12:42:11.492719 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 64/112] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:11 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1361 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:11.497064 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6d5acd6e-6e0c-4d65-98b8-812add5c78a3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:11.497657 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6d5acd6e-6e0c-4d65-98b8-812add5c78a3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:11.503274 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6d5acd6e-6e0c-4d65-98b8-812add5c78a3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:11.503750 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6d5acd6e-6e0c-4d65-98b8-812add5c78a3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:11.504177 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6d5acd6e-6e0c-4d65-98b8-812add5c78a3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:11.505390 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6d5acd6e-6e0c-4d65-98b8-812add5c78a3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:11.506010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6d5acd6e-6e0c-4d65-98b8-812add5c78a3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:11.506428 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6d5acd6e-6e0c-4d65-98b8-812add5c78a3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:11.514477 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e6e18407-366e-4766-b60e-866abd92c485 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:11.522881 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e6e18407-366e-4766-b60e-866abd92c485 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1365 microversion: 2.1 time: 0.463357 Aug 10 12:42:11.523579 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 49/113] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:11 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1365 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:11.641816 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6d5acd6e-6e0c-4d65-98b8-812add5c78a3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:11.649234 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6d5acd6e-6e0c-4d65-98b8-812add5c78a3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1322 microversion: 2.1 time: 0.155543 Aug 10 12:42:11.649816 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 65/114] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:11 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:12.017055 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1cf76d93-37a8-4917-b5a3-86ec2ccda8ca tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:12.017984 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [req-ff6dffaf-9b96-42f7-92f9-9cafbf4fedb9 req-1af3969f-0f19-4189-a823-173fae259f80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb8a78c0-11f5-4a26-991b-f654067d9422", "name": "network-vif-plugged", "status": "completed", "tag": "0629626a-06bb-4dab-8c94-8df7f0e88222"}, {"server_uuid": "e5bd9766-6096-4847-bb63-d90b985902f9", "name": "network-vif-plugged", "status": "completed", "tag": "2b65d1a0-93b1-490f-9c09-f9f7d35efd68"}]} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:42:12.019436 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1cf76d93-37a8-4917-b5a3-86ec2ccda8ca tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:12.032235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cf76d93-37a8-4917-b5a3-86ec2ccda8ca tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:12.032725 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cf76d93-37a8-4917-b5a3-86ec2ccda8ca tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:12.033154 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cf76d93-37a8-4917-b5a3-86ec2ccda8ca tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:12.033854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cf76d93-37a8-4917-b5a3-86ec2ccda8ca tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:12.039448 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-ff6dffaf-9b96-42f7-92f9-9cafbf4fedb9 req-1af3969f-0f19-4189-a823-173fae259f80 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:12.052481 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-ff6dffaf-9b96-42f7-92f9-9cafbf4fedb9 req-1af3969f-0f19-4189-a823-173fae259f80 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:12.052481 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-ff6dffaf-9b96-42f7-92f9-9cafbf4fedb9 req-1af3969f-0f19-4189-a823-173fae259f80 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:12.052899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cf76d93-37a8-4917-b5a3-86ec2ccda8ca tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:12.052899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cf76d93-37a8-4917-b5a3-86ec2ccda8ca tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:12.061572 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.compute.server_external_events [req-ff6dffaf-9b96-42f7-92f9-9cafbf4fedb9 req-1af3969f-0f19-4189-a823-173fae259f80 service nova] Creating event network-vif-plugged:0629626a-06bb-4dab-8c94-8df7f0e88222 for instance fb8a78c0-11f5-4a26-991b-f654067d9422 on hv-cinder-85199 Aug 10 12:42:12.062311 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.compute.server_external_events [req-ff6dffaf-9b96-42f7-92f9-9cafbf4fedb9 req-1af3969f-0f19-4189-a823-173fae259f80 service nova] Creating event network-vif-plugged:2b65d1a0-93b1-490f-9c09-f9f7d35efd68 for instance e5bd9766-6096-4847-bb63-d90b985902f9 on hv-cinder-85199 Aug 10 12:42:12.070859 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [req-ff6dffaf-9b96-42f7-92f9-9cafbf4fedb9 req-1af3969f-0f19-4189-a823-173fae259f80 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.068547 Aug 10 12:42:12.072027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 50/115] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:42:12.079228 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-28b4cbb6-3abe-4ac4-84f2-5a64b0ad669d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:12.080153 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-28b4cbb6-3abe-4ac4-84f2-5a64b0ad669d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:12.088708 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-28b4cbb6-3abe-4ac4-84f2-5a64b0ad669d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:12.089791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-28b4cbb6-3abe-4ac4-84f2-5a64b0ad669d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:12.090375 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-28b4cbb6-3abe-4ac4-84f2-5a64b0ad669d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:12.092135 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-28b4cbb6-3abe-4ac4-84f2-5a64b0ad669d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:12.096881 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-28b4cbb6-3abe-4ac4-84f2-5a64b0ad669d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:12.097610 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-28b4cbb6-3abe-4ac4-84f2-5a64b0ad669d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:12.380130 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1cf76d93-37a8-4917-b5a3-86ec2ccda8ca tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c598eb26614feaa0c31339b8135f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefe2d12cf334ecbad2001b327cb65e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:12.384132 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-28b4cbb6-3abe-4ac4-84f2-5a64b0ad669d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:12.388571 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1cf76d93-37a8-4917-b5a3-86ec2ccda8ca tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 200 len: 1315 microversion: 2.1 time: 0.380318 Aug 10 12:42:12.389390 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 66/116] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:12 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:12.392348 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-28b4cbb6-3abe-4ac4-84f2-5a64b0ad669d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:12.393844 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-28b4cbb6-3abe-4ac4-84f2-5a64b0ad669d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:12.395711 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-28b4cbb6-3abe-4ac4-84f2-5a64b0ad669d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1406 microversion: 2.20 time: 0.321896 Aug 10 12:42:12.396404 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 51/117] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:42:12 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1406 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:42:12.514036 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0b96f34a-54c2-4537-b93e-3f4f73495883 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:12.515071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0b96f34a-54c2-4537-b93e-3f4f73495883 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:12.532655 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b96f34a-54c2-4537-b93e-3f4f73495883 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:12.533435 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b96f34a-54c2-4537-b93e-3f4f73495883 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:12.533884 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b96f34a-54c2-4537-b93e-3f4f73495883 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:12.534577 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b96f34a-54c2-4537-b93e-3f4f73495883 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:12.535026 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b96f34a-54c2-4537-b93e-3f4f73495883 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:12.535488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b96f34a-54c2-4537-b93e-3f4f73495883 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:12.543643 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-17531108-a433-490e-96d6-ce95e9b5e216 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:12.544476 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-17531108-a433-490e-96d6-ce95e9b5e216 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:12.551213 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17531108-a433-490e-96d6-ce95e9b5e216 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:12.551746 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17531108-a433-490e-96d6-ce95e9b5e216 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:12.552263 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17531108-a433-490e-96d6-ce95e9b5e216 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:12.553025 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17531108-a433-490e-96d6-ce95e9b5e216 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:12.553643 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17531108-a433-490e-96d6-ce95e9b5e216 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:12.554084 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17531108-a433-490e-96d6-ce95e9b5e216 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:12.896282 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-17531108-a433-490e-96d6-ce95e9b5e216 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:12.898690 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0b96f34a-54c2-4537-b93e-3f4f73495883 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:12.904303 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-17531108-a433-490e-96d6-ce95e9b5e216 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1365 microversion: 2.1 time: 0.364480 Aug 10 12:42:12.905013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 52/118] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:12 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1365 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:42:12.906123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0b96f34a-54c2-4537-b93e-3f4f73495883 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1361 microversion: 2.1 time: 0.396968 Aug 10 12:42:12.906850 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 67/119] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:12 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1361 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:12.910163 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3fe1bec2-db80-4dfe-9802-2596a242d57f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:12.911374 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3fe1bec2-db80-4dfe-9802-2596a242d57f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:12.918631 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3fe1bec2-db80-4dfe-9802-2596a242d57f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:12.919419 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3fe1bec2-db80-4dfe-9802-2596a242d57f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:12.919943 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3fe1bec2-db80-4dfe-9802-2596a242d57f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:12.920701 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3fe1bec2-db80-4dfe-9802-2596a242d57f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:12.921362 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3fe1bec2-db80-4dfe-9802-2596a242d57f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:12.921788 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3fe1bec2-db80-4dfe-9802-2596a242d57f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:13.076763 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3fe1bec2-db80-4dfe-9802-2596a242d57f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:13.087019 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3fe1bec2-db80-4dfe-9802-2596a242d57f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1322 microversion: 2.1 time: 0.180760 Aug 10 12:42:13.087719 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 53/120] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:12 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:13.409821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d42e1112-81a8-4131-b72c-ed289a20d431 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:13.410521 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d42e1112-81a8-4131-b72c-ed289a20d431 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:13.416952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d42e1112-81a8-4131-b72c-ed289a20d431 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:13.417437 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d42e1112-81a8-4131-b72c-ed289a20d431 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:13.417802 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9a6a0211-eb6f-4492-87e6-3613e29060b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:13.417925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d42e1112-81a8-4131-b72c-ed289a20d431 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:13.418410 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9a6a0211-eb6f-4492-87e6-3613e29060b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:13.418538 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d42e1112-81a8-4131-b72c-ed289a20d431 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:13.418979 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d42e1112-81a8-4131-b72c-ed289a20d431 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:13.419446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d42e1112-81a8-4131-b72c-ed289a20d431 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:13.424406 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9a6a0211-eb6f-4492-87e6-3613e29060b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:13.424904 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9a6a0211-eb6f-4492-87e6-3613e29060b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:13.425319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9a6a0211-eb6f-4492-87e6-3613e29060b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:13.426010 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9a6a0211-eb6f-4492-87e6-3613e29060b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:13.426962 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9a6a0211-eb6f-4492-87e6-3613e29060b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:13.427522 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9a6a0211-eb6f-4492-87e6-3613e29060b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:13.613660 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d42e1112-81a8-4131-b72c-ed289a20d431 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c598eb26614feaa0c31339b8135f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefe2d12cf334ecbad2001b327cb65e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:13.618044 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9a6a0211-eb6f-4492-87e6-3613e29060b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:13.622428 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d42e1112-81a8-4131-b72c-ed289a20d431 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 200 len: 1315 microversion: 2.1 time: 0.216384 Aug 10 12:42:13.623022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 68/121] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:13 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:13.626095 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9a6a0211-eb6f-4492-87e6-3613e29060b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:13.627641 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9a6a0211-eb6f-4492-87e6-3613e29060b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:13.628747 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9a6a0211-eb6f-4492-87e6-3613e29060b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1406 microversion: 2.20 time: 0.214905 Aug 10 12:42:13.629562 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 54/122] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:42:13 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:42:13.928113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-873a3519-fbec-4c99-899d-f5a9b1edf3bd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:13.928961 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-873a3519-fbec-4c99-899d-f5a9b1edf3bd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:13.930102 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-921c345f-bfba-4b8a-bcb8-9e7ed9b9e847 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:13.930721 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-921c345f-bfba-4b8a-bcb8-9e7ed9b9e847 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:13.941070 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-921c345f-bfba-4b8a-bcb8-9e7ed9b9e847 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:13.941720 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-921c345f-bfba-4b8a-bcb8-9e7ed9b9e847 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:13.942197 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-921c345f-bfba-4b8a-bcb8-9e7ed9b9e847 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:13.943102 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-921c345f-bfba-4b8a-bcb8-9e7ed9b9e847 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:13.943686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-921c345f-bfba-4b8a-bcb8-9e7ed9b9e847 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:13.944115 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-921c345f-bfba-4b8a-bcb8-9e7ed9b9e847 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:13.949904 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-873a3519-fbec-4c99-899d-f5a9b1edf3bd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:13.950403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-873a3519-fbec-4c99-899d-f5a9b1edf3bd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:13.950831 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-873a3519-fbec-4c99-899d-f5a9b1edf3bd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:13.951556 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-873a3519-fbec-4c99-899d-f5a9b1edf3bd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:13.952156 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-873a3519-fbec-4c99-899d-f5a9b1edf3bd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:13.952781 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-873a3519-fbec-4c99-899d-f5a9b1edf3bd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:14.168984 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-873a3519-fbec-4c99-899d-f5a9b1edf3bd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:14.176940 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-873a3519-fbec-4c99-899d-f5a9b1edf3bd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1365 microversion: 2.1 time: 0.254619 Aug 10 12:42:14.185540 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-921c345f-bfba-4b8a-bcb8-9e7ed9b9e847 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:14.191295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 69/123] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:13 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:14.195233 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-921c345f-bfba-4b8a-bcb8-9e7ed9b9e847 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1361 microversion: 2.1 time: 0.270032 Aug 10 12:42:14.196181 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 55/124] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:13 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1361 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:14.198848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-12f14747-3068-4fab-876f-a3497ad20231 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:14.199735 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-12f14747-3068-4fab-876f-a3497ad20231 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:14.206606 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12f14747-3068-4fab-876f-a3497ad20231 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:14.208287 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12f14747-3068-4fab-876f-a3497ad20231 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:14.209132 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12f14747-3068-4fab-876f-a3497ad20231 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:14.210089 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12f14747-3068-4fab-876f-a3497ad20231 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:14.210755 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12f14747-3068-4fab-876f-a3497ad20231 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:14.211466 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12f14747-3068-4fab-876f-a3497ad20231 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:14.372848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-12f14747-3068-4fab-876f-a3497ad20231 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:14.383222 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-12f14747-3068-4fab-876f-a3497ad20231 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1322 microversion: 2.1 time: 0.189684 Aug 10 12:42:14.383831 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 70/125] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:14 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:14.403892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [req-a631bd15-e4dc-475e-b88c-9af91d7355ec req-0817f457-c57f-449a-8a9a-8156dd8833e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "572a91d2-8a56-4616-97e4-b0d48cc57ea5", "name": "network-vif-plugged", "status": "completed", "tag": "5bdde102-3780-4fb4-a112-3f9af85f6b61"}]} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:42:14.436695 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-a631bd15-e4dc-475e-b88c-9af91d7355ec req-0817f457-c57f-449a-8a9a-8156dd8833e7 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:14.438206 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-a631bd15-e4dc-475e-b88c-9af91d7355ec req-0817f457-c57f-449a-8a9a-8156dd8833e7 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:14.439906 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-a631bd15-e4dc-475e-b88c-9af91d7355ec req-0817f457-c57f-449a-8a9a-8156dd8833e7 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:14.456741 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.compute.server_external_events [req-a631bd15-e4dc-475e-b88c-9af91d7355ec req-0817f457-c57f-449a-8a9a-8156dd8833e7 service nova] Creating event network-vif-plugged:5bdde102-3780-4fb4-a112-3f9af85f6b61 for instance 572a91d2-8a56-4616-97e4-b0d48cc57ea5 on hv-cinder-85199 Aug 10 12:42:14.464890 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [req-a631bd15-e4dc-475e-b88c-9af91d7355ec req-0817f457-c57f-449a-8a9a-8156dd8833e7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074561 Aug 10 12:42:14.465831 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 56/126] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:42:14.643751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1dc1306c-fc6d-4d33-81ec-a3bdd8d04faf tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:14.644364 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1dc1306c-fc6d-4d33-81ec-a3bdd8d04faf tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:14.651692 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e5f31f65-df5f-4999-8add-756d200f1b13 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:14.652399 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e5f31f65-df5f-4999-8add-756d200f1b13 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:14.654693 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:42:14.662599 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1dc1306c-fc6d-4d33-81ec-a3bdd8d04faf tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:14.663354 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1dc1306c-fc6d-4d33-81ec-a3bdd8d04faf tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:14.665471 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1dc1306c-fc6d-4d33-81ec-a3bdd8d04faf tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:14.665471 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1dc1306c-fc6d-4d33-81ec-a3bdd8d04faf tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:14.665471 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1dc1306c-fc6d-4d33-81ec-a3bdd8d04faf tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:14.665761 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1dc1306c-fc6d-4d33-81ec-a3bdd8d04faf tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:14.667732 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5f31f65-df5f-4999-8add-756d200f1b13 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:14.668576 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5f31f65-df5f-4999-8add-756d200f1b13 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:14.669329 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5f31f65-df5f-4999-8add-756d200f1b13 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:14.671744 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5f31f65-df5f-4999-8add-756d200f1b13 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:14.672433 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5f31f65-df5f-4999-8add-756d200f1b13 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:14.673175 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5f31f65-df5f-4999-8add-756d200f1b13 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:14.929673 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1dc1306c-fc6d-4d33-81ec-a3bdd8d04faf tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c598eb26614feaa0c31339b8135f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefe2d12cf334ecbad2001b327cb65e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:14.937732 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e5f31f65-df5f-4999-8add-756d200f1b13 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:14.937956 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1dc1306c-fc6d-4d33-81ec-a3bdd8d04faf tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 200 len: 1315 microversion: 2.1 time: 0.298115 Aug 10 12:42:14.938928 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 71/127] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:14 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:14.959976 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e5f31f65-df5f-4999-8add-756d200f1b13 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:14.961467 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e5f31f65-df5f-4999-8add-756d200f1b13 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:14.962570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e5f31f65-df5f-4999-8add-756d200f1b13 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1406 microversion: 2.20 time: 0.315920 Aug 10 12:42:14.963137 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 57/128] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:42:14 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1406 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:42:15.198109 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a3604ae2-abf7-44d7-a132-29bd69d75ca7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:15.198711 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a3604ae2-abf7-44d7-a132-29bd69d75ca7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:15.204747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3604ae2-abf7-44d7-a132-29bd69d75ca7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:15.205218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3604ae2-abf7-44d7-a132-29bd69d75ca7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:15.205639 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3604ae2-abf7-44d7-a132-29bd69d75ca7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:15.206309 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3604ae2-abf7-44d7-a132-29bd69d75ca7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:15.206751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3604ae2-abf7-44d7-a132-29bd69d75ca7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:15.207162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3604ae2-abf7-44d7-a132-29bd69d75ca7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:15.217739 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6ed2aad1-6333-4ddd-92c2-f6205081df91 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:15.220770 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6ed2aad1-6333-4ddd-92c2-f6205081df91 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:15.226282 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6ed2aad1-6333-4ddd-92c2-f6205081df91 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:15.226741 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6ed2aad1-6333-4ddd-92c2-f6205081df91 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:15.227202 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6ed2aad1-6333-4ddd-92c2-f6205081df91 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:15.227902 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6ed2aad1-6333-4ddd-92c2-f6205081df91 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:15.228341 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6ed2aad1-6333-4ddd-92c2-f6205081df91 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:15.229022 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6ed2aad1-6333-4ddd-92c2-f6205081df91 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:15.443587 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a3604ae2-abf7-44d7-a132-29bd69d75ca7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:15.452098 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a3604ae2-abf7-44d7-a132-29bd69d75ca7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1365 microversion: 2.1 time: 0.257876 Aug 10 12:42:15.452590 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6ed2aad1-6333-4ddd-92c2-f6205081df91 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:15.453002 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 72/129] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:15 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1365 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:15.457604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a01fee35-efb7-4c42-b7eb-b47e1c472732 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:15.458208 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a01fee35-efb7-4c42-b7eb-b47e1c472732 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:15.464071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a01fee35-efb7-4c42-b7eb-b47e1c472732 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:15.464578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a01fee35-efb7-4c42-b7eb-b47e1c472732 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:15.465008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a01fee35-efb7-4c42-b7eb-b47e1c472732 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:15.465686 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a01fee35-efb7-4c42-b7eb-b47e1c472732 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:15.466133 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a01fee35-efb7-4c42-b7eb-b47e1c472732 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:15.466558 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a01fee35-efb7-4c42-b7eb-b47e1c472732 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:15.474367 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6ed2aad1-6333-4ddd-92c2-f6205081df91 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1361 microversion: 2.1 time: 0.260570 Aug 10 12:42:15.475032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 58/130] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:15 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1361 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:15.638313 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a01fee35-efb7-4c42-b7eb-b47e1c472732 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:15.646459 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a01fee35-efb7-4c42-b7eb-b47e1c472732 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1322 microversion: 2.1 time: 0.192326 Aug 10 12:42:15.647697 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 73/131] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:15 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:15.960735 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-45c35c1c-2fe5-4ae4-b071-faef89341a35 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:15.961351 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-45c35c1c-2fe5-4ae4-b071-faef89341a35 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:15.969728 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-45c35c1c-2fe5-4ae4-b071-faef89341a35 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:15.970235 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-45c35c1c-2fe5-4ae4-b071-faef89341a35 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:15.971060 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-45c35c1c-2fe5-4ae4-b071-faef89341a35 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:15.971426 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-45c35c1c-2fe5-4ae4-b071-faef89341a35 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:15.972218 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-45c35c1c-2fe5-4ae4-b071-faef89341a35 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:15.972462 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-45c35c1c-2fe5-4ae4-b071-faef89341a35 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:15.992621 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-490bf326-0b65-4fb7-b117-c6aabfe1947c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:15.993685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-490bf326-0b65-4fb7-b117-c6aabfe1947c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:16.012692 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-490bf326-0b65-4fb7-b117-c6aabfe1947c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:16.015667 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-490bf326-0b65-4fb7-b117-c6aabfe1947c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:16.017214 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-490bf326-0b65-4fb7-b117-c6aabfe1947c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:16.018419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-490bf326-0b65-4fb7-b117-c6aabfe1947c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:16.020825 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-490bf326-0b65-4fb7-b117-c6aabfe1947c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:16.023685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-490bf326-0b65-4fb7-b117-c6aabfe1947c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:16.234153 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-45c35c1c-2fe5-4ae4-b071-faef89341a35 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c598eb26614feaa0c31339b8135f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefe2d12cf334ecbad2001b327cb65e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:16.242595 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-45c35c1c-2fe5-4ae4-b071-faef89341a35 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 200 len: 1502 microversion: 2.1 time: 0.286748 Aug 10 12:42:16.249019 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-490bf326-0b65-4fb7-b117-c6aabfe1947c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:16.258946 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-490bf326-0b65-4fb7-b117-c6aabfe1947c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:16.260946 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-490bf326-0b65-4fb7-b117-c6aabfe1947c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:16.262221 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-490bf326-0b65-4fb7-b117-c6aabfe1947c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1406 microversion: 2.20 time: 0.279612 Aug 10 12:42:16.270734 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 59/132] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:15 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 1502 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:16.271963 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 74/133] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:42:15 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1406 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:42:16.474958 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e23c4f9c-5f2f-4f53-a4b3-84e05bbb28d5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:16.476797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e23c4f9c-5f2f-4f53-a4b3-84e05bbb28d5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:16.486736 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e23c4f9c-5f2f-4f53-a4b3-84e05bbb28d5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:16.487244 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e23c4f9c-5f2f-4f53-a4b3-84e05bbb28d5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:16.487674 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e23c4f9c-5f2f-4f53-a4b3-84e05bbb28d5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:16.488663 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e23c4f9c-5f2f-4f53-a4b3-84e05bbb28d5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:16.488970 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e23c4f9c-5f2f-4f53-a4b3-84e05bbb28d5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:16.489438 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e23c4f9c-5f2f-4f53-a4b3-84e05bbb28d5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:16.499847 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a93b22af-5274-46e7-8c92-f349a6613d0e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:16.502292 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a93b22af-5274-46e7-8c92-f349a6613d0e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:16.511053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a93b22af-5274-46e7-8c92-f349a6613d0e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:16.511771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a93b22af-5274-46e7-8c92-f349a6613d0e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:16.512366 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a93b22af-5274-46e7-8c92-f349a6613d0e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:16.513172 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a93b22af-5274-46e7-8c92-f349a6613d0e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:16.514469 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a93b22af-5274-46e7-8c92-f349a6613d0e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:16.514982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a93b22af-5274-46e7-8c92-f349a6613d0e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:16.742707 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e23c4f9c-5f2f-4f53-a4b3-84e05bbb28d5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:16.753716 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e23c4f9c-5f2f-4f53-a4b3-84e05bbb28d5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1365 microversion: 2.1 time: 0.283975 Aug 10 12:42:16.767385 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 60/134] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:16 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1365 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:16.779562 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [req-81b1b0a6-f089-44f3-bbbd-1dfd67149145 req-96f468ef-d474-4eec-8313-838a90f0b366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fad49521-8b28-4a9f-a4a0-88e41b5a1566", "name": "network-vif-plugged", "status": "completed", "tag": "63207b81-6588-46d1-8129-1070b16da6a5"}]} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:42:16.780374 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a93b22af-5274-46e7-8c92-f349a6613d0e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:16.789758 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-81b1b0a6-f089-44f3-bbbd-1dfd67149145 req-96f468ef-d474-4eec-8313-838a90f0b366 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:16.790479 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-81b1b0a6-f089-44f3-bbbd-1dfd67149145 req-96f468ef-d474-4eec-8313-838a90f0b366 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:16.791107 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-81b1b0a6-f089-44f3-bbbd-1dfd67149145 req-96f468ef-d474-4eec-8313-838a90f0b366 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:16.799296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a93b22af-5274-46e7-8c92-f349a6613d0e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1361 microversion: 2.1 time: 0.305877 Aug 10 12:42:16.800307 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 75/135] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:16 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1361 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:42:16.806505 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c4da4e77-cca9-478a-bc1c-8568fb8ee6fd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:16.807578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c4da4e77-cca9-478a-bc1c-8568fb8ee6fd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:16.815459 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4da4e77-cca9-478a-bc1c-8568fb8ee6fd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:16.815459 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4da4e77-cca9-478a-bc1c-8568fb8ee6fd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:16.815459 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4da4e77-cca9-478a-bc1c-8568fb8ee6fd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:16.816858 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4da4e77-cca9-478a-bc1c-8568fb8ee6fd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:16.818926 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4da4e77-cca9-478a-bc1c-8568fb8ee6fd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:16.819551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4da4e77-cca9-478a-bc1c-8568fb8ee6fd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:16.821258 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.compute.server_external_events [req-81b1b0a6-f089-44f3-bbbd-1dfd67149145 req-96f468ef-d474-4eec-8313-838a90f0b366 service nova] Creating event network-vif-plugged:63207b81-6588-46d1-8129-1070b16da6a5 for instance fad49521-8b28-4a9f-a4a0-88e41b5a1566 on hv-cinder-85199 Aug 10 12:42:16.824715 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:42:16.826828 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [req-81b1b0a6-f089-44f3-bbbd-1dfd67149145 req-96f468ef-d474-4eec-8313-838a90f0b366 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051016 Aug 10 12:42:16.827647 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 61/136] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:42:17.194617 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c4da4e77-cca9-478a-bc1c-8568fb8ee6fd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:17.205047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c4da4e77-cca9-478a-bc1c-8568fb8ee6fd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1322 microversion: 2.1 time: 0.402756 Aug 10 12:42:17.207101 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 76/137] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:16 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1322 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:17.288061 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-254a47de-8b8f-4eb1-a79f-f4868375c42d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:17.289552 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-254a47de-8b8f-4eb1-a79f-f4868375c42d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:17.300570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-254a47de-8b8f-4eb1-a79f-f4868375c42d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:17.301065 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-254a47de-8b8f-4eb1-a79f-f4868375c42d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:17.301632 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-254a47de-8b8f-4eb1-a79f-f4868375c42d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:17.302369 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-254a47de-8b8f-4eb1-a79f-f4868375c42d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:17.302820 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-254a47de-8b8f-4eb1-a79f-f4868375c42d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:17.303727 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-254a47de-8b8f-4eb1-a79f-f4868375c42d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:17.454254 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-254a47de-8b8f-4eb1-a79f-f4868375c42d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:17.463045 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-254a47de-8b8f-4eb1-a79f-f4868375c42d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:17.464902 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-254a47de-8b8f-4eb1-a79f-f4868375c42d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:17.465674 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-254a47de-8b8f-4eb1-a79f-f4868375c42d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1406 microversion: 2.20 time: 0.184864 Aug 10 12:42:17.466282 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 62/138] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:42:17 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:42:17.782196 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bbfda447-add5-4f52-b6a5-89be764c0766 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:17.782897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bbfda447-add5-4f52-b6a5-89be764c0766 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:17.797287 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bbfda447-add5-4f52-b6a5-89be764c0766 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:17.797877 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bbfda447-add5-4f52-b6a5-89be764c0766 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:17.798813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bbfda447-add5-4f52-b6a5-89be764c0766 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:17.805650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bbfda447-add5-4f52-b6a5-89be764c0766 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:17.805650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bbfda447-add5-4f52-b6a5-89be764c0766 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:17.805650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bbfda447-add5-4f52-b6a5-89be764c0766 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:17.825703 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5efcb941-ee73-4b49-82ff-9c8d530dc67a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:17.826319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5efcb941-ee73-4b49-82ff-9c8d530dc67a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:17.833449 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5efcb941-ee73-4b49-82ff-9c8d530dc67a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:17.833885 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5efcb941-ee73-4b49-82ff-9c8d530dc67a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:17.834277 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5efcb941-ee73-4b49-82ff-9c8d530dc67a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:17.834973 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5efcb941-ee73-4b49-82ff-9c8d530dc67a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:17.835451 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5efcb941-ee73-4b49-82ff-9c8d530dc67a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:17.835876 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5efcb941-ee73-4b49-82ff-9c8d530dc67a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:17.852768 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:42:18.046103 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-bbfda447-add5-4f52-b6a5-89be764c0766 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:18.052453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bbfda447-add5-4f52-b6a5-89be764c0766 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1365 microversion: 2.1 time: 0.273667 Aug 10 12:42:18.053888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 77/139] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:17 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1365 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:18.062403 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5efcb941-ee73-4b49-82ff-9c8d530dc67a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:18.072034 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5efcb941-ee73-4b49-82ff-9c8d530dc67a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1361 microversion: 2.1 time: 0.250087 Aug 10 12:42:18.072661 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 63/140] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:17 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1361 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:42:18.099326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b276238a-4385-45e5-aec5-9d4f530fb3de tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0062cd78-eeeb-456e-9604-4bce3e214ba5"}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:42:18.101791 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b276238a-4385-45e5-aec5-9d4f530fb3de tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:18.111442 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b276238a-4385-45e5-aec5-9d4f530fb3de tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:18.111781 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b276238a-4385-45e5-aec5-9d4f530fb3de tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:18.112482 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b276238a-4385-45e5-aec5-9d4f530fb3de tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:18.113328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b276238a-4385-45e5-aec5-9d4f530fb3de tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:18.114572 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b276238a-4385-45e5-aec5-9d4f530fb3de tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:18.115278 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b276238a-4385-45e5-aec5-9d4f530fb3de tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:18.229466 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-36f5cd12-b547-4f0d-b938-6f1b46b2f3d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:18.230174 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-36f5cd12-b547-4f0d-b938-6f1b46b2f3d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:18.237831 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-36f5cd12-b547-4f0d-b938-6f1b46b2f3d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:18.237831 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-36f5cd12-b547-4f0d-b938-6f1b46b2f3d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:18.239663 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-36f5cd12-b547-4f0d-b938-6f1b46b2f3d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:18.240931 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-36f5cd12-b547-4f0d-b938-6f1b46b2f3d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:18.241028 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-36f5cd12-b547-4f0d-b938-6f1b46b2f3d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:18.241380 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-36f5cd12-b547-4f0d-b938-6f1b46b2f3d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:18.411472 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-36f5cd12-b547-4f0d-b938-6f1b46b2f3d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:18.419111 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-36f5cd12-b547-4f0d-b938-6f1b46b2f3d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1516 microversion: 2.1 time: 0.193290 Aug 10 12:42:18.419942 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 64/141] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:18 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1516 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:18.447653 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2ccb949e-7e07-4c03-b6d8-0fc7d2a4ceff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:42:18.451031 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2ccb949e-7e07-4c03-b6d8-0fc7d2a4ceff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:18.458136 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2ccb949e-7e07-4c03-b6d8-0fc7d2a4ceff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:18.458877 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2ccb949e-7e07-4c03-b6d8-0fc7d2a4ceff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:18.459438 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2ccb949e-7e07-4c03-b6d8-0fc7d2a4ceff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:18.460201 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2ccb949e-7e07-4c03-b6d8-0fc7d2a4ceff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:18.460725 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2ccb949e-7e07-4c03-b6d8-0fc7d2a4ceff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:18.461206 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2ccb949e-7e07-4c03-b6d8-0fc7d2a4ceff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:18.529642 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.objects.instance [None req-2ccb949e-7e07-4c03-b6d8-0fc7d2a4ceff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lazy-loading 'flavor' on Instance uuid e5bd9766-6096-4847-bb63-d90b985902f9 {{(pid=124642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:42:18.935451 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2ccb949e-7e07-4c03-b6d8-0fc7d2a4ceff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "POST /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9/action" status: 200 len: 32 microversion: 2.1 time: 0.492601 Aug 10 12:42:18.936217 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 65/142] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 10 12:42:18 2022] POST /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9/action => generated 32 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 12:42:18.944241 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-318d1c83-d533-44f3-b50e-c9b93820507e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:18.945092 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-318d1c83-d533-44f3-b50e-c9b93820507e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:18.951320 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-318d1c83-d533-44f3-b50e-c9b93820507e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:18.951813 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-318d1c83-d533-44f3-b50e-c9b93820507e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:18.952747 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-318d1c83-d533-44f3-b50e-c9b93820507e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:18.952909 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-318d1c83-d533-44f3-b50e-c9b93820507e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:18.953335 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-318d1c83-d533-44f3-b50e-c9b93820507e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:18.953757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-318d1c83-d533-44f3-b50e-c9b93820507e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:19.108947 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-318d1c83-d533-44f3-b50e-c9b93820507e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:19.118804 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-318d1c83-d533-44f3-b50e-c9b93820507e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:19.120361 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-318d1c83-d533-44f3-b50e-c9b93820507e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:19.121522 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-318d1c83-d533-44f3-b50e-c9b93820507e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1598 microversion: 2.20 time: 0.184305 Aug 10 12:42:19.122086 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 66/143] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:42:18 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1598 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:42:19.139337 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [req-99268816-27a8-43ee-af7f-f968b5ad42bc req-26a54d97-951c-4172-9d52-b5e7c3fa4b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88f016f1-19e1-466c-9e03-5a125f281e25", "name": "network-vif-plugged", "status": "completed", "tag": "d9a14494-c057-4e68-b287-dbdca61760ac"}]} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:42:19.151600 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-99268816-27a8-43ee-af7f-f968b5ad42bc req-26a54d97-951c-4172-9d52-b5e7c3fa4b11 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:19.152251 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-99268816-27a8-43ee-af7f-f968b5ad42bc req-26a54d97-951c-4172-9d52-b5e7c3fa4b11 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:19.152876 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-99268816-27a8-43ee-af7f-f968b5ad42bc req-26a54d97-951c-4172-9d52-b5e7c3fa4b11 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:19.168255 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.compute.server_external_events [req-99268816-27a8-43ee-af7f-f968b5ad42bc req-26a54d97-951c-4172-9d52-b5e7c3fa4b11 service nova] Creating event network-vif-plugged:d9a14494-c057-4e68-b287-dbdca61760ac for instance 88f016f1-19e1-466c-9e03-5a125f281e25 on hv-cinder-85199 Aug 10 12:42:19.171854 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [req-99268816-27a8-43ee-af7f-f968b5ad42bc req-26a54d97-951c-4172-9d52-b5e7c3fa4b11 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048496 Aug 10 12:42:19.172691 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 67/144] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:42:19.179160 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-33b5db38-6e59-4b4a-ad01-3eec60da2e5f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:19.179887 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-33b5db38-6e59-4b4a-ad01-3eec60da2e5f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:19.186321 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-33b5db38-6e59-4b4a-ad01-3eec60da2e5f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:19.186801 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-33b5db38-6e59-4b4a-ad01-3eec60da2e5f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:19.187311 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-33b5db38-6e59-4b4a-ad01-3eec60da2e5f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:19.187954 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-33b5db38-6e59-4b4a-ad01-3eec60da2e5f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:19.188404 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-33b5db38-6e59-4b4a-ad01-3eec60da2e5f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:19.188826 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-33b5db38-6e59-4b4a-ad01-3eec60da2e5f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:19.325966 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-33b5db38-6e59-4b4a-ad01-3eec60da2e5f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:19.334047 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-33b5db38-6e59-4b4a-ad01-3eec60da2e5f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.160186 Aug 10 12:42:19.334707 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 68/145] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:19 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:19.339417 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-20a12781-81bf-4579-b35b-4e8d418998e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:19.340022 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-20a12781-81bf-4579-b35b-4e8d418998e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:19.352807 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20a12781-81bf-4579-b35b-4e8d418998e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:19.353297 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20a12781-81bf-4579-b35b-4e8d418998e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:19.353747 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20a12781-81bf-4579-b35b-4e8d418998e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:19.354417 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20a12781-81bf-4579-b35b-4e8d418998e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:19.354952 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20a12781-81bf-4579-b35b-4e8d418998e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:19.355471 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20a12781-81bf-4579-b35b-4e8d418998e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:19.493791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-20a12781-81bf-4579-b35b-4e8d418998e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:19.504600 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-20a12781-81bf-4579-b35b-4e8d418998e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1365 microversion: 2.1 time: 0.165526 Aug 10 12:42:19.504600 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 69/146] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:19 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:19.506797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2973c1b4-661c-4e14-b71a-2f83c7858e71 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:19.507419 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2973c1b4-661c-4e14-b71a-2f83c7858e71 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:19.513426 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2973c1b4-661c-4e14-b71a-2f83c7858e71 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:19.514056 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2973c1b4-661c-4e14-b71a-2f83c7858e71 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:19.514478 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2973c1b4-661c-4e14-b71a-2f83c7858e71 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:19.515337 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2973c1b4-661c-4e14-b71a-2f83c7858e71 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:19.515785 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2973c1b4-661c-4e14-b71a-2f83c7858e71 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:19.516199 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2973c1b4-661c-4e14-b71a-2f83c7858e71 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:19.651682 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2973c1b4-661c-4e14-b71a-2f83c7858e71 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:19.659339 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2973c1b4-661c-4e14-b71a-2f83c7858e71 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1361 microversion: 2.1 time: 0.156547 Aug 10 12:42:19.659906 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 70/147] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:19 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:19.673719 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-deab79a9-67e1-4e79-94d0-d611734631a3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:19.674201 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-deab79a9-67e1-4e79-94d0-d611734631a3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:19.680392 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-deab79a9-67e1-4e79-94d0-d611734631a3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:19.680920 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-deab79a9-67e1-4e79-94d0-d611734631a3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:19.681406 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-deab79a9-67e1-4e79-94d0-d611734631a3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:19.682090 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-deab79a9-67e1-4e79-94d0-d611734631a3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:19.682533 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-deab79a9-67e1-4e79-94d0-d611734631a3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:19.682946 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-deab79a9-67e1-4e79-94d0-d611734631a3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:19.759515 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-deab79a9-67e1-4e79-94d0-d611734631a3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.098528 Aug 10 12:42:19.760120 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 71/148] 10.222.0.49 () {60 vars in 1316 bytes} [Wed Aug 10 12:42:19 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:42:20.355141 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-cf686493-5cf0-469e-99aa-be200a5d56b2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:20.355924 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-cf686493-5cf0-469e-99aa-be200a5d56b2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:20.362725 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf686493-5cf0-469e-99aa-be200a5d56b2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:20.363242 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf686493-5cf0-469e-99aa-be200a5d56b2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:20.363675 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf686493-5cf0-469e-99aa-be200a5d56b2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:20.365223 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf686493-5cf0-469e-99aa-be200a5d56b2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:20.365713 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf686493-5cf0-469e-99aa-be200a5d56b2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:20.366210 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf686493-5cf0-469e-99aa-be200a5d56b2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:20.504135 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-cf686493-5cf0-469e-99aa-be200a5d56b2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:20.512222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-cf686493-5cf0-469e-99aa-be200a5d56b2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.161394 Aug 10 12:42:20.513230 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 72/149] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:20 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:42:20.530340 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a69ae8ac-10ff-4219-af2f-63918a27f6b0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:20.530949 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a69ae8ac-10ff-4219-af2f-63918a27f6b0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:20.537713 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a69ae8ac-10ff-4219-af2f-63918a27f6b0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:20.538398 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a69ae8ac-10ff-4219-af2f-63918a27f6b0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:20.538984 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a69ae8ac-10ff-4219-af2f-63918a27f6b0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:20.539876 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a69ae8ac-10ff-4219-af2f-63918a27f6b0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:20.540325 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a69ae8ac-10ff-4219-af2f-63918a27f6b0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:20.547043 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a69ae8ac-10ff-4219-af2f-63918a27f6b0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:20.675334 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a69ae8ac-10ff-4219-af2f-63918a27f6b0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:20.683417 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a69ae8ac-10ff-4219-af2f-63918a27f6b0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1365 microversion: 2.1 time: 0.156832 Aug 10 12:42:20.683985 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 73/150] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:20 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:20.688480 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1c8621e0-d4f7-43ee-992e-0f9d7ec36cdb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:20.689078 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1c8621e0-d4f7-43ee-992e-0f9d7ec36cdb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:20.695273 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c8621e0-d4f7-43ee-992e-0f9d7ec36cdb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:20.695750 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c8621e0-d4f7-43ee-992e-0f9d7ec36cdb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:20.696176 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c8621e0-d4f7-43ee-992e-0f9d7ec36cdb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:20.696855 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c8621e0-d4f7-43ee-992e-0f9d7ec36cdb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:20.697297 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c8621e0-d4f7-43ee-992e-0f9d7ec36cdb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:20.697757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c8621e0-d4f7-43ee-992e-0f9d7ec36cdb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:20.856670 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-1c8621e0-d4f7-43ee-992e-0f9d7ec36cdb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:20.866553 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1c8621e0-d4f7-43ee-992e-0f9d7ec36cdb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1361 microversion: 2.1 time: 0.181541 Aug 10 12:42:20.867123 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 74/151] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:20 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:21.233543 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [req-0739a0c4-2896-4231-88b4-62b975c758e8 req-250480a8-f466-489e-bb66-362830d72c01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "572a91d2-8a56-4616-97e4-b0d48cc57ea5", "tag": "5bdde102-3780-4fb4-a112-3f9af85f6b61"}]} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:42:21.254381 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-0739a0c4-2896-4231-88b4-62b975c758e8 req-250480a8-f466-489e-bb66-362830d72c01 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:21.254381 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-0739a0c4-2896-4231-88b4-62b975c758e8 req-250480a8-f466-489e-bb66-362830d72c01 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:21.254381 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-0739a0c4-2896-4231-88b4-62b975c758e8 req-250480a8-f466-489e-bb66-362830d72c01 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:21.276883 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.compute.server_external_events [req-0739a0c4-2896-4231-88b4-62b975c758e8 req-250480a8-f466-489e-bb66-362830d72c01 service nova] Creating event network-changed:5bdde102-3780-4fb4-a112-3f9af85f6b61 for instance 572a91d2-8a56-4616-97e4-b0d48cc57ea5 on hv-cinder-85199 Aug 10 12:42:21.282108 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [req-0739a0c4-2896-4231-88b4-62b975c758e8 req-250480a8-f466-489e-bb66-362830d72c01 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052287 Aug 10 12:42:21.282883 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 75/152] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:42:21.533494 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7d62b6bc-9722-43a3-b9fb-e1f571cfb559 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:21.534301 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7d62b6bc-9722-43a3-b9fb-e1f571cfb559 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:21.541162 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7d62b6bc-9722-43a3-b9fb-e1f571cfb559 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:21.541684 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7d62b6bc-9722-43a3-b9fb-e1f571cfb559 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:21.542114 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7d62b6bc-9722-43a3-b9fb-e1f571cfb559 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:21.542818 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7d62b6bc-9722-43a3-b9fb-e1f571cfb559 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:21.543294 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7d62b6bc-9722-43a3-b9fb-e1f571cfb559 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:21.543714 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7d62b6bc-9722-43a3-b9fb-e1f571cfb559 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:21.688861 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-7d62b6bc-9722-43a3-b9fb-e1f571cfb559 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:21.700875 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7d62b6bc-9722-43a3-b9fb-e1f571cfb559 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.167621 Aug 10 12:42:21.700875 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 76/153] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:21 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:42:21.714302 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f3ea359a-b51d-448d-abb2-3f85dac87917 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:21.714918 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f3ea359a-b51d-448d-abb2-3f85dac87917 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:21.720885 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f3ea359a-b51d-448d-abb2-3f85dac87917 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:21.721367 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f3ea359a-b51d-448d-abb2-3f85dac87917 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:21.726321 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f3ea359a-b51d-448d-abb2-3f85dac87917 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:21.727077 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f3ea359a-b51d-448d-abb2-3f85dac87917 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:21.727570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f3ea359a-b51d-448d-abb2-3f85dac87917 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:21.727998 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f3ea359a-b51d-448d-abb2-3f85dac87917 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:21.862829 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f3ea359a-b51d-448d-abb2-3f85dac87917 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:21.873433 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f3ea359a-b51d-448d-abb2-3f85dac87917 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1365 microversion: 2.1 time: 0.172551 Aug 10 12:42:21.874032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 77/154] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:21 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:42:21.887835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a4cf6120-74a1-4437-8775-e0c7660dce6c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:21.888447 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a4cf6120-74a1-4437-8775-e0c7660dce6c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:21.894439 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a4cf6120-74a1-4437-8775-e0c7660dce6c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:21.894918 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a4cf6120-74a1-4437-8775-e0c7660dce6c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:21.895418 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a4cf6120-74a1-4437-8775-e0c7660dce6c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:21.896249 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a4cf6120-74a1-4437-8775-e0c7660dce6c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:21.896902 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a4cf6120-74a1-4437-8775-e0c7660dce6c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:21.897259 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a4cf6120-74a1-4437-8775-e0c7660dce6c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:22.038835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a4cf6120-74a1-4437-8775-e0c7660dce6c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:22.046830 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a4cf6120-74a1-4437-8775-e0c7660dce6c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1361 microversion: 2.1 time: 0.162971 Aug 10 12:42:22.047422 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 78/155] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:21 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:42:22.717925 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e6a69e0f-d8dc-447e-ac37-0efb21dfda1f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:22.718598 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e6a69e0f-d8dc-447e-ac37-0efb21dfda1f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:22.724752 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e6a69e0f-d8dc-447e-ac37-0efb21dfda1f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:22.725227 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e6a69e0f-d8dc-447e-ac37-0efb21dfda1f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:22.725653 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e6a69e0f-d8dc-447e-ac37-0efb21dfda1f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:22.726334 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e6a69e0f-d8dc-447e-ac37-0efb21dfda1f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:22.726779 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e6a69e0f-d8dc-447e-ac37-0efb21dfda1f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:22.727222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e6a69e0f-d8dc-447e-ac37-0efb21dfda1f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:22.854881 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e6a69e0f-d8dc-447e-ac37-0efb21dfda1f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:22.857267 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:42:22.863518 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e6a69e0f-d8dc-447e-ac37-0efb21dfda1f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.149452 Aug 10 12:42:22.864116 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 79/156] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:22 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:42:22.899113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-860dff11-3ebe-40bd-8031-05cf452cf36a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:22.899744 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-860dff11-3ebe-40bd-8031-05cf452cf36a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:22.906021 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-860dff11-3ebe-40bd-8031-05cf452cf36a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:22.906492 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-860dff11-3ebe-40bd-8031-05cf452cf36a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:22.906915 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-860dff11-3ebe-40bd-8031-05cf452cf36a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:22.907616 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-860dff11-3ebe-40bd-8031-05cf452cf36a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:22.908057 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-860dff11-3ebe-40bd-8031-05cf452cf36a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:22.908470 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-860dff11-3ebe-40bd-8031-05cf452cf36a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:23.049496 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-860dff11-3ebe-40bd-8031-05cf452cf36a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:23.057962 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-860dff11-3ebe-40bd-8031-05cf452cf36a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1365 microversion: 2.1 time: 0.164406 Aug 10 12:42:23.058517 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 80/157] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:22 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:42:23.068013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5a4f2afb-effe-4e3a-964f-0a61490ef5a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:23.068976 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5a4f2afb-effe-4e3a-964f-0a61490ef5a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:23.076254 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a4f2afb-effe-4e3a-964f-0a61490ef5a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:23.077207 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a4f2afb-effe-4e3a-964f-0a61490ef5a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:23.077774 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a4f2afb-effe-4e3a-964f-0a61490ef5a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:23.078849 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a4f2afb-effe-4e3a-964f-0a61490ef5a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:23.079452 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a4f2afb-effe-4e3a-964f-0a61490ef5a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:23.079871 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a4f2afb-effe-4e3a-964f-0a61490ef5a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:23.211230 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5a4f2afb-effe-4e3a-964f-0a61490ef5a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:23.218716 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5a4f2afb-effe-4e3a-964f-0a61490ef5a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1361 microversion: 2.1 time: 0.154895 Aug 10 12:42:23.219305 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 81/158] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:23 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:42:23.884599 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-85009430-e99a-40f7-b4b3-ee7c7c122bd8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:23.885266 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-85009430-e99a-40f7-b4b3-ee7c7c122bd8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:23.891059 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-85009430-e99a-40f7-b4b3-ee7c7c122bd8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:23.891570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-85009430-e99a-40f7-b4b3-ee7c7c122bd8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:23.892017 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-85009430-e99a-40f7-b4b3-ee7c7c122bd8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:23.892686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-85009430-e99a-40f7-b4b3-ee7c7c122bd8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:23.893152 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-85009430-e99a-40f7-b4b3-ee7c7c122bd8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:23.893564 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-85009430-e99a-40f7-b4b3-ee7c7c122bd8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:24.048954 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-85009430-e99a-40f7-b4b3-ee7c7c122bd8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:24.057159 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-85009430-e99a-40f7-b4b3-ee7c7c122bd8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.176659 Aug 10 12:42:24.065416 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 82/159] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:23 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:42:24.079137 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6076fdeb-2fdd-4e6c-bdb4-d73cbc821015 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:24.079777 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6076fdeb-2fdd-4e6c-bdb4-d73cbc821015 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:24.090302 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6076fdeb-2fdd-4e6c-bdb4-d73cbc821015 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:24.092609 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6076fdeb-2fdd-4e6c-bdb4-d73cbc821015 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:24.092609 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6076fdeb-2fdd-4e6c-bdb4-d73cbc821015 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:24.092609 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6076fdeb-2fdd-4e6c-bdb4-d73cbc821015 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:24.092609 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6076fdeb-2fdd-4e6c-bdb4-d73cbc821015 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:24.096359 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6076fdeb-2fdd-4e6c-bdb4-d73cbc821015 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:24.251609 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6076fdeb-2fdd-4e6c-bdb4-d73cbc821015 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:24.259683 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6076fdeb-2fdd-4e6c-bdb4-d73cbc821015 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1365 microversion: 2.1 time: 0.184211 Aug 10 12:42:24.260281 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 83/160] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:24 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:42:24.267005 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5ced652d-1ad0-4020-a743-500001fa0e9d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:24.267005 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5ced652d-1ad0-4020-a743-500001fa0e9d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:24.271452 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5ced652d-1ad0-4020-a743-500001fa0e9d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:24.272002 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5ced652d-1ad0-4020-a743-500001fa0e9d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:24.272436 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5ced652d-1ad0-4020-a743-500001fa0e9d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:24.273138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5ced652d-1ad0-4020-a743-500001fa0e9d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:24.273572 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5ced652d-1ad0-4020-a743-500001fa0e9d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:24.273988 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5ced652d-1ad0-4020-a743-500001fa0e9d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:24.408914 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5ced652d-1ad0-4020-a743-500001fa0e9d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:24.417027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5ced652d-1ad0-4020-a743-500001fa0e9d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1361 microversion: 2.1 time: 0.155704 Aug 10 12:42:24.417600 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 84/161] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:24 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:24.665913 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b276238a-4385-45e5-aec5-9d4f530fb3de tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "POST /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.570964 Aug 10 12:42:24.671515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 78/162] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 10 12:42:18 2022] POST /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422/os-volume_attachments => generated 194 bytes in 6573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:42:25.080380 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bc7a67fe-c067-4cf3-a60c-8cf0e0a6bde3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:25.081415 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bc7a67fe-c067-4cf3-a60c-8cf0e0a6bde3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:25.088747 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc7a67fe-c067-4cf3-a60c-8cf0e0a6bde3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:25.089232 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc7a67fe-c067-4cf3-a60c-8cf0e0a6bde3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:25.089661 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc7a67fe-c067-4cf3-a60c-8cf0e0a6bde3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:25.091808 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc7a67fe-c067-4cf3-a60c-8cf0e0a6bde3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:25.092339 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc7a67fe-c067-4cf3-a60c-8cf0e0a6bde3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:25.092915 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc7a67fe-c067-4cf3-a60c-8cf0e0a6bde3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:25.249483 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-bc7a67fe-c067-4cf3-a60c-8cf0e0a6bde3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:25.257664 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bc7a67fe-c067-4cf3-a60c-8cf0e0a6bde3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.181971 Aug 10 12:42:25.258244 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 85/163] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:25 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:25.284283 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-abd0ef55-ed29-4b47-a38e-6809483e4b68 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:25.285107 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-abd0ef55-ed29-4b47-a38e-6809483e4b68 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:25.301109 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abd0ef55-ed29-4b47-a38e-6809483e4b68 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:25.303050 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abd0ef55-ed29-4b47-a38e-6809483e4b68 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:25.303708 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abd0ef55-ed29-4b47-a38e-6809483e4b68 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:25.311607 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abd0ef55-ed29-4b47-a38e-6809483e4b68 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:25.312172 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abd0ef55-ed29-4b47-a38e-6809483e4b68 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:25.312734 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abd0ef55-ed29-4b47-a38e-6809483e4b68 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:25.437949 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c471c0f7-8e84-4885-bf02-2c381a187079 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:25.438474 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c471c0f7-8e84-4885-bf02-2c381a187079 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:25.444425 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c471c0f7-8e84-4885-bf02-2c381a187079 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:25.446835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c471c0f7-8e84-4885-bf02-2c381a187079 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:25.446835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c471c0f7-8e84-4885-bf02-2c381a187079 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:25.446835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c471c0f7-8e84-4885-bf02-2c381a187079 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:25.446835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c471c0f7-8e84-4885-bf02-2c381a187079 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:25.447164 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c471c0f7-8e84-4885-bf02-2c381a187079 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:25.454079 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-abd0ef55-ed29-4b47-a38e-6809483e4b68 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:25.461930 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-abd0ef55-ed29-4b47-a38e-6809483e4b68 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1365 microversion: 2.1 time: 0.185033 Aug 10 12:42:25.462504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 79/164] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:25 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:25.581547 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c471c0f7-8e84-4885-bf02-2c381a187079 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:25.589187 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c471c0f7-8e84-4885-bf02-2c381a187079 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1361 microversion: 2.1 time: 0.155239 Aug 10 12:42:25.589756 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 86/165] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:25 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:42:26.281023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2c057911-f643-4d49-ab42-f6325083feb2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:26.282246 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2c057911-f643-4d49-ab42-f6325083feb2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:26.289839 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c057911-f643-4d49-ab42-f6325083feb2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:26.290319 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c057911-f643-4d49-ab42-f6325083feb2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:26.290754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c057911-f643-4d49-ab42-f6325083feb2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:26.291479 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c057911-f643-4d49-ab42-f6325083feb2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:26.291931 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c057911-f643-4d49-ab42-f6325083feb2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:26.292355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c057911-f643-4d49-ab42-f6325083feb2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:26.429367 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2c057911-f643-4d49-ab42-f6325083feb2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:26.437714 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2c057911-f643-4d49-ab42-f6325083feb2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.161952 Aug 10 12:42:26.449426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 80/166] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:26 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:26.486398 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-80f752ba-fbd6-4b55-8e0f-cf16982f3b9b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:26.487710 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-80f752ba-fbd6-4b55-8e0f-cf16982f3b9b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:26.495365 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-80f752ba-fbd6-4b55-8e0f-cf16982f3b9b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:26.496077 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-80f752ba-fbd6-4b55-8e0f-cf16982f3b9b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:26.496662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-80f752ba-fbd6-4b55-8e0f-cf16982f3b9b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:26.497362 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-80f752ba-fbd6-4b55-8e0f-cf16982f3b9b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:26.498175 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-80f752ba-fbd6-4b55-8e0f-cf16982f3b9b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:26.498610 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-80f752ba-fbd6-4b55-8e0f-cf16982f3b9b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:26.610229 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4bc05190-f5ef-4925-8eef-c1b6e71c38f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:26.618004 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4bc05190-f5ef-4925-8eef-c1b6e71c38f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:26.624484 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4bc05190-f5ef-4925-8eef-c1b6e71c38f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:26.626055 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4bc05190-f5ef-4925-8eef-c1b6e71c38f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:26.626055 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4bc05190-f5ef-4925-8eef-c1b6e71c38f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:26.626983 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4bc05190-f5ef-4925-8eef-c1b6e71c38f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:26.627687 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4bc05190-f5ef-4925-8eef-c1b6e71c38f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:26.628298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4bc05190-f5ef-4925-8eef-c1b6e71c38f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:26.662574 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-80f752ba-fbd6-4b55-8e0f-cf16982f3b9b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:26.672455 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-80f752ba-fbd6-4b55-8e0f-cf16982f3b9b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1554 microversion: 2.1 time: 0.192647 Aug 10 12:42:26.687673 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 87/167] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:26 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1554 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:26.705132 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-78e32f2e-6d41-4bd7-a267-b97756b88b77 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:26.706336 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-78e32f2e-6d41-4bd7-a267-b97756b88b77 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:26.714651 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-78e32f2e-6d41-4bd7-a267-b97756b88b77 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:26.715424 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-78e32f2e-6d41-4bd7-a267-b97756b88b77 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:26.716043 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-78e32f2e-6d41-4bd7-a267-b97756b88b77 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:26.716915 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-78e32f2e-6d41-4bd7-a267-b97756b88b77 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:26.717551 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-78e32f2e-6d41-4bd7-a267-b97756b88b77 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:26.718125 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-78e32f2e-6d41-4bd7-a267-b97756b88b77 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:26.816998 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-78e32f2e-6d41-4bd7-a267-b97756b88b77 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.121589 Aug 10 12:42:26.818194 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 88/168] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 10 12:42:26 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:42:27.113487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4bc05190-f5ef-4925-8eef-c1b6e71c38f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:27.122149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4bc05190-f5ef-4925-8eef-c1b6e71c38f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1361 microversion: 2.1 time: 0.516062 Aug 10 12:42:27.122648 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 81/169] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:26 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1361 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:42:27.461683 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-39e22f8b-ddec-45d4-972e-6c2cadfe21f7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:27.462290 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-39e22f8b-ddec-45d4-972e-6c2cadfe21f7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:27.468317 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-39e22f8b-ddec-45d4-972e-6c2cadfe21f7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:27.468791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-39e22f8b-ddec-45d4-972e-6c2cadfe21f7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:27.469408 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-39e22f8b-ddec-45d4-972e-6c2cadfe21f7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:27.470091 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-39e22f8b-ddec-45d4-972e-6c2cadfe21f7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:27.470537 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-39e22f8b-ddec-45d4-972e-6c2cadfe21f7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:27.470955 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-39e22f8b-ddec-45d4-972e-6c2cadfe21f7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:27.787807 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-39e22f8b-ddec-45d4-972e-6c2cadfe21f7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:27.794278 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-39e22f8b-ddec-45d4-972e-6c2cadfe21f7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.337532 Aug 10 12:42:27.795062 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 89/170] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:27 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:28.143083 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-99855e66-1111-4c79-80b3-1c52f4984dd2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:28.143949 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-99855e66-1111-4c79-80b3-1c52f4984dd2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:28.153814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99855e66-1111-4c79-80b3-1c52f4984dd2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:28.159837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99855e66-1111-4c79-80b3-1c52f4984dd2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:28.159837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99855e66-1111-4c79-80b3-1c52f4984dd2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:28.159837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99855e66-1111-4c79-80b3-1c52f4984dd2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:28.159837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99855e66-1111-4c79-80b3-1c52f4984dd2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:28.160292 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99855e66-1111-4c79-80b3-1c52f4984dd2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:28.354671 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-99855e66-1111-4c79-80b3-1c52f4984dd2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:28.362616 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-99855e66-1111-4c79-80b3-1c52f4984dd2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1546 microversion: 2.1 time: 0.223761 Aug 10 12:42:28.375200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 82/171] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:28 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1546 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:28.386509 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2996f9ba-8d0d-4171-91fa-38f6433cd858 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:28.387002 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2996f9ba-8d0d-4171-91fa-38f6433cd858 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:28.393277 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2996f9ba-8d0d-4171-91fa-38f6433cd858 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:28.393847 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2996f9ba-8d0d-4171-91fa-38f6433cd858 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:28.394333 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2996f9ba-8d0d-4171-91fa-38f6433cd858 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:28.395064 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2996f9ba-8d0d-4171-91fa-38f6433cd858 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:28.401857 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2996f9ba-8d0d-4171-91fa-38f6433cd858 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:28.401857 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2996f9ba-8d0d-4171-91fa-38f6433cd858 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:28.640131 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2996f9ba-8d0d-4171-91fa-38f6433cd858 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.257752 Aug 10 12:42:28.640808 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 90/172] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 10 12:42:28 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-interface => generated 284 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:42:28.775910 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-e6317550-1399-410b-8966-ef66d0b6e4cb req-04e92def-9e9c-41ae-b95f-3858f195d641 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fad49521-8b28-4a9f-a4a0-88e41b5a1566", "tag": "63207b81-6588-46d1-8129-1070b16da6a5"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:42:28.788812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-e6317550-1399-410b-8966-ef66d0b6e4cb req-04e92def-9e9c-41ae-b95f-3858f195d641 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:28.788812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-e6317550-1399-410b-8966-ef66d0b6e4cb req-04e92def-9e9c-41ae-b95f-3858f195d641 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:28.788812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-e6317550-1399-410b-8966-ef66d0b6e4cb req-04e92def-9e9c-41ae-b95f-3858f195d641 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:28.807019 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-e6317550-1399-410b-8966-ef66d0b6e4cb req-04e92def-9e9c-41ae-b95f-3858f195d641 service nova] Creating event network-changed:63207b81-6588-46d1-8129-1070b16da6a5 for instance fad49521-8b28-4a9f-a4a0-88e41b5a1566 on hv-cinder-85199 Aug 10 12:42:28.812638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-e6317550-1399-410b-8966-ef66d0b6e4cb req-04e92def-9e9c-41ae-b95f-3858f195d641 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040194 Aug 10 12:42:28.818004 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 83/173] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:42:28.819940 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0393e713-a48b-4052-af1c-cd1819fe132d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:28.820615 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0393e713-a48b-4052-af1c-cd1819fe132d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:28.830709 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0393e713-a48b-4052-af1c-cd1819fe132d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:28.834472 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0393e713-a48b-4052-af1c-cd1819fe132d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:28.836655 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0393e713-a48b-4052-af1c-cd1819fe132d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:28.839081 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0393e713-a48b-4052-af1c-cd1819fe132d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:28.841721 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0393e713-a48b-4052-af1c-cd1819fe132d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:28.842554 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0393e713-a48b-4052-af1c-cd1819fe132d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:29.172582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0393e713-a48b-4052-af1c-cd1819fe132d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:29.180884 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0393e713-a48b-4052-af1c-cd1819fe132d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.368268 Aug 10 12:42:29.181760 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 91/174] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:28 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:30.203640 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-be2b9d86-fab0-4ed4-996c-7f7608c519e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:30.204341 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-be2b9d86-fab0-4ed4-996c-7f7608c519e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:30.212143 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be2b9d86-fab0-4ed4-996c-7f7608c519e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:30.212625 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be2b9d86-fab0-4ed4-996c-7f7608c519e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:30.213053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be2b9d86-fab0-4ed4-996c-7f7608c519e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:30.213751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be2b9d86-fab0-4ed4-996c-7f7608c519e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:30.214197 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be2b9d86-fab0-4ed4-996c-7f7608c519e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:30.214619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be2b9d86-fab0-4ed4-996c-7f7608c519e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:30.398551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-be2b9d86-fab0-4ed4-996c-7f7608c519e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:30.407392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-be2b9d86-fab0-4ed4-996c-7f7608c519e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.209076 Aug 10 12:42:30.412968 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 84/175] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:30 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:30.829091 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [req-68eee36b-389d-401a-9266-38e5be82e201 req-555ecd6e-8af2-4196-9d36-7c6f917e31e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88f016f1-19e1-466c-9e03-5a125f281e25", "tag": "d9a14494-c057-4e68-b287-dbdca61760ac"}]} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:42:30.840512 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-68eee36b-389d-401a-9266-38e5be82e201 req-555ecd6e-8af2-4196-9d36-7c6f917e31e1 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:30.840984 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-68eee36b-389d-401a-9266-38e5be82e201 req-555ecd6e-8af2-4196-9d36-7c6f917e31e1 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:30.841433 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-68eee36b-389d-401a-9266-38e5be82e201 req-555ecd6e-8af2-4196-9d36-7c6f917e31e1 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:30.852035 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.compute.server_external_events [req-68eee36b-389d-401a-9266-38e5be82e201 req-555ecd6e-8af2-4196-9d36-7c6f917e31e1 service nova] Creating event network-changed:d9a14494-c057-4e68-b287-dbdca61760ac for instance 88f016f1-19e1-466c-9e03-5a125f281e25 on hv-cinder-85199 Aug 10 12:42:30.858425 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [req-68eee36b-389d-401a-9266-38e5be82e201 req-555ecd6e-8af2-4196-9d36-7c6f917e31e1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033131 Aug 10 12:42:30.859406 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 92/176] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:42:31.432501 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-feb1b9a8-0ae4-4629-8e2a-fd36f939fa91 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:31.433027 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-feb1b9a8-0ae4-4629-8e2a-fd36f939fa91 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:31.436556 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=95 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:42:31.440229 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-feb1b9a8-0ae4-4629-8e2a-fd36f939fa91 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:31.445699 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-feb1b9a8-0ae4-4629-8e2a-fd36f939fa91 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:31.445699 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-feb1b9a8-0ae4-4629-8e2a-fd36f939fa91 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:31.445699 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-feb1b9a8-0ae4-4629-8e2a-fd36f939fa91 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:31.445699 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-feb1b9a8-0ae4-4629-8e2a-fd36f939fa91 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:31.446100 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-feb1b9a8-0ae4-4629-8e2a-fd36f939fa91 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:31.612004 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-feb1b9a8-0ae4-4629-8e2a-fd36f939fa91 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:31.619817 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-feb1b9a8-0ae4-4629-8e2a-fd36f939fa91 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.191217 Aug 10 12:42:31.620386 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 85/177] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:31 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:32.643007 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-eab7cfa5-38bf-494b-bff9-cf5be6f7d144 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:32.643895 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-eab7cfa5-38bf-494b-bff9-cf5be6f7d144 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:32.651338 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eab7cfa5-38bf-494b-bff9-cf5be6f7d144 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:32.651816 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eab7cfa5-38bf-494b-bff9-cf5be6f7d144 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:32.652245 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eab7cfa5-38bf-494b-bff9-cf5be6f7d144 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:32.652927 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eab7cfa5-38bf-494b-bff9-cf5be6f7d144 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:32.653362 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eab7cfa5-38bf-494b-bff9-cf5be6f7d144 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:32.653948 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eab7cfa5-38bf-494b-bff9-cf5be6f7d144 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:32.809419 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-eab7cfa5-38bf-494b-bff9-cf5be6f7d144 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:32.817938 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-eab7cfa5-38bf-494b-bff9-cf5be6f7d144 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.179574 Aug 10 12:42:32.821861 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 93/178] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:32 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:33.840527 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a842a57d-c4ab-4e77-9b3c-8f8333b7aeaa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:33.841133 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a842a57d-c4ab-4e77-9b3c-8f8333b7aeaa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:33.847430 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a842a57d-c4ab-4e77-9b3c-8f8333b7aeaa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:33.847908 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a842a57d-c4ab-4e77-9b3c-8f8333b7aeaa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:33.848332 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a842a57d-c4ab-4e77-9b3c-8f8333b7aeaa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:33.849009 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a842a57d-c4ab-4e77-9b3c-8f8333b7aeaa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:33.849452 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a842a57d-c4ab-4e77-9b3c-8f8333b7aeaa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:33.849863 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a842a57d-c4ab-4e77-9b3c-8f8333b7aeaa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:33.984070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a842a57d-c4ab-4e77-9b3c-8f8333b7aeaa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:33.992476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a842a57d-c4ab-4e77-9b3c-8f8333b7aeaa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.155823 Aug 10 12:42:33.993051 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 86/179] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:33 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:35.013268 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e204d0a9-f97f-4073-889b-4654d55b5fb7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:35.014057 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e204d0a9-f97f-4073-889b-4654d55b5fb7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:35.020605 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e204d0a9-f97f-4073-889b-4654d55b5fb7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:35.021718 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e204d0a9-f97f-4073-889b-4654d55b5fb7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:35.023490 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e204d0a9-f97f-4073-889b-4654d55b5fb7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:35.024233 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e204d0a9-f97f-4073-889b-4654d55b5fb7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:35.024760 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e204d0a9-f97f-4073-889b-4654d55b5fb7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:35.025256 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e204d0a9-f97f-4073-889b-4654d55b5fb7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:35.168291 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e204d0a9-f97f-4073-889b-4654d55b5fb7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:35.176566 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e204d0a9-f97f-4073-889b-4654d55b5fb7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.167691 Aug 10 12:42:35.177137 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 94/180] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:35 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:36.198543 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bc27ed03-81ff-4ec4-bfaa-975c0b55ff67 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:36.199188 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bc27ed03-81ff-4ec4-bfaa-975c0b55ff67 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:36.206531 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc27ed03-81ff-4ec4-bfaa-975c0b55ff67 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:36.207024 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc27ed03-81ff-4ec4-bfaa-975c0b55ff67 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:36.208325 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc27ed03-81ff-4ec4-bfaa-975c0b55ff67 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:36.208325 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc27ed03-81ff-4ec4-bfaa-975c0b55ff67 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:36.208803 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc27ed03-81ff-4ec4-bfaa-975c0b55ff67 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:36.209220 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc27ed03-81ff-4ec4-bfaa-975c0b55ff67 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:36.396149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-bc27ed03-81ff-4ec4-bfaa-975c0b55ff67 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:36.404543 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bc27ed03-81ff-4ec4-bfaa-975c0b55ff67 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.210184 Aug 10 12:42:36.405137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 87/181] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:36 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:37.427075 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-36501e0f-e768-4b08-8f93-bcfde888b975 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:37.427719 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-36501e0f-e768-4b08-8f93-bcfde888b975 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:37.434234 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-36501e0f-e768-4b08-8f93-bcfde888b975 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:37.436031 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-36501e0f-e768-4b08-8f93-bcfde888b975 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:37.436031 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-36501e0f-e768-4b08-8f93-bcfde888b975 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:37.436031 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-36501e0f-e768-4b08-8f93-bcfde888b975 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:37.436285 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-36501e0f-e768-4b08-8f93-bcfde888b975 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:37.436666 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-36501e0f-e768-4b08-8f93-bcfde888b975 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:37.573178 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-36501e0f-e768-4b08-8f93-bcfde888b975 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:37.580877 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-36501e0f-e768-4b08-8f93-bcfde888b975 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.157639 Aug 10 12:42:37.581592 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 95/182] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:37 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:38.602883 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d3f2dffc-84b3-43de-8840-939194b4f434 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:38.603520 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d3f2dffc-84b3-43de-8840-939194b4f434 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:38.610169 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d3f2dffc-84b3-43de-8840-939194b4f434 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:38.610934 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d3f2dffc-84b3-43de-8840-939194b4f434 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:38.611497 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d3f2dffc-84b3-43de-8840-939194b4f434 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:38.612377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d3f2dffc-84b3-43de-8840-939194b4f434 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:38.612838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d3f2dffc-84b3-43de-8840-939194b4f434 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:38.613264 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d3f2dffc-84b3-43de-8840-939194b4f434 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:38.781409 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d3f2dffc-84b3-43de-8840-939194b4f434 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:38.792040 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d3f2dffc-84b3-43de-8840-939194b4f434 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.194016 Aug 10 12:42:38.795022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 88/183] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:38 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:38.811872 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d64481e5-1ac1-4d11-8e16-8f93a6f44bce tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:38.812372 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d64481e5-1ac1-4d11-8e16-8f93a6f44bce tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:38.818116 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d64481e5-1ac1-4d11-8e16-8f93a6f44bce tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:38.818658 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d64481e5-1ac1-4d11-8e16-8f93a6f44bce tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:38.819092 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d64481e5-1ac1-4d11-8e16-8f93a6f44bce tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:38.820681 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d64481e5-1ac1-4d11-8e16-8f93a6f44bce tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:38.820681 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d64481e5-1ac1-4d11-8e16-8f93a6f44bce tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:38.820681 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d64481e5-1ac1-4d11-8e16-8f93a6f44bce tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:38.845177 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d64481e5-1ac1-4d11-8e16-8f93a6f44bce tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Going to try to terminate instance {{(pid=124642) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:42:38.880550 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:42:39.162149 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d64481e5-1ac1-4d11-8e16-8f93a6f44bce tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 204 len: 0 microversion: 2.1 time: 0.353687 Aug 10 12:42:39.164842 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 96/184] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 12:42:38 2022] DELETE /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 12:42:39.177043 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-378dede7-ec3c-4c49-ba6e-fe25bc3d2204 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:39.178071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-378dede7-ec3c-4c49-ba6e-fe25bc3d2204 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:39.185706 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-378dede7-ec3c-4c49-ba6e-fe25bc3d2204 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:39.186594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-378dede7-ec3c-4c49-ba6e-fe25bc3d2204 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:39.187375 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-378dede7-ec3c-4c49-ba6e-fe25bc3d2204 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:39.188546 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-378dede7-ec3c-4c49-ba6e-fe25bc3d2204 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:39.189414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-378dede7-ec3c-4c49-ba6e-fe25bc3d2204 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:39.190020 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-378dede7-ec3c-4c49-ba6e-fe25bc3d2204 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:39.349712 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-378dede7-ec3c-4c49-ba6e-fe25bc3d2204 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c598eb26614feaa0c31339b8135f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefe2d12cf334ecbad2001b327cb65e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:39.358786 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-378dede7-ec3c-4c49-ba6e-fe25bc3d2204 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 200 len: 1554 microversion: 2.1 time: 0.185483 Aug 10 12:42:39.359567 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 89/185] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:39 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 1554 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:39.813550 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d02e46df-d9b5-412a-b87c-44f7327dfa23 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:39.814245 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d02e46df-d9b5-412a-b87c-44f7327dfa23 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:39.820613 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d02e46df-d9b5-412a-b87c-44f7327dfa23 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:39.821724 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d02e46df-d9b5-412a-b87c-44f7327dfa23 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:39.822153 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d02e46df-d9b5-412a-b87c-44f7327dfa23 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:39.822836 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d02e46df-d9b5-412a-b87c-44f7327dfa23 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:39.823357 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d02e46df-d9b5-412a-b87c-44f7327dfa23 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:39.823773 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d02e46df-d9b5-412a-b87c-44f7327dfa23 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:39.957895 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d02e46df-d9b5-412a-b87c-44f7327dfa23 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:39.966024 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d02e46df-d9b5-412a-b87c-44f7327dfa23 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.156702 Aug 10 12:42:39.966559 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 97/186] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:39 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:40.381174 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-428da361-b8f9-4c34-8355-e3f4177fd96f tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:40.381778 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-428da361-b8f9-4c34-8355-e3f4177fd96f tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:40.389408 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-428da361-b8f9-4c34-8355-e3f4177fd96f tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:40.389882 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-428da361-b8f9-4c34-8355-e3f4177fd96f tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:40.390309 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-428da361-b8f9-4c34-8355-e3f4177fd96f tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:40.390981 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-428da361-b8f9-4c34-8355-e3f4177fd96f tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:40.391453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-428da361-b8f9-4c34-8355-e3f4177fd96f tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:40.391870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-428da361-b8f9-4c34-8355-e3f4177fd96f tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:40.525792 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-428da361-b8f9-4c34-8355-e3f4177fd96f tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c598eb26614feaa0c31339b8135f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefe2d12cf334ecbad2001b327cb65e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:40.536306 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-428da361-b8f9-4c34-8355-e3f4177fd96f tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 200 len: 1554 microversion: 2.1 time: 0.158862 Aug 10 12:42:40.536956 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 90/187] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:40 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:40.987784 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-dcfb2ab4-6a43-4741-9632-b7bd58962e25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:40.988455 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-dcfb2ab4-6a43-4741-9632-b7bd58962e25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:40.994394 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dcfb2ab4-6a43-4741-9632-b7bd58962e25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:40.994870 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dcfb2ab4-6a43-4741-9632-b7bd58962e25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:40.995337 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dcfb2ab4-6a43-4741-9632-b7bd58962e25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:40.996015 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dcfb2ab4-6a43-4741-9632-b7bd58962e25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:40.996464 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dcfb2ab4-6a43-4741-9632-b7bd58962e25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:40.996879 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dcfb2ab4-6a43-4741-9632-b7bd58962e25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:41.128381 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-dcfb2ab4-6a43-4741-9632-b7bd58962e25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:41.137636 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-dcfb2ab4-6a43-4741-9632-b7bd58962e25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.154028 Aug 10 12:42:41.138623 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 98/188] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:40 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:41.561224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a961a8a2-1a4f-4a5e-9957-8e87dfb1bc66 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:41.562421 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a961a8a2-1a4f-4a5e-9957-8e87dfb1bc66 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:41.569864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a961a8a2-1a4f-4a5e-9957-8e87dfb1bc66 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:41.571948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a961a8a2-1a4f-4a5e-9957-8e87dfb1bc66 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:41.571948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a961a8a2-1a4f-4a5e-9957-8e87dfb1bc66 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:41.572441 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a961a8a2-1a4f-4a5e-9957-8e87dfb1bc66 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:41.573017 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a961a8a2-1a4f-4a5e-9957-8e87dfb1bc66 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:41.573531 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a961a8a2-1a4f-4a5e-9957-8e87dfb1bc66 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:41.711684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a961a8a2-1a4f-4a5e-9957-8e87dfb1bc66 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c598eb26614feaa0c31339b8135f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefe2d12cf334ecbad2001b327cb65e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:41.720322 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a961a8a2-1a4f-4a5e-9957-8e87dfb1bc66 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 200 len: 1554 microversion: 2.1 time: 0.163566 Aug 10 12:42:41.720901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 91/189] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:41 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:42.158074 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d1ca75f4-b892-449a-8e16-f608315cb696 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:42.158684 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d1ca75f4-b892-449a-8e16-f608315cb696 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:42.164735 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1ca75f4-b892-449a-8e16-f608315cb696 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:42.165859 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1ca75f4-b892-449a-8e16-f608315cb696 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:42.166491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1ca75f4-b892-449a-8e16-f608315cb696 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:42.167105 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1ca75f4-b892-449a-8e16-f608315cb696 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:42.167699 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1ca75f4-b892-449a-8e16-f608315cb696 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:42.168123 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1ca75f4-b892-449a-8e16-f608315cb696 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:42.312686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d1ca75f4-b892-449a-8e16-f608315cb696 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:42.320212 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d1ca75f4-b892-449a-8e16-f608315cb696 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.166030 Aug 10 12:42:42.320783 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 99/190] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:42 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:42.742322 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-893ab0cf-6430-4e3a-bee0-26f6805c6201 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:42.743064 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-893ab0cf-6430-4e3a-bee0-26f6805c6201 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:42.750198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-893ab0cf-6430-4e3a-bee0-26f6805c6201 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:42.750679 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-893ab0cf-6430-4e3a-bee0-26f6805c6201 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:42.751106 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-893ab0cf-6430-4e3a-bee0-26f6805c6201 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:42.751878 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-893ab0cf-6430-4e3a-bee0-26f6805c6201 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:42.752330 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-893ab0cf-6430-4e3a-bee0-26f6805c6201 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:42.752749 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-893ab0cf-6430-4e3a-bee0-26f6805c6201 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:42.755500 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:42:42.898301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-893ab0cf-6430-4e3a-bee0-26f6805c6201 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c598eb26614feaa0c31339b8135f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefe2d12cf334ecbad2001b327cb65e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:42.911350 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-893ab0cf-6430-4e3a-bee0-26f6805c6201 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 200 len: 1554 microversion: 2.1 time: 0.169940 Aug 10 12:42:42.911350 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 92/191] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:42 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:43.341110 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-adaf5692-b4df-4928-86ba-a4f70fc2e4c4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:43.341719 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-adaf5692-b4df-4928-86ba-a4f70fc2e4c4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:43.348140 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-adaf5692-b4df-4928-86ba-a4f70fc2e4c4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:43.348701 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-adaf5692-b4df-4928-86ba-a4f70fc2e4c4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:43.349195 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-adaf5692-b4df-4928-86ba-a4f70fc2e4c4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:43.349956 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-adaf5692-b4df-4928-86ba-a4f70fc2e4c4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:43.350468 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-adaf5692-b4df-4928-86ba-a4f70fc2e4c4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:43.350948 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-adaf5692-b4df-4928-86ba-a4f70fc2e4c4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:43.382544 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-3ef3d30f-1ada-474e-ab32-3fa79b7fa2e2 req-e8f35fb8-c594-493e-bdf7-1bbec367bb0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb8a78c0-11f5-4a26-991b-f654067d9422", "name": "network-vif-deleted", "tag": "0629626a-06bb-4dab-8c94-8df7f0e88222"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:42:43.405071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-3ef3d30f-1ada-474e-ab32-3fa79b7fa2e2 req-e8f35fb8-c594-493e-bdf7-1bbec367bb0b service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:43.405821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-3ef3d30f-1ada-474e-ab32-3fa79b7fa2e2 req-e8f35fb8-c594-493e-bdf7-1bbec367bb0b service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:43.406325 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-3ef3d30f-1ada-474e-ab32-3fa79b7fa2e2 req-e8f35fb8-c594-493e-bdf7-1bbec367bb0b service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:43.421540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-3ef3d30f-1ada-474e-ab32-3fa79b7fa2e2 req-e8f35fb8-c594-493e-bdf7-1bbec367bb0b service nova] Creating event network-vif-deleted:0629626a-06bb-4dab-8c94-8df7f0e88222 for instance fb8a78c0-11f5-4a26-991b-f654067d9422 on hv-cinder-85199 Aug 10 12:42:43.427332 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-3ef3d30f-1ada-474e-ab32-3fa79b7fa2e2 req-e8f35fb8-c594-493e-bdf7-1bbec367bb0b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048294 Aug 10 12:42:43.430291 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 93/192] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:42:43.522955 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-adaf5692-b4df-4928-86ba-a4f70fc2e4c4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:43.531310 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-adaf5692-b4df-4928-86ba-a4f70fc2e4c4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.194084 Aug 10 12:42:43.535220 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 100/193] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:43 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:43.931073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f581ff53-057a-468d-a1cf-ada6a408b144 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:43.932033 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f581ff53-057a-468d-a1cf-ada6a408b144 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:43.938073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f581ff53-057a-468d-a1cf-ada6a408b144 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:43.945242 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f581ff53-057a-468d-a1cf-ada6a408b144 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:43.945242 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f581ff53-057a-468d-a1cf-ada6a408b144 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:43.945242 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f581ff53-057a-468d-a1cf-ada6a408b144 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:43.945242 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f581ff53-057a-468d-a1cf-ada6a408b144 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:43.945875 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f581ff53-057a-468d-a1cf-ada6a408b144 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:44.015021 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f581ff53-057a-468d-a1cf-ada6a408b144 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c598eb26614feaa0c31339b8135f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefe2d12cf334ecbad2001b327cb65e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:44.026420 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f581ff53-057a-468d-a1cf-ada6a408b144 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 200 len: 1346 microversion: 2.1 time: 0.100408 Aug 10 12:42:44.027002 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 94/194] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:43 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 1346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:44.552342 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-424e2fd3-f067-480d-be48-13f1606b44ec tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:44.553040 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-424e2fd3-f067-480d-be48-13f1606b44ec tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:44.559093 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-424e2fd3-f067-480d-be48-13f1606b44ec tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:44.559687 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-424e2fd3-f067-480d-be48-13f1606b44ec tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:44.560334 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-424e2fd3-f067-480d-be48-13f1606b44ec tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:44.561098 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-424e2fd3-f067-480d-be48-13f1606b44ec tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:44.561757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-424e2fd3-f067-480d-be48-13f1606b44ec tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:44.562404 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-424e2fd3-f067-480d-be48-13f1606b44ec tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:44.704706 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-424e2fd3-f067-480d-be48-13f1606b44ec tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:44.715299 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-424e2fd3-f067-480d-be48-13f1606b44ec tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.165572 Aug 10 12:42:44.716141 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 101/195] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:44 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:45.048722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3f4ab03b-64d7-42bc-be88-82ea6dd7f4fd tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:45.049340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3f4ab03b-64d7-42bc-be88-82ea6dd7f4fd tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:45.056971 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f4ab03b-64d7-42bc-be88-82ea6dd7f4fd tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:45.057466 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f4ab03b-64d7-42bc-be88-82ea6dd7f4fd tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:45.058066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f4ab03b-64d7-42bc-be88-82ea6dd7f4fd tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:45.058951 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f4ab03b-64d7-42bc-be88-82ea6dd7f4fd tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:45.059586 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f4ab03b-64d7-42bc-be88-82ea6dd7f4fd tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:45.060012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f4ab03b-64d7-42bc-be88-82ea6dd7f4fd tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:45.074434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-3f4ab03b-64d7-42bc-be88-82ea6dd7f4fd tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] HTTP exception thrown: Instance fb8a78c0-11f5-4a26-991b-f654067d9422 could not be found. Aug 10 12:42:45.085419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3f4ab03b-64d7-42bc-be88-82ea6dd7f4fd tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Request method failure captured: Aug 10 12:42:45.085419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 HTTP/1.1 Aug 10 12:42:45.085419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 12:42:45.085419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 12:42:45.085419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 12:42:45.085419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 12:42:45.085419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 12:42:45.085419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 12:42:45.085419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 12:42:45.085419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 12:42:45.085419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86eBqYzW-cEakU864vB9mzqZ9R6f10pI_kiaE0DyudJG6iOSEX_riLZpnnjvnJM6R9bK0rjftVl4xKUl0udzLHZ55jyzo51FV-pidPrf3kncFklepwhqRanfE4yTm6FWMLy_AHaBamsiyGseX3gGyfnP4Xrexhrkq_deB919ADOx7x4 Aug 10 12:42:45.085419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 12:42:45.085419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 12:42:45.085419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 12:42:45.085419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 12:42:45.085419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 12:42:45.085419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 12:42:45.085419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: fefe2d12cf334ecbad2001b327cb65e8 Aug 10 12:42:45.085419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-DeleteServersTestJSON-1320411108 Aug 10 12:42:45.085419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 12:42:45.085419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 12:42:45.086901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fefe2d12cf334ecbad2001b327cb65e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fefe2d12cf334ecbad2001b327cb65e8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fefe2d12cf334ecbad2001b327cb65e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fefe2d12cf334ecbad2001b327cb65e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 12:42:45.086901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-DeleteServersTestJSON-1320411108 Aug 10 12:42:45.086901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: fefe2d12cf334ecbad2001b327cb65e8 Aug 10 12:42:45.086901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-DeleteServersTestJSON-1320411108 Aug 10 12:42:45.086901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-DeleteServersTestJSON-1320411108-project Aug 10 12:42:45.086901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 12:42:45.086901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 12:42:45.086901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 51c598eb26614feaa0c31339b8135f08 Aug 10 12:42:45.086901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-DeleteServersTestJSON-1320411108-project Aug 10 12:42:45.086901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 12:42:45.086901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance fb8a78c0-11f5-4a26-991b-f654067d9422 could not be found. Aug 10 12:42:45.086901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': 'fb8a78c0-11f5-4a26-991b-f654067d9422'} Aug 10 12:42:45.087790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:42:45.087790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:42:45.087790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:42:45.087790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:42:45.087790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:42:45.087790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:42:45.087790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:42:45.087790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:42:45.087790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:42:45.087790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:42:45.087790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb8a78c0-11f5-4a26-991b-f654067d9422 could not be found. Aug 10 12:42:45.087790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:42:45.087790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:42:45.087790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:42:45.087790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:42:45.087790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:42:45.087790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:42:45.087790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:42:45.087790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:42:45.087790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:42:45.088939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:42:45.088939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:42:45.088939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:42:45.088939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:42:45.088939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:42:45.088939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:42:45.088939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:42:45.088939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb8a78c0-11f5-4a26-991b-f654067d9422 could not be found. Aug 10 12:42:45.088939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:42:45.088939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:42:45.088939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:42:45.088939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:42:45.088939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:42:45.088939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:42:45.088939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:42:45.088939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:42:45.088939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb8a78c0-11f5-4a26-991b-f654067d9422 could not be found. Aug 10 12:42:45.088939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:42:45.090759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3f4ab03b-64d7-42bc-be88-82ea6dd7f4fd tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Returning 404 to user: Instance fb8a78c0-11f5-4a26-991b-f654067d9422 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:42:45.091805 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3f4ab03b-64d7-42bc-be88-82ea6dd7f4fd tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 404 len: 111 microversion: 2.1 time: 0.047057 Aug 10 12:42:45.092388 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 95/196] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:45 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:42:45.206003 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4b6c8b36-72dd-4538-86f7-952b140f40d4 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:45.208358 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4b6c8b36-72dd-4538-86f7-952b140f40d4 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:45.214962 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b6c8b36-72dd-4538-86f7-952b140f40d4 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:45.215553 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b6c8b36-72dd-4538-86f7-952b140f40d4 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:45.216155 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b6c8b36-72dd-4538-86f7-952b140f40d4 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:45.216849 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b6c8b36-72dd-4538-86f7-952b140f40d4 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:45.217296 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b6c8b36-72dd-4538-86f7-952b140f40d4 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:45.217711 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b6c8b36-72dd-4538-86f7-952b140f40d4 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:45.231078 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.wsgi [None req-4b6c8b36-72dd-4538-86f7-952b140f40d4 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] HTTP exception thrown: Instance fb8a78c0-11f5-4a26-991b-f654067d9422 could not be found. Aug 10 12:42:45.235542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4b6c8b36-72dd-4538-86f7-952b140f40d4 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Request method failure captured: Aug 10 12:42:45.235542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: request: GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422/os-volume_attachments HTTP/1.1 Aug 10 12:42:45.235542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Accept: application/json Aug 10 12:42:45.235542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Accept-Encoding: identity Aug 10 12:42:45.235542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Connection: close Aug 10 12:42:45.235542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Content-Length: 0 Aug 10 12:42:45.235542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Content-Type: application/json Aug 10 12:42:45.235542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Host: 10.222.0.49 Aug 10 12:42:45.235542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Openstack-System-Scope: None Aug 10 12:42:45.235542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: User-Agent: python-urllib3/1.26.11 Aug 10 12:42:45.235542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Auth-Token: gAAAAABi86eBqYzW-cEakU864vB9mzqZ9R6f10pI_kiaE0DyudJG6iOSEX_riLZpnnjvnJM6R9bK0rjftVl4xKUl0udzLHZ55jyzo51FV-pidPrf3kncFklepwhqRanfE4yTm6FWMLy_AHaBamsiyGseX3gGyfnP4Xrexhrkq_deB919ADOx7x4 Aug 10 12:42:45.235542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Domain-Id: None Aug 10 12:42:45.235542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Domain-Name: None Aug 10 12:42:45.235542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Identity-Status: Confirmed Aug 10 12:42:45.235542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Is-Admin-Project: True Aug 10 12:42:45.235542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Project-Domain-Id: default Aug 10 12:42:45.235542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Project-Domain-Name: Default Aug 10 12:42:45.235542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Project-Id: fefe2d12cf334ecbad2001b327cb65e8 Aug 10 12:42:45.235542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Project-Name: tempest-DeleteServersTestJSON-1320411108 Aug 10 12:42:45.235542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Role: reader,member Aug 10 12:42:45.235542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Roles: reader,member Aug 10 12:42:45.237144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fefe2d12cf334ecbad2001b327cb65e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fefe2d12cf334ecbad2001b327cb65e8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fefe2d12cf334ecbad2001b327cb65e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fefe2d12cf334ecbad2001b327cb65e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 12:42:45.237144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Tenant: tempest-DeleteServersTestJSON-1320411108 Aug 10 12:42:45.237144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Tenant-Id: fefe2d12cf334ecbad2001b327cb65e8 Aug 10 12:42:45.237144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Tenant-Name: tempest-DeleteServersTestJSON-1320411108 Aug 10 12:42:45.237144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User: tempest-DeleteServersTestJSON-1320411108-project Aug 10 12:42:45.237144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User-Domain-Id: default Aug 10 12:42:45.237144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User-Domain-Name: Default Aug 10 12:42:45.237144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User-Id: 51c598eb26614feaa0c31339b8135f08 Aug 10 12:42:45.237144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User-Name: tempest-DeleteServersTestJSON-1320411108-project Aug 10 12:42:45.237144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: method: > Aug 10 12:42:45.237144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: exception: Instance fb8a78c0-11f5-4a26-991b-f654067d9422 could not be found. Aug 10 12:42:45.237144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: action_args: {'server_id': 'fb8a78c0-11f5-4a26-991b-f654067d9422'} Aug 10 12:42:45.237882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:42:45.237882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:42:45.237882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:42:45.237882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:42:45.237882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:42:45.237882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:42:45.237882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:42:45.237882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:42:45.237882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:42:45.237882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:42:45.237882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb8a78c0-11f5-4a26-991b-f654067d9422 could not be found. Aug 10 12:42:45.237882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:42:45.237882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:42:45.237882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:42:45.237882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:42:45.237882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:42:45.237882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:42:45.237882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:42:45.237882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:42:45.237882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:42:45.238882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:42:45.238882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 12:42:45.238882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 12:42:45.238882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 12:42:45.238882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 12:42:45.238882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 10 12:42:45.238882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 10 12:42:45.238882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:42:45.238882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:42:45.238882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb8a78c0-11f5-4a26-991b-f654067d9422 could not be found. Aug 10 12:42:45.238882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:42:45.238882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:42:45.238882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:42:45.238882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:42:45.238882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:42:45.238882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:42:45.238882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:42:45.238882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:42:45.238882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb8a78c0-11f5-4a26-991b-f654067d9422 could not be found. Aug 10 12:42:45.238882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:42:45.239942 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4b6c8b36-72dd-4538-86f7-952b140f40d4 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Returning 404 to user: Instance fb8a78c0-11f5-4a26-991b-f654067d9422 could not be found. {{(pid=124642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:42:45.239942 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4b6c8b36-72dd-4538-86f7-952b140f40d4 tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035374 Aug 10 12:42:45.239942 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 102/197] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:42:45 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:42:45.737939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-231b36ad-193e-4e4f-9ea7-59fddbc51880 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:45.738499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-231b36ad-193e-4e4f-9ea7-59fddbc51880 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:45.745488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-231b36ad-193e-4e4f-9ea7-59fddbc51880 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:45.746234 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-231b36ad-193e-4e4f-9ea7-59fddbc51880 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:45.746676 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-231b36ad-193e-4e4f-9ea7-59fddbc51880 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:45.747415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-231b36ad-193e-4e4f-9ea7-59fddbc51880 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:45.749628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-231b36ad-193e-4e4f-9ea7-59fddbc51880 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:45.749628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-231b36ad-193e-4e4f-9ea7-59fddbc51880 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:45.879288 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-231b36ad-193e-4e4f-9ea7-59fddbc51880 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:45.887313 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-231b36ad-193e-4e4f-9ea7-59fddbc51880 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.153827 Aug 10 12:42:45.887878 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 96/198] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:45 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:46.649234 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-da0488b0-d375-436e-b0c9-c27ec395cbaa tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:46.650691 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-da0488b0-d375-436e-b0c9-c27ec395cbaa tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:46.657928 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-da0488b0-d375-436e-b0c9-c27ec395cbaa tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:46.658406 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-da0488b0-d375-436e-b0c9-c27ec395cbaa tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:46.658836 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-da0488b0-d375-436e-b0c9-c27ec395cbaa tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:46.659550 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-da0488b0-d375-436e-b0c9-c27ec395cbaa tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:46.660000 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-da0488b0-d375-436e-b0c9-c27ec395cbaa tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:46.660446 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-da0488b0-d375-436e-b0c9-c27ec395cbaa tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:46.674169 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.wsgi [None req-da0488b0-d375-436e-b0c9-c27ec395cbaa tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] HTTP exception thrown: Instance fb8a78c0-11f5-4a26-991b-f654067d9422 could not be found. Aug 10 12:42:46.676401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-da0488b0-d375-436e-b0c9-c27ec395cbaa tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Request method failure captured: Aug 10 12:42:46.676401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: request: DELETE /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 HTTP/1.1 Aug 10 12:42:46.676401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Accept: application/json Aug 10 12:42:46.676401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Accept-Encoding: identity Aug 10 12:42:46.676401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Connection: close Aug 10 12:42:46.676401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Content-Length: 0 Aug 10 12:42:46.676401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Content-Type: application/json Aug 10 12:42:46.676401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Host: 10.222.0.49 Aug 10 12:42:46.676401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Openstack-System-Scope: None Aug 10 12:42:46.676401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: User-Agent: python-urllib3/1.26.11 Aug 10 12:42:46.676401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Auth-Token: gAAAAABi86eBqYzW-cEakU864vB9mzqZ9R6f10pI_kiaE0DyudJG6iOSEX_riLZpnnjvnJM6R9bK0rjftVl4xKUl0udzLHZ55jyzo51FV-pidPrf3kncFklepwhqRanfE4yTm6FWMLy_AHaBamsiyGseX3gGyfnP4Xrexhrkq_deB919ADOx7x4 Aug 10 12:42:46.676401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Domain-Id: None Aug 10 12:42:46.676401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Domain-Name: None Aug 10 12:42:46.676401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Identity-Status: Confirmed Aug 10 12:42:46.676401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Is-Admin-Project: True Aug 10 12:42:46.676401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Project-Domain-Id: default Aug 10 12:42:46.676401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Project-Domain-Name: Default Aug 10 12:42:46.676401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Project-Id: fefe2d12cf334ecbad2001b327cb65e8 Aug 10 12:42:46.676401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Project-Name: tempest-DeleteServersTestJSON-1320411108 Aug 10 12:42:46.676401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Role: reader,member Aug 10 12:42:46.676401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Roles: reader,member Aug 10 12:42:46.677738 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fefe2d12cf334ecbad2001b327cb65e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fefe2d12cf334ecbad2001b327cb65e8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fefe2d12cf334ecbad2001b327cb65e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fefe2d12cf334ecbad2001b327cb65e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 12:42:46.677738 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Tenant: tempest-DeleteServersTestJSON-1320411108 Aug 10 12:42:46.677738 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Tenant-Id: fefe2d12cf334ecbad2001b327cb65e8 Aug 10 12:42:46.677738 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Tenant-Name: tempest-DeleteServersTestJSON-1320411108 Aug 10 12:42:46.677738 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User: tempest-DeleteServersTestJSON-1320411108-project Aug 10 12:42:46.677738 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User-Domain-Id: default Aug 10 12:42:46.677738 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User-Domain-Name: Default Aug 10 12:42:46.677738 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User-Id: 51c598eb26614feaa0c31339b8135f08 Aug 10 12:42:46.677738 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User-Name: tempest-DeleteServersTestJSON-1320411108-project Aug 10 12:42:46.677738 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: method: > Aug 10 12:42:46.677738 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: exception: Instance fb8a78c0-11f5-4a26-991b-f654067d9422 could not be found. Aug 10 12:42:46.677738 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: action_args: {'id': 'fb8a78c0-11f5-4a26-991b-f654067d9422'} Aug 10 12:42:46.678582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:42:46.678582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:42:46.678582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:42:46.678582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:42:46.678582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:42:46.678582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:42:46.678582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:42:46.678582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:42:46.678582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:42:46.678582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:42:46.678582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb8a78c0-11f5-4a26-991b-f654067d9422 could not be found. Aug 10 12:42:46.678582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:42:46.678582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:42:46.678582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:42:46.678582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:42:46.678582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:42:46.678582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:42:46.678582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:42:46.678582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:42:46.678582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:42:46.679787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:42:46.679787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 12:42:46.679787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 12:42:46.679787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 12:42:46.679787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 12:42:46.679787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:42:46.679787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:42:46.679787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:42:46.679787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:42:46.679787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb8a78c0-11f5-4a26-991b-f654067d9422 could not be found. Aug 10 12:42:46.679787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:42:46.679787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:42:46.679787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:42:46.679787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:42:46.679787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:42:46.679787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:42:46.679787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:42:46.679787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:42:46.679787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb8a78c0-11f5-4a26-991b-f654067d9422 could not be found. Aug 10 12:42:46.679787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:42:46.680846 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-da0488b0-d375-436e-b0c9-c27ec395cbaa tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Returning 404 to user: Instance fb8a78c0-11f5-4a26-991b-f654067d9422 could not be found. {{(pid=124642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:42:46.680846 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-da0488b0-d375-436e-b0c9-c27ec395cbaa tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 404 len: 111 microversion: 2.1 time: 0.033716 Aug 10 12:42:46.680846 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 103/199] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 12:42:46 2022] DELETE /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:42:46.690369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-848e9fca-9f1f-4271-912d-181f03e5bdff tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:46.691826 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-848e9fca-9f1f-4271-912d-181f03e5bdff tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] [instance: fb8a78c0-11f5-4a26-991b-f654067d9422] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:46.700471 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-848e9fca-9f1f-4271-912d-181f03e5bdff tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:46.701129 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-848e9fca-9f1f-4271-912d-181f03e5bdff tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:46.701851 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-848e9fca-9f1f-4271-912d-181f03e5bdff tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:46.702435 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-848e9fca-9f1f-4271-912d-181f03e5bdff tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:46.703492 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-848e9fca-9f1f-4271-912d-181f03e5bdff tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:46.704072 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-848e9fca-9f1f-4271-912d-181f03e5bdff tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:46.720124 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-848e9fca-9f1f-4271-912d-181f03e5bdff tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] HTTP exception thrown: Instance fb8a78c0-11f5-4a26-991b-f654067d9422 could not be found. Aug 10 12:42:46.721662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-848e9fca-9f1f-4271-912d-181f03e5bdff tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Request method failure captured: Aug 10 12:42:46.721662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 HTTP/1.1 Aug 10 12:42:46.721662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 12:42:46.721662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 12:42:46.721662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 12:42:46.721662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 12:42:46.721662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 12:42:46.721662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 12:42:46.721662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 12:42:46.721662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 12:42:46.721662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86eBqYzW-cEakU864vB9mzqZ9R6f10pI_kiaE0DyudJG6iOSEX_riLZpnnjvnJM6R9bK0rjftVl4xKUl0udzLHZ55jyzo51FV-pidPrf3kncFklepwhqRanfE4yTm6FWMLy_AHaBamsiyGseX3gGyfnP4Xrexhrkq_deB919ADOx7x4 Aug 10 12:42:46.721662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 12:42:46.721662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 12:42:46.721662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 12:42:46.721662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 12:42:46.721662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 12:42:46.721662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 12:42:46.721662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: fefe2d12cf334ecbad2001b327cb65e8 Aug 10 12:42:46.721662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-DeleteServersTestJSON-1320411108 Aug 10 12:42:46.721662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 12:42:46.721662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 12:42:46.723066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fefe2d12cf334ecbad2001b327cb65e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fefe2d12cf334ecbad2001b327cb65e8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fefe2d12cf334ecbad2001b327cb65e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fefe2d12cf334ecbad2001b327cb65e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 12:42:46.723066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-DeleteServersTestJSON-1320411108 Aug 10 12:42:46.723066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: fefe2d12cf334ecbad2001b327cb65e8 Aug 10 12:42:46.723066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-DeleteServersTestJSON-1320411108 Aug 10 12:42:46.723066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-DeleteServersTestJSON-1320411108-project Aug 10 12:42:46.723066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 12:42:46.723066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 12:42:46.723066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 51c598eb26614feaa0c31339b8135f08 Aug 10 12:42:46.723066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-DeleteServersTestJSON-1320411108-project Aug 10 12:42:46.723066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 12:42:46.723066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance fb8a78c0-11f5-4a26-991b-f654067d9422 could not be found. Aug 10 12:42:46.723066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': 'fb8a78c0-11f5-4a26-991b-f654067d9422'} Aug 10 12:42:46.723957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:42:46.723957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:42:46.723957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:42:46.723957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:42:46.723957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:42:46.723957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:42:46.723957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:42:46.723957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:42:46.723957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:42:46.723957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:42:46.723957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb8a78c0-11f5-4a26-991b-f654067d9422 could not be found. Aug 10 12:42:46.723957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:42:46.723957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:42:46.723957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:42:46.723957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:42:46.723957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:42:46.723957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:42:46.723957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:42:46.723957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:42:46.723957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:42:46.725448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:42:46.725448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:42:46.725448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:42:46.725448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:42:46.725448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:42:46.725448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:42:46.725448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:42:46.725448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb8a78c0-11f5-4a26-991b-f654067d9422 could not be found. Aug 10 12:42:46.725448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:42:46.725448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:42:46.725448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:42:46.725448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:42:46.725448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:42:46.725448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:42:46.725448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:42:46.725448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:42:46.725448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb8a78c0-11f5-4a26-991b-f654067d9422 could not be found. Aug 10 12:42:46.725448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:42:46.726568 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-848e9fca-9f1f-4271-912d-181f03e5bdff tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] Returning 404 to user: Instance fb8a78c0-11f5-4a26-991b-f654067d9422 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:42:46.726568 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-848e9fca-9f1f-4271-912d-181f03e5bdff tempest-DeleteServersTestJSON-1320411108 tempest-DeleteServersTestJSON-1320411108-project] 10.222.0.49 "GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422" status: 404 len: 111 microversion: 2.1 time: 0.039939 Aug 10 12:42:46.726568 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 97/200] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:46 2022] GET /compute/v2.1/servers/fb8a78c0-11f5-4a26-991b-f654067d9422 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:42:46.908752 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-366dc40b-a380-4ffa-b9c5-efa057182a50 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:46.909363 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-366dc40b-a380-4ffa-b9c5-efa057182a50 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:46.911496 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:42:46.916383 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-366dc40b-a380-4ffa-b9c5-efa057182a50 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:46.917072 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-366dc40b-a380-4ffa-b9c5-efa057182a50 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:46.917502 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-366dc40b-a380-4ffa-b9c5-efa057182a50 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:46.918183 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-366dc40b-a380-4ffa-b9c5-efa057182a50 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:46.918781 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-366dc40b-a380-4ffa-b9c5-efa057182a50 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:46.919209 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-366dc40b-a380-4ffa-b9c5-efa057182a50 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:47.076874 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-366dc40b-a380-4ffa-b9c5-efa057182a50 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:47.085768 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-366dc40b-a380-4ffa-b9c5-efa057182a50 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.180726 Aug 10 12:42:47.086740 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 104/201] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:46 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:48.108961 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-03b476b6-13c1-4429-a155-3fe87402a715 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:48.109678 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-03b476b6-13c1-4429-a155-3fe87402a715 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:48.120522 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03b476b6-13c1-4429-a155-3fe87402a715 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:48.121595 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03b476b6-13c1-4429-a155-3fe87402a715 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:48.122315 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03b476b6-13c1-4429-a155-3fe87402a715 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:48.123217 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03b476b6-13c1-4429-a155-3fe87402a715 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:48.123816 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03b476b6-13c1-4429-a155-3fe87402a715 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:48.124388 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03b476b6-13c1-4429-a155-3fe87402a715 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:48.358305 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-03b476b6-13c1-4429-a155-3fe87402a715 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:48.372580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-03b476b6-13c1-4429-a155-3fe87402a715 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.268124 Aug 10 12:42:48.373542 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 98/202] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:48 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:49.395443 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9762ac0b-aff8-4dd1-bb9c-bd2a0810cc46 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:49.396332 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9762ac0b-aff8-4dd1-bb9c-bd2a0810cc46 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:49.404301 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9762ac0b-aff8-4dd1-bb9c-bd2a0810cc46 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:49.404913 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9762ac0b-aff8-4dd1-bb9c-bd2a0810cc46 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:49.405484 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9762ac0b-aff8-4dd1-bb9c-bd2a0810cc46 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:49.406245 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9762ac0b-aff8-4dd1-bb9c-bd2a0810cc46 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:49.406882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9762ac0b-aff8-4dd1-bb9c-bd2a0810cc46 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:49.407404 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9762ac0b-aff8-4dd1-bb9c-bd2a0810cc46 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:49.613738 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9762ac0b-aff8-4dd1-bb9c-bd2a0810cc46 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:49.623303 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9762ac0b-aff8-4dd1-bb9c-bd2a0810cc46 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.232060 Aug 10 12:42:49.631266 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 105/203] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:49 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:50.645467 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-07ca09e8-50b1-4674-87ae-3b8dd57a3ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:50.646083 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-07ca09e8-50b1-4674-87ae-3b8dd57a3ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:50.668978 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07ca09e8-50b1-4674-87ae-3b8dd57a3ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:50.669492 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07ca09e8-50b1-4674-87ae-3b8dd57a3ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:50.669922 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07ca09e8-50b1-4674-87ae-3b8dd57a3ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:50.670637 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07ca09e8-50b1-4674-87ae-3b8dd57a3ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:50.672379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07ca09e8-50b1-4674-87ae-3b8dd57a3ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:50.672819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07ca09e8-50b1-4674-87ae-3b8dd57a3ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:50.851479 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-07ca09e8-50b1-4674-87ae-3b8dd57a3ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:50.859873 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-07ca09e8-50b1-4674-87ae-3b8dd57a3ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.218765 Aug 10 12:42:50.860672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 99/204] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:50 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:51.881322 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-25f96bac-022b-4dbe-9df2-bae3002c4c8d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:51.882011 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-25f96bac-022b-4dbe-9df2-bae3002c4c8d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:51.888225 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-25f96bac-022b-4dbe-9df2-bae3002c4c8d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:51.888710 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-25f96bac-022b-4dbe-9df2-bae3002c4c8d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:51.889147 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-25f96bac-022b-4dbe-9df2-bae3002c4c8d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:51.889850 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-25f96bac-022b-4dbe-9df2-bae3002c4c8d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:51.890281 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-25f96bac-022b-4dbe-9df2-bae3002c4c8d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:51.890705 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-25f96bac-022b-4dbe-9df2-bae3002c4c8d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:52.049624 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-25f96bac-022b-4dbe-9df2-bae3002c4c8d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:52.058500 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-25f96bac-022b-4dbe-9df2-bae3002c4c8d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.180552 Aug 10 12:42:52.059088 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 106/205] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:51 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:53.079807 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-57c3c822-712c-47e8-9e32-0dc2ac3cca17 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:53.080515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-57c3c822-712c-47e8-9e32-0dc2ac3cca17 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:53.086938 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-57c3c822-712c-47e8-9e32-0dc2ac3cca17 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:53.087458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-57c3c822-712c-47e8-9e32-0dc2ac3cca17 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:53.087868 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-57c3c822-712c-47e8-9e32-0dc2ac3cca17 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:53.089208 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-57c3c822-712c-47e8-9e32-0dc2ac3cca17 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:53.089662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-57c3c822-712c-47e8-9e32-0dc2ac3cca17 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:53.090085 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-57c3c822-712c-47e8-9e32-0dc2ac3cca17 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:53.238516 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-57c3c822-712c-47e8-9e32-0dc2ac3cca17 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:53.246103 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-57c3c822-712c-47e8-9e32-0dc2ac3cca17 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.170276 Aug 10 12:42:53.246861 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 100/206] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:53 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:42:54.266370 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ab1651b9-1391-4a20-a9ee-a5b3284e6136 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:54.266987 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ab1651b9-1391-4a20-a9ee-a5b3284e6136 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:54.272927 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab1651b9-1391-4a20-a9ee-a5b3284e6136 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:54.273411 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab1651b9-1391-4a20-a9ee-a5b3284e6136 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:54.273846 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab1651b9-1391-4a20-a9ee-a5b3284e6136 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:54.274568 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab1651b9-1391-4a20-a9ee-a5b3284e6136 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:54.275023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab1651b9-1391-4a20-a9ee-a5b3284e6136 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:54.275470 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab1651b9-1391-4a20-a9ee-a5b3284e6136 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:54.468854 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ab1651b9-1391-4a20-a9ee-a5b3284e6136 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:54.476364 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ab1651b9-1391-4a20-a9ee-a5b3284e6136 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.213818 Aug 10 12:42:54.476935 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 107/207] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:54 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:55.498370 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-23ad7d60-254d-4c2a-b7ac-0d6b912f3ecb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:55.499018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-23ad7d60-254d-4c2a-b7ac-0d6b912f3ecb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:55.505402 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23ad7d60-254d-4c2a-b7ac-0d6b912f3ecb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:55.506042 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23ad7d60-254d-4c2a-b7ac-0d6b912f3ecb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:55.506469 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23ad7d60-254d-4c2a-b7ac-0d6b912f3ecb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:55.507155 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23ad7d60-254d-4c2a-b7ac-0d6b912f3ecb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:55.507620 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23ad7d60-254d-4c2a-b7ac-0d6b912f3ecb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:55.508032 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23ad7d60-254d-4c2a-b7ac-0d6b912f3ecb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:55.847468 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-23ad7d60-254d-4c2a-b7ac-0d6b912f3ecb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:55.855601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-23ad7d60-254d-4c2a-b7ac-0d6b912f3ecb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.362418 Aug 10 12:42:55.856167 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 101/208] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:55 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:56.876047 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ef88736c-b915-4d3c-a08e-f78d6ec5af42 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:56.876655 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ef88736c-b915-4d3c-a08e-f78d6ec5af42 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:56.886190 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef88736c-b915-4d3c-a08e-f78d6ec5af42 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:56.888454 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef88736c-b915-4d3c-a08e-f78d6ec5af42 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:56.888911 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef88736c-b915-4d3c-a08e-f78d6ec5af42 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:56.889630 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef88736c-b915-4d3c-a08e-f78d6ec5af42 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:56.890088 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef88736c-b915-4d3c-a08e-f78d6ec5af42 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:56.890630 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef88736c-b915-4d3c-a08e-f78d6ec5af42 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:57.037420 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ef88736c-b915-4d3c-a08e-f78d6ec5af42 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:57.045670 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ef88736c-b915-4d3c-a08e-f78d6ec5af42 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.173488 Aug 10 12:42:57.046423 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 108/209] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:56 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:58.069548 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2d7ca21b-9579-4b66-8e0e-5e88a8ff0ff0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:58.071283 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2d7ca21b-9579-4b66-8e0e-5e88a8ff0ff0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:58.081331 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2d7ca21b-9579-4b66-8e0e-5e88a8ff0ff0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:58.082573 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2d7ca21b-9579-4b66-8e0e-5e88a8ff0ff0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:58.083217 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2d7ca21b-9579-4b66-8e0e-5e88a8ff0ff0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:58.084113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2d7ca21b-9579-4b66-8e0e-5e88a8ff0ff0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:58.084563 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2d7ca21b-9579-4b66-8e0e-5e88a8ff0ff0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:58.085144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2d7ca21b-9579-4b66-8e0e-5e88a8ff0ff0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:58.229420 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2d7ca21b-9579-4b66-8e0e-5e88a8ff0ff0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:58.239905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2d7ca21b-9579-4b66-8e0e-5e88a8ff0ff0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.176686 Aug 10 12:42:58.240646 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 102/210] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:58 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:42:59.298060 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fe6866ea-b3b2-4c62-9c38-92ef9527e144 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:42:59.298744 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fe6866ea-b3b2-4c62-9c38-92ef9527e144 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:42:59.304985 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe6866ea-b3b2-4c62-9c38-92ef9527e144 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:59.305460 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe6866ea-b3b2-4c62-9c38-92ef9527e144 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:59.305927 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe6866ea-b3b2-4c62-9c38-92ef9527e144 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:59.306663 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe6866ea-b3b2-4c62-9c38-92ef9527e144 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:42:59.307109 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe6866ea-b3b2-4c62-9c38-92ef9527e144 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:42:59.308391 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe6866ea-b3b2-4c62-9c38-92ef9527e144 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:42:59.485813 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fe6866ea-b3b2-4c62-9c38-92ef9527e144 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:42:59.493723 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fe6866ea-b3b2-4c62-9c38-92ef9527e144 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.199753 Aug 10 12:42:59.494300 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 109/211] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:42:59 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:00.522449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2c2f7e7e-bc91-44d5-8f70-d26a0ef4fc2b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:00.523779 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2c2f7e7e-bc91-44d5-8f70-d26a0ef4fc2b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:00.532295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c2f7e7e-bc91-44d5-8f70-d26a0ef4fc2b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:00.534458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c2f7e7e-bc91-44d5-8f70-d26a0ef4fc2b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:00.534458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c2f7e7e-bc91-44d5-8f70-d26a0ef4fc2b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:00.534458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c2f7e7e-bc91-44d5-8f70-d26a0ef4fc2b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:00.534854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c2f7e7e-bc91-44d5-8f70-d26a0ef4fc2b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:00.535310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c2f7e7e-bc91-44d5-8f70-d26a0ef4fc2b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:00.685254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2c2f7e7e-bc91-44d5-8f70-d26a0ef4fc2b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:00.694548 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2c2f7e7e-bc91-44d5-8f70-d26a0ef4fc2b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1522 microversion: 2.1 time: 0.182620 Aug 10 12:43:00.695941 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 103/212] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:00 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:01.717870 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-67d8db2a-6c35-45d2-b285-3d42f0dbd76a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:01.718486 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-67d8db2a-6c35-45d2-b285-3d42f0dbd76a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:01.724449 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-67d8db2a-6c35-45d2-b285-3d42f0dbd76a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:01.724931 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-67d8db2a-6c35-45d2-b285-3d42f0dbd76a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:01.725365 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-67d8db2a-6c35-45d2-b285-3d42f0dbd76a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:01.726053 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-67d8db2a-6c35-45d2-b285-3d42f0dbd76a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:01.726607 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-67d8db2a-6c35-45d2-b285-3d42f0dbd76a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:01.726935 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-67d8db2a-6c35-45d2-b285-3d42f0dbd76a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:01.860505 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-67d8db2a-6c35-45d2-b285-3d42f0dbd76a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:01.868253 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-67d8db2a-6c35-45d2-b285-3d42f0dbd76a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1502 microversion: 2.1 time: 0.154297 Aug 10 12:43:01.868821 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 110/213] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:01 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:01.891274 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-56bd52a3-fc6c-41f8-b7bd-9ba7c295ae5b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:01.892227 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-56bd52a3-fc6c-41f8-b7bd-9ba7c295ae5b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:01.897673 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=38 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:43:01.900619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56bd52a3-fc6c-41f8-b7bd-9ba7c295ae5b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:01.900619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56bd52a3-fc6c-41f8-b7bd-9ba7c295ae5b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:01.900619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56bd52a3-fc6c-41f8-b7bd-9ba7c295ae5b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:01.901495 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56bd52a3-fc6c-41f8-b7bd-9ba7c295ae5b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:01.902452 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56bd52a3-fc6c-41f8-b7bd-9ba7c295ae5b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:01.902876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56bd52a3-fc6c-41f8-b7bd-9ba7c295ae5b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:02.054409 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-56bd52a3-fc6c-41f8-b7bd-9ba7c295ae5b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:02.063247 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-56bd52a3-fc6c-41f8-b7bd-9ba7c295ae5b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48" status: 200 len: 1514 microversion: 2.1 time: 0.177305 Aug 10 12:43:02.068420 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 104/214] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:01 2022] GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:04.012106 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-86fe28e3-7021-4b7f-aa65-32f0143c5a26 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:43:04.018352 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-86fe28e3-7021-4b7f-aa65-32f0143c5a26 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:04.020645 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86fe28e3-7021-4b7f-aa65-32f0143c5a26 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:04.021131 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86fe28e3-7021-4b7f-aa65-32f0143c5a26 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:04.021556 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86fe28e3-7021-4b7f-aa65-32f0143c5a26 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:04.022252 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86fe28e3-7021-4b7f-aa65-32f0143c5a26 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:04.022850 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86fe28e3-7021-4b7f-aa65-32f0143c5a26 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:04.023308 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86fe28e3-7021-4b7f-aa65-32f0143c5a26 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:04.049353 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.objects.instance [None req-86fe28e3-7021-4b7f-aa65-32f0143c5a26 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lazy-loading 'flavor' on Instance uuid 47011594-f6d9-44a1-9751-c564121b1e48 {{(pid=124642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:43:04.392632 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-86fe28e3-7021-4b7f-aa65-32f0143c5a26 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "POST /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48/action" status: 200 len: 32 microversion: 2.1 time: 0.373255 Aug 10 12:43:04.392632 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 111/215] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 10 12:43:04 2022] POST /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48/action => generated 32 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 12:43:04.399377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c134aae2-9946-432e-8699-1eb004de976a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:04.400792 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c134aae2-9946-432e-8699-1eb004de976a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:04.410925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c134aae2-9946-432e-8699-1eb004de976a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:04.411774 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c134aae2-9946-432e-8699-1eb004de976a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:04.412418 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c134aae2-9946-432e-8699-1eb004de976a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:04.413327 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c134aae2-9946-432e-8699-1eb004de976a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:04.414216 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c134aae2-9946-432e-8699-1eb004de976a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:04.414828 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c134aae2-9946-432e-8699-1eb004de976a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:04.602375 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c134aae2-9946-432e-8699-1eb004de976a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:04.609163 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c134aae2-9946-432e-8699-1eb004de976a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48" status: 200 len: 1520 microversion: 2.1 time: 0.214366 Aug 10 12:43:04.609747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 105/216] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:04 2022] GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48 => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:05.631665 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3e8c3a9a-0e3f-4f63-86ed-5cda531194f6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:05.632509 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3e8c3a9a-0e3f-4f63-86ed-5cda531194f6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:05.639470 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e8c3a9a-0e3f-4f63-86ed-5cda531194f6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:05.639952 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e8c3a9a-0e3f-4f63-86ed-5cda531194f6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:05.640391 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e8c3a9a-0e3f-4f63-86ed-5cda531194f6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:05.641243 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e8c3a9a-0e3f-4f63-86ed-5cda531194f6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:05.641712 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e8c3a9a-0e3f-4f63-86ed-5cda531194f6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:05.642162 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e8c3a9a-0e3f-4f63-86ed-5cda531194f6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:05.647109 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:43:05.782189 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3e8c3a9a-0e3f-4f63-86ed-5cda531194f6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:05.789549 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3e8c3a9a-0e3f-4f63-86ed-5cda531194f6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48" status: 200 len: 1520 microversion: 2.1 time: 0.163296 Aug 10 12:43:05.790381 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 112/217] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:05 2022] GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:06.811626 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-95b3a8df-f9f0-46d2-b6dd-6a2aa5949afa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:06.812172 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-95b3a8df-f9f0-46d2-b6dd-6a2aa5949afa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:06.818427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-95b3a8df-f9f0-46d2-b6dd-6a2aa5949afa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:06.818897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-95b3a8df-f9f0-46d2-b6dd-6a2aa5949afa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:06.819359 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-95b3a8df-f9f0-46d2-b6dd-6a2aa5949afa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:06.820036 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-95b3a8df-f9f0-46d2-b6dd-6a2aa5949afa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:06.820479 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-95b3a8df-f9f0-46d2-b6dd-6a2aa5949afa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:06.820894 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-95b3a8df-f9f0-46d2-b6dd-6a2aa5949afa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:07.002527 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-95b3a8df-f9f0-46d2-b6dd-6a2aa5949afa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:07.019203 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-95b3a8df-f9f0-46d2-b6dd-6a2aa5949afa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48" status: 200 len: 1520 microversion: 2.1 time: 0.203298 Aug 10 12:43:07.019203 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 106/218] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:06 2022] GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48 => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:08.042926 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-17c8e79d-819d-4c81-843e-ea9c157f1fcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:08.045075 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-17c8e79d-819d-4c81-843e-ea9c157f1fcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:08.051485 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17c8e79d-819d-4c81-843e-ea9c157f1fcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:08.051978 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17c8e79d-819d-4c81-843e-ea9c157f1fcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:08.052413 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17c8e79d-819d-4c81-843e-ea9c157f1fcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:08.053093 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17c8e79d-819d-4c81-843e-ea9c157f1fcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:08.053535 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17c8e79d-819d-4c81-843e-ea9c157f1fcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:08.053949 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17c8e79d-819d-4c81-843e-ea9c157f1fcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:08.198044 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-17c8e79d-819d-4c81-843e-ea9c157f1fcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:08.208110 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-17c8e79d-819d-4c81-843e-ea9c157f1fcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48" status: 200 len: 1520 microversion: 2.1 time: 0.169060 Aug 10 12:43:08.209504 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 113/219] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:08 2022] GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:09.231228 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4d5dfdfe-5afa-4cba-9718-c2981fd0e653 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:09.232003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4d5dfdfe-5afa-4cba-9718-c2981fd0e653 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:09.238985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d5dfdfe-5afa-4cba-9718-c2981fd0e653 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:09.239783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d5dfdfe-5afa-4cba-9718-c2981fd0e653 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:09.240065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d5dfdfe-5afa-4cba-9718-c2981fd0e653 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:09.240756 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d5dfdfe-5afa-4cba-9718-c2981fd0e653 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:09.241206 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d5dfdfe-5afa-4cba-9718-c2981fd0e653 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:09.241646 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d5dfdfe-5afa-4cba-9718-c2981fd0e653 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:09.374711 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4d5dfdfe-5afa-4cba-9718-c2981fd0e653 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:09.383454 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4d5dfdfe-5afa-4cba-9718-c2981fd0e653 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48" status: 200 len: 1520 microversion: 2.1 time: 0.156443 Aug 10 12:43:09.384151 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 107/220] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:09 2022] GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:10.406290 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b01c9877-3d86-4c3e-b36d-0da872a51d03 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:10.406915 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b01c9877-3d86-4c3e-b36d-0da872a51d03 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:10.413310 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b01c9877-3d86-4c3e-b36d-0da872a51d03 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:10.413670 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b01c9877-3d86-4c3e-b36d-0da872a51d03 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:10.417945 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b01c9877-3d86-4c3e-b36d-0da872a51d03 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:10.417945 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b01c9877-3d86-4c3e-b36d-0da872a51d03 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:10.417945 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b01c9877-3d86-4c3e-b36d-0da872a51d03 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:10.417945 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b01c9877-3d86-4c3e-b36d-0da872a51d03 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:10.590375 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b01c9877-3d86-4c3e-b36d-0da872a51d03 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:10.597784 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b01c9877-3d86-4c3e-b36d-0da872a51d03 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48" status: 200 len: 1520 microversion: 2.1 time: 0.196781 Aug 10 12:43:10.598357 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 114/221] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:10 2022] GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48 => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:11.619802 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6738b2b9-1d51-4458-9803-fdfca5dc3b8e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:11.620401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6738b2b9-1d51-4458-9803-fdfca5dc3b8e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:11.627487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6738b2b9-1d51-4458-9803-fdfca5dc3b8e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:11.628627 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6738b2b9-1d51-4458-9803-fdfca5dc3b8e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:11.629066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6738b2b9-1d51-4458-9803-fdfca5dc3b8e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:11.629911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6738b2b9-1d51-4458-9803-fdfca5dc3b8e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:11.630355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6738b2b9-1d51-4458-9803-fdfca5dc3b8e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:11.630774 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6738b2b9-1d51-4458-9803-fdfca5dc3b8e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:11.759050 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6738b2b9-1d51-4458-9803-fdfca5dc3b8e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:11.767318 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6738b2b9-1d51-4458-9803-fdfca5dc3b8e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48" status: 200 len: 1520 microversion: 2.1 time: 0.151467 Aug 10 12:43:11.780715 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 108/222] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:11 2022] GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:12.789614 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c05367fa-a86a-4ace-8a61-3faba80ea909 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:12.790222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c05367fa-a86a-4ace-8a61-3faba80ea909 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:12.796169 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c05367fa-a86a-4ace-8a61-3faba80ea909 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:12.800468 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c05367fa-a86a-4ace-8a61-3faba80ea909 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:12.800468 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c05367fa-a86a-4ace-8a61-3faba80ea909 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:12.800468 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c05367fa-a86a-4ace-8a61-3faba80ea909 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:12.800468 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c05367fa-a86a-4ace-8a61-3faba80ea909 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:12.800779 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c05367fa-a86a-4ace-8a61-3faba80ea909 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:12.931032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c05367fa-a86a-4ace-8a61-3faba80ea909 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:12.940146 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c05367fa-a86a-4ace-8a61-3faba80ea909 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48" status: 200 len: 1520 microversion: 2.1 time: 0.154389 Aug 10 12:43:12.941071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 115/223] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:12 2022] GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:13.961912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-21045f1e-5948-45c2-b0ac-a28b326ac187 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:13.962595 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-21045f1e-5948-45c2-b0ac-a28b326ac187 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:13.970275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-21045f1e-5948-45c2-b0ac-a28b326ac187 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:13.970857 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-21045f1e-5948-45c2-b0ac-a28b326ac187 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:13.971384 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-21045f1e-5948-45c2-b0ac-a28b326ac187 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:13.972185 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-21045f1e-5948-45c2-b0ac-a28b326ac187 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:13.972693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-21045f1e-5948-45c2-b0ac-a28b326ac187 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:13.973175 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-21045f1e-5948-45c2-b0ac-a28b326ac187 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:13.977460 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=90 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:43:14.116424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-21045f1e-5948-45c2-b0ac-a28b326ac187 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:14.123211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-21045f1e-5948-45c2-b0ac-a28b326ac187 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48" status: 200 len: 1520 microversion: 2.1 time: 0.165184 Aug 10 12:43:14.123784 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 109/224] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:13 2022] GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:15.144711 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c063de3e-20d4-4954-a899-f183acfe532a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:15.145320 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c063de3e-20d4-4954-a899-f183acfe532a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:15.153863 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c063de3e-20d4-4954-a899-f183acfe532a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:15.154403 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c063de3e-20d4-4954-a899-f183acfe532a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:15.154888 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c063de3e-20d4-4954-a899-f183acfe532a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:15.155670 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c063de3e-20d4-4954-a899-f183acfe532a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:15.156184 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c063de3e-20d4-4954-a899-f183acfe532a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:15.156725 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c063de3e-20d4-4954-a899-f183acfe532a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:15.293605 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c063de3e-20d4-4954-a899-f183acfe532a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:15.301692 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c063de3e-20d4-4954-a899-f183acfe532a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48" status: 200 len: 1520 microversion: 2.1 time: 0.160791 Aug 10 12:43:15.302249 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 116/225] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:15 2022] GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:16.322780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ec880d1c-6dc8-479b-babf-2fb0f6edb217 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:16.323434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ec880d1c-6dc8-479b-babf-2fb0f6edb217 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:16.330433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec880d1c-6dc8-479b-babf-2fb0f6edb217 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:16.330915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec880d1c-6dc8-479b-babf-2fb0f6edb217 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:16.331375 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec880d1c-6dc8-479b-babf-2fb0f6edb217 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:16.332063 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec880d1c-6dc8-479b-babf-2fb0f6edb217 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:16.332512 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec880d1c-6dc8-479b-babf-2fb0f6edb217 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:16.332929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec880d1c-6dc8-479b-babf-2fb0f6edb217 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:16.466188 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ec880d1c-6dc8-479b-babf-2fb0f6edb217 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:16.487373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ec880d1c-6dc8-479b-babf-2fb0f6edb217 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48" status: 200 len: 1520 microversion: 2.1 time: 0.168674 Aug 10 12:43:16.510526 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 110/226] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:16 2022] GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:17.484561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ebea76e1-c83d-4ec8-a5a2-c5adee4cab8c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:17.485612 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ebea76e1-c83d-4ec8-a5a2-c5adee4cab8c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:17.492008 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebea76e1-c83d-4ec8-a5a2-c5adee4cab8c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:17.492481 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebea76e1-c83d-4ec8-a5a2-c5adee4cab8c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:17.493068 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebea76e1-c83d-4ec8-a5a2-c5adee4cab8c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:17.494071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebea76e1-c83d-4ec8-a5a2-c5adee4cab8c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:17.494521 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebea76e1-c83d-4ec8-a5a2-c5adee4cab8c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:17.494929 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebea76e1-c83d-4ec8-a5a2-c5adee4cab8c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:17.508609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f9a55207-3a96-41cb-adb1-932f7eb26fa1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:17.510117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f9a55207-3a96-41cb-adb1-932f7eb26fa1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:17.517784 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f9a55207-3a96-41cb-adb1-932f7eb26fa1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:17.518283 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f9a55207-3a96-41cb-adb1-932f7eb26fa1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:17.518717 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f9a55207-3a96-41cb-adb1-932f7eb26fa1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:17.519565 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f9a55207-3a96-41cb-adb1-932f7eb26fa1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:17.520155 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f9a55207-3a96-41cb-adb1-932f7eb26fa1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:17.520563 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f9a55207-3a96-41cb-adb1-932f7eb26fa1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:17.524116 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ebea76e1-c83d-4ec8-a5a2-c5adee4cab8c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/ips" status: 200 len: 152 microversion: 2.20 time: 0.043942 Aug 10 12:43:17.524703 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 117/227] 10.222.0.49 () {60 vars in 1289 bytes} [Wed Aug 10 12:43:17 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/ips => generated 152 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:43:17.706152 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f9a55207-3a96-41cb-adb1-932f7eb26fa1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:17.720993 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f9a55207-3a96-41cb-adb1-932f7eb26fa1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48" status: 200 len: 1520 microversion: 2.1 time: 0.216326 Aug 10 12:43:17.721574 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 111/228] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:17 2022] GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48 => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:43:18.742993 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c3976edc-4978-4d21-ac25-1876ab77a5ea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:18.743708 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c3976edc-4978-4d21-ac25-1876ab77a5ea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:18.749570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3976edc-4978-4d21-ac25-1876ab77a5ea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:18.750268 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3976edc-4978-4d21-ac25-1876ab77a5ea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:18.750700 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3976edc-4978-4d21-ac25-1876ab77a5ea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:18.751422 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3976edc-4978-4d21-ac25-1876ab77a5ea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:18.751876 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3976edc-4978-4d21-ac25-1876ab77a5ea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:18.752301 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3976edc-4978-4d21-ac25-1876ab77a5ea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:18.888080 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c3976edc-4978-4d21-ac25-1876ab77a5ea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:18.900284 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c3976edc-4978-4d21-ac25-1876ab77a5ea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48" status: 200 len: 1520 microversion: 2.1 time: 0.160996 Aug 10 12:43:18.900894 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 118/229] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:18 2022] GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:19.923201 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-73ed6e50-c55a-4c26-8ea0-0c150e00df13 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:19.926107 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-73ed6e50-c55a-4c26-8ea0-0c150e00df13 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:19.930343 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73ed6e50-c55a-4c26-8ea0-0c150e00df13 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:19.930834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73ed6e50-c55a-4c26-8ea0-0c150e00df13 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:19.931468 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73ed6e50-c55a-4c26-8ea0-0c150e00df13 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:19.932566 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73ed6e50-c55a-4c26-8ea0-0c150e00df13 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:19.933027 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73ed6e50-c55a-4c26-8ea0-0c150e00df13 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:19.933451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73ed6e50-c55a-4c26-8ea0-0c150e00df13 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:20.066383 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-73ed6e50-c55a-4c26-8ea0-0c150e00df13 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:20.073759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-73ed6e50-c55a-4c26-8ea0-0c150e00df13 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48" status: 200 len: 1520 microversion: 2.1 time: 0.155730 Aug 10 12:43:20.074324 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 112/230] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:19 2022] GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:20.473348 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-709675e2-83e3-403a-957f-c210b2ccd897 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:43:20.473956 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-709675e2-83e3-403a-957f-c210b2ccd897 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:20.486785 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=30 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:43:20.489078 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-709675e2-83e3-403a-957f-c210b2ccd897 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:20.489646 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-709675e2-83e3-403a-957f-c210b2ccd897 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:20.494896 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-709675e2-83e3-403a-957f-c210b2ccd897 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:20.494896 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-709675e2-83e3-403a-957f-c210b2ccd897 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:20.494896 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-709675e2-83e3-403a-957f-c210b2ccd897 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:20.494896 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-709675e2-83e3-403a-957f-c210b2ccd897 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:20.515808 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.objects.instance [None req-709675e2-83e3-403a-957f-c210b2ccd897 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lazy-loading 'flavor' on Instance uuid 572a91d2-8a56-4616-97e4-b0d48cc57ea5 {{(pid=124642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:43:21.077896 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-709675e2-83e3-403a-957f-c210b2ccd897 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "POST /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/action" status: 202 len: 0 microversion: 2.20 time: 0.608305 Aug 10 12:43:21.078479 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 119/231] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Aug 10 12:43:20 2022] POST /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/action => generated 0 bytes in 610 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 12:43:21.086939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e9f780de-38ec-4ad5-b447-892a31b1c94f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:21.087567 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e9f780de-38ec-4ad5-b447-892a31b1c94f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:21.094884 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9f780de-38ec-4ad5-b447-892a31b1c94f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:21.095455 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-dee0f53f-4f78-4f2d-98fc-8a1ea08158c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:21.095574 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9f780de-38ec-4ad5-b447-892a31b1c94f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:21.095893 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9f780de-38ec-4ad5-b447-892a31b1c94f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:21.096171 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-dee0f53f-4f78-4f2d-98fc-8a1ea08158c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:21.096565 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9f780de-38ec-4ad5-b447-892a31b1c94f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:21.097012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9f780de-38ec-4ad5-b447-892a31b1c94f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:21.097429 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9f780de-38ec-4ad5-b447-892a31b1c94f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:21.102725 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dee0f53f-4f78-4f2d-98fc-8a1ea08158c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:21.103302 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dee0f53f-4f78-4f2d-98fc-8a1ea08158c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:21.106474 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dee0f53f-4f78-4f2d-98fc-8a1ea08158c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:21.106474 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dee0f53f-4f78-4f2d-98fc-8a1ea08158c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:21.106474 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dee0f53f-4f78-4f2d-98fc-8a1ea08158c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:21.106474 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dee0f53f-4f78-4f2d-98fc-8a1ea08158c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:21.298100 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e9f780de-38ec-4ad5-b447-892a31b1c94f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:21.304910 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-dee0f53f-4f78-4f2d-98fc-8a1ea08158c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:21.307500 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e9f780de-38ec-4ad5-b447-892a31b1c94f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:21.307652 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e9f780de-38ec-4ad5-b447-892a31b1c94f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:21.308806 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e9f780de-38ec-4ad5-b447-892a31b1c94f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1723 microversion: 2.20 time: 0.225793 Aug 10 12:43:21.309362 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 113/232] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:21 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:43:21.312738 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-dee0f53f-4f78-4f2d-98fc-8a1ea08158c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48" status: 200 len: 1520 microversion: 2.1 time: 0.221864 Aug 10 12:43:21.313295 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 120/233] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:21 2022] GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:43:22.333710 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8655f71b-7572-4edb-b60b-161b6df7f57f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:22.334337 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-95019c13-2e1c-4c0b-9c49-bfd927c05d98 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:22.334696 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8655f71b-7572-4edb-b60b-161b6df7f57f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:22.334797 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-95019c13-2e1c-4c0b-9c49-bfd927c05d98 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:22.340316 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8655f71b-7572-4edb-b60b-161b6df7f57f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:22.340700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-95019c13-2e1c-4c0b-9c49-bfd927c05d98 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:22.340813 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8655f71b-7572-4edb-b60b-161b6df7f57f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:22.341174 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-95019c13-2e1c-4c0b-9c49-bfd927c05d98 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:22.341285 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8655f71b-7572-4edb-b60b-161b6df7f57f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:22.341627 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-95019c13-2e1c-4c0b-9c49-bfd927c05d98 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:22.341871 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8655f71b-7572-4edb-b60b-161b6df7f57f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:22.342317 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8655f71b-7572-4edb-b60b-161b6df7f57f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:22.342451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-95019c13-2e1c-4c0b-9c49-bfd927c05d98 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:22.342733 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8655f71b-7572-4edb-b60b-161b6df7f57f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:22.342932 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-95019c13-2e1c-4c0b-9c49-bfd927c05d98 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:22.343397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-95019c13-2e1c-4c0b-9c49-bfd927c05d98 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:22.536030 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-8655f71b-7572-4edb-b60b-161b6df7f57f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:22.540215 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-95019c13-2e1c-4c0b-9c49-bfd927c05d98 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:22.543950 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8655f71b-7572-4edb-b60b-161b6df7f57f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48" status: 200 len: 1520 microversion: 2.1 time: 0.214047 Aug 10 12:43:22.544649 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 121/234] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:22 2022] GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48 => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:43:22.548402 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-95019c13-2e1c-4c0b-9c49-bfd927c05d98 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:22.549918 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-95019c13-2e1c-4c0b-9c49-bfd927c05d98 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:22.551061 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-95019c13-2e1c-4c0b-9c49-bfd927c05d98 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1723 microversion: 2.20 time: 0.221272 Aug 10 12:43:22.551711 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 114/235] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:22 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:43:22.722729 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5df8631b-9e40-4107-a833-fecb2f36cc6b tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1797440936", "imageRef": "674dcf76-6c38-40de-b204-ad2842738058", "flavorRef": "452", "networks": [{"uuid": "2d3b6e86-7949-4709-9ced-f4c606857a50"}]}} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:43:22.776443 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.network.neutron [None req-5df8631b-9e40-4107-a833-fecb2f36cc6b tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] validate_networks() for [('2d3b6e86-7949-4709-9ced-f4c606857a50', None, None, None, None, None)] {{(pid=124642) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:43:23.132091 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-5df8631b-9e40-4107-a833-fecb2f36cc6b tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Flavor limits 0:0:0 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:43:23.132511 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-5df8631b-9e40-4107-a833-fecb2f36cc6b tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Image limits 0:0:0 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:43:23.132976 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-5df8631b-9e40-4107-a833-fecb2f36cc6b tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Flavor pref 0:0:0 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:43:23.133378 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-5df8631b-9e40-4107-a833-fecb2f36cc6b tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Image pref 0:0:0 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:43:23.133779 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-5df8631b-9e40-4107-a833-fecb2f36cc6b tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:43:23.143835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5df8631b-9e40-4107-a833-fecb2f36cc6b tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:23.144429 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5df8631b-9e40-4107-a833-fecb2f36cc6b tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:23.144930 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5df8631b-9e40-4107-a833-fecb2f36cc6b tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:23.145663 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5df8631b-9e40-4107-a833-fecb2f36cc6b tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:23.146116 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5df8631b-9e40-4107-a833-fecb2f36cc6b tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:23.146535 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5df8631b-9e40-4107-a833-fecb2f36cc6b tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:23.164675 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.quota [None req-5df8631b-9e40-4107-a833-fecb2f36cc6b tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Getting quotas for project ca783a603c484aad86d05156d7e9142c. Resources: {'cores', 'ram', 'instances'} {{(pid=124642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:43:23.171360 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.quota [None req-5df8631b-9e40-4107-a833-fecb2f36cc6b tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Getting quotas for user 00b19e56e11047e3b0f102efea439b7f and project ca783a603c484aad86d05156d7e9142c. Resources: {'cores', 'ram', 'instances'} {{(pid=124642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:43:23.184035 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5df8631b-9e40-4107-a833-fecb2f36cc6b tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Going to run 1 instances... {{(pid=124642) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:43:23.186616 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5df8631b-9e40-4107-a833-fecb2f36cc6b tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 590f8a6c-039f-4e6b-b23b-e56b9356dc48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='674dcf76-6c38-40de-b204-ad2842738058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:43:23.383140 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5df8631b-9e40-4107-a833-fecb2f36cc6b tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.658933 Aug 10 12:43:23.383140 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 122/236] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 12:43:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 12:43:23.390418 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fa40e73b-acda-443d-bcc7-9eab1103e1a1 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:23.391097 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fa40e73b-acda-443d-bcc7-9eab1103e1a1 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 590f8a6c-039f-4e6b-b23b-e56b9356dc48] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:23.446112 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fa40e73b-acda-443d-bcc7-9eab1103e1a1 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:23.453504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fa40e73b-acda-443d-bcc7-9eab1103e1a1 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48" status: 200 len: 1214 microversion: 2.1 time: 0.067309 Aug 10 12:43:23.466121 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 115/237] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:23 2022] GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:23.566654 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-afab92f5-3a6f-4e64-920c-df4d22c68a0c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:23.567868 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-afab92f5-3a6f-4e64-920c-df4d22c68a0c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:23.573191 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-79667ddf-14fb-4571-8f37-658a0e4674b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:23.573959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-79667ddf-14fb-4571-8f37-658a0e4674b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:23.575727 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-afab92f5-3a6f-4e64-920c-df4d22c68a0c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:23.577607 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-afab92f5-3a6f-4e64-920c-df4d22c68a0c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:23.578401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-afab92f5-3a6f-4e64-920c-df4d22c68a0c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:23.579302 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-afab92f5-3a6f-4e64-920c-df4d22c68a0c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:23.579758 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-afab92f5-3a6f-4e64-920c-df4d22c68a0c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:23.580178 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-afab92f5-3a6f-4e64-920c-df4d22c68a0c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:23.583559 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-79667ddf-14fb-4571-8f37-658a0e4674b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:23.583977 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-79667ddf-14fb-4571-8f37-658a0e4674b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:23.584403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-79667ddf-14fb-4571-8f37-658a0e4674b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:23.585091 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-79667ddf-14fb-4571-8f37-658a0e4674b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:23.585540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-79667ddf-14fb-4571-8f37-658a0e4674b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:23.585957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-79667ddf-14fb-4571-8f37-658a0e4674b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:23.788707 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-afab92f5-3a6f-4e64-920c-df4d22c68a0c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:23.791545 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-79667ddf-14fb-4571-8f37-658a0e4674b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:23.796953 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-afab92f5-3a6f-4e64-920c-df4d22c68a0c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48" status: 200 len: 1500 microversion: 2.1 time: 0.234602 Aug 10 12:43:23.797542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 123/238] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:23 2022] GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48 => generated 1500 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:23.799587 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-79667ddf-14fb-4571-8f37-658a0e4674b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:23.801096 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-79667ddf-14fb-4571-8f37-658a0e4674b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:23.802252 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-79667ddf-14fb-4571-8f37-658a0e4674b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1723 microversion: 2.20 time: 0.233181 Aug 10 12:43:23.802802 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 116/239] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:23 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:43:23.825111 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-127e8902-162e-4356-acc1-d3806a055086 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25e96ea0-c590-4d85-b0a5-b12987fcd6f3"}} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:43:23.829256 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-127e8902-162e-4356-acc1-d3806a055086 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:23.839997 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-127e8902-162e-4356-acc1-d3806a055086 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:23.839997 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-127e8902-162e-4356-acc1-d3806a055086 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:23.839997 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-127e8902-162e-4356-acc1-d3806a055086 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:23.839997 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-127e8902-162e-4356-acc1-d3806a055086 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:23.840607 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-127e8902-162e-4356-acc1-d3806a055086 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:23.840607 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-127e8902-162e-4356-acc1-d3806a055086 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:23.863374 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.wsgi [None req-127e8902-162e-4356-acc1-d3806a055086 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] HTTP exception thrown: Cannot 'attach_volume' instance 47011594-f6d9-44a1-9751-c564121b1e48 while it is in vm_state rescued Aug 10 12:43:23.865071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-127e8902-162e-4356-acc1-d3806a055086 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Request method failure captured: Aug 10 12:43:23.865071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: request: POST /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48/os-volume_attachments HTTP/1.1 Aug 10 12:43:23.865071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Accept: application/json Aug 10 12:43:23.865071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Accept-Encoding: identity Aug 10 12:43:23.865071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Connection: close Aug 10 12:43:23.865071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Content-Length: 74 Aug 10 12:43:23.865071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Content-Type: application/json Aug 10 12:43:23.865071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Host: 10.222.0.49 Aug 10 12:43:23.865071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Openstack-System-Scope: None Aug 10 12:43:23.865071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: User-Agent: python-urllib3/1.26.11 Aug 10 12:43:23.865071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Auth-Token: gAAAAABi86d8V7Brrx6jOFb99Co-FDZwmEvtyDVeYnH8_iANB7J0NxUN2f-snlAn2yDbwcWxDSfsOagaBhqRjhpuGGTJmnsBdXVXFojbAKSvab6i25pKG57S3rU9tOP4hLmZxjdwtg8aiJEX4QrfavtV7g9rCLVXL55K3jqoDXD9Uxp38OaL_Fg Aug 10 12:43:23.865071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Domain-Id: None Aug 10 12:43:23.865071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Domain-Name: None Aug 10 12:43:23.865071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Identity-Status: Confirmed Aug 10 12:43:23.865071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Is-Admin-Project: True Aug 10 12:43:23.865071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Project-Domain-Id: default Aug 10 12:43:23.865071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Project-Domain-Name: Default Aug 10 12:43:23.865071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Project-Id: e41d5b8acbce44248a45678d1e4f6b71 Aug 10 12:43:23.865071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1112223756 Aug 10 12:43:23.865071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Role: reader,member Aug 10 12:43:23.865071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Roles: reader,member Aug 10 12:43:23.868749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e41d5b8acbce44248a45678d1e4f6b71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e41d5b8acbce44248a45678d1e4f6b71", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e41d5b8acbce44248a45678d1e4f6b71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e41d5b8acbce44248a45678d1e4f6b71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 12:43:23.868749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1112223756 Aug 10 12:43:23.868749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Tenant-Id: e41d5b8acbce44248a45678d1e4f6b71 Aug 10 12:43:23.868749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1112223756 Aug 10 12:43:23.868749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User: tempest-ServerRescueNegativeTestJSON-1112223756-project Aug 10 12:43:23.868749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User-Domain-Id: default Aug 10 12:43:23.868749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User-Domain-Name: Default Aug 10 12:43:23.868749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User-Id: 39cb7e0c86b3460dbd17c58dc13ef0d9 Aug 10 12:43:23.868749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1112223756-project Aug 10 12:43:23.868749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Aug 10 12:43:23.868749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: {"volumeAttachment": {"volumeId": "25e96ea0-c590-4d85-b0a5-b12987fcd6f3"}} Aug 10 12:43:23.868749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: method: > Aug 10 12:43:23.869561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: exception: Cannot 'attach_volume' instance 47011594-f6d9-44a1-9751-c564121b1e48 while it is in vm_state rescued Aug 10 12:43:23.869561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: action_args: {'server_id': '47011594-f6d9-44a1-9751-c564121b1e48', 'body': {'volumeAttachment': {'volumeId': '25e96ea0-c590-4d85-b0a5-b12987fcd6f3'}}} Aug 10 12:43:23.869561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:43:23.869561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:43:23.869561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 12:43:23.869561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 12:43:23.869561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 12:43:23.869561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 12:43:23.869561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 12:43:23.869561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 12:43:23.869561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 47011594-f6d9-44a1-9751-c564121b1e48 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 10 12:43:23.869561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:43:23.869561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:43:23.869561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:43:23.869561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:43:23.869561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:43:23.869561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:43:23.869561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:43:23.869561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:43:23.871138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:43:23.871138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:43:23.871138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 12:43:23.871138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 12:43:23.871138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 12:43:23.871138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 12:43:23.871138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 12:43:23.871138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 12:43:23.871138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 10 12:43:23.871138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 12:43:23.871138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 12:43:23.871138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 12:43:23.871138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 47011594-f6d9-44a1-9751-c564121b1e48 while it is in vm_state rescued Aug 10 12:43:23.871138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:43:23.871138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:43:23.871138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:43:23.871138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:43:23.871138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:43:23.871138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:43:23.872506 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:43:23.872506 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:43:23.872506 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 47011594-f6d9-44a1-9751-c564121b1e48 while it is in vm_state rescued Aug 10 12:43:23.872506 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:43:23.872506 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-127e8902-162e-4356-acc1-d3806a055086 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Returning 409 to user: Cannot 'attach_volume' instance 47011594-f6d9-44a1-9751-c564121b1e48 while it is in vm_state rescued {{(pid=124642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:43:23.872506 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-127e8902-162e-4356-acc1-d3806a055086 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "POST /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045708 Aug 10 12:43:23.872506 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 124/240] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 10 12:43:23 2022] POST /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 12:43:23.876485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b2db0a78-645e-466e-be03-1497720aa122 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:43:23.877011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b2db0a78-645e-466e-be03-1497720aa122 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:23.882812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2db0a78-645e-466e-be03-1497720aa122 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:23.883318 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2db0a78-645e-466e-be03-1497720aa122 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:23.883745 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2db0a78-645e-466e-be03-1497720aa122 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:23.884415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2db0a78-645e-466e-be03-1497720aa122 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:23.884860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2db0a78-645e-466e-be03-1497720aa122 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:23.885314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2db0a78-645e-466e-be03-1497720aa122 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:24.144849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b2db0a78-645e-466e-be03-1497720aa122 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "POST /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48/action" status: 202 len: 0 microversion: 2.1 time: 0.272930 Aug 10 12:43:24.145519 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 117/241] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 10 12:43:23 2022] POST /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:43:24.153880 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-51a44fc5-0e87-41ab-8288-d2109c0eeed3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:24.154483 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-51a44fc5-0e87-41ab-8288-d2109c0eeed3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:24.161252 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51a44fc5-0e87-41ab-8288-d2109c0eeed3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:24.163108 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51a44fc5-0e87-41ab-8288-d2109c0eeed3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:24.163108 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51a44fc5-0e87-41ab-8288-d2109c0eeed3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:24.163108 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51a44fc5-0e87-41ab-8288-d2109c0eeed3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:24.163548 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51a44fc5-0e87-41ab-8288-d2109c0eeed3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:24.163975 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51a44fc5-0e87-41ab-8288-d2109c0eeed3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:24.306477 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-51a44fc5-0e87-41ab-8288-d2109c0eeed3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:24.315802 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-51a44fc5-0e87-41ab-8288-d2109c0eeed3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48" status: 200 len: 1508 microversion: 2.1 time: 0.165699 Aug 10 12:43:24.316227 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 125/242] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:24 2022] GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:24.382668 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f56e8e8d-d12f-46e5-84da-5ca95babb131 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:24.383893 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f56e8e8d-d12f-46e5-84da-5ca95babb131 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:24.392894 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f56e8e8d-d12f-46e5-84da-5ca95babb131 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:24.394008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f56e8e8d-d12f-46e5-84da-5ca95babb131 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:24.394630 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f56e8e8d-d12f-46e5-84da-5ca95babb131 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:24.395641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f56e8e8d-d12f-46e5-84da-5ca95babb131 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:24.396082 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f56e8e8d-d12f-46e5-84da-5ca95babb131 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:24.396921 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f56e8e8d-d12f-46e5-84da-5ca95babb131 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:24.424542 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f56e8e8d-d12f-46e5-84da-5ca95babb131 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/ips" status: 200 len: 149 microversion: 2.1 time: 0.045970 Aug 10 12:43:24.431663 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 118/243] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 10 12:43:24 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/ips => generated 149 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:43:24.474584 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8313cdc3-6323-42c3-b7f9-0c50016d28a1 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:24.475476 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8313cdc3-6323-42c3-b7f9-0c50016d28a1 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 590f8a6c-039f-4e6b-b23b-e56b9356dc48] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:24.485855 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8313cdc3-6323-42c3-b7f9-0c50016d28a1 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:24.486600 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8313cdc3-6323-42c3-b7f9-0c50016d28a1 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:24.487042 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8313cdc3-6323-42c3-b7f9-0c50016d28a1 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:24.487775 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8313cdc3-6323-42c3-b7f9-0c50016d28a1 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:24.488232 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8313cdc3-6323-42c3-b7f9-0c50016d28a1 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:24.488657 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8313cdc3-6323-42c3-b7f9-0c50016d28a1 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:24.579756 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-8313cdc3-6323-42c3-b7f9-0c50016d28a1 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:24.593433 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8313cdc3-6323-42c3-b7f9-0c50016d28a1 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48" status: 200 len: 1218 microversion: 2.1 time: 0.119239 Aug 10 12:43:24.606912 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 126/244] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:24 2022] GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48 => generated 1218 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:24.825265 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-edeeca66-8f38-4a73-a30d-d46a810837f2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:24.826046 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-edeeca66-8f38-4a73-a30d-d46a810837f2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:24.833675 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-edeeca66-8f38-4a73-a30d-d46a810837f2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:24.834178 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-edeeca66-8f38-4a73-a30d-d46a810837f2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:24.834593 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-edeeca66-8f38-4a73-a30d-d46a810837f2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:24.835315 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-edeeca66-8f38-4a73-a30d-d46a810837f2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:24.835765 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-edeeca66-8f38-4a73-a30d-d46a810837f2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:24.836185 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-edeeca66-8f38-4a73-a30d-d46a810837f2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:24.986063 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-edeeca66-8f38-4a73-a30d-d46a810837f2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:24.994206 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-edeeca66-8f38-4a73-a30d-d46a810837f2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:24.995763 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-edeeca66-8f38-4a73-a30d-d46a810837f2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:24.996913 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-edeeca66-8f38-4a73-a30d-d46a810837f2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1723 microversion: 2.20 time: 0.175660 Aug 10 12:43:24.997478 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 119/245] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:24 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:43:25.337073 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c3f40986-2f2a-4035-9b6f-dae573daea25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:25.337675 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c3f40986-2f2a-4035-9b6f-dae573daea25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:25.343839 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3f40986-2f2a-4035-9b6f-dae573daea25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:25.344318 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3f40986-2f2a-4035-9b6f-dae573daea25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:25.350453 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3f40986-2f2a-4035-9b6f-dae573daea25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:25.350453 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3f40986-2f2a-4035-9b6f-dae573daea25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:25.350453 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3f40986-2f2a-4035-9b6f-dae573daea25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:25.350453 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3f40986-2f2a-4035-9b6f-dae573daea25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:25.481290 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c3f40986-2f2a-4035-9b6f-dae573daea25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:25.490014 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c3f40986-2f2a-4035-9b6f-dae573daea25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48" status: 200 len: 1508 microversion: 2.1 time: 0.156833 Aug 10 12:43:25.490580 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 127/246] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:25 2022] GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:25.615367 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-25112a32-756a-45de-8e22-3d0bbfa75336 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:25.615952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-25112a32-756a-45de-8e22-3d0bbfa75336 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 590f8a6c-039f-4e6b-b23b-e56b9356dc48] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:25.622403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25112a32-756a-45de-8e22-3d0bbfa75336 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:25.622869 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25112a32-756a-45de-8e22-3d0bbfa75336 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:25.623347 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25112a32-756a-45de-8e22-3d0bbfa75336 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:25.624096 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25112a32-756a-45de-8e22-3d0bbfa75336 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:25.624573 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25112a32-756a-45de-8e22-3d0bbfa75336 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:25.624988 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25112a32-756a-45de-8e22-3d0bbfa75336 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:25.681268 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-be70264b-4b85-4350-84de-f5be06116c3e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:25.681787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-be70264b-4b85-4350-84de-f5be06116c3e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:25.687662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-25112a32-756a-45de-8e22-3d0bbfa75336 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:25.688287 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-be70264b-4b85-4350-84de-f5be06116c3e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:25.688811 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-be70264b-4b85-4350-84de-f5be06116c3e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:25.689248 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-be70264b-4b85-4350-84de-f5be06116c3e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:25.689942 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-be70264b-4b85-4350-84de-f5be06116c3e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:25.690394 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-be70264b-4b85-4350-84de-f5be06116c3e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:25.690818 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-be70264b-4b85-4350-84de-f5be06116c3e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:25.694715 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:43:25.695162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-25112a32-756a-45de-8e22-3d0bbfa75336 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48" status: 200 len: 1266 microversion: 2.1 time: 0.083987 Aug 10 12:43:25.695824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 120/247] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:25 2022] GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:25.714409 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-be70264b-4b85-4350-84de-f5be06116c3e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/ips" status: 200 len: 144 microversion: 2.1 time: 0.036959 Aug 10 12:43:25.714978 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 128/248] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 10 12:43:25 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/ips => generated 144 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:43:26.021767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e78e1f4d-f565-41c3-a8cf-2526eebeca94 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:26.022415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e78e1f4d-f565-41c3-a8cf-2526eebeca94 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:26.028661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e78e1f4d-f565-41c3-a8cf-2526eebeca94 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:26.029138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e78e1f4d-f565-41c3-a8cf-2526eebeca94 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:26.029676 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e78e1f4d-f565-41c3-a8cf-2526eebeca94 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:26.031010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e78e1f4d-f565-41c3-a8cf-2526eebeca94 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:26.031507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e78e1f4d-f565-41c3-a8cf-2526eebeca94 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:26.031928 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e78e1f4d-f565-41c3-a8cf-2526eebeca94 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:26.165976 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e78e1f4d-f565-41c3-a8cf-2526eebeca94 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:26.174173 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e78e1f4d-f565-41c3-a8cf-2526eebeca94 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:26.175681 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e78e1f4d-f565-41c3-a8cf-2526eebeca94 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:26.176814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e78e1f4d-f565-41c3-a8cf-2526eebeca94 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1723 microversion: 2.20 time: 0.159345 Aug 10 12:43:26.177377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 121/249] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:26 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:43:26.344419 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3d39f08a-9065-4e16-993f-a8be3a4faa60 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71d6da2e-35ff-4038-9ec8-9618a65cf0cf"}} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:43:26.347141 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3d39f08a-9065-4e16-993f-a8be3a4faa60 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:26.353824 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d39f08a-9065-4e16-993f-a8be3a4faa60 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:26.354591 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d39f08a-9065-4e16-993f-a8be3a4faa60 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:26.355251 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d39f08a-9065-4e16-993f-a8be3a4faa60 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:26.356182 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d39f08a-9065-4e16-993f-a8be3a4faa60 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:26.356758 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d39f08a-9065-4e16-993f-a8be3a4faa60 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:26.357660 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d39f08a-9065-4e16-993f-a8be3a4faa60 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:26.511535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1c0de114-f5e4-4007-b1c1-bfd422eaa4ea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:26.512147 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1c0de114-f5e4-4007-b1c1-bfd422eaa4ea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:26.518788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1c0de114-f5e4-4007-b1c1-bfd422eaa4ea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:26.519315 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1c0de114-f5e4-4007-b1c1-bfd422eaa4ea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:26.520243 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1c0de114-f5e4-4007-b1c1-bfd422eaa4ea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:26.520968 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1c0de114-f5e4-4007-b1c1-bfd422eaa4ea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:26.521580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1c0de114-f5e4-4007-b1c1-bfd422eaa4ea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:26.522014 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1c0de114-f5e4-4007-b1c1-bfd422eaa4ea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:26.652117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1c0de114-f5e4-4007-b1c1-bfd422eaa4ea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:26.660298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1c0de114-f5e4-4007-b1c1-bfd422eaa4ea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48" status: 200 len: 1508 microversion: 2.1 time: 0.152612 Aug 10 12:43:26.660891 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 122/250] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:26 2022] GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:43:26.715964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-91e69bb0-0ed9-456f-8247-4c4c0e17250a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:26.716602 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-91e69bb0-0ed9-456f-8247-4c4c0e17250a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 590f8a6c-039f-4e6b-b23b-e56b9356dc48] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:26.722570 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91e69bb0-0ed9-456f-8247-4c4c0e17250a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:26.723053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91e69bb0-0ed9-456f-8247-4c4c0e17250a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:26.723523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91e69bb0-0ed9-456f-8247-4c4c0e17250a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:26.724211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91e69bb0-0ed9-456f-8247-4c4c0e17250a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:26.724663 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91e69bb0-0ed9-456f-8247-4c4c0e17250a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:26.725088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91e69bb0-0ed9-456f-8247-4c4c0e17250a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:26.790775 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-91e69bb0-0ed9-456f-8247-4c4c0e17250a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:26.798857 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-91e69bb0-0ed9-456f-8247-4c4c0e17250a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48" status: 200 len: 1266 microversion: 2.1 time: 0.086725 Aug 10 12:43:26.799875 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 123/251] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:26 2022] GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:43:27.199315 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f5298a6a-e843-4366-90be-d76071d2d98a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:27.199981 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f5298a6a-e843-4366-90be-d76071d2d98a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:27.208362 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f5298a6a-e843-4366-90be-d76071d2d98a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:27.208846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f5298a6a-e843-4366-90be-d76071d2d98a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:27.209275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f5298a6a-e843-4366-90be-d76071d2d98a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:27.210034 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f5298a6a-e843-4366-90be-d76071d2d98a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:27.210491 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f5298a6a-e843-4366-90be-d76071d2d98a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:27.210909 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f5298a6a-e843-4366-90be-d76071d2d98a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:27.352687 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f5298a6a-e843-4366-90be-d76071d2d98a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:27.361822 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f5298a6a-e843-4366-90be-d76071d2d98a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:27.363341 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f5298a6a-e843-4366-90be-d76071d2d98a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:27.364485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f5298a6a-e843-4366-90be-d76071d2d98a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1723 microversion: 2.20 time: 0.169148 Aug 10 12:43:27.365055 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 124/252] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:27 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:43:27.594491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3d39f08a-9065-4e16-993f-a8be3a4faa60 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "POST /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.254660 Aug 10 12:43:27.596150 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 129/253] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 10 12:43:26 2022] POST /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 194 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:43:27.680928 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-98d3cba8-2e9c-4809-a822-5db02c64a0cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:27.682184 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-98d3cba8-2e9c-4809-a822-5db02c64a0cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:27.691238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98d3cba8-2e9c-4809-a822-5db02c64a0cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:27.691951 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98d3cba8-2e9c-4809-a822-5db02c64a0cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:27.692549 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98d3cba8-2e9c-4809-a822-5db02c64a0cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:27.693417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98d3cba8-2e9c-4809-a822-5db02c64a0cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:27.694072 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98d3cba8-2e9c-4809-a822-5db02c64a0cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:27.694675 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98d3cba8-2e9c-4809-a822-5db02c64a0cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:27.823038 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2bb9fd1e-ee2e-4b80-b42d-a1e4895f1dcc tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:27.825787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2bb9fd1e-ee2e-4b80-b42d-a1e4895f1dcc tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 590f8a6c-039f-4e6b-b23b-e56b9356dc48] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:27.846431 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bb9fd1e-ee2e-4b80-b42d-a1e4895f1dcc tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:27.848489 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bb9fd1e-ee2e-4b80-b42d-a1e4895f1dcc tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:27.848941 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bb9fd1e-ee2e-4b80-b42d-a1e4895f1dcc tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:27.849658 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bb9fd1e-ee2e-4b80-b42d-a1e4895f1dcc tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:27.850110 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bb9fd1e-ee2e-4b80-b42d-a1e4895f1dcc tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:27.850533 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bb9fd1e-ee2e-4b80-b42d-a1e4895f1dcc tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:27.947221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2bb9fd1e-ee2e-4b80-b42d-a1e4895f1dcc tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:27.955508 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2bb9fd1e-ee2e-4b80-b42d-a1e4895f1dcc tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48" status: 200 len: 1274 microversion: 2.1 time: 0.137607 Aug 10 12:43:27.956101 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 130/254] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:27 2022] GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48 => generated 1274 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:43:27.960143 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-98d3cba8-2e9c-4809-a822-5db02c64a0cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:27.967880 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-98d3cba8-2e9c-4809-a822-5db02c64a0cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48" status: 200 len: 1514 microversion: 2.1 time: 0.290812 Aug 10 12:43:27.968624 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 125/255] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:27 2022] GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48 => generated 1514 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:28.387047 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a0ac8ade-cef7-4f46-970f-4fff5a47739d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:28.387696 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a0ac8ade-cef7-4f46-970f-4fff5a47739d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:28.394939 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a0ac8ade-cef7-4f46-970f-4fff5a47739d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:28.397500 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a0ac8ade-cef7-4f46-970f-4fff5a47739d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:28.398240 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a0ac8ade-cef7-4f46-970f-4fff5a47739d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:28.399209 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a0ac8ade-cef7-4f46-970f-4fff5a47739d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:28.399701 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a0ac8ade-cef7-4f46-970f-4fff5a47739d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:28.400132 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a0ac8ade-cef7-4f46-970f-4fff5a47739d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:28.557856 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a0ac8ade-cef7-4f46-970f-4fff5a47739d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:28.567865 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a0ac8ade-cef7-4f46-970f-4fff5a47739d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:28.569734 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a0ac8ade-cef7-4f46-970f-4fff5a47739d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:28.571019 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a0ac8ade-cef7-4f46-970f-4fff5a47739d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1723 microversion: 2.20 time: 0.187962 Aug 10 12:43:28.571777 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 131/256] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:28 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:43:28.984156 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1a557bdb-707d-409e-92dc-b4c106bf9e21 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:28.985353 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1a557bdb-707d-409e-92dc-b4c106bf9e21 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 590f8a6c-039f-4e6b-b23b-e56b9356dc48] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:28.996717 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1a557bdb-707d-409e-92dc-b4c106bf9e21 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:28.997302 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1a557bdb-707d-409e-92dc-b4c106bf9e21 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:29.000287 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1a557bdb-707d-409e-92dc-b4c106bf9e21 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:29.002551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1a557bdb-707d-409e-92dc-b4c106bf9e21 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:29.003368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1a557bdb-707d-409e-92dc-b4c106bf9e21 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:29.006242 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1a557bdb-707d-409e-92dc-b4c106bf9e21 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:29.028846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:43:29.190662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1a557bdb-707d-409e-92dc-b4c106bf9e21 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:29.199072 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1a557bdb-707d-409e-92dc-b4c106bf9e21 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48" status: 200 len: 1314 microversion: 2.1 time: 0.219641 Aug 10 12:43:29.199680 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 126/257] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:28 2022] GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:29.594775 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-86530d7c-4eab-4c2f-a6db-7249c6a6c7ae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:29.595425 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-86530d7c-4eab-4c2f-a6db-7249c6a6c7ae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:29.601496 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86530d7c-4eab-4c2f-a6db-7249c6a6c7ae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:29.602102 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86530d7c-4eab-4c2f-a6db-7249c6a6c7ae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:29.602805 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86530d7c-4eab-4c2f-a6db-7249c6a6c7ae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:29.603191 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86530d7c-4eab-4c2f-a6db-7249c6a6c7ae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:29.603644 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86530d7c-4eab-4c2f-a6db-7249c6a6c7ae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:29.604064 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86530d7c-4eab-4c2f-a6db-7249c6a6c7ae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:29.757568 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-86530d7c-4eab-4c2f-a6db-7249c6a6c7ae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:29.765646 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-86530d7c-4eab-4c2f-a6db-7249c6a6c7ae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:29.767141 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-86530d7c-4eab-4c2f-a6db-7249c6a6c7ae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:29.768311 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-86530d7c-4eab-4c2f-a6db-7249c6a6c7ae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1723 microversion: 2.20 time: 0.177317 Aug 10 12:43:29.768876 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 132/258] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:29 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:43:29.835235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-3233ef1a-5b78-438f-883e-368422d69c77 req-b82e26af-1ceb-4f61-bd38-bede6a11a5b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "590f8a6c-039f-4e6b-b23b-e56b9356dc48", "tag": "c5b76b3e-8f4f-408b-ae5a-475ddd82e98e"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:43:29.848618 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-3233ef1a-5b78-438f-883e-368422d69c77 req-b82e26af-1ceb-4f61-bd38-bede6a11a5b6 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:29.849302 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-3233ef1a-5b78-438f-883e-368422d69c77 req-b82e26af-1ceb-4f61-bd38-bede6a11a5b6 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:29.849723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-3233ef1a-5b78-438f-883e-368422d69c77 req-b82e26af-1ceb-4f61-bd38-bede6a11a5b6 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:29.873265 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-3233ef1a-5b78-438f-883e-368422d69c77 req-b82e26af-1ceb-4f61-bd38-bede6a11a5b6 service nova] Creating event network-changed:c5b76b3e-8f4f-408b-ae5a-475ddd82e98e for instance 590f8a6c-039f-4e6b-b23b-e56b9356dc48 on hv-cinder-85199 Aug 10 12:43:29.885414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-3233ef1a-5b78-438f-883e-368422d69c77 req-b82e26af-1ceb-4f61-bd38-bede6a11a5b6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059814 Aug 10 12:43:29.885414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 127/259] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:43:29.922553 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-55b42dac-7ad0-47ee-a514-2dcfeb457319 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d5112d7-7c9b-4c4c-ac48-633e2324b7c5"}} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:43:29.925396 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-55b42dac-7ad0-47ee-a514-2dcfeb457319 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:29.931541 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-55b42dac-7ad0-47ee-a514-2dcfeb457319 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:29.932437 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-55b42dac-7ad0-47ee-a514-2dcfeb457319 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:29.935350 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-55b42dac-7ad0-47ee-a514-2dcfeb457319 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:29.935350 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-55b42dac-7ad0-47ee-a514-2dcfeb457319 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:29.935350 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-55b42dac-7ad0-47ee-a514-2dcfeb457319 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:29.935350 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-55b42dac-7ad0-47ee-a514-2dcfeb457319 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:30.165846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f0359c0e-eab8-4097-88f9-e993d8c63614 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Action: 'create', calling method: .version_select at 0x7fb826b70b80>, body: {"keypair": {"name": "tempest-keypair-899395175", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJPEt90pawy7jv6CjqtR6P6CgVNfkT7c+TunTgg/sBi0dExUDfxhT0XRcsoC9YBoHz0N+pV1gFV7NVABRtslAYqFZ/ReY0mXFIEJnRktQg+pb3LUYvw9BPTXTxWGWhbOw=="}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:43:30.182780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-f0359c0e-eab8-4097-88f9-e993d8c63614 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Getting quotas for project e41d5b8acbce44248a45678d1e4f6b71. Resources: {'key_pairs'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:43:30.187240 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-f0359c0e-eab8-4097-88f9-e993d8c63614 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Getting quotas for user 39cb7e0c86b3460dbd17c58dc13ef0d9 and project e41d5b8acbce44248a45678d1e4f6b71. Resources: {'key_pairs'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:43:30.289346 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f0359c0e-eab8-4097-88f9-e993d8c63614 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.128101 Aug 10 12:43:30.289346 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 128/260] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 10 12:43:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:43:30.290663 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-95d800fa-99eb-445c-bfb9-9bef7fb35ca8 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:30.291414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-95d800fa-99eb-445c-bfb9-9bef7fb35ca8 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 590f8a6c-039f-4e6b-b23b-e56b9356dc48] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:30.298962 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-95d800fa-99eb-445c-bfb9-9bef7fb35ca8 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:30.299480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-95d800fa-99eb-445c-bfb9-9bef7fb35ca8 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:30.299914 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-95d800fa-99eb-445c-bfb9-9bef7fb35ca8 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:30.300658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-95d800fa-99eb-445c-bfb9-9bef7fb35ca8 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:30.301108 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-95d800fa-99eb-445c-bfb9-9bef7fb35ca8 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:30.301523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-95d800fa-99eb-445c-bfb9-9bef7fb35ca8 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:30.482212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-95d800fa-99eb-445c-bfb9-9bef7fb35ca8 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:30.494594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-95d800fa-99eb-445c-bfb9-9bef7fb35ca8 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48" status: 200 len: 1314 microversion: 2.1 time: 0.207209 Aug 10 12:43:30.496042 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 129/261] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:30 2022] GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:30.792044 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0428ffdb-7f0b-4796-b4e3-2fbfef9062cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:30.792631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0428ffdb-7f0b-4796-b4e3-2fbfef9062cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:30.812511 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0428ffdb-7f0b-4796-b4e3-2fbfef9062cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:30.812511 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0428ffdb-7f0b-4796-b4e3-2fbfef9062cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:30.812511 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0428ffdb-7f0b-4796-b4e3-2fbfef9062cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:30.812511 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0428ffdb-7f0b-4796-b4e3-2fbfef9062cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:30.812847 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0428ffdb-7f0b-4796-b4e3-2fbfef9062cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:30.812847 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0428ffdb-7f0b-4796-b4e3-2fbfef9062cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:30.847988 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-55b42dac-7ad0-47ee-a514-2dcfeb457319 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "POST /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.930338 Aug 10 12:43:30.848759 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 133/262] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 10 12:43:29 2022] POST /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 194 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:43:31.012124 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0428ffdb-7f0b-4796-b4e3-2fbfef9062cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:31.022374 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0428ffdb-7f0b-4796-b4e3-2fbfef9062cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:31.023986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0428ffdb-7f0b-4796-b4e3-2fbfef9062cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:31.025158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0428ffdb-7f0b-4796-b4e3-2fbfef9062cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1723 microversion: 2.20 time: 0.237306 Aug 10 12:43:31.025717 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 130/263] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:30 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:43:31.517109 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e8e09f37-4804-4f11-b140-e3bab9652d69 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:31.517835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e8e09f37-4804-4f11-b140-e3bab9652d69 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 590f8a6c-039f-4e6b-b23b-e56b9356dc48] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:31.524845 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e8e09f37-4804-4f11-b140-e3bab9652d69 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:31.525332 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e8e09f37-4804-4f11-b140-e3bab9652d69 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:31.525761 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e8e09f37-4804-4f11-b140-e3bab9652d69 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:31.526457 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e8e09f37-4804-4f11-b140-e3bab9652d69 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:31.526908 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e8e09f37-4804-4f11-b140-e3bab9652d69 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:31.527388 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e8e09f37-4804-4f11-b140-e3bab9652d69 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:31.662238 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e8e09f37-4804-4f11-b140-e3bab9652d69 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:31.670779 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e8e09f37-4804-4f11-b140-e3bab9652d69 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48" status: 200 len: 1314 microversion: 2.1 time: 0.158481 Aug 10 12:43:31.671687 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 134/264] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:31 2022] GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:32.062518 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e6f1a404-29ef-4ee5-96a5-a1aff551084f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:32.062518 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e6f1a404-29ef-4ee5-96a5-a1aff551084f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:32.062518 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:43:32.062518 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6f1a404-29ef-4ee5-96a5-a1aff551084f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:32.063569 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6f1a404-29ef-4ee5-96a5-a1aff551084f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:32.063569 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6f1a404-29ef-4ee5-96a5-a1aff551084f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:32.064407 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6f1a404-29ef-4ee5-96a5-a1aff551084f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:32.065094 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6f1a404-29ef-4ee5-96a5-a1aff551084f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:32.065593 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6f1a404-29ef-4ee5-96a5-a1aff551084f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:32.309339 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e6f1a404-29ef-4ee5-96a5-a1aff551084f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:32.317884 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e6f1a404-29ef-4ee5-96a5-a1aff551084f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:32.319437 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e6f1a404-29ef-4ee5-96a5-a1aff551084f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:32.320634 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e6f1a404-29ef-4ee5-96a5-a1aff551084f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1723 microversion: 2.20 time: 0.275760 Aug 10 12:43:32.321200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 131/265] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:32 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1723 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:43:32.692464 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c52a8bb4-0294-409d-a08f-c0afacbe4d18 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:32.694619 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c52a8bb4-0294-409d-a08f-c0afacbe4d18 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 590f8a6c-039f-4e6b-b23b-e56b9356dc48] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:32.704667 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c52a8bb4-0294-409d-a08f-c0afacbe4d18 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:32.704667 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c52a8bb4-0294-409d-a08f-c0afacbe4d18 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:32.704667 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c52a8bb4-0294-409d-a08f-c0afacbe4d18 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:32.705505 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c52a8bb4-0294-409d-a08f-c0afacbe4d18 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:32.706277 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c52a8bb4-0294-409d-a08f-c0afacbe4d18 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:32.707203 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c52a8bb4-0294-409d-a08f-c0afacbe4d18 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:33.088294 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c52a8bb4-0294-409d-a08f-c0afacbe4d18 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:33.097692 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c52a8bb4-0294-409d-a08f-c0afacbe4d18 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48" status: 200 len: 1314 microversion: 2.1 time: 0.409603 Aug 10 12:43:33.099236 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 135/266] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:32 2022] GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:33.177457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-204eecf1-b881-44e3-8a00-20bfeb37a382 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1885960279", "imageRef": "674dcf76-6c38-40de-b204-ad2842738058", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "792b1b55-fb0b-40d5-a346-6e66d9958713"}], "security_groups": [{"name": "tempest-securitygroup--1045584955"}], "key_name": "tempest-keypair-899395175", "user_data": "}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:43:33.296915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.network.neutron [None req-204eecf1-b881-44e3-8a00-20bfeb37a382 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] validate_networks() for [('792b1b55-fb0b-40d5-a346-6e66d9958713', None, None, None, None, None)] {{(pid=124643) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:43:33.344658 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-990e0aad-3fdf-4c1f-bacb-57977e7e0565 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:33.345366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-990e0aad-3fdf-4c1f-bacb-57977e7e0565 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:33.347415 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell0:SELECT=2 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:43:33.348311 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell0:SELECT=6 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:43:33.354698 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-990e0aad-3fdf-4c1f-bacb-57977e7e0565 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:33.355453 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-990e0aad-3fdf-4c1f-bacb-57977e7e0565 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:33.356128 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-990e0aad-3fdf-4c1f-bacb-57977e7e0565 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:33.356930 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-990e0aad-3fdf-4c1f-bacb-57977e7e0565 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:33.357400 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-990e0aad-3fdf-4c1f-bacb-57977e7e0565 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:33.357816 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-990e0aad-3fdf-4c1f-bacb-57977e7e0565 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:33.574712 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-990e0aad-3fdf-4c1f-bacb-57977e7e0565 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:33.584056 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-990e0aad-3fdf-4c1f-bacb-57977e7e0565 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:33.585726 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-990e0aad-3fdf-4c1f-bacb-57977e7e0565 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:33.587901 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-990e0aad-3fdf-4c1f-bacb-57977e7e0565 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1723 microversion: 2.20 time: 0.246872 Aug 10 12:43:33.593277 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 136/267] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:33 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:43:33.770472 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-204eecf1-b881-44e3-8a00-20bfeb37a382 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Flavor limits 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:43:33.770898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-204eecf1-b881-44e3-8a00-20bfeb37a382 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Image limits 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:43:33.771405 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-204eecf1-b881-44e3-8a00-20bfeb37a382 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Flavor pref 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:43:33.771813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-204eecf1-b881-44e3-8a00-20bfeb37a382 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Image pref 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:43:33.772229 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-204eecf1-b881-44e3-8a00-20bfeb37a382 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:43:33.783042 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-204eecf1-b881-44e3-8a00-20bfeb37a382 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:33.786970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-204eecf1-b881-44e3-8a00-20bfeb37a382 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:33.786970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-204eecf1-b881-44e3-8a00-20bfeb37a382 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:33.786970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-204eecf1-b881-44e3-8a00-20bfeb37a382 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:33.786970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-204eecf1-b881-44e3-8a00-20bfeb37a382 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:33.787379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-204eecf1-b881-44e3-8a00-20bfeb37a382 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:33.803041 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-204eecf1-b881-44e3-8a00-20bfeb37a382 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Getting quotas for project e41d5b8acbce44248a45678d1e4f6b71. Resources: {'cores', 'ram', 'instances'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:43:33.807247 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-204eecf1-b881-44e3-8a00-20bfeb37a382 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Getting quotas for user 39cb7e0c86b3460dbd17c58dc13ef0d9 and project e41d5b8acbce44248a45678d1e4f6b71. Resources: {'cores', 'ram', 'instances'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:43:33.818351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-204eecf1-b881-44e3-8a00-20bfeb37a382 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Going to run 1 instances... {{(pid=124643) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:43:33.820745 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-204eecf1-b881-44e3-8a00-20bfeb37a382 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='674dcf76-6c38-40de-b204-ad2842738058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:43:33.965315 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-204eecf1-b881-44e3-8a00-20bfeb37a382 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.792115 Aug 10 12:43:33.965971 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 132/268] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 12:43:33 2022] POST /compute/v2.1/servers => generated 409 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 12:43:33.977620 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-97245488-6d0e-4087-a7a9-1d47d3c41c55 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:33.978633 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-97245488-6d0e-4087-a7a9-1d47d3c41c55 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:34.050349 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-97245488-6d0e-4087-a7a9-1d47d3c41c55 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:34.057613 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-97245488-6d0e-4087-a7a9-1d47d3c41c55 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1245 microversion: 2.1 time: 0.083881 Aug 10 12:43:34.058282 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 137/269] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:33 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:34.123201 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-219d3ff5-4a97-4b6e-9e1b-25ed7ff14278 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:34.128595 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-219d3ff5-4a97-4b6e-9e1b-25ed7ff14278 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 590f8a6c-039f-4e6b-b23b-e56b9356dc48] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:34.139755 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-219d3ff5-4a97-4b6e-9e1b-25ed7ff14278 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:34.139755 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-219d3ff5-4a97-4b6e-9e1b-25ed7ff14278 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:34.139755 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-219d3ff5-4a97-4b6e-9e1b-25ed7ff14278 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:34.139755 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-219d3ff5-4a97-4b6e-9e1b-25ed7ff14278 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:34.140172 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-219d3ff5-4a97-4b6e-9e1b-25ed7ff14278 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:34.140172 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-219d3ff5-4a97-4b6e-9e1b-25ed7ff14278 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:34.369291 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-219d3ff5-4a97-4b6e-9e1b-25ed7ff14278 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:34.396326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-219d3ff5-4a97-4b6e-9e1b-25ed7ff14278 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48" status: 200 len: 1314 microversion: 2.1 time: 0.279184 Aug 10 12:43:34.396923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 133/270] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:34 2022] GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:34.609858 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-63c8d3b9-4052-48be-9878-c7e6a75af18c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:34.610458 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-63c8d3b9-4052-48be-9878-c7e6a75af18c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:34.618481 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63c8d3b9-4052-48be-9878-c7e6a75af18c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:34.618998 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63c8d3b9-4052-48be-9878-c7e6a75af18c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:34.619893 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63c8d3b9-4052-48be-9878-c7e6a75af18c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:34.620604 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63c8d3b9-4052-48be-9878-c7e6a75af18c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:34.621066 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63c8d3b9-4052-48be-9878-c7e6a75af18c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:34.621475 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63c8d3b9-4052-48be-9878-c7e6a75af18c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:34.773915 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-63c8d3b9-4052-48be-9878-c7e6a75af18c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:34.784955 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-63c8d3b9-4052-48be-9878-c7e6a75af18c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:34.786381 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-63c8d3b9-4052-48be-9878-c7e6a75af18c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:34.787562 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-63c8d3b9-4052-48be-9878-c7e6a75af18c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1723 microversion: 2.20 time: 0.181601 Aug 10 12:43:34.788754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 138/271] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:34 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:43:35.082065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9150caff-970a-413d-823c-bf56dfe48d8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:35.082597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9150caff-970a-413d-823c-bf56dfe48d8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:35.088799 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9150caff-970a-413d-823c-bf56dfe48d8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:35.089279 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9150caff-970a-413d-823c-bf56dfe48d8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:35.089710 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9150caff-970a-413d-823c-bf56dfe48d8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:35.090410 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9150caff-970a-413d-823c-bf56dfe48d8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:35.090859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9150caff-970a-413d-823c-bf56dfe48d8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:35.091369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9150caff-970a-413d-823c-bf56dfe48d8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:35.153092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9150caff-970a-413d-823c-bf56dfe48d8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:35.162267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9150caff-970a-413d-823c-bf56dfe48d8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1249 microversion: 2.1 time: 0.084140 Aug 10 12:43:35.163023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 134/272] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:35 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:35.417015 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bed3bf8d-76a7-45f9-bd09-e9fef808ee23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Action: 'create', calling method: .version_select at 0x7fb8273b2430>, body: {"keypair": {"name": "tempest-keypair-1990573583", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaaWsW4yB8xOzSPGIhVoZkim7cr6rA/ny9k6PBiYrjZYJrrvYZ+tBA1ncZg4AKEva+Jer6dNJx8fWADNC8UNrQivPnd66PbD/XGr6d0qq6BvO93NfPtoYncWIgt9aql6Q=="}} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:43:35.420013 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a91fe21f-a826-4dc8-8696-6a34dfe15571 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:35.421475 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a91fe21f-a826-4dc8-8696-6a34dfe15571 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 590f8a6c-039f-4e6b-b23b-e56b9356dc48] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:35.428876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a91fe21f-a826-4dc8-8696-6a34dfe15571 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:35.432756 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a91fe21f-a826-4dc8-8696-6a34dfe15571 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:35.432756 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a91fe21f-a826-4dc8-8696-6a34dfe15571 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:35.432756 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a91fe21f-a826-4dc8-8696-6a34dfe15571 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:35.432756 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a91fe21f-a826-4dc8-8696-6a34dfe15571 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:35.433244 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a91fe21f-a826-4dc8-8696-6a34dfe15571 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:35.441094 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.quota [None req-bed3bf8d-76a7-45f9-bd09-e9fef808ee23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Getting quotas for project a2857015013f466d95f3a9037925c6fc. Resources: {'key_pairs'} {{(pid=124642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:43:35.445844 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.quota [None req-bed3bf8d-76a7-45f9-bd09-e9fef808ee23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Getting quotas for user 570c2a77b862411083b9444f8292192b and project a2857015013f466d95f3a9037925c6fc. Resources: {'key_pairs'} {{(pid=124642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:43:35.579548 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a91fe21f-a826-4dc8-8696-6a34dfe15571 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:35.587002 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a91fe21f-a826-4dc8-8696-6a34dfe15571 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48" status: 200 len: 1314 microversion: 2.1 time: 0.170887 Aug 10 12:43:35.587604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 135/273] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:35 2022] GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:35.628552 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bed3bf8d-76a7-45f9-bd09-e9fef808ee23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.216520 Aug 10 12:43:35.629145 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 139/274] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 10 12:43:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:43:35.811291 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3069f3f6-8483-45aa-8eee-7cb3e8740f31 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:35.812899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3069f3f6-8483-45aa-8eee-7cb3e8740f31 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:35.819511 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3069f3f6-8483-45aa-8eee-7cb3e8740f31 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:35.820407 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3069f3f6-8483-45aa-8eee-7cb3e8740f31 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:35.821043 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3069f3f6-8483-45aa-8eee-7cb3e8740f31 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:35.821948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3069f3f6-8483-45aa-8eee-7cb3e8740f31 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:35.822608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3069f3f6-8483-45aa-8eee-7cb3e8740f31 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:35.823254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3069f3f6-8483-45aa-8eee-7cb3e8740f31 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:35.978440 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3069f3f6-8483-45aa-8eee-7cb3e8740f31 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:35.987233 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3069f3f6-8483-45aa-8eee-7cb3e8740f31 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:35.988728 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3069f3f6-8483-45aa-8eee-7cb3e8740f31 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:35.990103 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3069f3f6-8483-45aa-8eee-7cb3e8740f31 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1723 microversion: 2.20 time: 0.182866 Aug 10 12:43:35.990664 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 136/275] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:35 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:43:36.187823 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-dbbad18d-4b63-4d56-8afd-7b18c3e77415 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:36.188441 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-dbbad18d-4b63-4d56-8afd-7b18c3e77415 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:36.195022 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dbbad18d-4b63-4d56-8afd-7b18c3e77415 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:36.203113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dbbad18d-4b63-4d56-8afd-7b18c3e77415 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:36.203113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dbbad18d-4b63-4d56-8afd-7b18c3e77415 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:36.203113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dbbad18d-4b63-4d56-8afd-7b18c3e77415 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:36.203113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dbbad18d-4b63-4d56-8afd-7b18c3e77415 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:36.203832 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dbbad18d-4b63-4d56-8afd-7b18c3e77415 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:36.276425 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-dbbad18d-4b63-4d56-8afd-7b18c3e77415 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:36.296075 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-dbbad18d-4b63-4d56-8afd-7b18c3e77415 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1305 microversion: 2.1 time: 0.112039 Aug 10 12:43:36.309147 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 140/276] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:36 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1305 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:36.518421 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-ad1f0552-4241-480c-a68c-65f1f66e26e7 req-0d837ec1-2821-4a6b-8418-c7dd56c672a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "590f8a6c-039f-4e6b-b23b-e56b9356dc48", "name": "network-vif-plugged", "status": "completed", "tag": "c5b76b3e-8f4f-408b-ae5a-475ddd82e98e"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:43:36.539779 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-ad1f0552-4241-480c-a68c-65f1f66e26e7 req-0d837ec1-2821-4a6b-8418-c7dd56c672a8 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:36.540500 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-ad1f0552-4241-480c-a68c-65f1f66e26e7 req-0d837ec1-2821-4a6b-8418-c7dd56c672a8 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:36.541021 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-ad1f0552-4241-480c-a68c-65f1f66e26e7 req-0d837ec1-2821-4a6b-8418-c7dd56c672a8 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:36.554897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-ad1f0552-4241-480c-a68c-65f1f66e26e7 req-0d837ec1-2821-4a6b-8418-c7dd56c672a8 service nova] Creating event network-vif-plugged:c5b76b3e-8f4f-408b-ae5a-475ddd82e98e for instance 590f8a6c-039f-4e6b-b23b-e56b9356dc48 on hv-cinder-85199 Aug 10 12:43:36.564350 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-ad1f0552-4241-480c-a68c-65f1f66e26e7 req-0d837ec1-2821-4a6b-8418-c7dd56c672a8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050582 Aug 10 12:43:36.566464 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 137/277] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:43:36.609338 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4d9e77b1-39fc-4abd-bb04-f840e1bab86b tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:36.609961 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4d9e77b1-39fc-4abd-bb04-f840e1bab86b tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 590f8a6c-039f-4e6b-b23b-e56b9356dc48] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:36.617305 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d9e77b1-39fc-4abd-bb04-f840e1bab86b tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:36.617996 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d9e77b1-39fc-4abd-bb04-f840e1bab86b tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:36.618429 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d9e77b1-39fc-4abd-bb04-f840e1bab86b tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:36.619126 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d9e77b1-39fc-4abd-bb04-f840e1bab86b tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:36.619605 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d9e77b1-39fc-4abd-bb04-f840e1bab86b tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:36.620029 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d9e77b1-39fc-4abd-bb04-f840e1bab86b tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:36.834341 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4d9e77b1-39fc-4abd-bb04-f840e1bab86b tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:36.841885 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4d9e77b1-39fc-4abd-bb04-f840e1bab86b tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48" status: 200 len: 1314 microversion: 2.1 time: 0.237254 Aug 10 12:43:36.842462 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 141/278] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:36 2022] GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:37.016443 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6b639146-4cc5-4e20-9df9-fdc561e5695d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:37.017415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6b639146-4cc5-4e20-9df9-fdc561e5695d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:37.025092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b639146-4cc5-4e20-9df9-fdc561e5695d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:37.025914 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b639146-4cc5-4e20-9df9-fdc561e5695d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:37.026554 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b639146-4cc5-4e20-9df9-fdc561e5695d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:37.027526 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b639146-4cc5-4e20-9df9-fdc561e5695d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:37.028221 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b639146-4cc5-4e20-9df9-fdc561e5695d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:37.028848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b639146-4cc5-4e20-9df9-fdc561e5695d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:37.176721 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6b639146-4cc5-4e20-9df9-fdc561e5695d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:37.185187 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6b639146-4cc5-4e20-9df9-fdc561e5695d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:37.186896 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6b639146-4cc5-4e20-9df9-fdc561e5695d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:37.188258 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6b639146-4cc5-4e20-9df9-fdc561e5695d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1723 microversion: 2.20 time: 0.176961 Aug 10 12:43:37.189159 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 138/279] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:37 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:43:37.318510 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f35c00c1-7d58-4415-97f2-85fff471ac9f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:37.319126 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f35c00c1-7d58-4415-97f2-85fff471ac9f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:37.325167 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f35c00c1-7d58-4415-97f2-85fff471ac9f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:37.325889 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f35c00c1-7d58-4415-97f2-85fff471ac9f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:37.329248 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f35c00c1-7d58-4415-97f2-85fff471ac9f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:37.329248 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f35c00c1-7d58-4415-97f2-85fff471ac9f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:37.329248 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f35c00c1-7d58-4415-97f2-85fff471ac9f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:37.329248 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f35c00c1-7d58-4415-97f2-85fff471ac9f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:37.391356 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f35c00c1-7d58-4415-97f2-85fff471ac9f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:37.399740 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f35c00c1-7d58-4415-97f2-85fff471ac9f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1303 microversion: 2.1 time: 0.085021 Aug 10 12:43:37.402921 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 142/280] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:37 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1303 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:37.866247 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-85d4db7a-280e-4e73-95c6-7090c596e7b3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:37.866854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-85d4db7a-280e-4e73-95c6-7090c596e7b3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 590f8a6c-039f-4e6b-b23b-e56b9356dc48] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:37.873277 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-85d4db7a-280e-4e73-95c6-7090c596e7b3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:37.873758 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-85d4db7a-280e-4e73-95c6-7090c596e7b3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:37.874385 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-85d4db7a-280e-4e73-95c6-7090c596e7b3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:37.875083 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-85d4db7a-280e-4e73-95c6-7090c596e7b3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:37.875584 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-85d4db7a-280e-4e73-95c6-7090c596e7b3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:37.875985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-85d4db7a-280e-4e73-95c6-7090c596e7b3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:38.073312 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-85d4db7a-280e-4e73-95c6-7090c596e7b3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:38.081501 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-85d4db7a-280e-4e73-95c6-7090c596e7b3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48" status: 200 len: 1314 microversion: 2.1 time: 0.219592 Aug 10 12:43:38.082123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 139/281] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:37 2022] GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:38.216432 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f1e29e29-d73b-4d14-b888-247e40647e39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:38.216432 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f1e29e29-d73b-4d14-b888-247e40647e39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:38.228022 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f1e29e29-d73b-4d14-b888-247e40647e39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:38.228413 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f1e29e29-d73b-4d14-b888-247e40647e39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:38.238636 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f1e29e29-d73b-4d14-b888-247e40647e39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:38.239689 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f1e29e29-d73b-4d14-b888-247e40647e39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:38.240173 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f1e29e29-d73b-4d14-b888-247e40647e39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:38.240599 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f1e29e29-d73b-4d14-b888-247e40647e39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:38.389142 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f1e29e29-d73b-4d14-b888-247e40647e39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:38.397571 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f1e29e29-d73b-4d14-b888-247e40647e39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:38.399399 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f1e29e29-d73b-4d14-b888-247e40647e39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:38.400733 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f1e29e29-d73b-4d14-b888-247e40647e39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1723 microversion: 2.20 time: 0.190983 Aug 10 12:43:38.403509 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 143/282] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:38 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:43:38.424142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6f1b0547-39ea-4118-acab-ee7861794702 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:38.424852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6f1b0547-39ea-4118-acab-ee7861794702 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:38.430711 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f1b0547-39ea-4118-acab-ee7861794702 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:38.431205 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f1b0547-39ea-4118-acab-ee7861794702 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:38.433846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f1b0547-39ea-4118-acab-ee7861794702 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:38.433846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f1b0547-39ea-4118-acab-ee7861794702 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:38.433846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f1b0547-39ea-4118-acab-ee7861794702 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:38.433846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f1b0547-39ea-4118-acab-ee7861794702 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:38.742321 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6f1b0547-39ea-4118-acab-ee7861794702 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:38.751654 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6f1b0547-39ea-4118-acab-ee7861794702 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1371 microversion: 2.1 time: 0.331500 Aug 10 12:43:38.752241 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 140/283] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:38 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1371 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:43:38.833271 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0328655b-68d8-4a2a-97f7-420013ca1806 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-595551905", "imageRef": "674dcf76-6c38-40de-b204-ad2842738058", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b8fb292-ce0b-4d10-a119-78752ef6ec31"}], "security_groups": [{"name": "tempest-securitygroup--1312534475"}], "key_name": "tempest-keypair-1990573583", "user_data": "}} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:43:38.943466 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.network.neutron [None req-0328655b-68d8-4a2a-97f7-420013ca1806 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] validate_networks() for [('7b8fb292-ce0b-4d10-a119-78752ef6ec31', None, None, None, None, None)] {{(pid=124642) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:43:39.104527 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7da5a63a-c370-4613-9d89-3c66b50a77ba tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:39.105239 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7da5a63a-c370-4613-9d89-3c66b50a77ba tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 590f8a6c-039f-4e6b-b23b-e56b9356dc48] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:39.113685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7da5a63a-c370-4613-9d89-3c66b50a77ba tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:39.114305 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7da5a63a-c370-4613-9d89-3c66b50a77ba tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:39.114822 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7da5a63a-c370-4613-9d89-3c66b50a77ba tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:39.115728 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7da5a63a-c370-4613-9d89-3c66b50a77ba tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:39.116273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7da5a63a-c370-4613-9d89-3c66b50a77ba tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:39.116848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7da5a63a-c370-4613-9d89-3c66b50a77ba tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:39.398967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7da5a63a-c370-4613-9d89-3c66b50a77ba tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:39.409156 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7da5a63a-c370-4613-9d89-3c66b50a77ba tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48" status: 200 len: 1314 microversion: 2.1 time: 0.309596 Aug 10 12:43:39.424818 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 141/284] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:39 2022] GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:39.430227 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-f5069a53-41a4-4a81-a631-634481b808ca req-5c6bac4b-1680-4a11-bfd5-3ddfc058d59c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3181426f-eb81-4712-97c6-8c92b61f53a0", "tag": "bd12d9c9-bde7-4a2b-92de-b4401e6328ab"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:43:39.444434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-f5069a53-41a4-4a81-a631-634481b808ca req-5c6bac4b-1680-4a11-bfd5-3ddfc058d59c service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:39.444967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-f5069a53-41a4-4a81-a631-634481b808ca req-5c6bac4b-1680-4a11-bfd5-3ddfc058d59c service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:39.445383 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-f5069a53-41a4-4a81-a631-634481b808ca req-5c6bac4b-1680-4a11-bfd5-3ddfc058d59c service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:39.457510 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-f5069a53-41a4-4a81-a631-634481b808ca req-5c6bac4b-1680-4a11-bfd5-3ddfc058d59c service nova] Creating event network-changed:bd12d9c9-bde7-4a2b-92de-b4401e6328ab for instance 3181426f-eb81-4712-97c6-8c92b61f53a0 on hv-cinder-85199 Aug 10 12:43:39.462986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-f5069a53-41a4-4a81-a631-634481b808ca req-5c6bac4b-1680-4a11-bfd5-3ddfc058d59c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036666 Aug 10 12:43:39.463812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 142/285] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:43:39.469785 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1342ac8d-de0e-4b25-a83a-39ae00f7187c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:39.470693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1342ac8d-de0e-4b25-a83a-39ae00f7187c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:39.476991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1342ac8d-de0e-4b25-a83a-39ae00f7187c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:39.477480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1342ac8d-de0e-4b25-a83a-39ae00f7187c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:39.477911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1342ac8d-de0e-4b25-a83a-39ae00f7187c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:39.478847 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1342ac8d-de0e-4b25-a83a-39ae00f7187c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:39.479341 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1342ac8d-de0e-4b25-a83a-39ae00f7187c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:39.479769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1342ac8d-de0e-4b25-a83a-39ae00f7187c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:39.601125 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-0328655b-68d8-4a2a-97f7-420013ca1806 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Flavor limits 0:0:0 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:43:39.601637 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-0328655b-68d8-4a2a-97f7-420013ca1806 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Image limits 0:0:0 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:43:39.602252 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-0328655b-68d8-4a2a-97f7-420013ca1806 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Flavor pref 0:0:0 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:43:39.602977 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-0328655b-68d8-4a2a-97f7-420013ca1806 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Image pref 0:0:0 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:43:39.603667 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-0328655b-68d8-4a2a-97f7-420013ca1806 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:43:39.618091 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0328655b-68d8-4a2a-97f7-420013ca1806 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:39.618751 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0328655b-68d8-4a2a-97f7-420013ca1806 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:39.619340 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0328655b-68d8-4a2a-97f7-420013ca1806 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:39.620232 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0328655b-68d8-4a2a-97f7-420013ca1806 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:39.620777 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0328655b-68d8-4a2a-97f7-420013ca1806 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:39.621499 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0328655b-68d8-4a2a-97f7-420013ca1806 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:39.654478 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.quota [None req-0328655b-68d8-4a2a-97f7-420013ca1806 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Getting quotas for project a2857015013f466d95f3a9037925c6fc. Resources: {'cores', 'ram', 'instances'} {{(pid=124642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:43:39.661100 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.quota [None req-0328655b-68d8-4a2a-97f7-420013ca1806 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Getting quotas for user 570c2a77b862411083b9444f8292192b and project a2857015013f466d95f3a9037925c6fc. Resources: {'cores', 'ram', 'instances'} {{(pid=124642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:43:39.680053 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0328655b-68d8-4a2a-97f7-420013ca1806 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Going to run 1 instances... {{(pid=124642) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:43:39.682890 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0328655b-68d8-4a2a-97f7-420013ca1806 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='674dcf76-6c38-40de-b204-ad2842738058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:43:39.730566 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1342ac8d-de0e-4b25-a83a-39ae00f7187c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:39.742191 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1342ac8d-de0e-4b25-a83a-39ae00f7187c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:39.743743 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1342ac8d-de0e-4b25-a83a-39ae00f7187c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:39.744936 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1342ac8d-de0e-4b25-a83a-39ae00f7187c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1723 microversion: 2.20 time: 0.279882 Aug 10 12:43:39.754185 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 143/286] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:39 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:43:39.771766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8ec6ba0b-8b90-4277-a73e-b4bf07763558 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:39.772465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8ec6ba0b-8b90-4277-a73e-b4bf07763558 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:39.778240 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ec6ba0b-8b90-4277-a73e-b4bf07763558 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:39.778722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ec6ba0b-8b90-4277-a73e-b4bf07763558 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:39.779154 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ec6ba0b-8b90-4277-a73e-b4bf07763558 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:39.779859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ec6ba0b-8b90-4277-a73e-b4bf07763558 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:39.781114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ec6ba0b-8b90-4277-a73e-b4bf07763558 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:39.781547 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ec6ba0b-8b90-4277-a73e-b4bf07763558 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:39.835877 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0328655b-68d8-4a2a-97f7-420013ca1806 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.006956 Aug 10 12:43:39.836809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 144/287] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 12:43:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 12:43:39.849834 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a193925b-4277-4140-9f78-a388ff3e4fdb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:39.850736 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a193925b-4277-4140-9f78-a388ff3e4fdb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:39.963339 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a193925b-4277-4140-9f78-a388ff3e4fdb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:39.984653 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a193925b-4277-4140-9f78-a388ff3e4fdb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1241 microversion: 2.1 time: 0.127575 Aug 10 12:43:39.984653 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 145/288] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:39 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1241 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:40.006700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8ec6ba0b-8b90-4277-a73e-b4bf07763558 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:40.014161 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8ec6ba0b-8b90-4277-a73e-b4bf07763558 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1371 microversion: 2.1 time: 0.246316 Aug 10 12:43:40.014896 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 144/289] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:39 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:43:40.438528 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e3a7364e-36fb-4acd-9588-6addc9732d76 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:40.439559 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e3a7364e-36fb-4acd-9588-6addc9732d76 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 590f8a6c-039f-4e6b-b23b-e56b9356dc48] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:40.446728 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e3a7364e-36fb-4acd-9588-6addc9732d76 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:40.447327 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e3a7364e-36fb-4acd-9588-6addc9732d76 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:40.447831 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e3a7364e-36fb-4acd-9588-6addc9732d76 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:40.448602 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e3a7364e-36fb-4acd-9588-6addc9732d76 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:40.449167 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e3a7364e-36fb-4acd-9588-6addc9732d76 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:40.449791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e3a7364e-36fb-4acd-9588-6addc9732d76 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:40.454085 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:43:40.579100 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e3a7364e-36fb-4acd-9588-6addc9732d76 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:40.586741 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e3a7364e-36fb-4acd-9588-6addc9732d76 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48" status: 200 len: 1497 microversion: 2.1 time: 0.152915 Aug 10 12:43:40.587333 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 146/290] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:40 2022] GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48 => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:40.769128 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a3f2e905-7bae-4d4c-b6c1-8cdac6072019 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:40.769769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a3f2e905-7bae-4d4c-b6c1-8cdac6072019 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:40.776166 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3f2e905-7bae-4d4c-b6c1-8cdac6072019 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:40.776587 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3f2e905-7bae-4d4c-b6c1-8cdac6072019 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:40.777017 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3f2e905-7bae-4d4c-b6c1-8cdac6072019 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:40.778469 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3f2e905-7bae-4d4c-b6c1-8cdac6072019 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:40.778919 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3f2e905-7bae-4d4c-b6c1-8cdac6072019 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:40.779363 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3f2e905-7bae-4d4c-b6c1-8cdac6072019 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:40.924976 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a3f2e905-7bae-4d4c-b6c1-8cdac6072019 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:40.932849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a3f2e905-7bae-4d4c-b6c1-8cdac6072019 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:40.934422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a3f2e905-7bae-4d4c-b6c1-8cdac6072019 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:40.935608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a3f2e905-7bae-4d4c-b6c1-8cdac6072019 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1723 microversion: 2.20 time: 0.170957 Aug 10 12:43:40.936176 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 145/291] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:40 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:43:40.996820 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fc08886c-8107-438c-98a9-598c8f203a97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:40.997422 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fc08886c-8107-438c-98a9-598c8f203a97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:40.999260 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:43:41.004218 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fc08886c-8107-438c-98a9-598c8f203a97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:41.004938 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fc08886c-8107-438c-98a9-598c8f203a97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:41.005368 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fc08886c-8107-438c-98a9-598c8f203a97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:41.006052 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fc08886c-8107-438c-98a9-598c8f203a97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:41.006517 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fc08886c-8107-438c-98a9-598c8f203a97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:41.006912 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fc08886c-8107-438c-98a9-598c8f203a97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:41.037963 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e6e020c0-408d-4092-9336-f52a0ba0376b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:41.038489 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e6e020c0-408d-4092-9336-f52a0ba0376b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:41.046945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6e020c0-408d-4092-9336-f52a0ba0376b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:41.046945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6e020c0-408d-4092-9336-f52a0ba0376b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:41.046945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6e020c0-408d-4092-9336-f52a0ba0376b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:41.047350 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6e020c0-408d-4092-9336-f52a0ba0376b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:41.047992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6e020c0-408d-4092-9336-f52a0ba0376b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:41.048603 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6e020c0-408d-4092-9336-f52a0ba0376b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:41.064295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:43:41.077009 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fc08886c-8107-438c-98a9-598c8f203a97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:41.088050 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fc08886c-8107-438c-98a9-598c8f203a97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1245 microversion: 2.1 time: 0.094782 Aug 10 12:43:41.088738 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 147/292] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:40 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:41.192861 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e6e020c0-408d-4092-9336-f52a0ba0376b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:41.200562 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e6e020c0-408d-4092-9336-f52a0ba0376b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1371 microversion: 2.1 time: 0.167521 Aug 10 12:43:41.201269 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 146/293] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:41 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:43:41.590336 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-dda93c79-de9f-42a0-8e1d-aa3a00cd9c15 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:41.590945 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-dda93c79-de9f-42a0-8e1d-aa3a00cd9c15 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 590f8a6c-039f-4e6b-b23b-e56b9356dc48] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:41.598459 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dda93c79-de9f-42a0-8e1d-aa3a00cd9c15 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:41.598942 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dda93c79-de9f-42a0-8e1d-aa3a00cd9c15 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:41.599401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dda93c79-de9f-42a0-8e1d-aa3a00cd9c15 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:41.600088 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dda93c79-de9f-42a0-8e1d-aa3a00cd9c15 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:41.600544 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dda93c79-de9f-42a0-8e1d-aa3a00cd9c15 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:41.600965 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dda93c79-de9f-42a0-8e1d-aa3a00cd9c15 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:41.627574 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-dda93c79-de9f-42a0-8e1d-aa3a00cd9c15 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 590f8a6c-039f-4e6b-b23b-e56b9356dc48] Going to try to terminate instance {{(pid=124642) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:43:41.937291 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-dda93c79-de9f-42a0-8e1d-aa3a00cd9c15 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "DELETE /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48" status: 204 len: 0 microversion: 2.1 time: 0.349985 Aug 10 12:43:41.937884 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 148/294] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 12:43:41 2022] DELETE /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 12:43:41.946667 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f9715539-7a80-4a9d-b70e-59df7096fbd9 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:41.947312 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f9715539-7a80-4a9d-b70e-59df7096fbd9 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 590f8a6c-039f-4e6b-b23b-e56b9356dc48] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:41.954597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f9715539-7a80-4a9d-b70e-59df7096fbd9 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:41.955085 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f9715539-7a80-4a9d-b70e-59df7096fbd9 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:41.955563 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f9715539-7a80-4a9d-b70e-59df7096fbd9 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:41.956426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f9715539-7a80-4a9d-b70e-59df7096fbd9 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:41.956882 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f9715539-7a80-4a9d-b70e-59df7096fbd9 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:41.957313 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f9715539-7a80-4a9d-b70e-59df7096fbd9 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:41.959981 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-89c869f8-a06c-4b79-9459-555b94f978c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:41.961271 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-89c869f8-a06c-4b79-9459-555b94f978c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:41.967715 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-89c869f8-a06c-4b79-9459-555b94f978c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:41.968282 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-89c869f8-a06c-4b79-9459-555b94f978c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:41.969004 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-89c869f8-a06c-4b79-9459-555b94f978c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:41.969773 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-89c869f8-a06c-4b79-9459-555b94f978c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:41.970437 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-89c869f8-a06c-4b79-9459-555b94f978c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:41.971067 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-89c869f8-a06c-4b79-9459-555b94f978c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:42.182063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-89c869f8-a06c-4b79-9459-555b94f978c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:42.194882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-89c869f8-a06c-4b79-9459-555b94f978c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:42.196420 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-89c869f8-a06c-4b79-9459-555b94f978c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:42.197593 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-89c869f8-a06c-4b79-9459-555b94f978c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1723 microversion: 2.20 time: 0.243188 Aug 10 12:43:42.206242 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f9715539-7a80-4a9d-b70e-59df7096fbd9 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:42.214522 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f9715539-7a80-4a9d-b70e-59df7096fbd9 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48" status: 200 len: 1503 microversion: 2.1 time: 0.271943 Aug 10 12:43:42.215078 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 149/295] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:41 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:43:42.217455 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 147/296] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:41 2022] GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48 => generated 1503 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:42.223484 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-52beeef8-ebca-45da-b7e6-ff9b94c9e84a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:42.232448 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-52beeef8-ebca-45da-b7e6-ff9b94c9e84a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:42.232699 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1d581bfc-0e5f-42a7-a525-4fa93343ec8d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:42.232699 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1d581bfc-0e5f-42a7-a525-4fa93343ec8d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:42.233104 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-52beeef8-ebca-45da-b7e6-ff9b94c9e84a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:42.233732 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-52beeef8-ebca-45da-b7e6-ff9b94c9e84a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:42.235058 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-52beeef8-ebca-45da-b7e6-ff9b94c9e84a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:42.235664 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-52beeef8-ebca-45da-b7e6-ff9b94c9e84a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:42.236172 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-52beeef8-ebca-45da-b7e6-ff9b94c9e84a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:42.236870 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-52beeef8-ebca-45da-b7e6-ff9b94c9e84a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:42.237912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d581bfc-0e5f-42a7-a525-4fa93343ec8d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:42.238398 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d581bfc-0e5f-42a7-a525-4fa93343ec8d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:42.238830 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d581bfc-0e5f-42a7-a525-4fa93343ec8d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:42.239559 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d581bfc-0e5f-42a7-a525-4fa93343ec8d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:42.240010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d581bfc-0e5f-42a7-a525-4fa93343ec8d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:42.240433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d581bfc-0e5f-42a7-a525-4fa93343ec8d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:42.365269 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-52beeef8-ebca-45da-b7e6-ff9b94c9e84a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:42.373193 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-52beeef8-ebca-45da-b7e6-ff9b94c9e84a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1237 microversion: 2.1 time: 0.157155 Aug 10 12:43:42.374007 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 150/297] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:42 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1237 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:42.448843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1d581bfc-0e5f-42a7-a525-4fa93343ec8d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:42.467621 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1d581bfc-0e5f-42a7-a525-4fa93343ec8d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1371 microversion: 2.1 time: 0.248000 Aug 10 12:43:42.468794 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 148/298] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:42 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1371 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:43.221637 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-184415b7-6bd3-4143-b75a-b297c32c4648 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:43.222290 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-184415b7-6bd3-4143-b75a-b297c32c4648 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:43.228708 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-184415b7-6bd3-4143-b75a-b297c32c4648 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:43.229289 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-184415b7-6bd3-4143-b75a-b297c32c4648 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:43.229761 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-184415b7-6bd3-4143-b75a-b297c32c4648 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:43.230471 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-184415b7-6bd3-4143-b75a-b297c32c4648 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:43.230925 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-184415b7-6bd3-4143-b75a-b297c32c4648 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:43.231398 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-184415b7-6bd3-4143-b75a-b297c32c4648 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:43.239291 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7d482550-4f84-4150-9b35-ba5cbbbee644 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:43.240444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7d482550-4f84-4150-9b35-ba5cbbbee644 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 590f8a6c-039f-4e6b-b23b-e56b9356dc48] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:43.246573 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d482550-4f84-4150-9b35-ba5cbbbee644 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:43.247052 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d482550-4f84-4150-9b35-ba5cbbbee644 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:43.247536 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d482550-4f84-4150-9b35-ba5cbbbee644 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:43.248235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d482550-4f84-4150-9b35-ba5cbbbee644 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:43.248684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d482550-4f84-4150-9b35-ba5cbbbee644 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:43.250124 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d482550-4f84-4150-9b35-ba5cbbbee644 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:43.447952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7d482550-4f84-4150-9b35-ba5cbbbee644 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:43.455035 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-184415b7-6bd3-4143-b75a-b297c32c4648 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:43.456897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7d482550-4f84-4150-9b35-ba5cbbbee644 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48" status: 200 len: 1503 microversion: 2.1 time: 0.222347 Aug 10 12:43:43.457589 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 149/299] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:43 2022] GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48 => generated 1503 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:43:43.462925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8394585c-0893-4107-b62f-ac7d476a1c56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:43.463832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8394585c-0893-4107-b62f-ac7d476a1c56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:43.463990 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-184415b7-6bd3-4143-b75a-b297c32c4648 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:43.465754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-184415b7-6bd3-4143-b75a-b297c32c4648 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:43.467220 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-184415b7-6bd3-4143-b75a-b297c32c4648 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1723 microversion: 2.20 time: 0.250275 Aug 10 12:43:43.471388 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8394585c-0893-4107-b62f-ac7d476a1c56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:43.472183 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8394585c-0893-4107-b62f-ac7d476a1c56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:43.472776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8394585c-0893-4107-b62f-ac7d476a1c56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:43.473484 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8394585c-0893-4107-b62f-ac7d476a1c56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:43.473934 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8394585c-0893-4107-b62f-ac7d476a1c56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:43.474357 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8394585c-0893-4107-b62f-ac7d476a1c56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:43.478901 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 151/300] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:43 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:43:43.489895 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d671faf6-d02d-4681-a8bc-0371a3a13882 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:43.490718 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d671faf6-d02d-4681-a8bc-0371a3a13882 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:43.496734 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d671faf6-d02d-4681-a8bc-0371a3a13882 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:43.497216 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d671faf6-d02d-4681-a8bc-0371a3a13882 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:43.497638 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d671faf6-d02d-4681-a8bc-0371a3a13882 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:43.498510 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d671faf6-d02d-4681-a8bc-0371a3a13882 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:43.499007 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d671faf6-d02d-4681-a8bc-0371a3a13882 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:43.499667 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d671faf6-d02d-4681-a8bc-0371a3a13882 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:43.540985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8394585c-0893-4107-b62f-ac7d476a1c56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:43.549952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8394585c-0893-4107-b62f-ac7d476a1c56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1237 microversion: 2.1 time: 0.090381 Aug 10 12:43:43.550265 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 150/301] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:43 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1237 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:43.675018 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d671faf6-d02d-4681-a8bc-0371a3a13882 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:43.682547 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d671faf6-d02d-4681-a8bc-0371a3a13882 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1371 microversion: 2.1 time: 0.196900 Aug 10 12:43:43.683130 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 152/302] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:43 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:43:44.461908 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-fcef5c4c-337d-4bc9-8855-8abd5fd637ff req-ac7c93ba-afc0-4c2e-8617-a6c8cf608135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3181426f-eb81-4712-97c6-8c92b61f53a0", "name": "network-vif-plugged", "status": "completed", "tag": "bd12d9c9-bde7-4a2b-92de-b4401e6328ab"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:43:44.467042 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=2 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:43:44.467796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=12 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:43:44.474542 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-fcef5c4c-337d-4bc9-8855-8abd5fd637ff req-ac7c93ba-afc0-4c2e-8617-a6c8cf608135 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:44.474542 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-fcef5c4c-337d-4bc9-8855-8abd5fd637ff req-ac7c93ba-afc0-4c2e-8617-a6c8cf608135 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:44.474542 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-fcef5c4c-337d-4bc9-8855-8abd5fd637ff req-ac7c93ba-afc0-4c2e-8617-a6c8cf608135 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:44.480044 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-67eafccf-2a24-43d0-91ce-21b26603fe8e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:44.480804 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-67eafccf-2a24-43d0-91ce-21b26603fe8e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 590f8a6c-039f-4e6b-b23b-e56b9356dc48] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:44.492836 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-67eafccf-2a24-43d0-91ce-21b26603fe8e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:44.493334 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-67eafccf-2a24-43d0-91ce-21b26603fe8e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:44.494040 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-67eafccf-2a24-43d0-91ce-21b26603fe8e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:44.494763 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-67eafccf-2a24-43d0-91ce-21b26603fe8e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:44.495400 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-67eafccf-2a24-43d0-91ce-21b26603fe8e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:44.496005 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-67eafccf-2a24-43d0-91ce-21b26603fe8e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:44.498050 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-fcef5c4c-337d-4bc9-8855-8abd5fd637ff req-ac7c93ba-afc0-4c2e-8617-a6c8cf608135 service nova] Creating event network-vif-plugged:bd12d9c9-bde7-4a2b-92de-b4401e6328ab for instance 3181426f-eb81-4712-97c6-8c92b61f53a0 on hv-cinder-85199 Aug 10 12:43:44.504056 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-fcef5c4c-337d-4bc9-8855-8abd5fd637ff req-ac7c93ba-afc0-4c2e-8617-a6c8cf608135 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045729 Aug 10 12:43:44.504852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 151/303] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:43:44.512679 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-53e7c99c-7662-43a7-a9da-cd65030ed738 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:44.512679 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-53e7c99c-7662-43a7-a9da-cd65030ed738 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:44.518953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53e7c99c-7662-43a7-a9da-cd65030ed738 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:44.519537 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53e7c99c-7662-43a7-a9da-cd65030ed738 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:44.520213 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53e7c99c-7662-43a7-a9da-cd65030ed738 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:44.521099 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53e7c99c-7662-43a7-a9da-cd65030ed738 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:44.521733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53e7c99c-7662-43a7-a9da-cd65030ed738 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:44.522340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53e7c99c-7662-43a7-a9da-cd65030ed738 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:44.821701 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-67eafccf-2a24-43d0-91ce-21b26603fe8e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:44.833307 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-67eafccf-2a24-43d0-91ce-21b26603fe8e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48" status: 200 len: 1503 microversion: 2.1 time: 0.357403 Aug 10 12:43:44.833523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-53e7c99c-7662-43a7-a9da-cd65030ed738 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:44.835337 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 153/304] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:44 2022] GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48 => generated 1503 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:43:44.840178 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9b4485c0-72d8-4dc6-ba71-9151d69e3435 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:44.841108 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9b4485c0-72d8-4dc6-ba71-9151d69e3435 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:44.845866 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-53e7c99c-7662-43a7-a9da-cd65030ed738 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:44.847468 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-53e7c99c-7662-43a7-a9da-cd65030ed738 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:44.847740 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b4485c0-72d8-4dc6-ba71-9151d69e3435 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:44.848323 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b4485c0-72d8-4dc6-ba71-9151d69e3435 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:44.848848 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b4485c0-72d8-4dc6-ba71-9151d69e3435 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:44.849417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-53e7c99c-7662-43a7-a9da-cd65030ed738 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1744 microversion: 2.20 time: 0.343317 Aug 10 12:43:44.850033 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 152/305] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:44 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1744 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:43:44.866319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b4485c0-72d8-4dc6-ba71-9151d69e3435 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:44.867087 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b4485c0-72d8-4dc6-ba71-9151d69e3435 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:44.867811 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b4485c0-72d8-4dc6-ba71-9151d69e3435 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:44.874926 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d52a9623-4a9a-4030-8d87-88157240a022 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:44.874926 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d52a9623-4a9a-4030-8d87-88157240a022 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:44.879160 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d52a9623-4a9a-4030-8d87-88157240a022 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:44.879784 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d52a9623-4a9a-4030-8d87-88157240a022 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:44.880283 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d52a9623-4a9a-4030-8d87-88157240a022 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:44.881092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d52a9623-4a9a-4030-8d87-88157240a022 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:44.881604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d52a9623-4a9a-4030-8d87-88157240a022 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:44.882168 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d52a9623-4a9a-4030-8d87-88157240a022 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:44.964010 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9b4485c0-72d8-4dc6-ba71-9151d69e3435 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:44.975973 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9b4485c0-72d8-4dc6-ba71-9151d69e3435 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1237 microversion: 2.1 time: 0.139357 Aug 10 12:43:44.979091 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 154/306] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:44 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1237 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:45.072787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-cb9e528c-1f35-4513-a55d-8c5835cea79a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:43:45.079593 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cb9e528c-1f35-4513-a55d-8c5835cea79a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:45.080317 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cb9e528c-1f35-4513-a55d-8c5835cea79a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:45.080861 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cb9e528c-1f35-4513-a55d-8c5835cea79a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:45.182291 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-cb9e528c-1f35-4513-a55d-8c5835cea79a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Going to try to stop instance {{(pid=124642) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 12:43:45.220146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d52a9623-4a9a-4030-8d87-88157240a022 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:45.230667 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d52a9623-4a9a-4030-8d87-88157240a022 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1371 microversion: 2.1 time: 0.379398 Aug 10 12:43:45.231847 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 153/307] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:44 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1371 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:45.340800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-3d539c40-bd8f-4d91-a0ad-c30aab6f9b6c req-30c2fe1e-18ce-4452-ba1c-a019fa28f9d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "590f8a6c-039f-4e6b-b23b-e56b9356dc48", "name": "network-vif-deleted", "tag": "c5b76b3e-8f4f-408b-ae5a-475ddd82e98e"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:43:45.351376 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-3d539c40-bd8f-4d91-a0ad-c30aab6f9b6c req-30c2fe1e-18ce-4452-ba1c-a019fa28f9d5 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:45.351852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-3d539c40-bd8f-4d91-a0ad-c30aab6f9b6c req-30c2fe1e-18ce-4452-ba1c-a019fa28f9d5 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:45.352298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-3d539c40-bd8f-4d91-a0ad-c30aab6f9b6c req-30c2fe1e-18ce-4452-ba1c-a019fa28f9d5 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:45.363399 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-3d539c40-bd8f-4d91-a0ad-c30aab6f9b6c req-30c2fe1e-18ce-4452-ba1c-a019fa28f9d5 service nova] Creating event network-vif-deleted:c5b76b3e-8f4f-408b-ae5a-475ddd82e98e for instance 590f8a6c-039f-4e6b-b23b-e56b9356dc48 on hv-cinder-85199 Aug 10 12:43:45.368617 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-3d539c40-bd8f-4d91-a0ad-c30aab6f9b6c req-30c2fe1e-18ce-4452-ba1c-a019fa28f9d5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031326 Aug 10 12:43:45.369191 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 154/308] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:43:45.411004 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-cb9e528c-1f35-4513-a55d-8c5835cea79a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "POST /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/action" status: 202 len: 0 microversion: 2.1 time: 0.341626 Aug 10 12:43:45.411802 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 155/309] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 10 12:43:45 2022] POST /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 12:43:45.421166 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-835771b5-61f1-44a6-b007-9f71f407de6d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:45.421876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-835771b5-61f1-44a6-b007-9f71f407de6d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:45.428448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-835771b5-61f1-44a6-b007-9f71f407de6d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:45.429010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-835771b5-61f1-44a6-b007-9f71f407de6d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:45.429511 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-835771b5-61f1-44a6-b007-9f71f407de6d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:45.430468 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-835771b5-61f1-44a6-b007-9f71f407de6d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:45.431003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-835771b5-61f1-44a6-b007-9f71f407de6d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:45.431591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-835771b5-61f1-44a6-b007-9f71f407de6d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:45.583301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-835771b5-61f1-44a6-b007-9f71f407de6d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:45.591622 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-835771b5-61f1-44a6-b007-9f71f407de6d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1720 microversion: 2.1 time: 0.175204 Aug 10 12:43:45.592201 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 155/310] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:45 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:45.857303 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f90ef78b-ba7f-480e-808e-317787182dcc tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:45.858023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f90ef78b-ba7f-480e-808e-317787182dcc tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 590f8a6c-039f-4e6b-b23b-e56b9356dc48] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:45.865109 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f90ef78b-ba7f-480e-808e-317787182dcc tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:45.868414 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f90ef78b-ba7f-480e-808e-317787182dcc tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:45.868414 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f90ef78b-ba7f-480e-808e-317787182dcc tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:45.868414 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f90ef78b-ba7f-480e-808e-317787182dcc tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:45.868414 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f90ef78b-ba7f-480e-808e-317787182dcc tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:45.868695 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f90ef78b-ba7f-480e-808e-317787182dcc tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:45.873360 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-794e86b1-7212-4269-89a1-a10beadc19a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:45.874502 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-794e86b1-7212-4269-89a1-a10beadc19a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:45.880942 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-794e86b1-7212-4269-89a1-a10beadc19a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:45.881427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-794e86b1-7212-4269-89a1-a10beadc19a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:45.881860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-794e86b1-7212-4269-89a1-a10beadc19a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:45.882552 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-794e86b1-7212-4269-89a1-a10beadc19a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:45.883001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-794e86b1-7212-4269-89a1-a10beadc19a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:45.883458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-794e86b1-7212-4269-89a1-a10beadc19a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:45.956866 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f90ef78b-ba7f-480e-808e-317787182dcc tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:45.965439 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f90ef78b-ba7f-480e-808e-317787182dcc tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48" status: 200 len: 1299 microversion: 2.1 time: 0.112799 Aug 10 12:43:45.966109 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 156/311] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:45 2022] GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48 => generated 1299 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:46.000625 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4ff6ff83-e8b7-4482-8221-1e78a1c5b8d4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:46.001240 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4ff6ff83-e8b7-4482-8221-1e78a1c5b8d4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:46.007228 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4ff6ff83-e8b7-4482-8221-1e78a1c5b8d4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:46.007715 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4ff6ff83-e8b7-4482-8221-1e78a1c5b8d4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:46.008144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4ff6ff83-e8b7-4482-8221-1e78a1c5b8d4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:46.009008 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4ff6ff83-e8b7-4482-8221-1e78a1c5b8d4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:46.009466 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4ff6ff83-e8b7-4482-8221-1e78a1c5b8d4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:46.009891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4ff6ff83-e8b7-4482-8221-1e78a1c5b8d4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:46.043632 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-794e86b1-7212-4269-89a1-a10beadc19a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:46.053826 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-794e86b1-7212-4269-89a1-a10beadc19a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:46.054464 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-794e86b1-7212-4269-89a1-a10beadc19a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:46.055845 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-794e86b1-7212-4269-89a1-a10beadc19a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1744 microversion: 2.20 time: 0.186233 Aug 10 12:43:46.056560 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 156/312] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:45 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1744 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:43:46.077922 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4ff6ff83-e8b7-4482-8221-1e78a1c5b8d4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:46.085401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4ff6ff83-e8b7-4482-8221-1e78a1c5b8d4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1293 microversion: 2.1 time: 0.088767 Aug 10 12:43:46.086046 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 157/313] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:45 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:43:46.252230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b086792f-365d-43b2-940d-7e30772b6b89 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:46.252822 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b086792f-365d-43b2-940d-7e30772b6b89 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:46.268830 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b086792f-365d-43b2-940d-7e30772b6b89 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:46.272970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b086792f-365d-43b2-940d-7e30772b6b89 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:46.272970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b086792f-365d-43b2-940d-7e30772b6b89 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:46.272970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b086792f-365d-43b2-940d-7e30772b6b89 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:46.272970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b086792f-365d-43b2-940d-7e30772b6b89 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:46.273316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b086792f-365d-43b2-940d-7e30772b6b89 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:46.419425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b086792f-365d-43b2-940d-7e30772b6b89 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:46.427730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b086792f-365d-43b2-940d-7e30772b6b89 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1371 microversion: 2.1 time: 0.179216 Aug 10 12:43:46.428489 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 157/314] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:46 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:43:46.615764 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4772876a-e4be-469e-a4ce-4819232992ac tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:46.616471 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4772876a-e4be-469e-a4ce-4819232992ac tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:46.622115 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4772876a-e4be-469e-a4ce-4819232992ac tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:46.622722 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4772876a-e4be-469e-a4ce-4819232992ac tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:46.623152 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4772876a-e4be-469e-a4ce-4819232992ac tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:46.623858 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4772876a-e4be-469e-a4ce-4819232992ac tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:46.624432 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4772876a-e4be-469e-a4ce-4819232992ac tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:46.624850 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4772876a-e4be-469e-a4ce-4819232992ac tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:46.765925 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4772876a-e4be-469e-a4ce-4819232992ac tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:46.781566 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4772876a-e4be-469e-a4ce-4819232992ac tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1720 microversion: 2.1 time: 0.167349 Aug 10 12:43:46.781566 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 158/315] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:46 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:46.988420 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a7327694-b750-40f0-b948-ff9699dc76f0 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:46.989140 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a7327694-b750-40f0-b948-ff9699dc76f0 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 590f8a6c-039f-4e6b-b23b-e56b9356dc48] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:46.995693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a7327694-b750-40f0-b948-ff9699dc76f0 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:46.996181 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a7327694-b750-40f0-b948-ff9699dc76f0 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:46.996615 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a7327694-b750-40f0-b948-ff9699dc76f0 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:46.997310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a7327694-b750-40f0-b948-ff9699dc76f0 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:46.997763 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a7327694-b750-40f0-b948-ff9699dc76f0 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:46.998188 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a7327694-b750-40f0-b948-ff9699dc76f0 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:47.033621 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a7327694-b750-40f0-b948-ff9699dc76f0 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:47.034034 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a7327694-b750-40f0-b948-ff9699dc76f0 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:47.034459 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a7327694-b750-40f0-b948-ff9699dc76f0 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:47.034917 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.objects.instance [None req-a7327694-b750-40f0-b948-ff9699dc76f0 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lazy-loading 'fault' on Instance uuid 590f8a6c-039f-4e6b-b23b-e56b9356dc48 {{(pid=124643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:43:47.078829 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a7327694-b750-40f0-b948-ff9699dc76f0 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:47.080317 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-22f019b6-3d19-433d-a022-ca4bc2b58626 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:47.080939 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-22f019b6-3d19-433d-a022-ca4bc2b58626 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:47.086591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a7327694-b750-40f0-b948-ff9699dc76f0 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48" status: 200 len: 1304 microversion: 2.1 time: 0.102979 Aug 10 12:43:47.087498 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 158/316] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:46 2022] GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:47.087611 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22f019b6-3d19-433d-a022-ca4bc2b58626 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:47.088165 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22f019b6-3d19-433d-a022-ca4bc2b58626 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:47.088606 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22f019b6-3d19-433d-a022-ca4bc2b58626 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:47.089470 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22f019b6-3d19-433d-a022-ca4bc2b58626 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:47.089938 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22f019b6-3d19-433d-a022-ca4bc2b58626 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:47.090361 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22f019b6-3d19-433d-a022-ca4bc2b58626 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:47.113427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9ec11aa4-4574-417c-997c-847d13be6de4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:47.114552 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9ec11aa4-4574-417c-997c-847d13be6de4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:47.120845 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ec11aa4-4574-417c-997c-847d13be6de4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:47.121506 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ec11aa4-4574-417c-997c-847d13be6de4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:47.122288 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ec11aa4-4574-417c-997c-847d13be6de4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:47.123332 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ec11aa4-4574-417c-997c-847d13be6de4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:47.123780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ec11aa4-4574-417c-997c-847d13be6de4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:47.124369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ec11aa4-4574-417c-997c-847d13be6de4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:47.212844 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9ec11aa4-4574-417c-997c-847d13be6de4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:47.222909 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9ec11aa4-4574-417c-997c-847d13be6de4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1293 microversion: 2.1 time: 0.114025 Aug 10 12:43:47.223774 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 159/317] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:47 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1293 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:43:47.269365 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-22f019b6-3d19-433d-a022-ca4bc2b58626 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:47.285078 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-22f019b6-3d19-433d-a022-ca4bc2b58626 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:47.286528 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-22f019b6-3d19-433d-a022-ca4bc2b58626 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:47.287725 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-22f019b6-3d19-433d-a022-ca4bc2b58626 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1744 microversion: 2.20 time: 0.212065 Aug 10 12:43:47.288291 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 159/318] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:47 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1744 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:43:47.448696 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a6cc311f-52f3-43ee-97c5-18fe0036569d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:47.449678 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a6cc311f-52f3-43ee-97c5-18fe0036569d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:47.456425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a6cc311f-52f3-43ee-97c5-18fe0036569d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:47.456899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a6cc311f-52f3-43ee-97c5-18fe0036569d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:47.457324 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a6cc311f-52f3-43ee-97c5-18fe0036569d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:47.458000 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a6cc311f-52f3-43ee-97c5-18fe0036569d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:47.458513 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a6cc311f-52f3-43ee-97c5-18fe0036569d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:47.458929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a6cc311f-52f3-43ee-97c5-18fe0036569d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:47.599433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a6cc311f-52f3-43ee-97c5-18fe0036569d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:47.606968 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a6cc311f-52f3-43ee-97c5-18fe0036569d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1565 microversion: 2.1 time: 0.162184 Aug 10 12:43:47.607577 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 160/319] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:47 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:47.628299 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-00afd0ae-4931-4e18-93d3-cf8def83d705 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:47.628604 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-00afd0ae-4931-4e18-93d3-cf8def83d705 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:47.634547 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-00afd0ae-4931-4e18-93d3-cf8def83d705 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:47.635025 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-00afd0ae-4931-4e18-93d3-cf8def83d705 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:47.639007 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-00afd0ae-4931-4e18-93d3-cf8def83d705 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:47.639007 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-00afd0ae-4931-4e18-93d3-cf8def83d705 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:47.639007 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-00afd0ae-4931-4e18-93d3-cf8def83d705 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:47.639007 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-00afd0ae-4931-4e18-93d3-cf8def83d705 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:47.641964 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:43:47.720141 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-00afd0ae-4931-4e18-93d3-cf8def83d705 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095926 Aug 10 12:43:47.720744 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 160/320] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 10 12:43:47 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:43:47.800682 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b4a9ce67-69dc-49d6-ad00-4bb11cc9d4e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:47.801349 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b4a9ce67-69dc-49d6-ad00-4bb11cc9d4e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:47.811340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4a9ce67-69dc-49d6-ad00-4bb11cc9d4e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:47.811340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4a9ce67-69dc-49d6-ad00-4bb11cc9d4e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:47.811340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4a9ce67-69dc-49d6-ad00-4bb11cc9d4e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:47.811340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4a9ce67-69dc-49d6-ad00-4bb11cc9d4e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:47.811777 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4a9ce67-69dc-49d6-ad00-4bb11cc9d4e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:47.811777 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4a9ce67-69dc-49d6-ad00-4bb11cc9d4e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:48.120958 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-897fd718-6355-4c2e-86db-07bb6900ebf7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:48.121578 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-897fd718-6355-4c2e-86db-07bb6900ebf7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 590f8a6c-039f-4e6b-b23b-e56b9356dc48] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:48.144694 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-897fd718-6355-4c2e-86db-07bb6900ebf7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:48.145193 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-897fd718-6355-4c2e-86db-07bb6900ebf7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:48.145624 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-897fd718-6355-4c2e-86db-07bb6900ebf7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:48.146938 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-897fd718-6355-4c2e-86db-07bb6900ebf7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:48.147430 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-897fd718-6355-4c2e-86db-07bb6900ebf7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:48.147863 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-897fd718-6355-4c2e-86db-07bb6900ebf7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:48.198717 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-897fd718-6355-4c2e-86db-07bb6900ebf7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:48.199623 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-897fd718-6355-4c2e-86db-07bb6900ebf7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:48.200201 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-897fd718-6355-4c2e-86db-07bb6900ebf7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:48.200796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.objects.instance [None req-897fd718-6355-4c2e-86db-07bb6900ebf7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lazy-loading 'fault' on Instance uuid 590f8a6c-039f-4e6b-b23b-e56b9356dc48 {{(pid=124642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:43:48.362791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-897fd718-6355-4c2e-86db-07bb6900ebf7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:48.371932 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-897fd718-6355-4c2e-86db-07bb6900ebf7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48" status: 200 len: 1304 microversion: 2.1 time: 0.265351 Aug 10 12:43:48.374154 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 161/321] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:48 2022] GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48 => generated 1304 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:48.379837 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5feb70db-bd80-49fd-ba2e-ad8d33f8c3f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:48.380607 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5feb70db-bd80-49fd-ba2e-ad8d33f8c3f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:48.442444 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5feb70db-bd80-49fd-ba2e-ad8d33f8c3f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:48.442975 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5feb70db-bd80-49fd-ba2e-ad8d33f8c3f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:48.443445 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5feb70db-bd80-49fd-ba2e-ad8d33f8c3f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:48.444175 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5feb70db-bd80-49fd-ba2e-ad8d33f8c3f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:48.444621 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5feb70db-bd80-49fd-ba2e-ad8d33f8c3f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:48.445047 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5feb70db-bd80-49fd-ba2e-ad8d33f8c3f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:48.471833 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b4a9ce67-69dc-49d6-ad00-4bb11cc9d4e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:48.485918 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b4a9ce67-69dc-49d6-ad00-4bb11cc9d4e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1720 microversion: 2.1 time: 0.689999 Aug 10 12:43:48.489355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 161/322] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:47 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1720 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:48.504399 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d37c4798-db8f-41de-975a-7a1b7c182007 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:48.505358 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d37c4798-db8f-41de-975a-7a1b7c182007 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:48.521267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d37c4798-db8f-41de-975a-7a1b7c182007 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:48.522063 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d37c4798-db8f-41de-975a-7a1b7c182007 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:48.523022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d37c4798-db8f-41de-975a-7a1b7c182007 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:48.523962 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d37c4798-db8f-41de-975a-7a1b7c182007 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:48.525949 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d37c4798-db8f-41de-975a-7a1b7c182007 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:48.530209 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d37c4798-db8f-41de-975a-7a1b7c182007 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:48.676221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5feb70db-bd80-49fd-ba2e-ad8d33f8c3f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:48.684758 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5feb70db-bd80-49fd-ba2e-ad8d33f8c3f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1311 microversion: 2.1 time: 0.308930 Aug 10 12:43:48.685343 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 162/323] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:48 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1311 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:48.713877 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [req-cc103d5b-f723-45b2-b595-cb8cd7ddcb3d req-fcf6a79e-cf3d-4e21-998c-033efc284491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "572a91d2-8a56-4616-97e4-b0d48cc57ea5", "name": "network-vif-plugged", "status": "completed", "tag": "5bdde102-3780-4fb4-a112-3f9af85f6b61"}]} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:43:48.743581 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-cc103d5b-f723-45b2-b595-cb8cd7ddcb3d req-fcf6a79e-cf3d-4e21-998c-033efc284491 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:48.759141 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-cc103d5b-f723-45b2-b595-cb8cd7ddcb3d req-fcf6a79e-cf3d-4e21-998c-033efc284491 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:48.759141 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-cc103d5b-f723-45b2-b595-cb8cd7ddcb3d req-fcf6a79e-cf3d-4e21-998c-033efc284491 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:48.759141 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.compute.server_external_events [req-cc103d5b-f723-45b2-b595-cb8cd7ddcb3d req-fcf6a79e-cf3d-4e21-998c-033efc284491 service nova] Creating event network-vif-plugged:5bdde102-3780-4fb4-a112-3f9af85f6b61 for instance 572a91d2-8a56-4616-97e4-b0d48cc57ea5 on hv-cinder-85199 Aug 10 12:43:48.772541 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [req-cc103d5b-f723-45b2-b595-cb8cd7ddcb3d req-fcf6a79e-cf3d-4e21-998c-033efc284491 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072440 Aug 10 12:43:48.773185 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 163/324] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:43:48.945989 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d37c4798-db8f-41de-975a-7a1b7c182007 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:48.962054 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d37c4798-db8f-41de-975a-7a1b7c182007 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:48.965332 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d37c4798-db8f-41de-975a-7a1b7c182007 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:48.967576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d37c4798-db8f-41de-975a-7a1b7c182007 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1739 microversion: 2.20 time: 0.476266 Aug 10 12:43:48.992333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 162/325] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:48 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1739 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:43:49.399474 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-53cc3b83-baab-4966-bb88-59a9b4bfa9b7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:49.400757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-53cc3b83-baab-4966-bb88-59a9b4bfa9b7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 590f8a6c-039f-4e6b-b23b-e56b9356dc48] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:49.413537 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53cc3b83-baab-4966-bb88-59a9b4bfa9b7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:49.433971 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53cc3b83-baab-4966-bb88-59a9b4bfa9b7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:49.433971 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53cc3b83-baab-4966-bb88-59a9b4bfa9b7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:49.433971 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53cc3b83-baab-4966-bb88-59a9b4bfa9b7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:49.433971 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53cc3b83-baab-4966-bb88-59a9b4bfa9b7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:49.434531 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53cc3b83-baab-4966-bb88-59a9b4bfa9b7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:49.445854 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.wsgi [None req-53cc3b83-baab-4966-bb88-59a9b4bfa9b7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] HTTP exception thrown: Instance 590f8a6c-039f-4e6b-b23b-e56b9356dc48 could not be found. Aug 10 12:43:49.454891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-53cc3b83-baab-4966-bb88-59a9b4bfa9b7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Request method failure captured: Aug 10 12:43:49.454891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: request: GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48 HTTP/1.1 Aug 10 12:43:49.454891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Accept: application/json Aug 10 12:43:49.454891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Accept-Encoding: identity Aug 10 12:43:49.454891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Connection: close Aug 10 12:43:49.454891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Content-Length: 0 Aug 10 12:43:49.454891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Content-Type: application/json Aug 10 12:43:49.454891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Host: 10.222.0.49 Aug 10 12:43:49.454891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Openstack-System-Scope: None Aug 10 12:43:49.454891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: User-Agent: python-urllib3/1.26.11 Aug 10 12:43:49.454891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Auth-Token: gAAAAABi86fotor3z2TnLejqJOV9qz10_EvlxfAtjV-tdtcx_h4mpHUCH635IXJReFRBl1UY-wwzOzTiKEnJFecMEz5dLRwZX2nq0q3zYpXGoillEtXK6Z2KDB08lLCIlcxVVfaCIwH3WNsmsMiRaKP9fTcezwJT4DbYNDIBIbu2ABipOLNJHO4 Aug 10 12:43:49.454891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Domain-Id: None Aug 10 12:43:49.454891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Domain-Name: None Aug 10 12:43:49.454891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Identity-Status: Confirmed Aug 10 12:43:49.454891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Is-Admin-Project: True Aug 10 12:43:49.454891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Project-Domain-Id: default Aug 10 12:43:49.454891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Project-Domain-Name: Default Aug 10 12:43:49.454891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Project-Id: ca783a603c484aad86d05156d7e9142c Aug 10 12:43:49.454891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Project-Name: tempest-VolumesActionsTest-1638191916 Aug 10 12:43:49.454891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Role: reader,member Aug 10 12:43:49.454891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Roles: reader,member Aug 10 12:43:49.456366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca783a603c484aad86d05156d7e9142c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca783a603c484aad86d05156d7e9142c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca783a603c484aad86d05156d7e9142c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca783a603c484aad86d05156d7e9142c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 12:43:49.456366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Tenant: tempest-VolumesActionsTest-1638191916 Aug 10 12:43:49.456366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Tenant-Id: ca783a603c484aad86d05156d7e9142c Aug 10 12:43:49.456366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Tenant-Name: tempest-VolumesActionsTest-1638191916 Aug 10 12:43:49.456366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User: tempest-VolumesActionsTest-1638191916-project Aug 10 12:43:49.456366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User-Domain-Id: default Aug 10 12:43:49.456366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User-Domain-Name: Default Aug 10 12:43:49.456366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User-Id: 00b19e56e11047e3b0f102efea439b7f Aug 10 12:43:49.456366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User-Name: tempest-VolumesActionsTest-1638191916-project Aug 10 12:43:49.456366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: method: > Aug 10 12:43:49.456366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: exception: Instance 590f8a6c-039f-4e6b-b23b-e56b9356dc48 could not be found. Aug 10 12:43:49.456366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: action_args: {'id': '590f8a6c-039f-4e6b-b23b-e56b9356dc48'} Aug 10 12:43:49.457063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:43:49.457063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:43:49.457063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:43:49.457063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:43:49.457063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:43:49.457063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:43:49.457063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:43:49.457063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:43:49.457063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:43:49.457063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:43:49.457063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 590f8a6c-039f-4e6b-b23b-e56b9356dc48 could not be found. Aug 10 12:43:49.457063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:43:49.457063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:43:49.457063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:43:49.457063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:43:49.457063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:43:49.457063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:43:49.457063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:43:49.457063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:43:49.457063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:43:49.458166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:43:49.458166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:43:49.458166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:43:49.458166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:43:49.458166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:43:49.458166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:43:49.458166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:43:49.458166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 590f8a6c-039f-4e6b-b23b-e56b9356dc48 could not be found. Aug 10 12:43:49.458166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:43:49.458166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:43:49.458166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:43:49.458166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:43:49.458166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:43:49.458166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:43:49.458166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:43:49.458166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:43:49.458166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 590f8a6c-039f-4e6b-b23b-e56b9356dc48 could not be found. Aug 10 12:43:49.458166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:43:49.459138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-53cc3b83-baab-4966-bb88-59a9b4bfa9b7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Returning 404 to user: Instance 590f8a6c-039f-4e6b-b23b-e56b9356dc48 could not be found. {{(pid=124642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:43:49.459138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-53cc3b83-baab-4966-bb88-59a9b4bfa9b7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48" status: 404 len: 111 microversion: 2.1 time: 0.068101 Aug 10 12:43:49.459749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 164/326] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:49 2022] GET /compute/v2.1/servers/590f8a6c-039f-4e6b-b23b-e56b9356dc48 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:43:49.510617 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5be1c1a7-f65b-4544-b41e-e959f141d58c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:49.512111 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5be1c1a7-f65b-4544-b41e-e959f141d58c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:49.521649 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5be1c1a7-f65b-4544-b41e-e959f141d58c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:49.522141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5be1c1a7-f65b-4544-b41e-e959f141d58c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:49.522578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5be1c1a7-f65b-4544-b41e-e959f141d58c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:49.539566 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5be1c1a7-f65b-4544-b41e-e959f141d58c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:49.540534 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5be1c1a7-f65b-4544-b41e-e959f141d58c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:49.541823 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5be1c1a7-f65b-4544-b41e-e959f141d58c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:49.653346 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2621d122-2177-4d1d-9345-1c51c7b7693a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1746226435", "imageRef": "674dcf76-6c38-40de-b204-ad2842738058", "flavorRef": "452", "networks": [{"uuid": "2d3b6e86-7949-4709-9ced-f4c606857a50"}]}} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:43:49.680841 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell0:SELECT=2 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:43:49.786493 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.network.neutron [None req-2621d122-2177-4d1d-9345-1c51c7b7693a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] validate_networks() for [('2d3b6e86-7949-4709-9ced-f4c606857a50', None, None, None, None, None)] {{(pid=124642) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:43:49.970544 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell0:SELECT=14 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:43:50.105715 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5be1c1a7-f65b-4544-b41e-e959f141d58c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:50.119926 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5be1c1a7-f65b-4544-b41e-e959f141d58c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1720 microversion: 2.1 time: 0.613346 Aug 10 12:43:50.126008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 163/327] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:49 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1720 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:50.131060 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-cb3999ae-ca50-4671-9577-7659fa8770ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:50.141890 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-cb3999ae-ca50-4671-9577-7659fa8770ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:50.158207 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb3999ae-ca50-4671-9577-7659fa8770ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:50.169071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb3999ae-ca50-4671-9577-7659fa8770ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:50.173032 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb3999ae-ca50-4671-9577-7659fa8770ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:50.173032 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb3999ae-ca50-4671-9577-7659fa8770ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:50.173032 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb3999ae-ca50-4671-9577-7659fa8770ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:50.173032 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb3999ae-ca50-4671-9577-7659fa8770ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:50.190918 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:43:50.660652 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-cb3999ae-ca50-4671-9577-7659fa8770ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:50.679983 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-cb3999ae-ca50-4671-9577-7659fa8770ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1367 microversion: 2.1 time: 0.548870 Aug 10 12:43:50.681323 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 164/328] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:50 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1367 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:50.691513 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-12e48155-5fbf-476d-8b3a-92afe04a84e6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:50.696152 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-12e48155-5fbf-476d-8b3a-92afe04a84e6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:50.721655 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12e48155-5fbf-476d-8b3a-92afe04a84e6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:50.723698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12e48155-5fbf-476d-8b3a-92afe04a84e6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:50.725934 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12e48155-5fbf-476d-8b3a-92afe04a84e6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:50.727477 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12e48155-5fbf-476d-8b3a-92afe04a84e6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:50.732741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12e48155-5fbf-476d-8b3a-92afe04a84e6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:50.733994 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12e48155-5fbf-476d-8b3a-92afe04a84e6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:50.944524 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-2621d122-2177-4d1d-9345-1c51c7b7693a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Flavor limits 0:0:0 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:43:50.945579 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-2621d122-2177-4d1d-9345-1c51c7b7693a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Image limits 0:0:0 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:43:50.946265 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-2621d122-2177-4d1d-9345-1c51c7b7693a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Flavor pref 0:0:0 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:43:50.947003 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-2621d122-2177-4d1d-9345-1c51c7b7693a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Image pref 0:0:0 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:43:50.947633 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.virt.hardware [None req-2621d122-2177-4d1d-9345-1c51c7b7693a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:43:50.960329 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2621d122-2177-4d1d-9345-1c51c7b7693a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:50.963259 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2621d122-2177-4d1d-9345-1c51c7b7693a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:50.963956 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2621d122-2177-4d1d-9345-1c51c7b7693a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:50.964856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-12e48155-5fbf-476d-8b3a-92afe04a84e6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:50.966982 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2621d122-2177-4d1d-9345-1c51c7b7693a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:50.967769 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2621d122-2177-4d1d-9345-1c51c7b7693a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:50.968441 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2621d122-2177-4d1d-9345-1c51c7b7693a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:50.974222 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-12e48155-5fbf-476d-8b3a-92afe04a84e6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:50.976030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-12e48155-5fbf-476d-8b3a-92afe04a84e6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:50.977539 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-12e48155-5fbf-476d-8b3a-92afe04a84e6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1739 microversion: 2.20 time: 0.294820 Aug 10 12:43:50.978377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 165/329] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:50 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1739 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:43:50.984566 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-e774376b-c5b2-4939-a042-0671b9650557 req-f8dd70c2-2297-419c-bf3e-8a211bcdff01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3181426f-eb81-4712-97c6-8c92b61f53a0", "tag": "bd12d9c9-bde7-4a2b-92de-b4401e6328ab"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:43:50.995086 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-e774376b-c5b2-4939-a042-0671b9650557 req-f8dd70c2-2297-419c-bf3e-8a211bcdff01 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:50.995946 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-e774376b-c5b2-4939-a042-0671b9650557 req-f8dd70c2-2297-419c-bf3e-8a211bcdff01 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:50.996608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-e774376b-c5b2-4939-a042-0671b9650557 req-f8dd70c2-2297-419c-bf3e-8a211bcdff01 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:51.011635 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-e774376b-c5b2-4939-a042-0671b9650557 req-f8dd70c2-2297-419c-bf3e-8a211bcdff01 service nova] Creating event network-changed:bd12d9c9-bde7-4a2b-92de-b4401e6328ab for instance 3181426f-eb81-4712-97c6-8c92b61f53a0 on hv-cinder-85199 Aug 10 12:43:51.021290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-e774376b-c5b2-4939-a042-0671b9650557 req-f8dd70c2-2297-419c-bf3e-8a211bcdff01 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039337 Aug 10 12:43:51.022551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 166/330] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:43:51.026766 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.quota [None req-2621d122-2177-4d1d-9345-1c51c7b7693a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Getting quotas for project ca783a603c484aad86d05156d7e9142c. Resources: {'cores', 'ram', 'instances'} {{(pid=124642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:43:51.033033 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.quota [None req-2621d122-2177-4d1d-9345-1c51c7b7693a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Getting quotas for user 00b19e56e11047e3b0f102efea439b7f and project ca783a603c484aad86d05156d7e9142c. Resources: {'cores', 'ram', 'instances'} {{(pid=124642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:43:51.060188 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2621d122-2177-4d1d-9345-1c51c7b7693a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Going to run 1 instances... {{(pid=124642) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:43:51.063497 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2621d122-2177-4d1d-9345-1c51c7b7693a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 38bd2d87-ab3f-44c7-af3a-31625fbc988e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='674dcf76-6c38-40de-b204-ad2842738058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:43:51.147695 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bc2f69ba-427e-426e-b32c-eb6c8eb7d96b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:51.148392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bc2f69ba-427e-426e-b32c-eb6c8eb7d96b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:51.157775 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc2f69ba-427e-426e-b32c-eb6c8eb7d96b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:51.158273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc2f69ba-427e-426e-b32c-eb6c8eb7d96b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:51.158709 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc2f69ba-427e-426e-b32c-eb6c8eb7d96b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:51.159439 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc2f69ba-427e-426e-b32c-eb6c8eb7d96b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:51.159895 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc2f69ba-427e-426e-b32c-eb6c8eb7d96b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:51.171935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc2f69ba-427e-426e-b32c-eb6c8eb7d96b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:51.274526 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2621d122-2177-4d1d-9345-1c51c7b7693a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.626040 Aug 10 12:43:51.276201 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 165/331] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 12:43:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 12:43:51.328748 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9a702752-1881-4dc8-bd86-88334d3c420e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:51.329913 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9a702752-1881-4dc8-bd86-88334d3c420e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 38bd2d87-ab3f-44c7-af3a-31625fbc988e] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:51.592347 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9a702752-1881-4dc8-bd86-88334d3c420e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:51.601079 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9a702752-1881-4dc8-bd86-88334d3c420e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e" status: 200 len: 1214 microversion: 2.1 time: 0.278064 Aug 10 12:43:51.606383 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 166/332] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:51 2022] GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e => generated 1214 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:51.709122 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2739878e-ad1a-4e7b-8db8-5bd1121cb03f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:51.709895 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2739878e-ad1a-4e7b-8db8-5bd1121cb03f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:51.729251 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2739878e-ad1a-4e7b-8db8-5bd1121cb03f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:51.730017 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2739878e-ad1a-4e7b-8db8-5bd1121cb03f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:51.730714 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2739878e-ad1a-4e7b-8db8-5bd1121cb03f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:51.731698 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2739878e-ad1a-4e7b-8db8-5bd1121cb03f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:51.732382 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2739878e-ad1a-4e7b-8db8-5bd1121cb03f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:51.733699 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2739878e-ad1a-4e7b-8db8-5bd1121cb03f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:52.419039 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-bc2f69ba-427e-426e-b32c-eb6c8eb7d96b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:52.439953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bc2f69ba-427e-426e-b32c-eb6c8eb7d96b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1720 microversion: 2.1 time: 1.297256 Aug 10 12:43:52.460217 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 167/333] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:51 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1720 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:52.471812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-46865da5-1c8e-4656-a47f-056fb551bbd1 req-8a4160c0-f625-434d-b289-3204fd8b00b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d0315a8-29f9-4d6e-9298-f5a1d0d69e36", "tag": "ed664c7d-23bb-4772-ac75-7b70d3de4c8d"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:43:52.497997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-46865da5-1c8e-4656-a47f-056fb551bbd1 req-8a4160c0-f625-434d-b289-3204fd8b00b6 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:52.498965 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-46865da5-1c8e-4656-a47f-056fb551bbd1 req-8a4160c0-f625-434d-b289-3204fd8b00b6 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:52.500359 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-46865da5-1c8e-4656-a47f-056fb551bbd1 req-8a4160c0-f625-434d-b289-3204fd8b00b6 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:52.517139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-46865da5-1c8e-4656-a47f-056fb551bbd1 req-8a4160c0-f625-434d-b289-3204fd8b00b6 service nova] Creating event network-changed:ed664c7d-23bb-4772-ac75-7b70d3de4c8d for instance 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 on hv-cinder-85199 Aug 10 12:43:52.524507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-46865da5-1c8e-4656-a47f-056fb551bbd1 req-8a4160c0-f625-434d-b289-3204fd8b00b6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065389 Aug 10 12:43:52.525210 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 168/334] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:43:52.533469 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-eafb5b3f-00d2-4bec-bf4b-1fe19224717b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:52.534626 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-eafb5b3f-00d2-4bec-bf4b-1fe19224717b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:52.555738 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eafb5b3f-00d2-4bec-bf4b-1fe19224717b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:52.556805 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eafb5b3f-00d2-4bec-bf4b-1fe19224717b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:52.557554 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eafb5b3f-00d2-4bec-bf4b-1fe19224717b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:52.558383 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eafb5b3f-00d2-4bec-bf4b-1fe19224717b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:52.559526 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eafb5b3f-00d2-4bec-bf4b-1fe19224717b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:52.560197 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eafb5b3f-00d2-4bec-bf4b-1fe19224717b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:52.632690 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2739878e-ad1a-4e7b-8db8-5bd1121cb03f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:52.670754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2739878e-ad1a-4e7b-8db8-5bd1121cb03f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1367 microversion: 2.1 time: 0.942556 Aug 10 12:43:52.670754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 167/335] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:51 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1367 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:52.679805 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a93668c7-8a71-4d61-9e81-e56e83ca6bb5 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:52.680287 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a93668c7-8a71-4d61-9e81-e56e83ca6bb5 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 38bd2d87-ab3f-44c7-af3a-31625fbc988e] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:52.846363 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a93668c7-8a71-4d61-9e81-e56e83ca6bb5 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:52.855286 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a93668c7-8a71-4d61-9e81-e56e83ca6bb5 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e" status: 200 len: 1214 microversion: 2.1 time: 0.202196 Aug 10 12:43:52.857639 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 168/336] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:52 2022] GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e => generated 1214 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:52.978426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-eafb5b3f-00d2-4bec-bf4b-1fe19224717b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:52.990487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-eafb5b3f-00d2-4bec-bf4b-1fe19224717b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:52.992456 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-eafb5b3f-00d2-4bec-bf4b-1fe19224717b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:52.993981 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-eafb5b3f-00d2-4bec-bf4b-1fe19224717b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1739 microversion: 2.20 time: 0.466665 Aug 10 12:43:52.995085 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 169/337] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:52 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1739 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:43:53.462617 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-36fb26f5-214a-4aa4-a8af-029e9d8e0d1f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:53.464024 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-36fb26f5-214a-4aa4-a8af-029e9d8e0d1f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:53.476286 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-36fb26f5-214a-4aa4-a8af-029e9d8e0d1f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:53.477060 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-36fb26f5-214a-4aa4-a8af-029e9d8e0d1f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:53.477498 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-36fb26f5-214a-4aa4-a8af-029e9d8e0d1f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:53.478197 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-36fb26f5-214a-4aa4-a8af-029e9d8e0d1f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:53.478847 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-36fb26f5-214a-4aa4-a8af-029e9d8e0d1f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:53.479352 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-36fb26f5-214a-4aa4-a8af-029e9d8e0d1f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:53.679828 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a2943cf9-a70f-4b97-9c75-0dc2dfa3df30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:53.681432 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a2943cf9-a70f-4b97-9c75-0dc2dfa3df30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:53.691920 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a2943cf9-a70f-4b97-9c75-0dc2dfa3df30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:53.692674 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a2943cf9-a70f-4b97-9c75-0dc2dfa3df30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:53.693261 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a2943cf9-a70f-4b97-9c75-0dc2dfa3df30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:53.694117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a2943cf9-a70f-4b97-9c75-0dc2dfa3df30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:53.694709 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a2943cf9-a70f-4b97-9c75-0dc2dfa3df30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:53.695465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a2943cf9-a70f-4b97-9c75-0dc2dfa3df30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:53.725286 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-36fb26f5-214a-4aa4-a8af-029e9d8e0d1f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:53.737815 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-36fb26f5-214a-4aa4-a8af-029e9d8e0d1f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1720 microversion: 2.1 time: 0.279611 Aug 10 12:43:53.751230 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 169/338] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:53 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1720 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:53.895698 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6abf2d3b-4afa-46b3-82fa-e8d2cc839a82 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:53.896638 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6abf2d3b-4afa-46b3-82fa-e8d2cc839a82 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 38bd2d87-ab3f-44c7-af3a-31625fbc988e] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:53.907516 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6abf2d3b-4afa-46b3-82fa-e8d2cc839a82 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:53.909921 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6abf2d3b-4afa-46b3-82fa-e8d2cc839a82 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:53.911121 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6abf2d3b-4afa-46b3-82fa-e8d2cc839a82 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:53.912169 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6abf2d3b-4afa-46b3-82fa-e8d2cc839a82 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:53.914777 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6abf2d3b-4afa-46b3-82fa-e8d2cc839a82 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:53.915480 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6abf2d3b-4afa-46b3-82fa-e8d2cc839a82 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:53.947404 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a2943cf9-a70f-4b97-9c75-0dc2dfa3df30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:53.956072 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a2943cf9-a70f-4b97-9c75-0dc2dfa3df30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1367 microversion: 2.1 time: 0.280536 Aug 10 12:43:53.959254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 170/339] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:53 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:54.001040 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6abf2d3b-4afa-46b3-82fa-e8d2cc839a82 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:54.008939 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6abf2d3b-4afa-46b3-82fa-e8d2cc839a82 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e" status: 200 len: 1218 microversion: 2.1 time: 0.134858 Aug 10 12:43:54.021133 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 170/340] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:53 2022] GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e => generated 1218 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:54.026404 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2cfa3d8a-4887-498e-8d22-a3367ffa0596 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:54.027424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2cfa3d8a-4887-498e-8d22-a3367ffa0596 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:54.035639 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2cfa3d8a-4887-498e-8d22-a3367ffa0596 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:54.036698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2cfa3d8a-4887-498e-8d22-a3367ffa0596 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:54.037263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2cfa3d8a-4887-498e-8d22-a3367ffa0596 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:54.038051 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2cfa3d8a-4887-498e-8d22-a3367ffa0596 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:54.038580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2cfa3d8a-4887-498e-8d22-a3367ffa0596 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:54.039100 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2cfa3d8a-4887-498e-8d22-a3367ffa0596 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:54.247438 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2cfa3d8a-4887-498e-8d22-a3367ffa0596 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:54.257370 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2cfa3d8a-4887-498e-8d22-a3367ffa0596 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:54.259237 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2cfa3d8a-4887-498e-8d22-a3367ffa0596 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:54.260658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2cfa3d8a-4887-498e-8d22-a3367ffa0596 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1739 microversion: 2.20 time: 0.243049 Aug 10 12:43:54.261516 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 171/341] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:54 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1739 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:43:54.760459 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f98d261c-8595-439f-b89c-657dbaf9769e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:54.761070 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f98d261c-8595-439f-b89c-657dbaf9769e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:54.768170 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f98d261c-8595-439f-b89c-657dbaf9769e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:54.768649 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f98d261c-8595-439f-b89c-657dbaf9769e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:54.769086 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f98d261c-8595-439f-b89c-657dbaf9769e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:54.769775 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f98d261c-8595-439f-b89c-657dbaf9769e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:54.770227 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f98d261c-8595-439f-b89c-657dbaf9769e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:54.770704 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f98d261c-8595-439f-b89c-657dbaf9769e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:54.903666 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f98d261c-8595-439f-b89c-657dbaf9769e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:54.922144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f98d261c-8595-439f-b89c-657dbaf9769e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1720 microversion: 2.1 time: 0.164763 Aug 10 12:43:54.922978 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 171/342] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:54 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:54.976836 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-64592a75-b56a-415e-8f19-22f9de6b0d1e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:54.977437 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-64592a75-b56a-415e-8f19-22f9de6b0d1e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:54.980101 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:43:54.985834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64592a75-b56a-415e-8f19-22f9de6b0d1e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:54.986584 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64592a75-b56a-415e-8f19-22f9de6b0d1e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:54.987476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64592a75-b56a-415e-8f19-22f9de6b0d1e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:54.988396 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64592a75-b56a-415e-8f19-22f9de6b0d1e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:54.989053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64592a75-b56a-415e-8f19-22f9de6b0d1e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:54.989644 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64592a75-b56a-415e-8f19-22f9de6b0d1e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:55.031468 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1e858c98-2bff-48a9-b5f2-5fa10af7acd8 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:55.032382 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1e858c98-2bff-48a9-b5f2-5fa10af7acd8 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 38bd2d87-ab3f-44c7-af3a-31625fbc988e] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:55.043215 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1e858c98-2bff-48a9-b5f2-5fa10af7acd8 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:55.043691 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1e858c98-2bff-48a9-b5f2-5fa10af7acd8 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:55.044143 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1e858c98-2bff-48a9-b5f2-5fa10af7acd8 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:55.044844 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1e858c98-2bff-48a9-b5f2-5fa10af7acd8 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:55.045289 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1e858c98-2bff-48a9-b5f2-5fa10af7acd8 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:55.047779 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1e858c98-2bff-48a9-b5f2-5fa10af7acd8 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:55.141138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-1e858c98-2bff-48a9-b5f2-5fa10af7acd8 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:55.151662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1e858c98-2bff-48a9-b5f2-5fa10af7acd8 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e" status: 200 len: 1218 microversion: 2.1 time: 0.125464 Aug 10 12:43:55.163963 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 172/343] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:55 2022] GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e => generated 1218 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:55.216636 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-64592a75-b56a-415e-8f19-22f9de6b0d1e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:55.226101 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-64592a75-b56a-415e-8f19-22f9de6b0d1e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1367 microversion: 2.1 time: 0.253011 Aug 10 12:43:55.227056 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 172/344] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:54 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:55.291737 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0a10897e-e99c-4b3e-8e0a-f2db910400af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:55.307491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0a10897e-e99c-4b3e-8e0a-f2db910400af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:55.307491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0a10897e-e99c-4b3e-8e0a-f2db910400af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:55.307491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0a10897e-e99c-4b3e-8e0a-f2db910400af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:55.307491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0a10897e-e99c-4b3e-8e0a-f2db910400af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:55.307921 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0a10897e-e99c-4b3e-8e0a-f2db910400af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:55.307921 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0a10897e-e99c-4b3e-8e0a-f2db910400af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:55.307921 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0a10897e-e99c-4b3e-8e0a-f2db910400af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:55.512225 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0a10897e-e99c-4b3e-8e0a-f2db910400af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:55.522414 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0a10897e-e99c-4b3e-8e0a-f2db910400af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:55.524132 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0a10897e-e99c-4b3e-8e0a-f2db910400af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:55.525691 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0a10897e-e99c-4b3e-8e0a-f2db910400af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1739 microversion: 2.20 time: 0.239165 Aug 10 12:43:55.526724 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 173/345] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:55 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1739 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:43:55.944416 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f768ca84-a600-4cfe-939d-ce96006b986a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:55.945431 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f768ca84-a600-4cfe-939d-ce96006b986a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:55.951786 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f768ca84-a600-4cfe-939d-ce96006b986a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:55.952556 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f768ca84-a600-4cfe-939d-ce96006b986a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:55.953659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f768ca84-a600-4cfe-939d-ce96006b986a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:55.954557 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f768ca84-a600-4cfe-939d-ce96006b986a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:55.955165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f768ca84-a600-4cfe-939d-ce96006b986a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:55.955812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f768ca84-a600-4cfe-939d-ce96006b986a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:56.113109 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f768ca84-a600-4cfe-939d-ce96006b986a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:56.121657 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f768ca84-a600-4cfe-939d-ce96006b986a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1720 microversion: 2.1 time: 0.181357 Aug 10 12:43:56.122809 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 173/346] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:55 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1720 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:56.178974 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a696e17e-6b65-4622-b244-28b25a37b955 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:56.183369 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a696e17e-6b65-4622-b244-28b25a37b955 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 38bd2d87-ab3f-44c7-af3a-31625fbc988e] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:56.192179 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a696e17e-6b65-4622-b244-28b25a37b955 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:56.192675 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a696e17e-6b65-4622-b244-28b25a37b955 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:56.193366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a696e17e-6b65-4622-b244-28b25a37b955 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:56.194080 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a696e17e-6b65-4622-b244-28b25a37b955 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:56.194643 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a696e17e-6b65-4622-b244-28b25a37b955 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:56.195100 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a696e17e-6b65-4622-b244-28b25a37b955 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:56.247846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e867caf4-3f55-40d5-9c6a-2c04e3e036f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:56.250450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e867caf4-3f55-40d5-9c6a-2c04e3e036f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:56.267801 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e867caf4-3f55-40d5-9c6a-2c04e3e036f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:56.268964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e867caf4-3f55-40d5-9c6a-2c04e3e036f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:56.269606 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e867caf4-3f55-40d5-9c6a-2c04e3e036f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:56.270316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e867caf4-3f55-40d5-9c6a-2c04e3e036f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:56.270771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e867caf4-3f55-40d5-9c6a-2c04e3e036f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:56.271216 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e867caf4-3f55-40d5-9c6a-2c04e3e036f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:56.302353 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a696e17e-6b65-4622-b244-28b25a37b955 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:56.314691 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a696e17e-6b65-4622-b244-28b25a37b955 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e" status: 200 len: 1218 microversion: 2.1 time: 0.139765 Aug 10 12:43:56.315475 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 174/347] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:56 2022] GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e => generated 1218 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:56.441120 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e867caf4-3f55-40d5-9c6a-2c04e3e036f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:56.450207 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e867caf4-3f55-40d5-9c6a-2c04e3e036f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1367 microversion: 2.1 time: 0.205985 Aug 10 12:43:56.450511 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 174/348] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:56 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:43:56.557727 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7be7ba38-b807-4944-9acf-2bbe1aef2d53 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1320661799", "imageRef": "674dcf76-6c38-40de-b204-ad2842738058", "flavorRef": "452", "networks": [{"uuid": "36512045-7c91-46fc-a912-eec327d8b73b"}]}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:43:56.559442 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f4ac0acb-d2f0-4f14-8798-07bd7abd40ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:56.562199 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f4ac0acb-d2f0-4f14-8798-07bd7abd40ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:56.575688 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f4ac0acb-d2f0-4f14-8798-07bd7abd40ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:56.578534 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f4ac0acb-d2f0-4f14-8798-07bd7abd40ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:56.580808 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f4ac0acb-d2f0-4f14-8798-07bd7abd40ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:56.583620 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f4ac0acb-d2f0-4f14-8798-07bd7abd40ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:56.584058 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f4ac0acb-d2f0-4f14-8798-07bd7abd40ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:56.595976 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f4ac0acb-d2f0-4f14-8798-07bd7abd40ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:56.643254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.network.neutron [None req-7be7ba38-b807-4944-9acf-2bbe1aef2d53 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] validate_networks() for [('36512045-7c91-46fc-a912-eec327d8b73b', None, None, None, None, None)] {{(pid=124643) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 12:43:57.020633 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f4ac0acb-d2f0-4f14-8798-07bd7abd40ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:57.047649 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f4ac0acb-d2f0-4f14-8798-07bd7abd40ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:57.055642 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f4ac0acb-d2f0-4f14-8798-07bd7abd40ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:57.058324 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f4ac0acb-d2f0-4f14-8798-07bd7abd40ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1739 microversion: 2.20 time: 0.509233 Aug 10 12:43:57.058953 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 175/349] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:56 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1739 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:43:57.146121 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6e0a51c4-d120-4538-9065-72127cffa00d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:57.147161 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6e0a51c4-d120-4538-9065-72127cffa00d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:57.160432 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6e0a51c4-d120-4538-9065-72127cffa00d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:57.161545 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6e0a51c4-d120-4538-9065-72127cffa00d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:57.162311 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6e0a51c4-d120-4538-9065-72127cffa00d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:57.163326 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6e0a51c4-d120-4538-9065-72127cffa00d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:57.164910 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6e0a51c4-d120-4538-9065-72127cffa00d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:57.173687 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6e0a51c4-d120-4538-9065-72127cffa00d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:57.443722 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6e0a51c4-d120-4538-9065-72127cffa00d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:57.457000 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6e0a51c4-d120-4538-9065-72127cffa00d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1720 microversion: 2.1 time: 0.312410 Aug 10 12:43:57.457862 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 176/350] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:57 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1720 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:57.467920 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4767726d-7023-4239-91a1-057f3178ae98 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:57.468965 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4767726d-7023-4239-91a1-057f3178ae98 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 38bd2d87-ab3f-44c7-af3a-31625fbc988e] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:57.480733 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4767726d-7023-4239-91a1-057f3178ae98 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:57.481227 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4767726d-7023-4239-91a1-057f3178ae98 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:57.481658 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4767726d-7023-4239-91a1-057f3178ae98 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:57.482562 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4767726d-7023-4239-91a1-057f3178ae98 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:57.483013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4767726d-7023-4239-91a1-057f3178ae98 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:57.484457 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4767726d-7023-4239-91a1-057f3178ae98 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:57.553053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-7be7ba38-b807-4944-9acf-2bbe1aef2d53 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Flavor limits 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 12:43:57.554786 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-7be7ba38-b807-4944-9acf-2bbe1aef2d53 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Image limits 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 12:43:57.564164 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-7be7ba38-b807-4944-9acf-2bbe1aef2d53 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Flavor pref 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 12:43:57.564711 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-7be7ba38-b807-4944-9acf-2bbe1aef2d53 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Image pref 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 12:43:57.565695 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-7be7ba38-b807-4944-9acf-2bbe1aef2d53 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 12:43:57.576121 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7be7ba38-b807-4944-9acf-2bbe1aef2d53 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:57.576585 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7be7ba38-b807-4944-9acf-2bbe1aef2d53 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:57.577744 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7be7ba38-b807-4944-9acf-2bbe1aef2d53 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:57.578517 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7be7ba38-b807-4944-9acf-2bbe1aef2d53 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:57.578967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7be7ba38-b807-4944-9acf-2bbe1aef2d53 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:57.579420 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7be7ba38-b807-4944-9acf-2bbe1aef2d53 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:57.594512 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4767726d-7023-4239-91a1-057f3178ae98 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:57.594512 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4767726d-7023-4239-91a1-057f3178ae98 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e" status: 200 len: 1266 microversion: 2.1 time: 0.129073 Aug 10 12:43:57.594512 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 177/351] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:57 2022] GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e => generated 1266 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:57.594512 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5dcf3b59-1e81-4dd8-a586-4c2860191415 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:57.595234 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5dcf3b59-1e81-4dd8-a586-4c2860191415 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:57.601867 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5dcf3b59-1e81-4dd8-a586-4c2860191415 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:57.602353 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5dcf3b59-1e81-4dd8-a586-4c2860191415 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:57.602796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5dcf3b59-1e81-4dd8-a586-4c2860191415 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:57.603538 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5dcf3b59-1e81-4dd8-a586-4c2860191415 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:57.604176 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5dcf3b59-1e81-4dd8-a586-4c2860191415 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:57.604601 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5dcf3b59-1e81-4dd8-a586-4c2860191415 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:57.606039 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-7be7ba38-b807-4944-9acf-2bbe1aef2d53 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Getting quotas for project 4f4fa99fc6514cceb31af25c94623178. Resources: {'cores', 'ram', 'instances'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 12:43:57.612749 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-7be7ba38-b807-4944-9acf-2bbe1aef2d53 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Getting quotas for user d8e3d29dcfbc43a1aa2c26b676f5894c and project 4f4fa99fc6514cceb31af25c94623178. Resources: {'cores', 'ram', 'instances'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 12:43:57.623347 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7be7ba38-b807-4944-9acf-2bbe1aef2d53 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Going to run 1 instances... {{(pid=124643) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 12:43:57.626604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7be7ba38-b807-4944-9acf-2bbe1aef2d53 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='674dcf76-6c38-40de-b204-ad2842738058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 12:43:57.740985 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5dcf3b59-1e81-4dd8-a586-4c2860191415 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:57.750306 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5dcf3b59-1e81-4dd8-a586-4c2860191415 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1367 microversion: 2.1 time: 0.160563 Aug 10 12:43:57.751063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 178/352] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:57 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:58.082234 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f06c5265-4926-4728-afce-8d1eadd1f76c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:58.082854 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f06c5265-4926-4728-afce-8d1eadd1f76c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:58.088782 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f06c5265-4926-4728-afce-8d1eadd1f76c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:58.089261 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f06c5265-4926-4728-afce-8d1eadd1f76c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:58.089685 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f06c5265-4926-4728-afce-8d1eadd1f76c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:58.090362 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f06c5265-4926-4728-afce-8d1eadd1f76c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:58.090806 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f06c5265-4926-4728-afce-8d1eadd1f76c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:58.091241 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f06c5265-4926-4728-afce-8d1eadd1f76c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:58.252647 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f06c5265-4926-4728-afce-8d1eadd1f76c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:58.260943 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f06c5265-4926-4728-afce-8d1eadd1f76c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:58.262459 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f06c5265-4926-4728-afce-8d1eadd1f76c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:58.263823 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f06c5265-4926-4728-afce-8d1eadd1f76c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1739 microversion: 2.20 time: 0.185485 Aug 10 12:43:58.264430 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 179/353] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:58 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:43:58.365927 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7be7ba38-b807-4944-9acf-2bbe1aef2d53 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.814632 Aug 10 12:43:58.366570 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 175/354] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 12:43:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 12:43:58.378015 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6eea58e0-80c6-4bd8-8016-d28e63561ff8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:58.382099 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6eea58e0-80c6-4bd8-8016-d28e63561ff8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:58.435646 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6eea58e0-80c6-4bd8-8016-d28e63561ff8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:58.442917 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6eea58e0-80c6-4bd8-8016-d28e63561ff8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1219 microversion: 2.1 time: 0.069291 Aug 10 12:43:58.443581 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 180/355] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:58 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:58.480423 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-42243875-cd08-409c-a4b8-d2d2af1195b9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:58.481032 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-42243875-cd08-409c-a4b8-d2d2af1195b9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:58.488605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-42243875-cd08-409c-a4b8-d2d2af1195b9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:58.489065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-42243875-cd08-409c-a4b8-d2d2af1195b9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:58.489492 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-42243875-cd08-409c-a4b8-d2d2af1195b9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:58.490198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-42243875-cd08-409c-a4b8-d2d2af1195b9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:58.490643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-42243875-cd08-409c-a4b8-d2d2af1195b9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:58.491062 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-42243875-cd08-409c-a4b8-d2d2af1195b9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:58.610746 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-24af8356-5973-44ac-aa71-eba8c86f5dd7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:58.611441 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-24af8356-5973-44ac-aa71-eba8c86f5dd7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 38bd2d87-ab3f-44c7-af3a-31625fbc988e] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:58.623550 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24af8356-5973-44ac-aa71-eba8c86f5dd7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:58.624115 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24af8356-5973-44ac-aa71-eba8c86f5dd7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:58.624570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24af8356-5973-44ac-aa71-eba8c86f5dd7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:58.625298 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24af8356-5973-44ac-aa71-eba8c86f5dd7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:58.628205 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24af8356-5973-44ac-aa71-eba8c86f5dd7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:58.628681 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24af8356-5973-44ac-aa71-eba8c86f5dd7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:58.734858 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-24af8356-5973-44ac-aa71-eba8c86f5dd7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:58.737877 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:43:58.747511 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-24af8356-5973-44ac-aa71-eba8c86f5dd7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e" status: 200 len: 1274 microversion: 2.1 time: 0.141289 Aug 10 12:43:58.748695 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 181/356] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:58 2022] GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e => generated 1274 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:58.781191 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3d01b745-8307-43dd-ae0e-4030a2137f76 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:58.782125 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3d01b745-8307-43dd-ae0e-4030a2137f76 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:58.798664 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d01b745-8307-43dd-ae0e-4030a2137f76 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:58.799960 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d01b745-8307-43dd-ae0e-4030a2137f76 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:58.800832 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d01b745-8307-43dd-ae0e-4030a2137f76 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:58.801837 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d01b745-8307-43dd-ae0e-4030a2137f76 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:58.802457 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d01b745-8307-43dd-ae0e-4030a2137f76 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:58.803044 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d01b745-8307-43dd-ae0e-4030a2137f76 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:58.874542 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-42243875-cd08-409c-a4b8-d2d2af1195b9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:58.884810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-42243875-cd08-409c-a4b8-d2d2af1195b9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1720 microversion: 2.1 time: 0.408393 Aug 10 12:43:58.888885 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 176/357] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:58 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1720 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:58.992487 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3d01b745-8307-43dd-ae0e-4030a2137f76 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:59.004343 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3d01b745-8307-43dd-ae0e-4030a2137f76 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1367 microversion: 2.1 time: 0.228017 Aug 10 12:43:59.024376 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 182/358] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:58 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:59.289147 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-885b31c0-3e83-446c-81e9-4ded3a8ce3f0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:59.290802 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-885b31c0-3e83-446c-81e9-4ded3a8ce3f0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:59.297354 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-885b31c0-3e83-446c-81e9-4ded3a8ce3f0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:59.298118 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-885b31c0-3e83-446c-81e9-4ded3a8ce3f0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:59.298851 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-885b31c0-3e83-446c-81e9-4ded3a8ce3f0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:59.300017 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-885b31c0-3e83-446c-81e9-4ded3a8ce3f0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:59.300617 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-885b31c0-3e83-446c-81e9-4ded3a8ce3f0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:59.301181 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-885b31c0-3e83-446c-81e9-4ded3a8ce3f0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:59.459606 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-885b31c0-3e83-446c-81e9-4ded3a8ce3f0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:59.463945 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-601ca8d4-abf9-4cec-8de9-ed6404209a8e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:59.464767 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-601ca8d4-abf9-4cec-8de9-ed6404209a8e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:59.468686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:43:59.474524 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-885b31c0-3e83-446c-81e9-4ded3a8ce3f0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:59.479816 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-885b31c0-3e83-446c-81e9-4ded3a8ce3f0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:59.482253 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-885b31c0-3e83-446c-81e9-4ded3a8ce3f0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1739 microversion: 2.20 time: 0.197708 Aug 10 12:43:59.484261 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 177/359] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:43:59 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:43:59.524269 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-601ca8d4-abf9-4cec-8de9-ed6404209a8e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:59.532612 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-601ca8d4-abf9-4cec-8de9-ed6404209a8e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1219 microversion: 2.1 time: 0.072416 Aug 10 12:43:59.533184 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 183/360] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:59 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:43:59.770597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b9ed30e2-730d-4a5f-8cf4-24bfdc8537bb tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:59.771390 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b9ed30e2-730d-4a5f-8cf4-24bfdc8537bb tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 38bd2d87-ab3f-44c7-af3a-31625fbc988e] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:59.779434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b9ed30e2-730d-4a5f-8cf4-24bfdc8537bb tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:59.780211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b9ed30e2-730d-4a5f-8cf4-24bfdc8537bb tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:59.781377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b9ed30e2-730d-4a5f-8cf4-24bfdc8537bb tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:59.782257 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b9ed30e2-730d-4a5f-8cf4-24bfdc8537bb tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:59.782809 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b9ed30e2-730d-4a5f-8cf4-24bfdc8537bb tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:59.783482 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b9ed30e2-730d-4a5f-8cf4-24bfdc8537bb tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:59.850919 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b9ed30e2-730d-4a5f-8cf4-24bfdc8537bb tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:43:59.859609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b9ed30e2-730d-4a5f-8cf4-24bfdc8537bb tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e" status: 200 len: 1274 microversion: 2.1 time: 0.092199 Aug 10 12:43:59.863302 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 178/361] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:59 2022] GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e => generated 1274 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:43:59.911011 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0e9f1e38-f3d8-426f-97dc-5118713da210 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:43:59.911664 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0e9f1e38-f3d8-426f-97dc-5118713da210 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:43:59.922141 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e9f1e38-f3d8-426f-97dc-5118713da210 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:59.922789 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e9f1e38-f3d8-426f-97dc-5118713da210 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:59.923255 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e9f1e38-f3d8-426f-97dc-5118713da210 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:43:59.923964 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e9f1e38-f3d8-426f-97dc-5118713da210 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:43:59.924411 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e9f1e38-f3d8-426f-97dc-5118713da210 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:43:59.925910 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e9f1e38-f3d8-426f-97dc-5118713da210 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:00.025828 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a6eed4c8-3f20-4d0b-a196-6076009e023f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:00.026587 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a6eed4c8-3f20-4d0b-a196-6076009e023f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:00.035259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a6eed4c8-3f20-4d0b-a196-6076009e023f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:00.036023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a6eed4c8-3f20-4d0b-a196-6076009e023f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:00.036452 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a6eed4c8-3f20-4d0b-a196-6076009e023f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:00.037151 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a6eed4c8-3f20-4d0b-a196-6076009e023f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:00.037595 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a6eed4c8-3f20-4d0b-a196-6076009e023f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:00.038552 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a6eed4c8-3f20-4d0b-a196-6076009e023f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:00.125875 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0e9f1e38-f3d8-426f-97dc-5118713da210 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:00.134191 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0e9f1e38-f3d8-426f-97dc-5118713da210 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1720 microversion: 2.1 time: 0.227626 Aug 10 12:44:00.137616 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 184/362] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:43:59 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1720 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:00.206647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a6eed4c8-3f20-4d0b-a196-6076009e023f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:00.214602 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a6eed4c8-3f20-4d0b-a196-6076009e023f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1367 microversion: 2.1 time: 0.192630 Aug 10 12:44:00.215539 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 179/363] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:00 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:00.510177 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ca224fdf-281d-4cfa-bd3f-4ef7f179dd8e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:00.511170 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ca224fdf-281d-4cfa-bd3f-4ef7f179dd8e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:00.519792 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca224fdf-281d-4cfa-bd3f-4ef7f179dd8e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:00.521642 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca224fdf-281d-4cfa-bd3f-4ef7f179dd8e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:00.522321 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca224fdf-281d-4cfa-bd3f-4ef7f179dd8e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:00.523352 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca224fdf-281d-4cfa-bd3f-4ef7f179dd8e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:00.523818 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca224fdf-281d-4cfa-bd3f-4ef7f179dd8e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:00.524249 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca224fdf-281d-4cfa-bd3f-4ef7f179dd8e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:00.553886 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-98a37b91-8bea-43b5-8b8b-026c21052df2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:00.554610 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-98a37b91-8bea-43b5-8b8b-026c21052df2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:00.565902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98a37b91-8bea-43b5-8b8b-026c21052df2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:00.567084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98a37b91-8bea-43b5-8b8b-026c21052df2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:00.569052 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98a37b91-8bea-43b5-8b8b-026c21052df2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:00.570204 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98a37b91-8bea-43b5-8b8b-026c21052df2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:00.571412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98a37b91-8bea-43b5-8b8b-026c21052df2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:00.572407 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98a37b91-8bea-43b5-8b8b-026c21052df2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:00.696581 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-98a37b91-8bea-43b5-8b8b-026c21052df2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:00.712708 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-98a37b91-8bea-43b5-8b8b-026c21052df2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1223 microversion: 2.1 time: 0.162934 Aug 10 12:44:00.713547 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 180/364] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:00 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1223 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:44:00.790825 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ca224fdf-281d-4cfa-bd3f-4ef7f179dd8e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:00.801350 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ca224fdf-281d-4cfa-bd3f-4ef7f179dd8e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:00.803252 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ca224fdf-281d-4cfa-bd3f-4ef7f179dd8e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:00.804567 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ca224fdf-281d-4cfa-bd3f-4ef7f179dd8e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1739 microversion: 2.20 time: 0.301631 Aug 10 12:44:00.805455 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 185/365] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:00 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1739 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:00.880677 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0eaa7f14-8896-4ff2-af16-67ae63228ba6 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:00.881721 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0eaa7f14-8896-4ff2-af16-67ae63228ba6 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 38bd2d87-ab3f-44c7-af3a-31625fbc988e] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:00.888815 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0eaa7f14-8896-4ff2-af16-67ae63228ba6 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:00.890194 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0eaa7f14-8896-4ff2-af16-67ae63228ba6 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:00.890882 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0eaa7f14-8896-4ff2-af16-67ae63228ba6 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:00.891700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0eaa7f14-8896-4ff2-af16-67ae63228ba6 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:00.892343 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0eaa7f14-8896-4ff2-af16-67ae63228ba6 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:00.892889 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0eaa7f14-8896-4ff2-af16-67ae63228ba6 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:00.987376 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0eaa7f14-8896-4ff2-af16-67ae63228ba6 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:00.998111 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0eaa7f14-8896-4ff2-af16-67ae63228ba6 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e" status: 200 len: 1284 microversion: 2.1 time: 0.120690 Aug 10 12:44:00.998996 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 181/366] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:00 2022] GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e => generated 1284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:01.153139 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell0:SELECT=2 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:44:01.159281 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-06770787-5356-4e60-9e06-94e049761c06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:01.165194 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-06770787-5356-4e60-9e06-94e049761c06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:01.168202 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06770787-5356-4e60-9e06-94e049761c06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:01.169168 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06770787-5356-4e60-9e06-94e049761c06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:01.169825 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06770787-5356-4e60-9e06-94e049761c06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:01.170971 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06770787-5356-4e60-9e06-94e049761c06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:01.171813 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06770787-5356-4e60-9e06-94e049761c06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:01.172405 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06770787-5356-4e60-9e06-94e049761c06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:01.237311 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8afa27f8-02c8-414d-af05-74ef00d04846 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:01.238662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8afa27f8-02c8-414d-af05-74ef00d04846 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:01.245118 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8afa27f8-02c8-414d-af05-74ef00d04846 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:01.245953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8afa27f8-02c8-414d-af05-74ef00d04846 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:01.246612 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8afa27f8-02c8-414d-af05-74ef00d04846 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:01.247591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8afa27f8-02c8-414d-af05-74ef00d04846 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:01.248429 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8afa27f8-02c8-414d-af05-74ef00d04846 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:01.249582 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8afa27f8-02c8-414d-af05-74ef00d04846 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:01.424227 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-06770787-5356-4e60-9e06-94e049761c06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:01.432570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-06770787-5356-4e60-9e06-94e049761c06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1720 microversion: 2.1 time: 0.281145 Aug 10 12:44:01.433332 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 186/367] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:01 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1720 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:01.481633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8afa27f8-02c8-414d-af05-74ef00d04846 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:01.484678 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:44:01.492536 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8afa27f8-02c8-414d-af05-74ef00d04846 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1367 microversion: 2.1 time: 0.259621 Aug 10 12:44:01.493849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 182/368] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:01 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1367 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:44:01.733228 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-88cc9310-b024-4cb4-9d13-a44b61a77ec3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:01.734569 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-88cc9310-b024-4cb4-9d13-a44b61a77ec3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:01.743227 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-88cc9310-b024-4cb4-9d13-a44b61a77ec3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:01.743740 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-88cc9310-b024-4cb4-9d13-a44b61a77ec3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:01.744276 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-88cc9310-b024-4cb4-9d13-a44b61a77ec3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:01.744997 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-88cc9310-b024-4cb4-9d13-a44b61a77ec3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:01.745495 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-88cc9310-b024-4cb4-9d13-a44b61a77ec3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:01.745921 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-88cc9310-b024-4cb4-9d13-a44b61a77ec3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:01.828281 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-88cc9310-b024-4cb4-9d13-a44b61a77ec3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:01.828781 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3c61be01-b1c8-40d9-9f51-629220a754d2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:01.829465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3c61be01-b1c8-40d9-9f51-629220a754d2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:01.836756 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c61be01-b1c8-40d9-9f51-629220a754d2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:01.837533 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c61be01-b1c8-40d9-9f51-629220a754d2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:01.838140 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c61be01-b1c8-40d9-9f51-629220a754d2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:01.839008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c61be01-b1c8-40d9-9f51-629220a754d2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:01.839613 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-88cc9310-b024-4cb4-9d13-a44b61a77ec3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1271 microversion: 2.1 time: 0.110234 Aug 10 12:44:01.839784 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c61be01-b1c8-40d9-9f51-629220a754d2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:01.840062 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c61be01-b1c8-40d9-9f51-629220a754d2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:01.847245 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 187/369] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:01 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1271 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:01.977248 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3c61be01-b1c8-40d9-9f51-629220a754d2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:02.004198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3c61be01-b1c8-40d9-9f51-629220a754d2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:02.005694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3c61be01-b1c8-40d9-9f51-629220a754d2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:02.006943 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3c61be01-b1c8-40d9-9f51-629220a754d2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1739 microversion: 2.20 time: 0.182532 Aug 10 12:44:02.007534 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 183/370] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:01 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:02.023237 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-aa34fa68-17a4-428e-b680-e9efa39522f3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:02.023849 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-aa34fa68-17a4-428e-b680-e9efa39522f3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 38bd2d87-ab3f-44c7-af3a-31625fbc988e] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:02.031973 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aa34fa68-17a4-428e-b680-e9efa39522f3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:02.032469 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aa34fa68-17a4-428e-b680-e9efa39522f3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:02.032899 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aa34fa68-17a4-428e-b680-e9efa39522f3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:02.033585 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aa34fa68-17a4-428e-b680-e9efa39522f3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:02.034032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aa34fa68-17a4-428e-b680-e9efa39522f3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:02.034481 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aa34fa68-17a4-428e-b680-e9efa39522f3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:02.395109 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-aa34fa68-17a4-428e-b680-e9efa39522f3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:02.404749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-aa34fa68-17a4-428e-b680-e9efa39522f3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e" status: 200 len: 1314 microversion: 2.1 time: 0.385139 Aug 10 12:44:02.407706 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 188/371] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:02 2022] GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:02.456499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-986956b5-5045-4338-9854-023c46407ee1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:02.457212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-986956b5-5045-4338-9854-023c46407ee1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:02.469900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-986956b5-5045-4338-9854-023c46407ee1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:02.469900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-986956b5-5045-4338-9854-023c46407ee1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:02.469900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-986956b5-5045-4338-9854-023c46407ee1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:02.469900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-986956b5-5045-4338-9854-023c46407ee1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:02.470262 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-986956b5-5045-4338-9854-023c46407ee1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:02.470262 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-986956b5-5045-4338-9854-023c46407ee1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:02.514076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-896c3c0c-2b3a-4927-960e-139dfa3e04f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:02.523998 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-896c3c0c-2b3a-4927-960e-139dfa3e04f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:02.536131 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-896c3c0c-2b3a-4927-960e-139dfa3e04f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:02.538471 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-896c3c0c-2b3a-4927-960e-139dfa3e04f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:02.539144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-896c3c0c-2b3a-4927-960e-139dfa3e04f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:02.543741 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-896c3c0c-2b3a-4927-960e-139dfa3e04f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:02.544863 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-896c3c0c-2b3a-4927-960e-139dfa3e04f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:02.545615 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-896c3c0c-2b3a-4927-960e-139dfa3e04f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:02.884676 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-986956b5-5045-4338-9854-023c46407ee1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:02.901608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-986956b5-5045-4338-9854-023c46407ee1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1720 microversion: 2.1 time: 0.451461 Aug 10 12:44:02.902438 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 184/372] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:02 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1720 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:02.929882 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-f6360b5c-f630-4c2e-825c-9911c92d7b25 req-079754e6-6c4d-43ff-8357-ebc6270be20d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d0315a8-29f9-4d6e-9298-f5a1d0d69e36", "name": "network-vif-plugged", "status": "completed", "tag": "ed664c7d-23bb-4772-ac75-7b70d3de4c8d"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:44:02.970540 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-896c3c0c-2b3a-4927-960e-139dfa3e04f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:02.977266 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-f6360b5c-f630-4c2e-825c-9911c92d7b25 req-079754e6-6c4d-43ff-8357-ebc6270be20d service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:02.977751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-f6360b5c-f630-4c2e-825c-9911c92d7b25 req-079754e6-6c4d-43ff-8357-ebc6270be20d service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:02.981446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-f6360b5c-f630-4c2e-825c-9911c92d7b25 req-079754e6-6c4d-43ff-8357-ebc6270be20d service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:02.982881 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-896c3c0c-2b3a-4927-960e-139dfa3e04f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1367 microversion: 2.1 time: 0.472844 Aug 10 12:44:02.988202 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 189/373] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:02 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1367 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:44:02.996255 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1f1de9e5-b023-48b2-b572-d3fcb80827bc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:02.996871 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1f1de9e5-b023-48b2-b572-d3fcb80827bc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:03.009912 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1f1de9e5-b023-48b2-b572-d3fcb80827bc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:03.016213 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1f1de9e5-b023-48b2-b572-d3fcb80827bc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:03.016970 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1f1de9e5-b023-48b2-b572-d3fcb80827bc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:03.018881 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1f1de9e5-b023-48b2-b572-d3fcb80827bc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:03.020339 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1f1de9e5-b023-48b2-b572-d3fcb80827bc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:03.020943 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1f1de9e5-b023-48b2-b572-d3fcb80827bc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:03.022819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-f6360b5c-f630-4c2e-825c-9911c92d7b25 req-079754e6-6c4d-43ff-8357-ebc6270be20d service nova] Creating event network-vif-plugged:ed664c7d-23bb-4772-ac75-7b70d3de4c8d for instance 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 on hv-cinder-85199 Aug 10 12:44:03.036948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-f6360b5c-f630-4c2e-825c-9911c92d7b25 req-079754e6-6c4d-43ff-8357-ebc6270be20d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132771 Aug 10 12:44:03.039236 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 185/374] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:44:03.069266 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c38d6e47-8cc1-4d87-a128-3a028fdde368 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:03.071207 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c38d6e47-8cc1-4d87-a128-3a028fdde368 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:03.089338 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c38d6e47-8cc1-4d87-a128-3a028fdde368 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:03.091045 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c38d6e47-8cc1-4d87-a128-3a028fdde368 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:03.091529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c38d6e47-8cc1-4d87-a128-3a028fdde368 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:03.094239 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c38d6e47-8cc1-4d87-a128-3a028fdde368 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:03.094771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c38d6e47-8cc1-4d87-a128-3a028fdde368 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:03.098182 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c38d6e47-8cc1-4d87-a128-3a028fdde368 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:03.308714 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-1f1de9e5-b023-48b2-b572-d3fcb80827bc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:03.324590 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1f1de9e5-b023-48b2-b572-d3fcb80827bc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1289 microversion: 2.1 time: 0.333338 Aug 10 12:44:03.325650 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 190/375] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:02 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1289 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:03.410081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c38d6e47-8cc1-4d87-a128-3a028fdde368 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:03.420339 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c38d6e47-8cc1-4d87-a128-3a028fdde368 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:03.427417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c38d6e47-8cc1-4d87-a128-3a028fdde368 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:03.430334 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-40d5d599-2a1c-4871-96c4-6db2088725be tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:03.431825 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c38d6e47-8cc1-4d87-a128-3a028fdde368 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1739 microversion: 2.20 time: 0.387232 Aug 10 12:44:03.432055 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-40d5d599-2a1c-4871-96c4-6db2088725be tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 38bd2d87-ab3f-44c7-af3a-31625fbc988e] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:03.433574 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 186/376] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:03 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1739 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:03.452104 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-40d5d599-2a1c-4871-96c4-6db2088725be tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:03.454117 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-40d5d599-2a1c-4871-96c4-6db2088725be tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:03.457106 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-40d5d599-2a1c-4871-96c4-6db2088725be tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:03.457928 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-40d5d599-2a1c-4871-96c4-6db2088725be tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:03.458397 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-40d5d599-2a1c-4871-96c4-6db2088725be tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:03.458828 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-40d5d599-2a1c-4871-96c4-6db2088725be tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:03.538584 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-1548232f-5806-49d2-bf14-700f8a0d77e3 req-1d2553e0-eaba-4398-9150-c5b10efb18b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38bd2d87-ab3f-44c7-af3a-31625fbc988e", "tag": "93ff4c59-145b-4d00-af21-5ef7b5b88c68"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:44:03.548718 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-1548232f-5806-49d2-bf14-700f8a0d77e3 req-1d2553e0-eaba-4398-9150-c5b10efb18b1 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:03.549325 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-1548232f-5806-49d2-bf14-700f8a0d77e3 req-1d2553e0-eaba-4398-9150-c5b10efb18b1 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:03.549848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-1548232f-5806-49d2-bf14-700f8a0d77e3 req-1d2553e0-eaba-4398-9150-c5b10efb18b1 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:03.565073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-1548232f-5806-49d2-bf14-700f8a0d77e3 req-1d2553e0-eaba-4398-9150-c5b10efb18b1 service nova] Creating event network-changed:93ff4c59-145b-4d00-af21-5ef7b5b88c68 for instance 38bd2d87-ab3f-44c7-af3a-31625fbc988e on hv-cinder-85199 Aug 10 12:44:03.571544 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-1548232f-5806-49d2-bf14-700f8a0d77e3 req-1d2553e0-eaba-4398-9150-c5b10efb18b1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036234 Aug 10 12:44:03.572731 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 187/377] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:44:03.724198 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-40d5d599-2a1c-4871-96c4-6db2088725be tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:03.731802 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-40d5d599-2a1c-4871-96c4-6db2088725be tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e" status: 200 len: 1314 microversion: 2.1 time: 0.307647 Aug 10 12:44:03.732464 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 191/378] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:03 2022] GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:44:03.924548 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c89c3687-504b-4bca-bdb1-8d13255fce76 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:03.925235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c89c3687-504b-4bca-bdb1-8d13255fce76 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:03.931738 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c89c3687-504b-4bca-bdb1-8d13255fce76 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:03.932241 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c89c3687-504b-4bca-bdb1-8d13255fce76 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:03.932723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c89c3687-504b-4bca-bdb1-8d13255fce76 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:03.933410 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c89c3687-504b-4bca-bdb1-8d13255fce76 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:03.934228 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c89c3687-504b-4bca-bdb1-8d13255fce76 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:03.934353 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c89c3687-504b-4bca-bdb1-8d13255fce76 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:04.012832 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-dc9a35c0-fc51-443a-ae6a-37098dbbf4fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:04.013447 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-dc9a35c0-fc51-443a-ae6a-37098dbbf4fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:04.020276 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc9a35c0-fc51-443a-ae6a-37098dbbf4fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:04.020761 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc9a35c0-fc51-443a-ae6a-37098dbbf4fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:04.021222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc9a35c0-fc51-443a-ae6a-37098dbbf4fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:04.021919 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc9a35c0-fc51-443a-ae6a-37098dbbf4fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:04.022375 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc9a35c0-fc51-443a-ae6a-37098dbbf4fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:04.022802 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc9a35c0-fc51-443a-ae6a-37098dbbf4fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:04.207670 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c89c3687-504b-4bca-bdb1-8d13255fce76 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:04.219538 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c89c3687-504b-4bca-bdb1-8d13255fce76 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1697 microversion: 2.1 time: 0.300118 Aug 10 12:44:04.220320 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 188/379] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:03 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1697 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:44:04.239315 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-dc9a35c0-fc51-443a-ae6a-37098dbbf4fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:04.241458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-208185ea-5358-4a59-9851-76c1ea78226b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:44:04.247778 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-dc9a35c0-fc51-443a-ae6a-37098dbbf4fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1367 microversion: 2.1 time: 0.238822 Aug 10 12:44:04.250323 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 192/380] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:04 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:44:04.250461 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-208185ea-5358-4a59-9851-76c1ea78226b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:04.250461 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-208185ea-5358-4a59-9851-76c1ea78226b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:04.250461 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-208185ea-5358-4a59-9851-76c1ea78226b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:04.314259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-208185ea-5358-4a59-9851-76c1ea78226b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Going to try to start instance {{(pid=124643) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 12:44:04.347930 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-565c0119-26db-4633-a687-7c69d791a0a0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:04.349762 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-565c0119-26db-4633-a687-7c69d791a0a0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:04.356410 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-565c0119-26db-4633-a687-7c69d791a0a0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:04.357300 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-565c0119-26db-4633-a687-7c69d791a0a0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:04.357894 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-565c0119-26db-4633-a687-7c69d791a0a0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:04.359684 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-565c0119-26db-4633-a687-7c69d791a0a0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:04.360319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-565c0119-26db-4633-a687-7c69d791a0a0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:04.360755 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-565c0119-26db-4633-a687-7c69d791a0a0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:04.485904 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-208185ea-5358-4a59-9851-76c1ea78226b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "POST /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/action" status: 202 len: 0 microversion: 2.1 time: 0.248019 Aug 10 12:44:04.490698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 189/381] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 10 12:44:04 2022] POST /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 12:44:04.492770 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1e5fd0fb-03b4-444f-b41b-c47e6f7e00b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:04.495038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1e5fd0fb-03b4-444f-b41b-c47e6f7e00b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:04.499998 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1e5fd0fb-03b4-444f-b41b-c47e6f7e00b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:04.501589 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1e5fd0fb-03b4-444f-b41b-c47e6f7e00b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:04.501589 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1e5fd0fb-03b4-444f-b41b-c47e6f7e00b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:04.501589 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1e5fd0fb-03b4-444f-b41b-c47e6f7e00b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:04.502055 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1e5fd0fb-03b4-444f-b41b-c47e6f7e00b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:04.502449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1e5fd0fb-03b4-444f-b41b-c47e6f7e00b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:04.540300 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-565c0119-26db-4633-a687-7c69d791a0a0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:04.548883 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-565c0119-26db-4633-a687-7c69d791a0a0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1319 microversion: 2.1 time: 0.205997 Aug 10 12:44:04.549749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 193/382] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:04 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:44:04.558491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-13d2b73c-8946-4b7b-ae98-15065021e89d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:04.559134 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-13d2b73c-8946-4b7b-ae98-15065021e89d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:04.566593 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-13d2b73c-8946-4b7b-ae98-15065021e89d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:04.570257 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-13d2b73c-8946-4b7b-ae98-15065021e89d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:04.570257 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-13d2b73c-8946-4b7b-ae98-15065021e89d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:04.570257 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-13d2b73c-8946-4b7b-ae98-15065021e89d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:04.570257 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-13d2b73c-8946-4b7b-ae98-15065021e89d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:04.570633 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-13d2b73c-8946-4b7b-ae98-15065021e89d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:04.840798 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1e5fd0fb-03b4-444f-b41b-c47e6f7e00b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:04.859155 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1e5fd0fb-03b4-444f-b41b-c47e6f7e00b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:04.860662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1e5fd0fb-03b4-444f-b41b-c47e6f7e00b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:04.861846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1e5fd0fb-03b4-444f-b41b-c47e6f7e00b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1739 microversion: 2.20 time: 0.373819 Aug 10 12:44:04.862914 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 190/383] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:04 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1739 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:04.882275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6f0d6661-0a13-4a2a-b11d-06e1172fc203 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:04.882932 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6f0d6661-0a13-4a2a-b11d-06e1172fc203 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 38bd2d87-ab3f-44c7-af3a-31625fbc988e] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:04.892916 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-13d2b73c-8946-4b7b-ae98-15065021e89d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:04.893108 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f0d6661-0a13-4a2a-b11d-06e1172fc203 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:04.893581 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f0d6661-0a13-4a2a-b11d-06e1172fc203 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:04.894007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f0d6661-0a13-4a2a-b11d-06e1172fc203 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:04.894700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f0d6661-0a13-4a2a-b11d-06e1172fc203 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:04.895141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f0d6661-0a13-4a2a-b11d-06e1172fc203 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:04.895594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f0d6661-0a13-4a2a-b11d-06e1172fc203 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:04.905392 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-13d2b73c-8946-4b7b-ae98-15065021e89d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1706 microversion: 2.1 time: 0.354313 Aug 10 12:44:04.907782 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 194/384] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:04 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1706 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:05.063113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6f0d6661-0a13-4a2a-b11d-06e1172fc203 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:05.070512 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6f0d6661-0a13-4a2a-b11d-06e1172fc203 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e" status: 200 len: 1314 microversion: 2.1 time: 0.192009 Aug 10 12:44:05.073464 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 191/385] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:04 2022] GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:05.277987 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-963c356f-a442-4c38-b06a-fd45496afcbe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:05.278515 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-963c356f-a442-4c38-b06a-fd45496afcbe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:05.285824 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-963c356f-a442-4c38-b06a-fd45496afcbe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:05.288586 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-963c356f-a442-4c38-b06a-fd45496afcbe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:05.288586 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-963c356f-a442-4c38-b06a-fd45496afcbe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:05.288586 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-963c356f-a442-4c38-b06a-fd45496afcbe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:05.288586 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-963c356f-a442-4c38-b06a-fd45496afcbe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:05.288935 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-963c356f-a442-4c38-b06a-fd45496afcbe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:05.399799 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-f22f7e8c-c3cc-4157-9504-59feb7834920 req-073f9273-068e-4c55-aae3-a2c00a372ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a", "tag": "811605ba-52c3-45e2-85fd-e5d880491764"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:44:05.416758 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-f22f7e8c-c3cc-4157-9504-59feb7834920 req-073f9273-068e-4c55-aae3-a2c00a372ee0 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:05.417898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-f22f7e8c-c3cc-4157-9504-59feb7834920 req-073f9273-068e-4c55-aae3-a2c00a372ee0 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:05.418546 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-f22f7e8c-c3cc-4157-9504-59feb7834920 req-073f9273-068e-4c55-aae3-a2c00a372ee0 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:05.439915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-f22f7e8c-c3cc-4157-9504-59feb7834920 req-073f9273-068e-4c55-aae3-a2c00a372ee0 service nova] Creating event network-changed:811605ba-52c3-45e2-85fd-e5d880491764 for instance 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a on hv-cinder-85199 Aug 10 12:44:05.446282 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-f22f7e8c-c3cc-4157-9504-59feb7834920 req-073f9273-068e-4c55-aae3-a2c00a372ee0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051624 Aug 10 12:44:05.447051 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 192/386] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:44:05.561880 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-963c356f-a442-4c38-b06a-fd45496afcbe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:05.572656 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c84e3f11-9df4-4fbb-8db3-a28a5759e8ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:05.573366 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c84e3f11-9df4-4fbb-8db3-a28a5759e8ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:05.582158 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-963c356f-a442-4c38-b06a-fd45496afcbe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1557 microversion: 2.1 time: 0.308111 Aug 10 12:44:05.586156 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c84e3f11-9df4-4fbb-8db3-a28a5759e8ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:05.586642 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c84e3f11-9df4-4fbb-8db3-a28a5759e8ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:05.587073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c84e3f11-9df4-4fbb-8db3-a28a5759e8ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:05.587842 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 195/387] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:05 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1557 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:05.609296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c84e3f11-9df4-4fbb-8db3-a28a5759e8ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:05.614788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c84e3f11-9df4-4fbb-8db3-a28a5759e8ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:05.614788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c84e3f11-9df4-4fbb-8db3-a28a5759e8ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:05.615758 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-46666822-3e04-4787-b611-3edd5adfcc14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:05.616319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-46666822-3e04-4787-b611-3edd5adfcc14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:05.632979 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46666822-3e04-4787-b611-3edd5adfcc14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:05.633614 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46666822-3e04-4787-b611-3edd5adfcc14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:05.633981 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46666822-3e04-4787-b611-3edd5adfcc14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:05.634689 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46666822-3e04-4787-b611-3edd5adfcc14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:05.635145 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46666822-3e04-4787-b611-3edd5adfcc14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:05.641376 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46666822-3e04-4787-b611-3edd5adfcc14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:05.799032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-46666822-3e04-4787-b611-3edd5adfcc14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.192557 Aug 10 12:44:05.799913 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 196/388] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 10 12:44:05 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36/os-interface => generated 285 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:44:05.885441 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6d67cac7-78e0-4a85-8f37-1cd6503d36db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:05.886087 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6d67cac7-78e0-4a85-8f37-1cd6503d36db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:05.892909 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6d67cac7-78e0-4a85-8f37-1cd6503d36db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:05.893478 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6d67cac7-78e0-4a85-8f37-1cd6503d36db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:05.893995 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6d67cac7-78e0-4a85-8f37-1cd6503d36db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:05.894758 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6d67cac7-78e0-4a85-8f37-1cd6503d36db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:05.895337 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6d67cac7-78e0-4a85-8f37-1cd6503d36db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:05.895829 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6d67cac7-78e0-4a85-8f37-1cd6503d36db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:06.083120 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c84e3f11-9df4-4fbb-8db3-a28a5759e8ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:06.089630 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c84e3f11-9df4-4fbb-8db3-a28a5759e8ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1319 microversion: 2.1 time: 0.523390 Aug 10 12:44:06.090265 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 193/389] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:05 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1319 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:06.095739 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a053c3b7-1d1b-4fc2-a0a2-ed8d5727608f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:06.096339 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a053c3b7-1d1b-4fc2-a0a2-ed8d5727608f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:06.102675 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a053c3b7-1d1b-4fc2-a0a2-ed8d5727608f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:06.109392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a053c3b7-1d1b-4fc2-a0a2-ed8d5727608f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:06.109392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a053c3b7-1d1b-4fc2-a0a2-ed8d5727608f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:06.109392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a053c3b7-1d1b-4fc2-a0a2-ed8d5727608f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:06.109392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a053c3b7-1d1b-4fc2-a0a2-ed8d5727608f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:06.110178 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a053c3b7-1d1b-4fc2-a0a2-ed8d5727608f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:06.292990 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6d67cac7-78e0-4a85-8f37-1cd6503d36db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:06.301157 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6d67cac7-78e0-4a85-8f37-1cd6503d36db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:06.302659 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6d67cac7-78e0-4a85-8f37-1cd6503d36db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:06.303860 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6d67cac7-78e0-4a85-8f37-1cd6503d36db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1721 microversion: 2.20 time: 0.422568 Aug 10 12:44:06.304420 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 197/390] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:05 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1721 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:44:06.308835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-579058f9-7ff8-4a0a-a5f3-1124d549a1f7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:06.309440 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-579058f9-7ff8-4a0a-a5f3-1124d549a1f7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 38bd2d87-ab3f-44c7-af3a-31625fbc988e] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:06.316025 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-579058f9-7ff8-4a0a-a5f3-1124d549a1f7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:06.316820 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-579058f9-7ff8-4a0a-a5f3-1124d549a1f7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:06.317480 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-579058f9-7ff8-4a0a-a5f3-1124d549a1f7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:06.318309 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-579058f9-7ff8-4a0a-a5f3-1124d549a1f7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:06.318774 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-579058f9-7ff8-4a0a-a5f3-1124d549a1f7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:06.319914 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-579058f9-7ff8-4a0a-a5f3-1124d549a1f7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:06.373216 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a053c3b7-1d1b-4fc2-a0a2-ed8d5727608f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:06.381670 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a053c3b7-1d1b-4fc2-a0a2-ed8d5727608f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1706 microversion: 2.1 time: 0.290423 Aug 10 12:44:06.383767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 194/391] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:06 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1706 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:06.797419 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-579058f9-7ff8-4a0a-a5f3-1124d549a1f7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:06.805867 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-579058f9-7ff8-4a0a-a5f3-1124d549a1f7 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e" status: 200 len: 1314 microversion: 2.1 time: 0.500409 Aug 10 12:44:06.810656 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 198/392] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:06 2022] GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e => generated 1314 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:07.110920 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-66869239-ac40-475c-9109-6aa29150ee78 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:07.111493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-66869239-ac40-475c-9109-6aa29150ee78 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:07.118088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-66869239-ac40-475c-9109-6aa29150ee78 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:07.118578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-66869239-ac40-475c-9109-6aa29150ee78 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:07.119011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-66869239-ac40-475c-9109-6aa29150ee78 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:07.119744 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-66869239-ac40-475c-9109-6aa29150ee78 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:07.120190 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-66869239-ac40-475c-9109-6aa29150ee78 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:07.120611 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-66869239-ac40-475c-9109-6aa29150ee78 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:07.327884 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b89978af-bad1-4c1d-a644-8d53078d953c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:07.328559 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b89978af-bad1-4c1d-a644-8d53078d953c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:07.334971 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b89978af-bad1-4c1d-a644-8d53078d953c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:07.335487 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b89978af-bad1-4c1d-a644-8d53078d953c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:07.335924 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b89978af-bad1-4c1d-a644-8d53078d953c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:07.336621 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b89978af-bad1-4c1d-a644-8d53078d953c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:07.337076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b89978af-bad1-4c1d-a644-8d53078d953c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:07.337500 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b89978af-bad1-4c1d-a644-8d53078d953c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:07.367770 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-66869239-ac40-475c-9109-6aa29150ee78 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:07.376311 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-66869239-ac40-475c-9109-6aa29150ee78 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1319 microversion: 2.1 time: 0.269374 Aug 10 12:44:07.376988 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 195/393] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:07 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:07.403220 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-36dc0131-39c5-46bc-ac8a-68f1bb7196eb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:07.403810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-36dc0131-39c5-46bc-ac8a-68f1bb7196eb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:07.409859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36dc0131-39c5-46bc-ac8a-68f1bb7196eb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:07.410340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36dc0131-39c5-46bc-ac8a-68f1bb7196eb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:07.410772 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36dc0131-39c5-46bc-ac8a-68f1bb7196eb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:07.411507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36dc0131-39c5-46bc-ac8a-68f1bb7196eb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:07.411957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36dc0131-39c5-46bc-ac8a-68f1bb7196eb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:07.412376 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36dc0131-39c5-46bc-ac8a-68f1bb7196eb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:07.586953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=2 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:44:07.618679 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=6 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:44:07.626159 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b89978af-bad1-4c1d-a644-8d53078d953c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:07.628381 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:44:07.634817 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b89978af-bad1-4c1d-a644-8d53078d953c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:07.636390 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b89978af-bad1-4c1d-a644-8d53078d953c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:07.637695 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b89978af-bad1-4c1d-a644-8d53078d953c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1721 microversion: 2.20 time: 0.314470 Aug 10 12:44:07.638439 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 199/394] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:07 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1721 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:44:07.681213 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-36dc0131-39c5-46bc-ac8a-68f1bb7196eb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:07.689174 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-36dc0131-39c5-46bc-ac8a-68f1bb7196eb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1706 microversion: 2.1 time: 0.289756 Aug 10 12:44:07.689783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 196/395] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:07 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1706 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:44:07.748883 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [req-2599f0eb-160a-4dc1-9dde-bd59dd0d0727 req-ee36a4d7-8b2c-4755-8573-d9b3a824caeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d0315a8-29f9-4d6e-9298-f5a1d0d69e36", "tag": "ed664c7d-23bb-4772-ac75-7b70d3de4c8d"}]} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:44:07.758158 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-2599f0eb-160a-4dc1-9dde-bd59dd0d0727 req-ee36a4d7-8b2c-4755-8573-d9b3a824caeb service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:07.758628 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-2599f0eb-160a-4dc1-9dde-bd59dd0d0727 req-ee36a4d7-8b2c-4755-8573-d9b3a824caeb service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:07.759055 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-2599f0eb-160a-4dc1-9dde-bd59dd0d0727 req-ee36a4d7-8b2c-4755-8573-d9b3a824caeb service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:07.770496 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.compute.server_external_events [req-2599f0eb-160a-4dc1-9dde-bd59dd0d0727 req-ee36a4d7-8b2c-4755-8573-d9b3a824caeb service nova] Creating event network-changed:ed664c7d-23bb-4772-ac75-7b70d3de4c8d for instance 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 on hv-cinder-85199 Aug 10 12:44:07.775564 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [req-2599f0eb-160a-4dc1-9dde-bd59dd0d0727 req-ee36a4d7-8b2c-4755-8573-d9b3a824caeb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030601 Aug 10 12:44:07.776155 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 200/396] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:44:07.827824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bef929f9-b949-459d-b8ac-23c206ac4488 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:07.828845 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bef929f9-b949-459d-b8ac-23c206ac4488 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 38bd2d87-ab3f-44c7-af3a-31625fbc988e] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:07.835068 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bef929f9-b949-459d-b8ac-23c206ac4488 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:07.835669 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bef929f9-b949-459d-b8ac-23c206ac4488 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:07.836168 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bef929f9-b949-459d-b8ac-23c206ac4488 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:07.836933 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bef929f9-b949-459d-b8ac-23c206ac4488 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:07.837475 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bef929f9-b949-459d-b8ac-23c206ac4488 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:07.837958 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bef929f9-b949-459d-b8ac-23c206ac4488 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:07.972435 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-bef929f9-b949-459d-b8ac-23c206ac4488 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:07.979816 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bef929f9-b949-459d-b8ac-23c206ac4488 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e" status: 200 len: 1314 microversion: 2.1 time: 0.156489 Aug 10 12:44:07.980379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 197/397] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:07 2022] GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:08.397893 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-35cb4447-5b09-496f-8b47-0724265b8af4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:08.398584 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-35cb4447-5b09-496f-8b47-0724265b8af4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:08.405149 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-35cb4447-5b09-496f-8b47-0724265b8af4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:08.406385 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-35cb4447-5b09-496f-8b47-0724265b8af4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:08.406987 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-35cb4447-5b09-496f-8b47-0724265b8af4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:08.407701 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-35cb4447-5b09-496f-8b47-0724265b8af4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:08.408154 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-35cb4447-5b09-496f-8b47-0724265b8af4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:08.408570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-35cb4447-5b09-496f-8b47-0724265b8af4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:08.541245 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-35cb4447-5b09-496f-8b47-0724265b8af4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:08.548940 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-35cb4447-5b09-496f-8b47-0724265b8af4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1319 microversion: 2.1 time: 0.155315 Aug 10 12:44:08.549763 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 201/398] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:08 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:08.662145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-40bf471f-c6c2-476a-b928-87ae318b5bb1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:08.662785 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-40bf471f-c6c2-476a-b928-87ae318b5bb1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:08.669539 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40bf471f-c6c2-476a-b928-87ae318b5bb1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:08.670022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40bf471f-c6c2-476a-b928-87ae318b5bb1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:08.670452 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40bf471f-c6c2-476a-b928-87ae318b5bb1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:08.671242 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40bf471f-c6c2-476a-b928-87ae318b5bb1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:08.671719 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40bf471f-c6c2-476a-b928-87ae318b5bb1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:08.672355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40bf471f-c6c2-476a-b928-87ae318b5bb1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:08.709780 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-39837f40-a404-4df3-867a-361e455bb4c1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:08.710392 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-39837f40-a404-4df3-867a-361e455bb4c1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:08.716703 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-39837f40-a404-4df3-867a-361e455bb4c1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:08.717446 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-39837f40-a404-4df3-867a-361e455bb4c1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:08.718543 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-39837f40-a404-4df3-867a-361e455bb4c1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:08.719713 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-39837f40-a404-4df3-867a-361e455bb4c1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:08.720176 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-39837f40-a404-4df3-867a-361e455bb4c1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:08.720599 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-39837f40-a404-4df3-867a-361e455bb4c1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:08.886789 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-40bf471f-c6c2-476a-b928-87ae318b5bb1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:08.896701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-40bf471f-c6c2-476a-b928-87ae318b5bb1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:08.898889 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-40bf471f-c6c2-476a-b928-87ae318b5bb1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:08.899517 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-40bf471f-c6c2-476a-b928-87ae318b5bb1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1721 microversion: 2.20 time: 0.241414 Aug 10 12:44:08.903467 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-39837f40-a404-4df3-867a-361e455bb4c1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:08.912288 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-39837f40-a404-4df3-867a-361e455bb4c1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1706 microversion: 2.1 time: 0.206295 Aug 10 12:44:08.912848 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 202/400] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:08 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1706 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:44:08.913058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 198/400] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:08 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1721 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:09.001255 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d07dbe95-2dfc-447d-a186-55fcdb528bc4 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:09.001864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d07dbe95-2dfc-447d-a186-55fcdb528bc4 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 38bd2d87-ab3f-44c7-af3a-31625fbc988e] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:09.007822 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d07dbe95-2dfc-447d-a186-55fcdb528bc4 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:09.008307 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d07dbe95-2dfc-447d-a186-55fcdb528bc4 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:09.008745 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d07dbe95-2dfc-447d-a186-55fcdb528bc4 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:09.009434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d07dbe95-2dfc-447d-a186-55fcdb528bc4 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:09.009885 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d07dbe95-2dfc-447d-a186-55fcdb528bc4 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:09.010307 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d07dbe95-2dfc-447d-a186-55fcdb528bc4 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:09.144744 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d07dbe95-2dfc-447d-a186-55fcdb528bc4 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:09.152209 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d07dbe95-2dfc-447d-a186-55fcdb528bc4 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e" status: 200 len: 1314 microversion: 2.1 time: 0.155348 Aug 10 12:44:09.152783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 199/401] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:08 2022] GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:09.570144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-67483458-0f6a-4a5a-ac5a-353f3e908a4b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:09.570779 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-67483458-0f6a-4a5a-ac5a-353f3e908a4b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:09.573198 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell0:SELECT=14 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:44:09.578751 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-67483458-0f6a-4a5a-ac5a-353f3e908a4b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:09.582295 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-67483458-0f6a-4a5a-ac5a-353f3e908a4b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:09.582295 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-67483458-0f6a-4a5a-ac5a-353f3e908a4b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:09.582295 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-67483458-0f6a-4a5a-ac5a-353f3e908a4b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:09.582295 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-67483458-0f6a-4a5a-ac5a-353f3e908a4b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:09.582696 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-67483458-0f6a-4a5a-ac5a-353f3e908a4b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:09.750168 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-67483458-0f6a-4a5a-ac5a-353f3e908a4b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:09.758709 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-67483458-0f6a-4a5a-ac5a-353f3e908a4b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1319 microversion: 2.1 time: 0.191735 Aug 10 12:44:09.759135 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 203/402] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:09 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:09.794360 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-49cf19b7-62bf-4247-a16f-b1b61466f548 req-ff93d7d1-a8a1-4ca9-8dd3-a6a7a39e870a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "572a91d2-8a56-4616-97e4-b0d48cc57ea5", "name": "network-vif-unplugged", "status": "completed", "tag": "5bdde102-3780-4fb4-a112-3f9af85f6b61"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:44:09.809287 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-49cf19b7-62bf-4247-a16f-b1b61466f548 req-ff93d7d1-a8a1-4ca9-8dd3-a6a7a39e870a service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:09.809287 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-49cf19b7-62bf-4247-a16f-b1b61466f548 req-ff93d7d1-a8a1-4ca9-8dd3-a6a7a39e870a service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:09.809287 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-49cf19b7-62bf-4247-a16f-b1b61466f548 req-ff93d7d1-a8a1-4ca9-8dd3-a6a7a39e870a service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:09.818469 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-49cf19b7-62bf-4247-a16f-b1b61466f548 req-ff93d7d1-a8a1-4ca9-8dd3-a6a7a39e870a service nova] Creating event network-vif-unplugged:5bdde102-3780-4fb4-a112-3f9af85f6b61 for instance 572a91d2-8a56-4616-97e4-b0d48cc57ea5 on hv-cinder-85199 Aug 10 12:44:09.823590 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-49cf19b7-62bf-4247-a16f-b1b61466f548 req-ff93d7d1-a8a1-4ca9-8dd3-a6a7a39e870a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032948 Aug 10 12:44:09.824226 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 200/403] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:44:09.922792 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0f428289-5d3f-4990-9d9e-80b1681cd220 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:09.923439 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0f428289-5d3f-4990-9d9e-80b1681cd220 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:09.929300 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f428289-5d3f-4990-9d9e-80b1681cd220 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:09.929845 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f428289-5d3f-4990-9d9e-80b1681cd220 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:09.930271 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f428289-5d3f-4990-9d9e-80b1681cd220 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:09.930972 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f428289-5d3f-4990-9d9e-80b1681cd220 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:09.931490 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f428289-5d3f-4990-9d9e-80b1681cd220 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:09.931883 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f428289-5d3f-4990-9d9e-80b1681cd220 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:09.934644 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2e0f5f57-ff7e-4446-a0ad-a0389e4c8fe7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:09.935301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2e0f5f57-ff7e-4446-a0ad-a0389e4c8fe7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:09.942415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e0f5f57-ff7e-4446-a0ad-a0389e4c8fe7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:09.943142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e0f5f57-ff7e-4446-a0ad-a0389e4c8fe7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:09.943765 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e0f5f57-ff7e-4446-a0ad-a0389e4c8fe7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:09.944637 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e0f5f57-ff7e-4446-a0ad-a0389e4c8fe7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:09.945254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e0f5f57-ff7e-4446-a0ad-a0389e4c8fe7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:09.945834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e0f5f57-ff7e-4446-a0ad-a0389e4c8fe7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:09.950608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:44:10.320569 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0f428289-5d3f-4990-9d9e-80b1681cd220 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:10.328543 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0f428289-5d3f-4990-9d9e-80b1681cd220 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:10.330058 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0f428289-5d3f-4990-9d9e-80b1681cd220 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:10.331265 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0f428289-5d3f-4990-9d9e-80b1681cd220 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1721 microversion: 2.20 time: 0.413111 Aug 10 12:44:10.331836 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 204/404] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:09 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1721 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:10.336256 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f57f0fbf-29aa-4c32-a74d-fd14ec75f643 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:10.336866 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f57f0fbf-29aa-4c32-a74d-fd14ec75f643 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 38bd2d87-ab3f-44c7-af3a-31625fbc988e] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:10.338708 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2e0f5f57-ff7e-4446-a0ad-a0389e4c8fe7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:10.342710 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f57f0fbf-29aa-4c32-a74d-fd14ec75f643 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:10.343885 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f57f0fbf-29aa-4c32-a74d-fd14ec75f643 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:10.344332 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f57f0fbf-29aa-4c32-a74d-fd14ec75f643 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:10.345029 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f57f0fbf-29aa-4c32-a74d-fd14ec75f643 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:10.345486 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f57f0fbf-29aa-4c32-a74d-fd14ec75f643 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:10.346086 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f57f0fbf-29aa-4c32-a74d-fd14ec75f643 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:10.348023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2e0f5f57-ff7e-4446-a0ad-a0389e4c8fe7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1706 microversion: 2.1 time: 0.417916 Aug 10 12:44:10.348662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 201/405] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:09 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1706 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:44:10.476073 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f57f0fbf-29aa-4c32-a74d-fd14ec75f643 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:10.483488 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f57f0fbf-29aa-4c32-a74d-fd14ec75f643 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e" status: 200 len: 1314 microversion: 2.1 time: 0.150671 Aug 10 12:44:10.484739 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 205/406] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:10 2022] GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:10.779620 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8dd92bd6-454c-45dd-a775-39deac4db9f8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:10.780226 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8dd92bd6-454c-45dd-a775-39deac4db9f8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:10.786949 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8dd92bd6-454c-45dd-a775-39deac4db9f8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:10.787463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8dd92bd6-454c-45dd-a775-39deac4db9f8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:10.787894 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8dd92bd6-454c-45dd-a775-39deac4db9f8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:10.788583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8dd92bd6-454c-45dd-a775-39deac4db9f8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:10.789030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8dd92bd6-454c-45dd-a775-39deac4db9f8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:10.789448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8dd92bd6-454c-45dd-a775-39deac4db9f8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:11.034966 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8dd92bd6-454c-45dd-a775-39deac4db9f8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:11.048508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8dd92bd6-454c-45dd-a775-39deac4db9f8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1319 microversion: 2.1 time: 0.272275 Aug 10 12:44:11.050947 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 202/407] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:10 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:11.354569 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-995508ca-7427-4d47-8032-799b385f1491 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:11.355453 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-995508ca-7427-4d47-8032-799b385f1491 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:11.363221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-995508ca-7427-4d47-8032-799b385f1491 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:11.363712 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-995508ca-7427-4d47-8032-799b385f1491 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:11.367761 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-995508ca-7427-4d47-8032-799b385f1491 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:11.367761 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-995508ca-7427-4d47-8032-799b385f1491 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:11.367761 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-995508ca-7427-4d47-8032-799b385f1491 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:11.367761 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-995508ca-7427-4d47-8032-799b385f1491 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:11.370936 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8aa41a73-b6ea-4807-b48a-c85db5049de7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:11.372073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8aa41a73-b6ea-4807-b48a-c85db5049de7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:11.380011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8aa41a73-b6ea-4807-b48a-c85db5049de7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:11.380901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8aa41a73-b6ea-4807-b48a-c85db5049de7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:11.381442 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8aa41a73-b6ea-4807-b48a-c85db5049de7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:11.383631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8aa41a73-b6ea-4807-b48a-c85db5049de7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:11.384493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8aa41a73-b6ea-4807-b48a-c85db5049de7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:11.385116 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8aa41a73-b6ea-4807-b48a-c85db5049de7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:11.576784 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-995508ca-7427-4d47-8032-799b385f1491 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:11.580187 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8aa41a73-b6ea-4807-b48a-c85db5049de7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:11.585368 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-995508ca-7427-4d47-8032-799b385f1491 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:11.587075 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-995508ca-7427-4d47-8032-799b385f1491 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:11.588064 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8aa41a73-b6ea-4807-b48a-c85db5049de7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1710 microversion: 2.1 time: 0.221323 Aug 10 12:44:11.588252 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-995508ca-7427-4d47-8032-799b385f1491 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1721 microversion: 2.20 time: 0.237627 Aug 10 12:44:11.588803 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 206/409] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:11 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1721 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:11.588946 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 203/409] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:11 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1710 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:11.594675 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f01d97b8-e489-4d8c-9683-f7e788b65376 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:11.596304 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f01d97b8-e489-4d8c-9683-f7e788b65376 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 38bd2d87-ab3f-44c7-af3a-31625fbc988e] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:11.602989 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f01d97b8-e489-4d8c-9683-f7e788b65376 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:11.603516 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f01d97b8-e489-4d8c-9683-f7e788b65376 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:11.603979 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f01d97b8-e489-4d8c-9683-f7e788b65376 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:11.604667 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f01d97b8-e489-4d8c-9683-f7e788b65376 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:11.605283 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f01d97b8-e489-4d8c-9683-f7e788b65376 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:11.605943 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f01d97b8-e489-4d8c-9683-f7e788b65376 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:11.736478 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f01d97b8-e489-4d8c-9683-f7e788b65376 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:11.744219 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f01d97b8-e489-4d8c-9683-f7e788b65376 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e" status: 200 len: 1314 microversion: 2.1 time: 0.154459 Aug 10 12:44:11.744796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 204/410] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:11 2022] GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:11.837976 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [req-ebcc170c-67c4-4e18-b3bc-af97e8d2292b req-871c1812-bfd8-47b4-8dd4-97fa2b04a22d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38bd2d87-ab3f-44c7-af3a-31625fbc988e", "name": "network-vif-plugged", "status": "completed", "tag": "93ff4c59-145b-4d00-af21-5ef7b5b88c68"}]} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:44:11.847246 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-ebcc170c-67c4-4e18-b3bc-af97e8d2292b req-871c1812-bfd8-47b4-8dd4-97fa2b04a22d service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:11.847717 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-ebcc170c-67c4-4e18-b3bc-af97e8d2292b req-871c1812-bfd8-47b4-8dd4-97fa2b04a22d service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:11.848142 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-ebcc170c-67c4-4e18-b3bc-af97e8d2292b req-871c1812-bfd8-47b4-8dd4-97fa2b04a22d service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:11.858396 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.compute.server_external_events [req-ebcc170c-67c4-4e18-b3bc-af97e8d2292b req-871c1812-bfd8-47b4-8dd4-97fa2b04a22d service nova] Creating event network-vif-plugged:93ff4c59-145b-4d00-af21-5ef7b5b88c68 for instance 38bd2d87-ab3f-44c7-af3a-31625fbc988e on hv-cinder-85199 Aug 10 12:44:11.863624 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [req-ebcc170c-67c4-4e18-b3bc-af97e8d2292b req-871c1812-bfd8-47b4-8dd4-97fa2b04a22d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029198 Aug 10 12:44:11.864371 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 207/411] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:44:12.071393 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-781e86ba-9cc1-4e50-ad78-506c20528f13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:12.072013 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-781e86ba-9cc1-4e50-ad78-506c20528f13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:12.078978 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-781e86ba-9cc1-4e50-ad78-506c20528f13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:12.079412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-781e86ba-9cc1-4e50-ad78-506c20528f13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:12.079842 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-781e86ba-9cc1-4e50-ad78-506c20528f13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:12.080515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-781e86ba-9cc1-4e50-ad78-506c20528f13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:12.080956 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-781e86ba-9cc1-4e50-ad78-506c20528f13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:12.081367 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-781e86ba-9cc1-4e50-ad78-506c20528f13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:12.214862 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-781e86ba-9cc1-4e50-ad78-506c20528f13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:12.223495 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-781e86ba-9cc1-4e50-ad78-506c20528f13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1319 microversion: 2.1 time: 0.155895 Aug 10 12:44:12.224138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 205/412] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:12 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:12.615868 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-113262ac-2cf1-466d-b48c-ca9c4f6b7532 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:12.616567 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-113262ac-2cf1-466d-b48c-ca9c4f6b7532 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:12.622544 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-113262ac-2cf1-466d-b48c-ca9c4f6b7532 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:12.624009 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-113262ac-2cf1-466d-b48c-ca9c4f6b7532 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:12.624009 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-113262ac-2cf1-466d-b48c-ca9c4f6b7532 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:12.624222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-113262ac-2cf1-466d-b48c-ca9c4f6b7532 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:12.624578 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-113262ac-2cf1-466d-b48c-ca9c4f6b7532 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:12.624995 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-113262ac-2cf1-466d-b48c-ca9c4f6b7532 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:12.755553 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-113262ac-2cf1-466d-b48c-ca9c4f6b7532 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:12.763527 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-113262ac-2cf1-466d-b48c-ca9c4f6b7532 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:12.765016 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-113262ac-2cf1-466d-b48c-ca9c4f6b7532 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:12.765483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-088e348e-a418-4830-b750-a69a489466b3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:12.766216 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-113262ac-2cf1-466d-b48c-ca9c4f6b7532 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1721 microversion: 2.20 time: 0.155398 Aug 10 12:44:12.766498 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-088e348e-a418-4830-b750-a69a489466b3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 38bd2d87-ab3f-44c7-af3a-31625fbc988e] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:12.767271 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 208/413] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:12 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:12.772651 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-088e348e-a418-4830-b750-a69a489466b3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:12.778749 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-088e348e-a418-4830-b750-a69a489466b3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:12.778749 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-088e348e-a418-4830-b750-a69a489466b3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:12.778749 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-088e348e-a418-4830-b750-a69a489466b3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:12.778749 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-088e348e-a418-4830-b750-a69a489466b3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:12.779110 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-088e348e-a418-4830-b750-a69a489466b3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:12.905394 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-088e348e-a418-4830-b750-a69a489466b3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:12.913987 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-088e348e-a418-4830-b750-a69a489466b3 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e" status: 200 len: 1314 microversion: 2.1 time: 0.152577 Aug 10 12:44:12.914617 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 206/414] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:12 2022] GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:44:13.245835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4bcfb5cf-5f3e-4a4f-b525-13619e2ea27f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:13.246353 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4bcfb5cf-5f3e-4a4f-b525-13619e2ea27f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:13.252342 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bcfb5cf-5f3e-4a4f-b525-13619e2ea27f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:13.252823 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bcfb5cf-5f3e-4a4f-b525-13619e2ea27f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:13.253257 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bcfb5cf-5f3e-4a4f-b525-13619e2ea27f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:13.253942 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bcfb5cf-5f3e-4a4f-b525-13619e2ea27f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:13.254391 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bcfb5cf-5f3e-4a4f-b525-13619e2ea27f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:13.254811 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bcfb5cf-5f3e-4a4f-b525-13619e2ea27f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:13.597564 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4bcfb5cf-5f3e-4a4f-b525-13619e2ea27f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:13.604938 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4bcfb5cf-5f3e-4a4f-b525-13619e2ea27f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1319 microversion: 2.1 time: 0.363055 Aug 10 12:44:13.605501 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 209/415] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:13 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:13.789499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1d1db8c0-c1ec-4a29-87a3-376d8b2a0bad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:13.790094 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1d1db8c0-c1ec-4a29-87a3-376d8b2a0bad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:13.797826 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d1db8c0-c1ec-4a29-87a3-376d8b2a0bad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:13.798237 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d1db8c0-c1ec-4a29-87a3-376d8b2a0bad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:13.798830 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d1db8c0-c1ec-4a29-87a3-376d8b2a0bad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:13.799578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d1db8c0-c1ec-4a29-87a3-376d8b2a0bad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:13.800020 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d1db8c0-c1ec-4a29-87a3-376d8b2a0bad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:13.800435 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d1db8c0-c1ec-4a29-87a3-376d8b2a0bad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:13.938075 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-13424dfb-a85f-476b-95cc-685b9c0d139e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:13.947997 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-13424dfb-a85f-476b-95cc-685b9c0d139e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 38bd2d87-ab3f-44c7-af3a-31625fbc988e] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:13.956936 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-13424dfb-a85f-476b-95cc-685b9c0d139e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:13.957440 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-13424dfb-a85f-476b-95cc-685b9c0d139e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:13.957874 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-13424dfb-a85f-476b-95cc-685b9c0d139e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:13.958604 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-13424dfb-a85f-476b-95cc-685b9c0d139e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:13.959056 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-13424dfb-a85f-476b-95cc-685b9c0d139e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:13.959521 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-13424dfb-a85f-476b-95cc-685b9c0d139e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:14.097100 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1d1db8c0-c1ec-4a29-87a3-376d8b2a0bad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:14.107430 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1d1db8c0-c1ec-4a29-87a3-376d8b2a0bad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:14.110478 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1d1db8c0-c1ec-4a29-87a3-376d8b2a0bad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:14.112951 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1d1db8c0-c1ec-4a29-87a3-376d8b2a0bad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1721 microversion: 2.20 time: 0.326452 Aug 10 12:44:14.114179 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 207/416] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:13 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1721 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:14.271264 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-13424dfb-a85f-476b-95cc-685b9c0d139e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:14.288079 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-13424dfb-a85f-476b-95cc-685b9c0d139e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e" status: 200 len: 1314 microversion: 2.1 time: 0.356062 Aug 10 12:44:14.288669 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 210/417] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:13 2022] GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:44:14.626511 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-61f96ccf-b024-4fff-9b22-fc74cf45d0e5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:14.627035 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-61f96ccf-b024-4fff-9b22-fc74cf45d0e5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:14.632977 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61f96ccf-b024-4fff-9b22-fc74cf45d0e5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:14.633449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61f96ccf-b024-4fff-9b22-fc74cf45d0e5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:14.633883 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61f96ccf-b024-4fff-9b22-fc74cf45d0e5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:14.634589 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61f96ccf-b024-4fff-9b22-fc74cf45d0e5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:14.635028 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61f96ccf-b024-4fff-9b22-fc74cf45d0e5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:14.635469 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61f96ccf-b024-4fff-9b22-fc74cf45d0e5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:14.767057 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-61f96ccf-b024-4fff-9b22-fc74cf45d0e5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:14.774472 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-61f96ccf-b024-4fff-9b22-fc74cf45d0e5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1319 microversion: 2.1 time: 0.151880 Aug 10 12:44:14.775036 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 208/418] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:14 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:15.137210 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-30122b24-6903-43dc-aff9-1ef449f72177 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:15.137826 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-30122b24-6903-43dc-aff9-1ef449f72177 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:15.144367 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-30122b24-6903-43dc-aff9-1ef449f72177 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:15.144846 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-30122b24-6903-43dc-aff9-1ef449f72177 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:15.145274 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-30122b24-6903-43dc-aff9-1ef449f72177 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:15.145966 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-30122b24-6903-43dc-aff9-1ef449f72177 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:15.146411 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-30122b24-6903-43dc-aff9-1ef449f72177 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:15.146828 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-30122b24-6903-43dc-aff9-1ef449f72177 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:15.285307 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-30122b24-6903-43dc-aff9-1ef449f72177 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:15.293550 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-30122b24-6903-43dc-aff9-1ef449f72177 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:15.295069 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-30122b24-6903-43dc-aff9-1ef449f72177 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:15.296256 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-30122b24-6903-43dc-aff9-1ef449f72177 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1724 microversion: 2.20 time: 0.163203 Aug 10 12:44:15.297624 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 211/419] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:15 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:15.310313 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f4989ac5-5569-461a-9315-941d1d47aa30 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:15.314928 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f4989ac5-5569-461a-9315-941d1d47aa30 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 38bd2d87-ab3f-44c7-af3a-31625fbc988e] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:15.318740 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f4989ac5-5569-461a-9315-941d1d47aa30 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:15.319422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f4989ac5-5569-461a-9315-941d1d47aa30 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:15.320069 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f4989ac5-5569-461a-9315-941d1d47aa30 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:15.321167 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f4989ac5-5569-461a-9315-941d1d47aa30 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:15.321540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f4989ac5-5569-461a-9315-941d1d47aa30 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:15.321962 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f4989ac5-5569-461a-9315-941d1d47aa30 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:15.322760 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d7d2f93d-b0d1-4fe7-bc11-efe1fc99002e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff851858-628d-4652-8179-bd9f8b05eb25"}} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:44:15.325533 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d7d2f93d-b0d1-4fe7-bc11-efe1fc99002e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:15.333174 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7d2f93d-b0d1-4fe7-bc11-efe1fc99002e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:15.333910 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7d2f93d-b0d1-4fe7-bc11-efe1fc99002e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:15.334516 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7d2f93d-b0d1-4fe7-bc11-efe1fc99002e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:15.335358 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7d2f93d-b0d1-4fe7-bc11-efe1fc99002e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:15.335801 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7d2f93d-b0d1-4fe7-bc11-efe1fc99002e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:15.340298 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7d2f93d-b0d1-4fe7-bc11-efe1fc99002e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:15.478317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f4989ac5-5569-461a-9315-941d1d47aa30 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:15.487341 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f4989ac5-5569-461a-9315-941d1d47aa30 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e" status: 200 len: 1314 microversion: 2.1 time: 0.180817 Aug 10 12:44:15.491225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 209/420] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:15 2022] GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:15.795672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e22b383f-b496-4ce1-9384-cb408d1b65f3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:15.796197 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e22b383f-b496-4ce1-9384-cb408d1b65f3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:15.802473 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e22b383f-b496-4ce1-9384-cb408d1b65f3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:15.804820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e22b383f-b496-4ce1-9384-cb408d1b65f3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:15.804820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e22b383f-b496-4ce1-9384-cb408d1b65f3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:15.804820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e22b383f-b496-4ce1-9384-cb408d1b65f3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:15.804820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e22b383f-b496-4ce1-9384-cb408d1b65f3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:15.805175 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e22b383f-b496-4ce1-9384-cb408d1b65f3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:15.941335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e22b383f-b496-4ce1-9384-cb408d1b65f3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:15.949171 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e22b383f-b496-4ce1-9384-cb408d1b65f3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1319 microversion: 2.1 time: 0.158524 Aug 10 12:44:15.949745 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 210/421] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:15 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:44:16.329164 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d7d2f93d-b0d1-4fe7-bc11-efe1fc99002e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "POST /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.010749 Aug 10 12:44:16.331459 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 212/422] 10.222.0.49 () {62 vars in 1364 bytes} [Wed Aug 10 12:44:15 2022] POST /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 188 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:44:16.475787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8b43754f-1254-4650-89fd-4cdcd5a96e59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:44:16.476260 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8b43754f-1254-4650-89fd-4cdcd5a96e59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:16.482958 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8b43754f-1254-4650-89fd-4cdcd5a96e59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:16.483470 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8b43754f-1254-4650-89fd-4cdcd5a96e59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:16.485638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8b43754f-1254-4650-89fd-4cdcd5a96e59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:16.485638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8b43754f-1254-4650-89fd-4cdcd5a96e59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:16.485638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8b43754f-1254-4650-89fd-4cdcd5a96e59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:16.485638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8b43754f-1254-4650-89fd-4cdcd5a96e59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:16.507920 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0a6b063d-3432-4b43-a101-9f576c87d405 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:16.508530 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0a6b063d-3432-4b43-a101-9f576c87d405 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 38bd2d87-ab3f-44c7-af3a-31625fbc988e] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:16.514274 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0a6b063d-3432-4b43-a101-9f576c87d405 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:16.514746 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0a6b063d-3432-4b43-a101-9f576c87d405 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:16.516077 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0a6b063d-3432-4b43-a101-9f576c87d405 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:16.516077 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0a6b063d-3432-4b43-a101-9f576c87d405 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:16.516401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0a6b063d-3432-4b43-a101-9f576c87d405 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:16.516820 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0a6b063d-3432-4b43-a101-9f576c87d405 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:16.529983 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8b43754f-1254-4650-89fd-4cdcd5a96e59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124643) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 12:44:16.652262 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0a6b063d-3432-4b43-a101-9f576c87d405 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:16.659790 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0a6b063d-3432-4b43-a101-9f576c87d405 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e" status: 200 len: 1497 microversion: 2.1 time: 0.155754 Aug 10 12:44:16.660379 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 213/423] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:16 2022] GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:16.909081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8b43754f-1254-4650-89fd-4cdcd5a96e59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "POST /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/action" status: 202 len: 0 microversion: 2.20 time: 0.437776 Aug 10 12:44:16.909691 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 211/424] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Aug 10 12:44:16 2022] POST /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/action => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 12:44:16.920575 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d221d95d-78f5-44a8-a3d5-e63d0c080845 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:16.920883 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d221d95d-78f5-44a8-a3d5-e63d0c080845 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:16.928865 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d221d95d-78f5-44a8-a3d5-e63d0c080845 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:16.929007 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d221d95d-78f5-44a8-a3d5-e63d0c080845 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:16.929572 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d221d95d-78f5-44a8-a3d5-e63d0c080845 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:16.930359 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d221d95d-78f5-44a8-a3d5-e63d0c080845 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:16.930821 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d221d95d-78f5-44a8-a3d5-e63d0c080845 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:16.931438 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d221d95d-78f5-44a8-a3d5-e63d0c080845 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:16.970324 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7a01f74f-cf39-4c31-a0d0-03442be6539c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:16.971237 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7a01f74f-cf39-4c31-a0d0-03442be6539c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:16.974165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:44:16.977543 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a01f74f-cf39-4c31-a0d0-03442be6539c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:16.978028 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a01f74f-cf39-4c31-a0d0-03442be6539c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:16.978464 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a01f74f-cf39-4c31-a0d0-03442be6539c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:16.979165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a01f74f-cf39-4c31-a0d0-03442be6539c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:16.979639 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a01f74f-cf39-4c31-a0d0-03442be6539c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:16.980064 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a01f74f-cf39-4c31-a0d0-03442be6539c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:17.152147 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d221d95d-78f5-44a8-a3d5-e63d0c080845 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:17.165322 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d221d95d-78f5-44a8-a3d5-e63d0c080845 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:17.169820 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d221d95d-78f5-44a8-a3d5-e63d0c080845 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:17.171345 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d221d95d-78f5-44a8-a3d5-e63d0c080845 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1750 microversion: 2.20 time: 0.257117 Aug 10 12:44:17.190791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 214/425] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:16 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1750 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:44:17.194064 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7a01f74f-cf39-4c31-a0d0-03442be6539c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:17.203264 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7a01f74f-cf39-4c31-a0d0-03442be6539c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1319 microversion: 2.1 time: 0.237076 Aug 10 12:44:17.215415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 212/426] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:16 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:44:17.305153 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [req-4d1b1fe2-2a24-4491-95fb-74ae250567ec req-6066366c-1e30-4987-8524-5154aacae643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a", "name": "network-vif-plugged", "status": "completed", "tag": "811605ba-52c3-45e2-85fd-e5d880491764"}]} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:44:17.315895 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-4d1b1fe2-2a24-4491-95fb-74ae250567ec req-6066366c-1e30-4987-8524-5154aacae643 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:17.316370 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-4d1b1fe2-2a24-4491-95fb-74ae250567ec req-6066366c-1e30-4987-8524-5154aacae643 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:17.316794 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-4d1b1fe2-2a24-4491-95fb-74ae250567ec req-6066366c-1e30-4987-8524-5154aacae643 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:17.320730 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:44:17.328572 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.compute.server_external_events [req-4d1b1fe2-2a24-4491-95fb-74ae250567ec req-6066366c-1e30-4987-8524-5154aacae643 service nova] Creating event network-vif-plugged:811605ba-52c3-45e2-85fd-e5d880491764 for instance 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a on hv-cinder-85199 Aug 10 12:44:17.333506 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [req-4d1b1fe2-2a24-4491-95fb-74ae250567ec req-6066366c-1e30-4987-8524-5154aacae643 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033567 Aug 10 12:44:17.334305 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 215/427] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:44:17.547819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-74fb7815-e0bc-486b-81e9-0aa8ba2d0b70 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:17.548347 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-74fb7815-e0bc-486b-81e9-0aa8ba2d0b70 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 38bd2d87-ab3f-44c7-af3a-31625fbc988e] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:17.554656 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-74fb7815-e0bc-486b-81e9-0aa8ba2d0b70 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:17.555126 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-74fb7815-e0bc-486b-81e9-0aa8ba2d0b70 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:17.555586 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-74fb7815-e0bc-486b-81e9-0aa8ba2d0b70 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:17.556267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-74fb7815-e0bc-486b-81e9-0aa8ba2d0b70 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:17.556712 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-74fb7815-e0bc-486b-81e9-0aa8ba2d0b70 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:17.557135 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-74fb7815-e0bc-486b-81e9-0aa8ba2d0b70 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:17.583478 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-74fb7815-e0bc-486b-81e9-0aa8ba2d0b70 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 38bd2d87-ab3f-44c7-af3a-31625fbc988e] Going to try to terminate instance {{(pid=124643) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:44:17.952637 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-74fb7815-e0bc-486b-81e9-0aa8ba2d0b70 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "DELETE /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e" status: 204 len: 0 microversion: 2.1 time: 0.409690 Aug 10 12:44:17.953951 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 213/428] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 12:44:17 2022] DELETE /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 12:44:17.963095 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1379a6fb-afb1-48d4-8a41-7b956155b08e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:17.964081 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1379a6fb-afb1-48d4-8a41-7b956155b08e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 38bd2d87-ab3f-44c7-af3a-31625fbc988e] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:17.971641 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1379a6fb-afb1-48d4-8a41-7b956155b08e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:17.972448 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1379a6fb-afb1-48d4-8a41-7b956155b08e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:17.972880 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1379a6fb-afb1-48d4-8a41-7b956155b08e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:17.973584 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1379a6fb-afb1-48d4-8a41-7b956155b08e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:17.974033 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1379a6fb-afb1-48d4-8a41-7b956155b08e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:17.974456 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1379a6fb-afb1-48d4-8a41-7b956155b08e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:18.159539 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-1379a6fb-afb1-48d4-8a41-7b956155b08e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:18.167482 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1379a6fb-afb1-48d4-8a41-7b956155b08e tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e" status: 200 len: 1503 microversion: 2.1 time: 0.208375 Aug 10 12:44:18.168062 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 216/429] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:17 2022] GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e => generated 1503 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:18.197248 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7b133aed-e8ae-4d4b-9d27-27ee33aa4f67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:18.197980 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7b133aed-e8ae-4d4b-9d27-27ee33aa4f67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:18.204353 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b133aed-e8ae-4d4b-9d27-27ee33aa4f67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:18.204652 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b133aed-e8ae-4d4b-9d27-27ee33aa4f67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:18.205088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b133aed-e8ae-4d4b-9d27-27ee33aa4f67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:18.205785 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b133aed-e8ae-4d4b-9d27-27ee33aa4f67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:18.206365 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b133aed-e8ae-4d4b-9d27-27ee33aa4f67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:18.206788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b133aed-e8ae-4d4b-9d27-27ee33aa4f67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:18.228242 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-86c61d52-c8ae-4673-b2d2-cf0212b004d5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:18.229039 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-86c61d52-c8ae-4673-b2d2-cf0212b004d5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:18.244135 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86c61d52-c8ae-4673-b2d2-cf0212b004d5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:18.244135 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86c61d52-c8ae-4673-b2d2-cf0212b004d5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:18.244135 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86c61d52-c8ae-4673-b2d2-cf0212b004d5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:18.244135 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86c61d52-c8ae-4673-b2d2-cf0212b004d5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:18.244466 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86c61d52-c8ae-4673-b2d2-cf0212b004d5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:18.244466 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86c61d52-c8ae-4673-b2d2-cf0212b004d5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:18.415671 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7b133aed-e8ae-4d4b-9d27-27ee33aa4f67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:18.426055 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7b133aed-e8ae-4d4b-9d27-27ee33aa4f67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:18.427641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7b133aed-e8ae-4d4b-9d27-27ee33aa4f67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:18.428813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7b133aed-e8ae-4d4b-9d27-27ee33aa4f67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1750 microversion: 2.20 time: 0.235983 Aug 10 12:44:18.429374 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 214/430] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:18 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1750 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:18.431507 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-86c61d52-c8ae-4673-b2d2-cf0212b004d5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:18.440850 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-86c61d52-c8ae-4673-b2d2-cf0212b004d5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1319 microversion: 2.1 time: 0.216332 Aug 10 12:44:18.441414 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 217/431] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:18 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:19.189597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-afd8161d-0982-424c-ae80-2196ff8377a2 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:19.190204 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-afd8161d-0982-424c-ae80-2196ff8377a2 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 38bd2d87-ab3f-44c7-af3a-31625fbc988e] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:19.196088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-afd8161d-0982-424c-ae80-2196ff8377a2 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:19.196563 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-afd8161d-0982-424c-ae80-2196ff8377a2 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:19.196989 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-afd8161d-0982-424c-ae80-2196ff8377a2 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:19.197664 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-afd8161d-0982-424c-ae80-2196ff8377a2 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:19.198110 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-afd8161d-0982-424c-ae80-2196ff8377a2 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:19.198525 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-afd8161d-0982-424c-ae80-2196ff8377a2 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:19.201114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:44:19.344043 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-afd8161d-0982-424c-ae80-2196ff8377a2 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:19.352122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-afd8161d-0982-424c-ae80-2196ff8377a2 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e" status: 200 len: 1503 microversion: 2.1 time: 0.166331 Aug 10 12:44:19.352845 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 215/432] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:19 2022] GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:19.452740 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-66be6b46-3e05-4459-9ded-b017d0f322d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:19.453542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-66be6b46-3e05-4459-9ded-b017d0f322d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:19.460442 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-66be6b46-3e05-4459-9ded-b017d0f322d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:19.460931 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-66be6b46-3e05-4459-9ded-b017d0f322d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:19.461365 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-66be6b46-3e05-4459-9ded-b017d0f322d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:19.461714 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-eefa50b2-0f9a-4cbb-bf22-9f7b9127be9a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:19.462086 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-66be6b46-3e05-4459-9ded-b017d0f322d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:19.462329 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-eefa50b2-0f9a-4cbb-bf22-9f7b9127be9a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:19.462537 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-66be6b46-3e05-4459-9ded-b017d0f322d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:19.462974 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-66be6b46-3e05-4459-9ded-b017d0f322d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:19.470421 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eefa50b2-0f9a-4cbb-bf22-9f7b9127be9a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:19.472430 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eefa50b2-0f9a-4cbb-bf22-9f7b9127be9a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:19.472430 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eefa50b2-0f9a-4cbb-bf22-9f7b9127be9a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:19.472430 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eefa50b2-0f9a-4cbb-bf22-9f7b9127be9a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:19.472693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eefa50b2-0f9a-4cbb-bf22-9f7b9127be9a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:19.473078 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eefa50b2-0f9a-4cbb-bf22-9f7b9127be9a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:19.665239 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-eefa50b2-0f9a-4cbb-bf22-9f7b9127be9a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:19.668164 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-66be6b46-3e05-4459-9ded-b017d0f322d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:19.672911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-eefa50b2-0f9a-4cbb-bf22-9f7b9127be9a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1319 microversion: 2.1 time: 0.215010 Aug 10 12:44:19.673489 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 216/433] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:19 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:44:19.677249 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-66be6b46-3e05-4459-9ded-b017d0f322d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:19.678812 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-66be6b46-3e05-4459-9ded-b017d0f322d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:19.680059 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-66be6b46-3e05-4459-9ded-b017d0f322d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1750 microversion: 2.20 time: 0.231395 Aug 10 12:44:19.680701 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 218/434] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:19 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1750 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:20.374981 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5f58d267-6eef-4584-93d6-bbbae4b7b5ff tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:20.375641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5f58d267-6eef-4584-93d6-bbbae4b7b5ff tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 38bd2d87-ab3f-44c7-af3a-31625fbc988e] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:20.381934 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5f58d267-6eef-4584-93d6-bbbae4b7b5ff tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:20.382410 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5f58d267-6eef-4584-93d6-bbbae4b7b5ff tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:20.382834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5f58d267-6eef-4584-93d6-bbbae4b7b5ff tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:20.383541 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5f58d267-6eef-4584-93d6-bbbae4b7b5ff tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:20.383985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5f58d267-6eef-4584-93d6-bbbae4b7b5ff tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:20.384402 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5f58d267-6eef-4584-93d6-bbbae4b7b5ff tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:20.514443 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5f58d267-6eef-4584-93d6-bbbae4b7b5ff tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:20.522590 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5f58d267-6eef-4584-93d6-bbbae4b7b5ff tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e" status: 200 len: 1503 microversion: 2.1 time: 0.151481 Aug 10 12:44:20.523162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 217/435] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:20 2022] GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:20.693711 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6479a016-8047-45c4-91f0-c450196a2bba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:20.694318 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6479a016-8047-45c4-91f0-c450196a2bba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:20.700816 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6479a016-8047-45c4-91f0-c450196a2bba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:20.701309 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6479a016-8047-45c4-91f0-c450196a2bba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:20.701753 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6479a016-8047-45c4-91f0-c450196a2bba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:20.702435 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6479a016-8047-45c4-91f0-c450196a2bba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:20.702882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6479a016-8047-45c4-91f0-c450196a2bba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:20.703097 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8f7b7da1-516c-49cb-bf3d-24650e07d65b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:20.703317 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6479a016-8047-45c4-91f0-c450196a2bba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:20.703898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8f7b7da1-516c-49cb-bf3d-24650e07d65b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:20.711994 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f7b7da1-516c-49cb-bf3d-24650e07d65b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:20.712406 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f7b7da1-516c-49cb-bf3d-24650e07d65b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:20.712839 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f7b7da1-516c-49cb-bf3d-24650e07d65b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:20.713584 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f7b7da1-516c-49cb-bf3d-24650e07d65b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:20.714078 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f7b7da1-516c-49cb-bf3d-24650e07d65b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:20.714892 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f7b7da1-516c-49cb-bf3d-24650e07d65b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:21.058940 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6479a016-8047-45c4-91f0-c450196a2bba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:21.066840 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6479a016-8047-45c4-91f0-c450196a2bba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1508 microversion: 2.1 time: 0.376873 Aug 10 12:44:21.067464 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 219/436] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:20 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1508 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:21.071726 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8f7b7da1-516c-49cb-bf3d-24650e07d65b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:21.081344 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8f7b7da1-516c-49cb-bf3d-24650e07d65b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:21.082877 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8f7b7da1-516c-49cb-bf3d-24650e07d65b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:21.084480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8f7b7da1-516c-49cb-bf3d-24650e07d65b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1752 microversion: 2.20 time: 0.385016 Aug 10 12:44:21.095664 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 218/437] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:20 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1752 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:44:21.438198 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [req-55272c9c-ea2d-493e-9bec-3bc39c78b643 req-070c6617-ef34-4532-b245-48108f9d9dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38bd2d87-ab3f-44c7-af3a-31625fbc988e", "name": "network-vif-deleted", "tag": "93ff4c59-145b-4d00-af21-5ef7b5b88c68"}]} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:44:21.448774 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-55272c9c-ea2d-493e-9bec-3bc39c78b643 req-070c6617-ef34-4532-b245-48108f9d9dd1 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:21.449247 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-55272c9c-ea2d-493e-9bec-3bc39c78b643 req-070c6617-ef34-4532-b245-48108f9d9dd1 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:21.449679 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-55272c9c-ea2d-493e-9bec-3bc39c78b643 req-070c6617-ef34-4532-b245-48108f9d9dd1 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:21.460901 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.compute.server_external_events [req-55272c9c-ea2d-493e-9bec-3bc39c78b643 req-070c6617-ef34-4532-b245-48108f9d9dd1 service nova] Creating event network-vif-deleted:93ff4c59-145b-4d00-af21-5ef7b5b88c68 for instance 38bd2d87-ab3f-44c7-af3a-31625fbc988e on hv-cinder-85199 Aug 10 12:44:21.465796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [req-55272c9c-ea2d-493e-9bec-3bc39c78b643 req-070c6617-ef34-4532-b245-48108f9d9dd1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031543 Aug 10 12:44:21.466561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 220/438] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:44:21.542775 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b8944028-3f63-4327-9ab6-446e4d752d7a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:21.543430 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b8944028-3f63-4327-9ab6-446e4d752d7a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 38bd2d87-ab3f-44c7-af3a-31625fbc988e] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:21.550475 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8944028-3f63-4327-9ab6-446e4d752d7a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:21.550945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8944028-3f63-4327-9ab6-446e4d752d7a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:21.551409 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8944028-3f63-4327-9ab6-446e4d752d7a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:21.552086 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8944028-3f63-4327-9ab6-446e4d752d7a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:21.552530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8944028-3f63-4327-9ab6-446e4d752d7a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:21.552947 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8944028-3f63-4327-9ab6-446e4d752d7a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:21.620802 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b8944028-3f63-4327-9ab6-446e4d752d7a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b19e56e11047e3b0f102efea439b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca783a603c484aad86d05156d7e9142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:21.628480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b8944028-3f63-4327-9ab6-446e4d752d7a tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e" status: 200 len: 1299 microversion: 2.1 time: 0.089449 Aug 10 12:44:21.629053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 219/439] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:21 2022] GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e => generated 1299 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:22.108312 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fb2220fd-4468-4db5-8521-938ac46076bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:22.108988 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fb2220fd-4468-4db5-8521-938ac46076bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:22.116118 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fb2220fd-4468-4db5-8521-938ac46076bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:22.116572 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fb2220fd-4468-4db5-8521-938ac46076bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:22.116997 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fb2220fd-4468-4db5-8521-938ac46076bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:22.117671 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fb2220fd-4468-4db5-8521-938ac46076bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:22.118149 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fb2220fd-4468-4db5-8521-938ac46076bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:22.118562 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fb2220fd-4468-4db5-8521-938ac46076bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:22.247474 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fb2220fd-4468-4db5-8521-938ac46076bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:22.258084 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fb2220fd-4468-4db5-8521-938ac46076bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:22.259656 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fb2220fd-4468-4db5-8521-938ac46076bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:22.260814 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fb2220fd-4468-4db5-8521-938ac46076bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1752 microversion: 2.20 time: 0.157018 Aug 10 12:44:22.261372 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 221/440] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:22 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:22.649234 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ddd1ed1c-ebf9-4bf3-bbf6-1d40e7ef34c5 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:22.649779 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ddd1ed1c-ebf9-4bf3-bbf6-1d40e7ef34c5 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] [instance: 38bd2d87-ab3f-44c7-af3a-31625fbc988e] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:22.656261 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ddd1ed1c-ebf9-4bf3-bbf6-1d40e7ef34c5 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:22.661571 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ddd1ed1c-ebf9-4bf3-bbf6-1d40e7ef34c5 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:22.661571 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ddd1ed1c-ebf9-4bf3-bbf6-1d40e7ef34c5 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:22.661571 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ddd1ed1c-ebf9-4bf3-bbf6-1d40e7ef34c5 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:22.661571 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ddd1ed1c-ebf9-4bf3-bbf6-1d40e7ef34c5 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:22.661913 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ddd1ed1c-ebf9-4bf3-bbf6-1d40e7ef34c5 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:22.671671 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-ddd1ed1c-ebf9-4bf3-bbf6-1d40e7ef34c5 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] HTTP exception thrown: Instance 38bd2d87-ab3f-44c7-af3a-31625fbc988e could not be found. Aug 10 12:44:22.673832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ddd1ed1c-ebf9-4bf3-bbf6-1d40e7ef34c5 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Request method failure captured: Aug 10 12:44:22.673832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e HTTP/1.1 Aug 10 12:44:22.673832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 12:44:22.673832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 12:44:22.673832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 12:44:22.673832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 12:44:22.673832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 12:44:22.673832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 12:44:22.673832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 12:44:22.673832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 12:44:22.673832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86fotor3z2TnLejqJOV9qz10_EvlxfAtjV-tdtcx_h4mpHUCH635IXJReFRBl1UY-wwzOzTiKEnJFecMEz5dLRwZX2nq0q3zYpXGoillEtXK6Z2KDB08lLCIlcxVVfaCIwH3WNsmsMiRaKP9fTcezwJT4DbYNDIBIbu2ABipOLNJHO4 Aug 10 12:44:22.673832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 12:44:22.673832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 12:44:22.673832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 12:44:22.673832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 12:44:22.673832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 12:44:22.673832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 12:44:22.673832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: ca783a603c484aad86d05156d7e9142c Aug 10 12:44:22.673832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-VolumesActionsTest-1638191916 Aug 10 12:44:22.673832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 12:44:22.673832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 12:44:22.675776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca783a603c484aad86d05156d7e9142c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca783a603c484aad86d05156d7e9142c", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca783a603c484aad86d05156d7e9142c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca783a603c484aad86d05156d7e9142c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 12:44:22.675776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-VolumesActionsTest-1638191916 Aug 10 12:44:22.675776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: ca783a603c484aad86d05156d7e9142c Aug 10 12:44:22.675776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-VolumesActionsTest-1638191916 Aug 10 12:44:22.675776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-VolumesActionsTest-1638191916-project Aug 10 12:44:22.675776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 12:44:22.675776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 12:44:22.675776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 00b19e56e11047e3b0f102efea439b7f Aug 10 12:44:22.675776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-VolumesActionsTest-1638191916-project Aug 10 12:44:22.675776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 12:44:22.675776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance 38bd2d87-ab3f-44c7-af3a-31625fbc988e could not be found. Aug 10 12:44:22.675776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': '38bd2d87-ab3f-44c7-af3a-31625fbc988e'} Aug 10 12:44:22.676780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:44:22.676780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:44:22.676780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:44:22.676780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:44:22.676780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:44:22.676780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:44:22.676780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:44:22.676780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:44:22.676780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:44:22.676780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:44:22.676780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38bd2d87-ab3f-44c7-af3a-31625fbc988e could not be found. Aug 10 12:44:22.676780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:44:22.676780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:44:22.676780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:44:22.676780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:44:22.676780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:44:22.676780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:44:22.676780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:44:22.676780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:44:22.676780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:44:22.678165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:44:22.678165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:44:22.678165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:44:22.678165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:44:22.678165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:44:22.678165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:44:22.678165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:44:22.678165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38bd2d87-ab3f-44c7-af3a-31625fbc988e could not be found. Aug 10 12:44:22.678165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:44:22.678165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:44:22.678165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:44:22.678165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:44:22.678165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:44:22.678165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:44:22.678165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:44:22.678165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:44:22.678165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38bd2d87-ab3f-44c7-af3a-31625fbc988e could not be found. Aug 10 12:44:22.678165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:44:22.679433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ddd1ed1c-ebf9-4bf3-bbf6-1d40e7ef34c5 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] Returning 404 to user: Instance 38bd2d87-ab3f-44c7-af3a-31625fbc988e could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:44:22.679433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ddd1ed1c-ebf9-4bf3-bbf6-1d40e7ef34c5 tempest-VolumesActionsTest-1638191916 tempest-VolumesActionsTest-1638191916-project] 10.222.0.49 "GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e" status: 404 len: 111 microversion: 2.1 time: 0.030217 Aug 10 12:44:22.679433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 220/441] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:22 2022] GET /compute/v2.1/servers/38bd2d87-ab3f-44c7-af3a-31625fbc988e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 12:44:23.285401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2256dd8d-faa7-4e98-9757-b6772d926098 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:23.286020 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2256dd8d-faa7-4e98-9757-b6772d926098 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:23.292722 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2256dd8d-faa7-4e98-9757-b6772d926098 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:23.293221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2256dd8d-faa7-4e98-9757-b6772d926098 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:23.293658 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2256dd8d-faa7-4e98-9757-b6772d926098 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:23.294367 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2256dd8d-faa7-4e98-9757-b6772d926098 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:23.295002 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2256dd8d-faa7-4e98-9757-b6772d926098 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:23.295599 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2256dd8d-faa7-4e98-9757-b6772d926098 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:23.735656 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2256dd8d-faa7-4e98-9757-b6772d926098 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:23.748586 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2256dd8d-faa7-4e98-9757-b6772d926098 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:23.750276 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2256dd8d-faa7-4e98-9757-b6772d926098 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:23.751500 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2256dd8d-faa7-4e98-9757-b6772d926098 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1808 microversion: 2.20 time: 0.471007 Aug 10 12:44:23.752817 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 222/442] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:23 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1808 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:24.779825 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-60cfc370-cbab-463d-ade2-a823f1521f7a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:24.780458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-60cfc370-cbab-463d-ade2-a823f1521f7a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:24.786893 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60cfc370-cbab-463d-ade2-a823f1521f7a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:24.787401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60cfc370-cbab-463d-ade2-a823f1521f7a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:24.787831 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60cfc370-cbab-463d-ade2-a823f1521f7a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:24.788507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60cfc370-cbab-463d-ade2-a823f1521f7a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:24.788957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60cfc370-cbab-463d-ade2-a823f1521f7a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:24.789369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60cfc370-cbab-463d-ade2-a823f1521f7a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:24.923013 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-60cfc370-cbab-463d-ade2-a823f1521f7a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:24.932775 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-60cfc370-cbab-463d-ade2-a823f1521f7a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:24.934237 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-60cfc370-cbab-463d-ade2-a823f1521f7a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:24.935430 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-60cfc370-cbab-463d-ade2-a823f1521f7a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1808 microversion: 2.20 time: 0.159481 Aug 10 12:44:24.935985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 221/443] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:24 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:25.959807 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-940b52e2-5bb6-4bd4-927e-6ce9844f923c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:25.960995 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-940b52e2-5bb6-4bd4-927e-6ce9844f923c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:25.967674 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-940b52e2-5bb6-4bd4-927e-6ce9844f923c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:25.968147 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-940b52e2-5bb6-4bd4-927e-6ce9844f923c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:25.968571 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-940b52e2-5bb6-4bd4-927e-6ce9844f923c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:25.969282 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-940b52e2-5bb6-4bd4-927e-6ce9844f923c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:25.969726 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-940b52e2-5bb6-4bd4-927e-6ce9844f923c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:25.970142 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-940b52e2-5bb6-4bd4-927e-6ce9844f923c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:26.139687 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-940b52e2-5bb6-4bd4-927e-6ce9844f923c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:26.148842 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-940b52e2-5bb6-4bd4-927e-6ce9844f923c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:26.150644 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-940b52e2-5bb6-4bd4-927e-6ce9844f923c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:26.152020 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-940b52e2-5bb6-4bd4-927e-6ce9844f923c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1808 microversion: 2.20 time: 0.196196 Aug 10 12:44:26.152733 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 223/444] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:25 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:27.177274 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fe12b507-0d89-40fe-8890-a06d960fbb6a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:27.177869 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fe12b507-0d89-40fe-8890-a06d960fbb6a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:27.184821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe12b507-0d89-40fe-8890-a06d960fbb6a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:27.185285 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe12b507-0d89-40fe-8890-a06d960fbb6a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:27.185711 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe12b507-0d89-40fe-8890-a06d960fbb6a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:27.186413 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe12b507-0d89-40fe-8890-a06d960fbb6a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:27.186856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe12b507-0d89-40fe-8890-a06d960fbb6a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:27.187301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe12b507-0d89-40fe-8890-a06d960fbb6a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:27.327107 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fe12b507-0d89-40fe-8890-a06d960fbb6a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:27.336027 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fe12b507-0d89-40fe-8890-a06d960fbb6a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:27.337573 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fe12b507-0d89-40fe-8890-a06d960fbb6a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:27.338753 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fe12b507-0d89-40fe-8890-a06d960fbb6a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1808 microversion: 2.20 time: 0.165571 Aug 10 12:44:27.339344 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 222/445] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:27 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:28.362688 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1f759d95-9629-4311-988a-8f6da7db674c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:28.364092 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1f759d95-9629-4311-988a-8f6da7db674c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:28.373467 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1f759d95-9629-4311-988a-8f6da7db674c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:28.374030 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1f759d95-9629-4311-988a-8f6da7db674c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:28.374475 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1f759d95-9629-4311-988a-8f6da7db674c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:28.375208 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1f759d95-9629-4311-988a-8f6da7db674c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:28.375745 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1f759d95-9629-4311-988a-8f6da7db674c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:28.376161 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1f759d95-9629-4311-988a-8f6da7db674c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:28.530244 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-1f759d95-9629-4311-988a-8f6da7db674c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:28.541886 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-1f759d95-9629-4311-988a-8f6da7db674c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:28.543825 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-1f759d95-9629-4311-988a-8f6da7db674c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:28.545434 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1f759d95-9629-4311-988a-8f6da7db674c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1808 microversion: 2.20 time: 0.187475 Aug 10 12:44:28.546380 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 224/446] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:28 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:29.580132 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d41c7386-7c65-4814-8276-539720d97da3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:29.580742 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d41c7386-7c65-4814-8276-539720d97da3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:29.587444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d41c7386-7c65-4814-8276-539720d97da3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:29.587934 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d41c7386-7c65-4814-8276-539720d97da3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:29.588371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d41c7386-7c65-4814-8276-539720d97da3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:29.589075 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d41c7386-7c65-4814-8276-539720d97da3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:29.589527 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d41c7386-7c65-4814-8276-539720d97da3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:29.589953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d41c7386-7c65-4814-8276-539720d97da3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:29.726808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d41c7386-7c65-4814-8276-539720d97da3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:29.735733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d41c7386-7c65-4814-8276-539720d97da3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:29.737498 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d41c7386-7c65-4814-8276-539720d97da3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:29.739360 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d41c7386-7c65-4814-8276-539720d97da3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1808 microversion: 2.20 time: 0.163130 Aug 10 12:44:29.739929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 223/447] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:29 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:44:30.765421 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-731f6825-6d8d-420c-8d9c-c12a8f7c855d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:30.766009 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-731f6825-6d8d-420c-8d9c-c12a8f7c855d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:30.768622 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=86 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:44:30.774083 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-731f6825-6d8d-420c-8d9c-c12a8f7c855d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:30.774570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-731f6825-6d8d-420c-8d9c-c12a8f7c855d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:30.775230 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-731f6825-6d8d-420c-8d9c-c12a8f7c855d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:30.776097 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-731f6825-6d8d-420c-8d9c-c12a8f7c855d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:30.776697 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-731f6825-6d8d-420c-8d9c-c12a8f7c855d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:30.777265 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-731f6825-6d8d-420c-8d9c-c12a8f7c855d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:30.925680 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-731f6825-6d8d-420c-8d9c-c12a8f7c855d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:30.935096 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-731f6825-6d8d-420c-8d9c-c12a8f7c855d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:30.936657 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-731f6825-6d8d-420c-8d9c-c12a8f7c855d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:30.937901 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-731f6825-6d8d-420c-8d9c-c12a8f7c855d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1808 microversion: 2.20 time: 0.176558 Aug 10 12:44:30.938474 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 225/448] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:30 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:31.962870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-142da04d-bfc4-4206-9974-7e03eac06022 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:31.963518 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-142da04d-bfc4-4206-9974-7e03eac06022 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:31.969864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-142da04d-bfc4-4206-9974-7e03eac06022 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:31.970349 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-142da04d-bfc4-4206-9974-7e03eac06022 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:31.970783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-142da04d-bfc4-4206-9974-7e03eac06022 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:31.971708 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-142da04d-bfc4-4206-9974-7e03eac06022 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:31.972317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-142da04d-bfc4-4206-9974-7e03eac06022 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:31.973451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-142da04d-bfc4-4206-9974-7e03eac06022 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:32.121426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-142da04d-bfc4-4206-9974-7e03eac06022 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:32.130113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-142da04d-bfc4-4206-9974-7e03eac06022 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:32.131665 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-142da04d-bfc4-4206-9974-7e03eac06022 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:32.132805 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-142da04d-bfc4-4206-9974-7e03eac06022 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1808 microversion: 2.20 time: 0.175380 Aug 10 12:44:32.133363 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 224/449] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:31 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:33.156327 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d9842323-df8d-40ec-86b1-30acdf97207f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:33.156942 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d9842323-df8d-40ec-86b1-30acdf97207f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:33.163892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d9842323-df8d-40ec-86b1-30acdf97207f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:33.164383 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d9842323-df8d-40ec-86b1-30acdf97207f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:33.165057 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d9842323-df8d-40ec-86b1-30acdf97207f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:33.165844 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d9842323-df8d-40ec-86b1-30acdf97207f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:33.166518 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d9842323-df8d-40ec-86b1-30acdf97207f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:33.166950 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d9842323-df8d-40ec-86b1-30acdf97207f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:33.310820 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d9842323-df8d-40ec-86b1-30acdf97207f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:33.320177 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d9842323-df8d-40ec-86b1-30acdf97207f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:33.321672 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d9842323-df8d-40ec-86b1-30acdf97207f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:33.322836 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d9842323-df8d-40ec-86b1-30acdf97207f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1808 microversion: 2.20 time: 0.170524 Aug 10 12:44:33.323612 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 226/450] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:33 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:34.344965 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f13472f2-6e9b-4608-8934-2cc35018c6cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:34.345898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f13472f2-6e9b-4608-8934-2cc35018c6cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:34.353614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f13472f2-6e9b-4608-8934-2cc35018c6cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:34.354009 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f13472f2-6e9b-4608-8934-2cc35018c6cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:34.354442 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f13472f2-6e9b-4608-8934-2cc35018c6cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:34.355145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f13472f2-6e9b-4608-8934-2cc35018c6cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:34.356004 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f13472f2-6e9b-4608-8934-2cc35018c6cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:34.356420 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f13472f2-6e9b-4608-8934-2cc35018c6cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:34.501752 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f13472f2-6e9b-4608-8934-2cc35018c6cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:34.510957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f13472f2-6e9b-4608-8934-2cc35018c6cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:34.512526 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f13472f2-6e9b-4608-8934-2cc35018c6cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:34.513677 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f13472f2-6e9b-4608-8934-2cc35018c6cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1808 microversion: 2.20 time: 0.172780 Aug 10 12:44:34.514234 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 225/451] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:34 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:35.541752 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fcd65004-c641-4631-9685-2ce516c010e5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:35.549091 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fcd65004-c641-4631-9685-2ce516c010e5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:35.563330 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fcd65004-c641-4631-9685-2ce516c010e5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:35.564526 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fcd65004-c641-4631-9685-2ce516c010e5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:35.598242 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fcd65004-c641-4631-9685-2ce516c010e5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:35.602922 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fcd65004-c641-4631-9685-2ce516c010e5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:35.605308 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fcd65004-c641-4631-9685-2ce516c010e5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:35.608625 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fcd65004-c641-4631-9685-2ce516c010e5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:35.940414 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fcd65004-c641-4631-9685-2ce516c010e5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:35.956767 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fcd65004-c641-4631-9685-2ce516c010e5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:35.959152 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fcd65004-c641-4631-9685-2ce516c010e5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:35.962536 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fcd65004-c641-4631-9685-2ce516c010e5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1808 microversion: 2.20 time: 0.427017 Aug 10 12:44:35.979687 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 227/452] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:35 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1808 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:36.990581 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5393c630-2682-4580-bcae-7cac4fa93ad8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:36.991389 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5393c630-2682-4580-bcae-7cac4fa93ad8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:36.999823 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5393c630-2682-4580-bcae-7cac4fa93ad8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:37.001009 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5393c630-2682-4580-bcae-7cac4fa93ad8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:37.001439 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5393c630-2682-4580-bcae-7cac4fa93ad8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:37.002320 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5393c630-2682-4580-bcae-7cac4fa93ad8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:37.002775 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5393c630-2682-4580-bcae-7cac4fa93ad8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:37.003216 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5393c630-2682-4580-bcae-7cac4fa93ad8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:37.314680 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5393c630-2682-4580-bcae-7cac4fa93ad8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:37.326190 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5393c630-2682-4580-bcae-7cac4fa93ad8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:37.329151 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5393c630-2682-4580-bcae-7cac4fa93ad8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:37.330797 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5393c630-2682-4580-bcae-7cac4fa93ad8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1808 microversion: 2.20 time: 0.345197 Aug 10 12:44:37.331902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 226/453] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:36 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1808 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:38.354481 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9d3fa434-bb50-4b7d-b339-e5f221b9497a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:38.355080 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9d3fa434-bb50-4b7d-b339-e5f221b9497a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:38.361389 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d3fa434-bb50-4b7d-b339-e5f221b9497a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:38.361863 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d3fa434-bb50-4b7d-b339-e5f221b9497a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:38.362293 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d3fa434-bb50-4b7d-b339-e5f221b9497a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:38.363262 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d3fa434-bb50-4b7d-b339-e5f221b9497a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:38.364412 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d3fa434-bb50-4b7d-b339-e5f221b9497a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:38.364828 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d3fa434-bb50-4b7d-b339-e5f221b9497a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:38.505839 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9d3fa434-bb50-4b7d-b339-e5f221b9497a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:38.514604 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9d3fa434-bb50-4b7d-b339-e5f221b9497a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:38.516499 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9d3fa434-bb50-4b7d-b339-e5f221b9497a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:38.517736 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9d3fa434-bb50-4b7d-b339-e5f221b9497a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1808 microversion: 2.20 time: 0.167255 Aug 10 12:44:38.518295 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 228/454] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:38 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:39.540904 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9d28a376-6655-44f6-9f4f-b02fa8ca404d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:39.542195 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9d28a376-6655-44f6-9f4f-b02fa8ca404d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:39.549431 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d28a376-6655-44f6-9f4f-b02fa8ca404d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:39.555858 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d28a376-6655-44f6-9f4f-b02fa8ca404d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:39.555858 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d28a376-6655-44f6-9f4f-b02fa8ca404d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:39.555858 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d28a376-6655-44f6-9f4f-b02fa8ca404d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:39.555858 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d28a376-6655-44f6-9f4f-b02fa8ca404d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:39.556214 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d28a376-6655-44f6-9f4f-b02fa8ca404d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:39.757921 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9d28a376-6655-44f6-9f4f-b02fa8ca404d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:39.777813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9d28a376-6655-44f6-9f4f-b02fa8ca404d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:39.779930 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9d28a376-6655-44f6-9f4f-b02fa8ca404d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:39.781295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9d28a376-6655-44f6-9f4f-b02fa8ca404d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1808 microversion: 2.20 time: 0.244387 Aug 10 12:44:39.782385 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 227/455] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:39 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1808 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:40.805555 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-eba045fa-bcae-42e5-8acc-8751d5f64ef0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:40.806829 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-eba045fa-bcae-42e5-8acc-8751d5f64ef0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:40.813271 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eba045fa-bcae-42e5-8acc-8751d5f64ef0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:40.814079 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eba045fa-bcae-42e5-8acc-8751d5f64ef0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:40.814774 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eba045fa-bcae-42e5-8acc-8751d5f64ef0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:40.815747 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eba045fa-bcae-42e5-8acc-8751d5f64ef0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:40.816958 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eba045fa-bcae-42e5-8acc-8751d5f64ef0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:40.817749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eba045fa-bcae-42e5-8acc-8751d5f64ef0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:40.970380 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-eba045fa-bcae-42e5-8acc-8751d5f64ef0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:40.981088 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-eba045fa-bcae-42e5-8acc-8751d5f64ef0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:40.982686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-eba045fa-bcae-42e5-8acc-8751d5f64ef0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:40.984213 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-eba045fa-bcae-42e5-8acc-8751d5f64ef0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1808 microversion: 2.20 time: 0.182618 Aug 10 12:44:40.999801 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 229/456] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:40 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:42.009884 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6e513939-4f02-44ee-9061-ece272e22b05 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:42.010724 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6e513939-4f02-44ee-9061-ece272e22b05 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:42.017525 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6e513939-4f02-44ee-9061-ece272e22b05 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:42.018015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6e513939-4f02-44ee-9061-ece272e22b05 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:42.019098 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6e513939-4f02-44ee-9061-ece272e22b05 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:42.020580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6e513939-4f02-44ee-9061-ece272e22b05 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:42.021057 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6e513939-4f02-44ee-9061-ece272e22b05 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:42.021545 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6e513939-4f02-44ee-9061-ece272e22b05 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:42.204693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6e513939-4f02-44ee-9061-ece272e22b05 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:42.214997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6e513939-4f02-44ee-9061-ece272e22b05 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:42.216612 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6e513939-4f02-44ee-9061-ece272e22b05 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:42.217783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6e513939-4f02-44ee-9061-ece272e22b05 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1808 microversion: 2.20 time: 0.211853 Aug 10 12:44:42.220524 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 228/457] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:42 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1808 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:43.203665 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4f030b5f-e09a-4811-bf6f-8447015723d3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d435d52-7025-4eb5-97f9-cd775f5c3424"}} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:44:43.206141 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4f030b5f-e09a-4811-bf6f-8447015723d3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:43.213571 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4f030b5f-e09a-4811-bf6f-8447015723d3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:43.214057 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4f030b5f-e09a-4811-bf6f-8447015723d3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:43.214496 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4f030b5f-e09a-4811-bf6f-8447015723d3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:43.215211 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4f030b5f-e09a-4811-bf6f-8447015723d3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:43.215664 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4f030b5f-e09a-4811-bf6f-8447015723d3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:43.216088 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4f030b5f-e09a-4811-bf6f-8447015723d3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:43.241877 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3c9b693f-eab9-40e9-b166-61d9e418cfe0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:43.242490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3c9b693f-eab9-40e9-b166-61d9e418cfe0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:43.249916 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c9b693f-eab9-40e9-b166-61d9e418cfe0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:43.250762 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c9b693f-eab9-40e9-b166-61d9e418cfe0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:43.251418 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c9b693f-eab9-40e9-b166-61d9e418cfe0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:43.252305 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c9b693f-eab9-40e9-b166-61d9e418cfe0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:43.253001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c9b693f-eab9-40e9-b166-61d9e418cfe0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:43.253578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c9b693f-eab9-40e9-b166-61d9e418cfe0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:43.409591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3c9b693f-eab9-40e9-b166-61d9e418cfe0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:43.419090 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3c9b693f-eab9-40e9-b166-61d9e418cfe0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:43.420655 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3c9b693f-eab9-40e9-b166-61d9e418cfe0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:43.422023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3c9b693f-eab9-40e9-b166-61d9e418cfe0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1808 microversion: 2.20 time: 0.184986 Aug 10 12:44:43.422634 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 229/458] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:43 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:44.030622 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4f030b5f-e09a-4811-bf6f-8447015723d3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "POST /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.831594 Aug 10 12:44:44.031344 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 230/459] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 10 12:44:43 2022] POST /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 194 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:44:44.272205 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d85a82ef-a1e0-41db-bb54-49553e2b8a48 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f20fae1b-31eb-4842-96ec-e2b76745be2d", "device": "/dev/sdb"}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:44:44.275239 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d85a82ef-a1e0-41db-bb54-49553e2b8a48 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:44.286662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d85a82ef-a1e0-41db-bb54-49553e2b8a48 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:44.286662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d85a82ef-a1e0-41db-bb54-49553e2b8a48 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:44.286662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d85a82ef-a1e0-41db-bb54-49553e2b8a48 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:44.286662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d85a82ef-a1e0-41db-bb54-49553e2b8a48 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:44.287321 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d85a82ef-a1e0-41db-bb54-49553e2b8a48 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:44.287321 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d85a82ef-a1e0-41db-bb54-49553e2b8a48 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:44.447499 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-03003d06-efc5-4652-9cef-490044db1869 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:44.448801 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-03003d06-efc5-4652-9cef-490044db1869 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:44.455482 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-03003d06-efc5-4652-9cef-490044db1869 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:44.456176 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-03003d06-efc5-4652-9cef-490044db1869 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:44.456773 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-03003d06-efc5-4652-9cef-490044db1869 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:44.458081 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-03003d06-efc5-4652-9cef-490044db1869 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:44.458706 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-03003d06-efc5-4652-9cef-490044db1869 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:44.459131 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-03003d06-efc5-4652-9cef-490044db1869 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:44.634909 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-03003d06-efc5-4652-9cef-490044db1869 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:44.637938 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:44:44.647064 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-03003d06-efc5-4652-9cef-490044db1869 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:44.650349 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-03003d06-efc5-4652-9cef-490044db1869 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:44.650349 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-03003d06-efc5-4652-9cef-490044db1869 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1808 microversion: 2.20 time: 0.206994 Aug 10 12:44:44.662925 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 231/460] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:44 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:44:45.677679 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f662bb62-65c3-4dc2-b0c2-c383993d1e61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:45.678407 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f662bb62-65c3-4dc2-b0c2-c383993d1e61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:45.686164 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f662bb62-65c3-4dc2-b0c2-c383993d1e61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:45.686653 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f662bb62-65c3-4dc2-b0c2-c383993d1e61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:45.687270 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f662bb62-65c3-4dc2-b0c2-c383993d1e61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:45.687949 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f662bb62-65c3-4dc2-b0c2-c383993d1e61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:45.688405 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f662bb62-65c3-4dc2-b0c2-c383993d1e61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:45.688834 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f662bb62-65c3-4dc2-b0c2-c383993d1e61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:45.854934 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f662bb62-65c3-4dc2-b0c2-c383993d1e61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:45.865310 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f662bb62-65c3-4dc2-b0c2-c383993d1e61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:45.874805 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f662bb62-65c3-4dc2-b0c2-c383993d1e61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:45.876056 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f662bb62-65c3-4dc2-b0c2-c383993d1e61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1808 microversion: 2.20 time: 0.202874 Aug 10 12:44:45.879681 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 232/461] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:45 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:44:46.030850 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d85a82ef-a1e0-41db-bb54-49553e2b8a48 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "POST /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.763427 Aug 10 12:44:46.031569 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 230/462] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 10 12:44:44 2022] POST /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a/os-volume_attachments => generated 194 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:44:46.903912 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5d0a8639-d6c6-45ee-a195-76383830173b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:46.905732 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5d0a8639-d6c6-45ee-a195-76383830173b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:46.914474 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d0a8639-d6c6-45ee-a195-76383830173b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:46.914951 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d0a8639-d6c6-45ee-a195-76383830173b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:46.915462 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d0a8639-d6c6-45ee-a195-76383830173b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:46.916153 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d0a8639-d6c6-45ee-a195-76383830173b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:46.916599 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d0a8639-d6c6-45ee-a195-76383830173b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:46.917016 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d0a8639-d6c6-45ee-a195-76383830173b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:47.120397 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5d0a8639-d6c6-45ee-a195-76383830173b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:47.131600 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5d0a8639-d6c6-45ee-a195-76383830173b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:47.134335 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5d0a8639-d6c6-45ee-a195-76383830173b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:47.135773 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5d0a8639-d6c6-45ee-a195-76383830173b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1808 microversion: 2.20 time: 0.236959 Aug 10 12:44:47.136798 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 233/463] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:46 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1808 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:48.167392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2a62b1c1-e402-4a88-b758-128daa55b714 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:48.169260 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2a62b1c1-e402-4a88-b758-128daa55b714 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:48.177671 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:44:48.179848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a62b1c1-e402-4a88-b758-128daa55b714 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:48.180679 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a62b1c1-e402-4a88-b758-128daa55b714 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:48.181319 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a62b1c1-e402-4a88-b758-128daa55b714 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:48.188707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a62b1c1-e402-4a88-b758-128daa55b714 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:48.188707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a62b1c1-e402-4a88-b758-128daa55b714 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:48.188707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a62b1c1-e402-4a88-b758-128daa55b714 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:48.199509 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:44:48.333473 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2a62b1c1-e402-4a88-b758-128daa55b714 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:48.342770 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2a62b1c1-e402-4a88-b758-128daa55b714 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:48.344507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2a62b1c1-e402-4a88-b758-128daa55b714 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:48.349880 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2a62b1c1-e402-4a88-b758-128daa55b714 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1808 microversion: 2.20 time: 0.183494 Aug 10 12:44:48.349880 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 231/464] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:48 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:49.369863 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8f8f6a6e-86cd-46bf-b3f8-6377708e1a7b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:49.371252 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8f8f6a6e-86cd-46bf-b3f8-6377708e1a7b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:49.378185 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8f8f6a6e-86cd-46bf-b3f8-6377708e1a7b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:49.379076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8f8f6a6e-86cd-46bf-b3f8-6377708e1a7b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:49.380216 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8f8f6a6e-86cd-46bf-b3f8-6377708e1a7b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:49.381239 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8f8f6a6e-86cd-46bf-b3f8-6377708e1a7b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:49.381698 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8f8f6a6e-86cd-46bf-b3f8-6377708e1a7b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:49.382294 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8f8f6a6e-86cd-46bf-b3f8-6377708e1a7b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:49.464019 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-d471b444-76ba-439e-9520-c6b9813fa0b4 req-2acac961-50ee-4061-8377-ad096cf71a4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "572a91d2-8a56-4616-97e4-b0d48cc57ea5", "name": "network-vif-plugged", "status": "completed", "tag": "5bdde102-3780-4fb4-a112-3f9af85f6b61"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:44:49.487101 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-d471b444-76ba-439e-9520-c6b9813fa0b4 req-2acac961-50ee-4061-8377-ad096cf71a4c service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:49.487101 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-d471b444-76ba-439e-9520-c6b9813fa0b4 req-2acac961-50ee-4061-8377-ad096cf71a4c service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:49.487101 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-d471b444-76ba-439e-9520-c6b9813fa0b4 req-2acac961-50ee-4061-8377-ad096cf71a4c service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:49.520545 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-d471b444-76ba-439e-9520-c6b9813fa0b4 req-2acac961-50ee-4061-8377-ad096cf71a4c service nova] Creating event network-vif-plugged:5bdde102-3780-4fb4-a112-3f9af85f6b61 for instance 572a91d2-8a56-4616-97e4-b0d48cc57ea5 on hv-cinder-85199 Aug 10 12:44:49.525787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-d471b444-76ba-439e-9520-c6b9813fa0b4 req-2acac961-50ee-4061-8377-ad096cf71a4c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065503 Aug 10 12:44:49.526461 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 232/465] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:44:49.576910 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-8f8f6a6e-86cd-46bf-b3f8-6377708e1a7b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:49.588040 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-8f8f6a6e-86cd-46bf-b3f8-6377708e1a7b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:49.591300 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-8f8f6a6e-86cd-46bf-b3f8-6377708e1a7b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:49.592217 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8f8f6a6e-86cd-46bf-b3f8-6377708e1a7b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1808 microversion: 2.20 time: 0.226278 Aug 10 12:44:49.593458 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 234/466] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:49 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1808 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:50.619901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-68572e0a-3682-4f65-8cbe-04c65d7625c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:50.620601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-68572e0a-3682-4f65-8cbe-04c65d7625c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:50.627564 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68572e0a-3682-4f65-8cbe-04c65d7625c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:50.628045 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68572e0a-3682-4f65-8cbe-04c65d7625c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:50.628778 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68572e0a-3682-4f65-8cbe-04c65d7625c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:50.629609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68572e0a-3682-4f65-8cbe-04c65d7625c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:50.630058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68572e0a-3682-4f65-8cbe-04c65d7625c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:50.630485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68572e0a-3682-4f65-8cbe-04c65d7625c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:50.794065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-68572e0a-3682-4f65-8cbe-04c65d7625c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:50.803488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-68572e0a-3682-4f65-8cbe-04c65d7625c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:50.805342 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-68572e0a-3682-4f65-8cbe-04c65d7625c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:50.806521 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-68572e0a-3682-4f65-8cbe-04c65d7625c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1808 microversion: 2.20 time: 0.191608 Aug 10 12:44:50.807081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 233/467] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:50 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:44:51.829285 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b2f45851-fea7-4146-b103-f0f85383a0cf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:51.830587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b2f45851-fea7-4146-b103-f0f85383a0cf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:51.837760 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2f45851-fea7-4146-b103-f0f85383a0cf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:51.838251 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2f45851-fea7-4146-b103-f0f85383a0cf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:51.838671 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2f45851-fea7-4146-b103-f0f85383a0cf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:51.839392 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2f45851-fea7-4146-b103-f0f85383a0cf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:51.839835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2f45851-fea7-4146-b103-f0f85383a0cf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:51.840476 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2f45851-fea7-4146-b103-f0f85383a0cf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:51.992982 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b2f45851-fea7-4146-b103-f0f85383a0cf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:52.009903 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b2f45851-fea7-4146-b103-f0f85383a0cf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:52.012157 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b2f45851-fea7-4146-b103-f0f85383a0cf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:52.014164 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b2f45851-fea7-4146-b103-f0f85383a0cf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1808 microversion: 2.20 time: 0.188581 Aug 10 12:44:52.016870 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 235/468] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:51 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:53.041255 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8130abf1-6e3f-433b-8c86-506ff1b06330 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:53.041840 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8130abf1-6e3f-433b-8c86-506ff1b06330 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:53.048292 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8130abf1-6e3f-433b-8c86-506ff1b06330 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:53.048766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8130abf1-6e3f-433b-8c86-506ff1b06330 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:53.049192 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8130abf1-6e3f-433b-8c86-506ff1b06330 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:53.049871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8130abf1-6e3f-433b-8c86-506ff1b06330 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:53.050317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8130abf1-6e3f-433b-8c86-506ff1b06330 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:53.050737 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8130abf1-6e3f-433b-8c86-506ff1b06330 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:53.184796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8130abf1-6e3f-433b-8c86-506ff1b06330 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:53.193942 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8130abf1-6e3f-433b-8c86-506ff1b06330 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:53.195576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8130abf1-6e3f-433b-8c86-506ff1b06330 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:53.196744 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8130abf1-6e3f-433b-8c86-506ff1b06330 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1808 microversion: 2.20 time: 0.159431 Aug 10 12:44:53.197296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 234/469] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:53 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:44:53.820532 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c13afc21-baf3-40fa-82c3-30f87f48f0c0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:44:53.822764 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c13afc21-baf3-40fa-82c3-30f87f48f0c0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:53.829263 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c13afc21-baf3-40fa-82c3-30f87f48f0c0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:53.832435 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c13afc21-baf3-40fa-82c3-30f87f48f0c0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:53.832435 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c13afc21-baf3-40fa-82c3-30f87f48f0c0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:53.832435 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c13afc21-baf3-40fa-82c3-30f87f48f0c0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:53.832435 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c13afc21-baf3-40fa-82c3-30f87f48f0c0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:53.832842 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c13afc21-baf3-40fa-82c3-30f87f48f0c0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:53.855117 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.objects.instance [None req-c13afc21-baf3-40fa-82c3-30f87f48f0c0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lazy-loading 'flavor' on Instance uuid 3181426f-eb81-4712-97c6-8c92b61f53a0 {{(pid=124642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:44:54.214446 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c13afc21-baf3-40fa-82c3-30f87f48f0c0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "POST /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/action" status: 200 len: 32 microversion: 2.1 time: 0.398050 Aug 10 12:44:54.215460 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 236/470] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 10 12:44:53 2022] POST /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/action => generated 32 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 12:44:54.219862 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-89ca4843-d791-429f-b78a-ec6ba6a26aa7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:54.220391 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-89ca4843-d791-429f-b78a-ec6ba6a26aa7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:54.226569 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9b1ad0d4-8cb7-4392-8b17-68c6e9ff2108 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:54.226569 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9b1ad0d4-8cb7-4392-8b17-68c6e9ff2108 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:54.226841 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-89ca4843-d791-429f-b78a-ec6ba6a26aa7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:54.227470 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-89ca4843-d791-429f-b78a-ec6ba6a26aa7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:54.227904 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-89ca4843-d791-429f-b78a-ec6ba6a26aa7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:54.228617 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-89ca4843-d791-429f-b78a-ec6ba6a26aa7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:54.229069 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-89ca4843-d791-429f-b78a-ec6ba6a26aa7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:54.229494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-89ca4843-d791-429f-b78a-ec6ba6a26aa7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:54.232135 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b1ad0d4-8cb7-4392-8b17-68c6e9ff2108 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:54.232621 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b1ad0d4-8cb7-4392-8b17-68c6e9ff2108 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:54.233053 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b1ad0d4-8cb7-4392-8b17-68c6e9ff2108 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:54.233749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b1ad0d4-8cb7-4392-8b17-68c6e9ff2108 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:54.234337 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b1ad0d4-8cb7-4392-8b17-68c6e9ff2108 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:54.234763 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b1ad0d4-8cb7-4392-8b17-68c6e9ff2108 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:54.531613 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9b1ad0d4-8cb7-4392-8b17-68c6e9ff2108 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:54.534496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-89ca4843-d791-429f-b78a-ec6ba6a26aa7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:54.540470 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9b1ad0d4-8cb7-4392-8b17-68c6e9ff2108 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.319407 Aug 10 12:44:54.541044 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 237/471] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:54 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:44:54.559454 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-89ca4843-d791-429f-b78a-ec6ba6a26aa7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:54.559454 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-89ca4843-d791-429f-b78a-ec6ba6a26aa7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:54.559454 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-89ca4843-d791-429f-b78a-ec6ba6a26aa7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1795 microversion: 2.20 time: 0.330757 Aug 10 12:44:54.560081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 235/472] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:44:54 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1795 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:44:55.562839 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-60ebf2ae-ba77-477c-af71-892503f564cb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:55.563449 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-60ebf2ae-ba77-477c-af71-892503f564cb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:55.569889 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60ebf2ae-ba77-477c-af71-892503f564cb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:55.570367 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60ebf2ae-ba77-477c-af71-892503f564cb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:55.570798 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60ebf2ae-ba77-477c-af71-892503f564cb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:55.571524 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60ebf2ae-ba77-477c-af71-892503f564cb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:55.571983 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60ebf2ae-ba77-477c-af71-892503f564cb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:55.572410 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60ebf2ae-ba77-477c-af71-892503f564cb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:55.705009 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-60ebf2ae-ba77-477c-af71-892503f564cb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:55.713672 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-60ebf2ae-ba77-477c-af71-892503f564cb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.154851 Aug 10 12:44:55.714245 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 238/473] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:55 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:56.737036 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9a58a2a7-e732-4e40-bcaa-0f4e9039d9d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:56.738008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9a58a2a7-e732-4e40-bcaa-0f4e9039d9d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:56.745262 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a58a2a7-e732-4e40-bcaa-0f4e9039d9d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:56.745864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a58a2a7-e732-4e40-bcaa-0f4e9039d9d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:56.746307 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a58a2a7-e732-4e40-bcaa-0f4e9039d9d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:56.747010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a58a2a7-e732-4e40-bcaa-0f4e9039d9d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:56.747485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a58a2a7-e732-4e40-bcaa-0f4e9039d9d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:56.747911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a58a2a7-e732-4e40-bcaa-0f4e9039d9d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:56.884522 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9a58a2a7-e732-4e40-bcaa-0f4e9039d9d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:56.892786 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9a58a2a7-e732-4e40-bcaa-0f4e9039d9d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.160620 Aug 10 12:44:56.893361 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 236/474] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:56 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:57.914197 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a2890f7e-f9f4-494e-84f0-a101ac7224ac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:57.914800 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a2890f7e-f9f4-494e-84f0-a101ac7224ac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:57.921263 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2890f7e-f9f4-494e-84f0-a101ac7224ac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:57.921743 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2890f7e-f9f4-494e-84f0-a101ac7224ac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:57.922182 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2890f7e-f9f4-494e-84f0-a101ac7224ac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:57.922868 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2890f7e-f9f4-494e-84f0-a101ac7224ac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:57.923496 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2890f7e-f9f4-494e-84f0-a101ac7224ac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:57.923928 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2890f7e-f9f4-494e-84f0-a101ac7224ac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:58.055830 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a2890f7e-f9f4-494e-84f0-a101ac7224ac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:58.063700 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a2890f7e-f9f4-494e-84f0-a101ac7224ac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.153471 Aug 10 12:44:58.064270 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 239/475] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:57 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:44:59.085614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8e1a160f-9966-49e4-929d-99d21032f7c3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:44:59.086213 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8e1a160f-9966-49e4-929d-99d21032f7c3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:44:59.092767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8e1a160f-9966-49e4-929d-99d21032f7c3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:59.093251 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8e1a160f-9966-49e4-929d-99d21032f7c3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:59.093682 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8e1a160f-9966-49e4-929d-99d21032f7c3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:59.094364 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8e1a160f-9966-49e4-929d-99d21032f7c3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:44:59.094812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8e1a160f-9966-49e4-929d-99d21032f7c3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:44:59.095262 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8e1a160f-9966-49e4-929d-99d21032f7c3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:44:59.224708 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8e1a160f-9966-49e4-929d-99d21032f7c3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:44:59.232577 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8e1a160f-9966-49e4-929d-99d21032f7c3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.151107 Aug 10 12:44:59.233157 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 237/476] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:44:59 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:00.255474 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e625b34a-00df-4132-97da-de179057b9b3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:00.256099 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e625b34a-00df-4132-97da-de179057b9b3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:00.262579 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e625b34a-00df-4132-97da-de179057b9b3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:00.263055 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e625b34a-00df-4132-97da-de179057b9b3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:00.263516 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e625b34a-00df-4132-97da-de179057b9b3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:00.264223 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e625b34a-00df-4132-97da-de179057b9b3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:00.269003 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e625b34a-00df-4132-97da-de179057b9b3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:00.269003 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e625b34a-00df-4132-97da-de179057b9b3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:00.395408 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e625b34a-00df-4132-97da-de179057b9b3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:00.403277 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e625b34a-00df-4132-97da-de179057b9b3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.152387 Aug 10 12:45:00.403852 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 240/477] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:00 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:01.425025 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ac31b891-628f-47a4-83ac-1e07bd33881f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:01.425624 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ac31b891-628f-47a4-83ac-1e07bd33881f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:01.433175 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac31b891-628f-47a4-83ac-1e07bd33881f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:01.433660 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac31b891-628f-47a4-83ac-1e07bd33881f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:01.434096 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac31b891-628f-47a4-83ac-1e07bd33881f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:01.434796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac31b891-628f-47a4-83ac-1e07bd33881f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:01.435294 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac31b891-628f-47a4-83ac-1e07bd33881f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:01.435748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac31b891-628f-47a4-83ac-1e07bd33881f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:01.577836 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ac31b891-628f-47a4-83ac-1e07bd33881f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:01.585917 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ac31b891-628f-47a4-83ac-1e07bd33881f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.164884 Aug 10 12:45:01.586484 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 238/478] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:01 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:02.605950 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ece0abf1-a065-4968-8d9b-e2b4fbf49367 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:02.606567 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ece0abf1-a065-4968-8d9b-e2b4fbf49367 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:02.609064 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=32 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:45:02.613948 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ece0abf1-a065-4968-8d9b-e2b4fbf49367 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:02.614432 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ece0abf1-a065-4968-8d9b-e2b4fbf49367 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:02.615136 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ece0abf1-a065-4968-8d9b-e2b4fbf49367 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:02.615631 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ece0abf1-a065-4968-8d9b-e2b4fbf49367 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:02.616087 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ece0abf1-a065-4968-8d9b-e2b4fbf49367 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:02.616513 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ece0abf1-a065-4968-8d9b-e2b4fbf49367 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:02.747265 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ece0abf1-a065-4968-8d9b-e2b4fbf49367 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:02.755573 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ece0abf1-a065-4968-8d9b-e2b4fbf49367 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.152907 Aug 10 12:45:02.756471 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 241/479] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:02 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:03.776209 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-58c6729c-33d6-4554-aa9d-cd31a67c5949 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:03.776803 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-58c6729c-33d6-4554-aa9d-cd31a67c5949 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:03.783137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-58c6729c-33d6-4554-aa9d-cd31a67c5949 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:03.783652 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-58c6729c-33d6-4554-aa9d-cd31a67c5949 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:03.784089 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-58c6729c-33d6-4554-aa9d-cd31a67c5949 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:03.784776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-58c6729c-33d6-4554-aa9d-cd31a67c5949 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:03.785230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-58c6729c-33d6-4554-aa9d-cd31a67c5949 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:03.785653 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-58c6729c-33d6-4554-aa9d-cd31a67c5949 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:03.914412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-58c6729c-33d6-4554-aa9d-cd31a67c5949 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:03.922346 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-58c6729c-33d6-4554-aa9d-cd31a67c5949 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.150028 Aug 10 12:45:03.922914 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 239/480] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:03 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:04.378823 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1c053dbf-4bdf-4cc4-be47-96f1dbaa8a6e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:04.379427 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1c053dbf-4bdf-4cc4-be47-96f1dbaa8a6e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:04.386672 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c053dbf-4bdf-4cc4-be47-96f1dbaa8a6e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:04.387154 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c053dbf-4bdf-4cc4-be47-96f1dbaa8a6e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:04.387614 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c053dbf-4bdf-4cc4-be47-96f1dbaa8a6e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:04.388308 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c053dbf-4bdf-4cc4-be47-96f1dbaa8a6e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:04.388757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c053dbf-4bdf-4cc4-be47-96f1dbaa8a6e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:04.389191 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c053dbf-4bdf-4cc4-be47-96f1dbaa8a6e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:04.413007 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1c053dbf-4bdf-4cc4-be47-96f1dbaa8a6e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36/ips" status: 200 len: 150 microversion: 2.1 time: 0.038169 Aug 10 12:45:04.413582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 242/481] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 10 12:45:04 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:45:04.425123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-46b2df3c-c877-487b-83ff-03f924f86a7f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71d6da2e-35ff-4038-9ec8-9618a65cf0cf"}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:45:04.427785 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-46b2df3c-c877-487b-83ff-03f924f86a7f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:04.433670 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-46b2df3c-c877-487b-83ff-03f924f86a7f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:04.434146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-46b2df3c-c877-487b-83ff-03f924f86a7f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:04.434574 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-46b2df3c-c877-487b-83ff-03f924f86a7f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:04.435277 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-46b2df3c-c877-487b-83ff-03f924f86a7f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:04.435724 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-46b2df3c-c877-487b-83ff-03f924f86a7f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:04.436141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-46b2df3c-c877-487b-83ff-03f924f86a7f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:04.513929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-46b2df3c-c877-487b-83ff-03f924f86a7f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] HTTP exception thrown: Invalid volume: volume 71d6da2e-35ff-4038-9ec8-9618a65cf0cf is already attached to instances: fad49521-8b28-4a9f-a4a0-88e41b5a1566 Aug 10 12:45:04.515865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-46b2df3c-c877-487b-83ff-03f924f86a7f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Request method failure captured: Aug 10 12:45:04.515865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: POST /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36/os-volume_attachments HTTP/1.1 Aug 10 12:45:04.515865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 12:45:04.515865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 12:45:04.515865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 12:45:04.515865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 74 Aug 10 12:45:04.515865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 12:45:04.515865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 12:45:04.515865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 12:45:04.515865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 12:45:04.515865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86eGBGdgG-u30FY8ayuf9_oWfGm9Ue4wmiSD5HqZh9YFv6FZKb_K68ZxcABXBS1rsdBpDNgeZy47c1LKjpCTnjQZpQhdzFdsloDzIBkPWEMNrwJi0km_Dv-TGwCe6OdPlftNtoByFeD3k29rbgMXrfvFX26pc9GnUHHvgZESD2gvxTQ Aug 10 12:45:04.515865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 12:45:04.515865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 12:45:04.515865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 12:45:04.515865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 12:45:04.515865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 12:45:04.515865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 12:45:04.515865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: a2857015013f466d95f3a9037925c6fc Aug 10 12:45:04.515865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 12:45:04.515865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 12:45:04.515865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 12:45:04.517368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2857015013f466d95f3a9037925c6fc", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 12:45:04.517368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 12:45:04.517368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: a2857015013f466d95f3a9037925c6fc Aug 10 12:45:04.517368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 12:45:04.517368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-AttachVolumeNegativeTest-1707265238-project Aug 10 12:45:04.517368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 12:45:04.517368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 12:45:04.517368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 570c2a77b862411083b9444f8292192b Aug 10 12:45:04.517368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-AttachVolumeNegativeTest-1707265238-project Aug 10 12:45:04.517368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Aug 10 12:45:04.517368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {"volumeAttachment": {"volumeId": "71d6da2e-35ff-4038-9ec8-9618a65cf0cf"}} Aug 10 12:45:04.517368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 12:45:04.518141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Invalid volume: volume 71d6da2e-35ff-4038-9ec8-9618a65cf0cf is already attached to instances: fad49521-8b28-4a9f-a4a0-88e41b5a1566 Aug 10 12:45:04.518141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'server_id': '9d0315a8-29f9-4d6e-9298-f5a1d0d69e36', 'body': {'volumeAttachment': {'volumeId': '71d6da2e-35ff-4038-9ec8-9618a65cf0cf'}}} Aug 10 12:45:04.518141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:45:04.518141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:45:04.518141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 12:45:04.518141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 12:45:04.518141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 12:45:04.518141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 12:45:04.518141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 12:45:04.518141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 12:45:04.518141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 10 12:45:04.518141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 10 12:45:04.518141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 10 12:45:04.518141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 10 12:45:04.518141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 71d6da2e-35ff-4038-9ec8-9618a65cf0cf is already attached to instances: fad49521-8b28-4a9f-a4a0-88e41b5a1566 Aug 10 12:45:04.518141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:45:04.518141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:45:04.518141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:45:04.518141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:45:04.519377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:45:04.519377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:45:04.519377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:45:04.519377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:45:04.519377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:45:04.519377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:45:04.519377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 12:45:04.519377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 12:45:04.519377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 12:45:04.519377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 12:45:04.519377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 12:45:04.519377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 12:45:04.519377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 10 12:45:04.519377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 12:45:04.519377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 71d6da2e-35ff-4038-9ec8-9618a65cf0cf is already attached to instances: fad49521-8b28-4a9f-a4a0-88e41b5a1566 Aug 10 12:45:04.519377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:45:04.519377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:45:04.519377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:45:04.519377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:45:04.519377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:45:04.520601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:45:04.520601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:45:04.520601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:45:04.520601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 71d6da2e-35ff-4038-9ec8-9618a65cf0cf is already attached to instances: fad49521-8b28-4a9f-a4a0-88e41b5a1566 Aug 10 12:45:04.520601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:45:04.520601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-46b2df3c-c877-487b-83ff-03f924f86a7f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Returning 400 to user: Invalid volume: volume 71d6da2e-35ff-4038-9ec8-9618a65cf0cf is already attached to instances: fad49521-8b28-4a9f-a4a0-88e41b5a1566 {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:45:04.520601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-46b2df3c-c877-487b-83ff-03f924f86a7f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "POST /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096206 Aug 10 12:45:04.520601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 240/482] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 10 12:45:04 2022] POST /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 12:45:04.528693 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8ab98c8f-d2c8-4d9e-a9bb-a35b08bab494 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:04.529194 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8ab98c8f-d2c8-4d9e-a9bb-a35b08bab494 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:04.536508 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8ab98c8f-d2c8-4d9e-a9bb-a35b08bab494 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:04.537118 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8ab98c8f-d2c8-4d9e-a9bb-a35b08bab494 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:04.537563 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8ab98c8f-d2c8-4d9e-a9bb-a35b08bab494 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:04.538252 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8ab98c8f-d2c8-4d9e-a9bb-a35b08bab494 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:04.538735 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8ab98c8f-d2c8-4d9e-a9bb-a35b08bab494 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:04.539161 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8ab98c8f-d2c8-4d9e-a9bb-a35b08bab494 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:04.563512 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8ab98c8f-d2c8-4d9e-a9bb-a35b08bab494 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Going to try to terminate instance {{(pid=124642) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:45:04.872610 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8ab98c8f-d2c8-4d9e-a9bb-a35b08bab494 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 204 len: 0 microversion: 2.1 time: 0.349439 Aug 10 12:45:04.873199 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 243/483] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 12:45:04 2022] DELETE /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 12:45:04.882605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-73b74e86-a6a0-4207-8aab-2d2f518e1f65 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:04.883239 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-73b74e86-a6a0-4207-8aab-2d2f518e1f65 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:04.890412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73b74e86-a6a0-4207-8aab-2d2f518e1f65 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:04.890810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73b74e86-a6a0-4207-8aab-2d2f518e1f65 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:04.891273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73b74e86-a6a0-4207-8aab-2d2f518e1f65 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:04.891959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73b74e86-a6a0-4207-8aab-2d2f518e1f65 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:04.892404 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73b74e86-a6a0-4207-8aab-2d2f518e1f65 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:04.892821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73b74e86-a6a0-4207-8aab-2d2f518e1f65 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:04.945420 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-cdcfdb5c-2148-4e2f-b7b1-b03f72420d87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:04.946195 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-cdcfdb5c-2148-4e2f-b7b1-b03f72420d87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:04.952270 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cdcfdb5c-2148-4e2f-b7b1-b03f72420d87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:04.952759 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cdcfdb5c-2148-4e2f-b7b1-b03f72420d87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:04.953231 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cdcfdb5c-2148-4e2f-b7b1-b03f72420d87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:04.953929 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cdcfdb5c-2148-4e2f-b7b1-b03f72420d87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:04.954390 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cdcfdb5c-2148-4e2f-b7b1-b03f72420d87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:04.954818 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cdcfdb5c-2148-4e2f-b7b1-b03f72420d87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:05.066398 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-73b74e86-a6a0-4207-8aab-2d2f518e1f65 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:05.074395 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-73b74e86-a6a0-4207-8aab-2d2f518e1f65 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1682 microversion: 2.1 time: 0.196779 Aug 10 12:45:05.074982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 241/484] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:04 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1682 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:45:05.111341 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-cdcfdb5c-2148-4e2f-b7b1-b03f72420d87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:05.120080 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-cdcfdb5c-2148-4e2f-b7b1-b03f72420d87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.179257 Aug 10 12:45:05.120651 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 244/485] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:04 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:45:06.101588 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c7deef37-3468-48ea-996d-548e108e7960 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:06.102198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c7deef37-3468-48ea-996d-548e108e7960 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:06.108586 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7deef37-3468-48ea-996d-548e108e7960 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:06.109061 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7deef37-3468-48ea-996d-548e108e7960 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:06.109490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7deef37-3468-48ea-996d-548e108e7960 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:06.110174 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7deef37-3468-48ea-996d-548e108e7960 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:06.110621 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7deef37-3468-48ea-996d-548e108e7960 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:06.111044 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7deef37-3468-48ea-996d-548e108e7960 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:06.140914 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7faad6a1-a1b3-4bc2-aed3-d2f160ac870d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:06.141519 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7faad6a1-a1b3-4bc2-aed3-d2f160ac870d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:06.148519 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7faad6a1-a1b3-4bc2-aed3-d2f160ac870d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:06.148953 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7faad6a1-a1b3-4bc2-aed3-d2f160ac870d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:06.149538 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7faad6a1-a1b3-4bc2-aed3-d2f160ac870d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:06.150225 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7faad6a1-a1b3-4bc2-aed3-d2f160ac870d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:06.150668 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7faad6a1-a1b3-4bc2-aed3-d2f160ac870d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:06.151087 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7faad6a1-a1b3-4bc2-aed3-d2f160ac870d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:06.155241 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:45:06.295837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c7deef37-3468-48ea-996d-548e108e7960 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:06.303123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c7deef37-3468-48ea-996d-548e108e7960 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1682 microversion: 2.1 time: 0.205369 Aug 10 12:45:06.304701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 242/486] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:06 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1682 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:06.324556 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-7faad6a1-a1b3-4bc2-aed3-d2f160ac870d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:06.332357 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7faad6a1-a1b3-4bc2-aed3-d2f160ac870d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.195091 Aug 10 12:45:06.332921 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 245/487] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:06 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:45:07.325767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3fddb2b8-5ac4-4d24-8301-1f3b70368d3c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:07.326333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3fddb2b8-5ac4-4d24-8301-1f3b70368d3c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:07.332749 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3fddb2b8-5ac4-4d24-8301-1f3b70368d3c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:07.333227 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3fddb2b8-5ac4-4d24-8301-1f3b70368d3c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:07.333654 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3fddb2b8-5ac4-4d24-8301-1f3b70368d3c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:07.334330 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3fddb2b8-5ac4-4d24-8301-1f3b70368d3c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:07.334775 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3fddb2b8-5ac4-4d24-8301-1f3b70368d3c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:07.335211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3fddb2b8-5ac4-4d24-8301-1f3b70368d3c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:07.353697 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9af5241f-81e9-496b-9b3a-76ab39bc54db tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:07.354302 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9af5241f-81e9-496b-9b3a-76ab39bc54db tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:07.360635 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9af5241f-81e9-496b-9b3a-76ab39bc54db tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:07.361112 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9af5241f-81e9-496b-9b3a-76ab39bc54db tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:07.361541 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9af5241f-81e9-496b-9b3a-76ab39bc54db tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:07.362220 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9af5241f-81e9-496b-9b3a-76ab39bc54db tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:07.362935 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9af5241f-81e9-496b-9b3a-76ab39bc54db tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:07.363390 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9af5241f-81e9-496b-9b3a-76ab39bc54db tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:07.531785 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3fddb2b8-5ac4-4d24-8301-1f3b70368d3c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:07.538341 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9af5241f-81e9-496b-9b3a-76ab39bc54db tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:07.540772 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3fddb2b8-5ac4-4d24-8301-1f3b70368d3c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1682 microversion: 2.1 time: 0.218876 Aug 10 12:45:07.541725 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 243/488] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:07 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1682 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:45:07.546419 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9af5241f-81e9-496b-9b3a-76ab39bc54db tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.197089 Aug 10 12:45:07.547270 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 246/489] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:07 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:45:08.563808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-23b6242b-74c6-43cc-a5fa-0181f52467fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:08.564325 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-23b6242b-74c6-43cc-a5fa-0181f52467fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:08.569136 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-23a37dee-46ac-4da2-813e-9061542a5d55 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:08.570303 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-23a37dee-46ac-4da2-813e-9061542a5d55 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:08.571218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23b6242b-74c6-43cc-a5fa-0181f52467fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:08.571720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23b6242b-74c6-43cc-a5fa-0181f52467fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:08.572148 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23b6242b-74c6-43cc-a5fa-0181f52467fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:08.572842 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23b6242b-74c6-43cc-a5fa-0181f52467fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:08.573288 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23b6242b-74c6-43cc-a5fa-0181f52467fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:08.573702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23b6242b-74c6-43cc-a5fa-0181f52467fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:08.577224 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23a37dee-46ac-4da2-813e-9061542a5d55 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:08.577713 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23a37dee-46ac-4da2-813e-9061542a5d55 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:08.578345 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23a37dee-46ac-4da2-813e-9061542a5d55 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:08.578981 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23a37dee-46ac-4da2-813e-9061542a5d55 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:08.579469 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23a37dee-46ac-4da2-813e-9061542a5d55 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:08.579895 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23a37dee-46ac-4da2-813e-9061542a5d55 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:08.770675 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-23b6242b-74c6-43cc-a5fa-0181f52467fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:08.774204 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-23a37dee-46ac-4da2-813e-9061542a5d55 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:08.779289 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-23b6242b-74c6-43cc-a5fa-0181f52467fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1682 microversion: 2.1 time: 0.219346 Aug 10 12:45:08.780051 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 244/490] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:08 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1682 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:08.782736 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-23a37dee-46ac-4da2-813e-9061542a5d55 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.217500 Aug 10 12:45:08.783481 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 247/491] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:08 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:09.801034 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-50b3bd49-b45a-4084-9039-8f7fdaedf2d6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:09.801648 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-50b3bd49-b45a-4084-9039-8f7fdaedf2d6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:09.804837 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-021686da-03a7-4017-817d-28c61098d8f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:09.805701 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-021686da-03a7-4017-817d-28c61098d8f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:09.808795 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50b3bd49-b45a-4084-9039-8f7fdaedf2d6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:09.809281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50b3bd49-b45a-4084-9039-8f7fdaedf2d6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:09.809718 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50b3bd49-b45a-4084-9039-8f7fdaedf2d6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:09.810416 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50b3bd49-b45a-4084-9039-8f7fdaedf2d6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:09.810870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50b3bd49-b45a-4084-9039-8f7fdaedf2d6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:09.811326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50b3bd49-b45a-4084-9039-8f7fdaedf2d6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:09.811791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-021686da-03a7-4017-817d-28c61098d8f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:09.812271 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-021686da-03a7-4017-817d-28c61098d8f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:09.812713 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-021686da-03a7-4017-817d-28c61098d8f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:09.813673 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-021686da-03a7-4017-817d-28c61098d8f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:09.814242 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-021686da-03a7-4017-817d-28c61098d8f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:09.814663 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-021686da-03a7-4017-817d-28c61098d8f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:10.008586 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-50b3bd49-b45a-4084-9039-8f7fdaedf2d6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:10.011762 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-021686da-03a7-4017-817d-28c61098d8f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:10.016133 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-50b3bd49-b45a-4084-9039-8f7fdaedf2d6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1682 microversion: 2.1 time: 0.219129 Aug 10 12:45:10.016700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 245/492] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:09 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1682 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:10.019660 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-021686da-03a7-4017-817d-28c61098d8f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.219294 Aug 10 12:45:10.020228 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 248/493] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:09 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:45:11.037961 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-895a916a-6891-4b72-9e17-ed71bafed370 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:11.038906 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-895a916a-6891-4b72-9e17-ed71bafed370 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:11.040909 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ec7831cb-5624-4537-952b-14f7926fc200 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:11.041527 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ec7831cb-5624-4537-952b-14f7926fc200 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:11.045653 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-895a916a-6891-4b72-9e17-ed71bafed370 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:11.046208 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-895a916a-6891-4b72-9e17-ed71bafed370 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:11.046645 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-895a916a-6891-4b72-9e17-ed71bafed370 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:11.047383 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-895a916a-6891-4b72-9e17-ed71bafed370 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:11.047836 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-895a916a-6891-4b72-9e17-ed71bafed370 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:11.048279 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-895a916a-6891-4b72-9e17-ed71bafed370 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:11.048664 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ec7831cb-5624-4537-952b-14f7926fc200 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:11.049238 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ec7831cb-5624-4537-952b-14f7926fc200 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:11.049680 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ec7831cb-5624-4537-952b-14f7926fc200 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:11.050373 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ec7831cb-5624-4537-952b-14f7926fc200 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:11.050881 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ec7831cb-5624-4537-952b-14f7926fc200 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:11.051330 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ec7831cb-5624-4537-952b-14f7926fc200 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:11.241275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-895a916a-6891-4b72-9e17-ed71bafed370 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:11.246193 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ec7831cb-5624-4537-952b-14f7926fc200 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:11.249755 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-895a916a-6891-4b72-9e17-ed71bafed370 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1682 microversion: 2.1 time: 0.216088 Aug 10 12:45:11.250371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 246/494] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:11 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1682 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:11.254921 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ec7831cb-5624-4537-952b-14f7926fc200 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.217904 Aug 10 12:45:11.255589 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 249/495] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:11 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:45:12.274578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d7a7f6fa-1662-44a4-b8b2-80b0bbf1aa92 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:12.275222 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d7a7f6fa-1662-44a4-b8b2-80b0bbf1aa92 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:12.278387 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-968a9353-edfe-4152-a0f2-85b4ec419106 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:12.279006 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-968a9353-edfe-4152-a0f2-85b4ec419106 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:12.281754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d7a7f6fa-1662-44a4-b8b2-80b0bbf1aa92 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:12.282214 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d7a7f6fa-1662-44a4-b8b2-80b0bbf1aa92 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:12.282644 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d7a7f6fa-1662-44a4-b8b2-80b0bbf1aa92 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:12.283367 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d7a7f6fa-1662-44a4-b8b2-80b0bbf1aa92 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:12.283815 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d7a7f6fa-1662-44a4-b8b2-80b0bbf1aa92 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:12.284228 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d7a7f6fa-1662-44a4-b8b2-80b0bbf1aa92 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:12.285023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-968a9353-edfe-4152-a0f2-85b4ec419106 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:12.285499 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-968a9353-edfe-4152-a0f2-85b4ec419106 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:12.285929 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-968a9353-edfe-4152-a0f2-85b4ec419106 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:12.286731 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-968a9353-edfe-4152-a0f2-85b4ec419106 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:12.287202 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-968a9353-edfe-4152-a0f2-85b4ec419106 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:12.287610 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-968a9353-edfe-4152-a0f2-85b4ec419106 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:12.478010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d7a7f6fa-1662-44a4-b8b2-80b0bbf1aa92 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:12.480786 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-968a9353-edfe-4152-a0f2-85b4ec419106 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:12.485726 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d7a7f6fa-1662-44a4-b8b2-80b0bbf1aa92 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1682 microversion: 2.1 time: 0.217542 Aug 10 12:45:12.486462 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 247/496] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:12 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1682 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:12.488990 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-968a9353-edfe-4152-a0f2-85b4ec419106 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.216403 Aug 10 12:45:12.489557 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 250/497] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:12 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:13.508485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c5a67f33-1fe6-4f0a-a579-21e3b6d667e5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:13.509131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c5a67f33-1fe6-4f0a-a579-21e3b6d667e5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:13.509530 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fe79ea49-fa41-4f33-8154-59ea3c052580 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:13.510135 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fe79ea49-fa41-4f33-8154-59ea3c052580 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:13.515558 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c5a67f33-1fe6-4f0a-a579-21e3b6d667e5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:13.516036 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c5a67f33-1fe6-4f0a-a579-21e3b6d667e5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:13.516468 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c5a67f33-1fe6-4f0a-a579-21e3b6d667e5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:13.516626 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe79ea49-fa41-4f33-8154-59ea3c052580 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:13.517104 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe79ea49-fa41-4f33-8154-59ea3c052580 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:13.517222 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c5a67f33-1fe6-4f0a-a579-21e3b6d667e5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:13.517567 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe79ea49-fa41-4f33-8154-59ea3c052580 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:13.517679 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c5a67f33-1fe6-4f0a-a579-21e3b6d667e5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:13.518004 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c5a67f33-1fe6-4f0a-a579-21e3b6d667e5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:13.518248 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe79ea49-fa41-4f33-8154-59ea3c052580 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:13.518692 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe79ea49-fa41-4f33-8154-59ea3c052580 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:13.519108 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe79ea49-fa41-4f33-8154-59ea3c052580 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:13.534130 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:45:13.712310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c5a67f33-1fe6-4f0a-a579-21e3b6d667e5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:13.716195 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fe79ea49-fa41-4f33-8154-59ea3c052580 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:13.719841 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c5a67f33-1fe6-4f0a-a579-21e3b6d667e5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1682 microversion: 2.1 time: 0.215375 Aug 10 12:45:13.720418 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 248/498] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:13 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1682 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:13.724194 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fe79ea49-fa41-4f33-8154-59ea3c052580 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.218435 Aug 10 12:45:13.724833 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 251/499] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:13 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:45:14.379808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-38988a61-da95-45e2-9d1d-bff37aace91d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:14.380209 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-38988a61-da95-45e2-9d1d-bff37aace91d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:14.387689 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38988a61-da95-45e2-9d1d-bff37aace91d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:14.388181 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38988a61-da95-45e2-9d1d-bff37aace91d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:14.388876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38988a61-da95-45e2-9d1d-bff37aace91d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:14.389471 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38988a61-da95-45e2-9d1d-bff37aace91d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:14.389921 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38988a61-da95-45e2-9d1d-bff37aace91d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:14.390346 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38988a61-da95-45e2-9d1d-bff37aace91d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:14.529299 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.objects.instance [None req-38988a61-da95-45e2-9d1d-bff37aace91d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lazy-loading 'services' on Instance uuid 88f016f1-19e1-466c-9e03-5a125f281e25 {{(pid=124643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:45:14.743039 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a6d9814f-a274-4807-8d72-8a813d65c52a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:14.743631 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a6d9814f-a274-4807-8d72-8a813d65c52a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:14.749961 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a6d9814f-a274-4807-8d72-8a813d65c52a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:14.750441 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a6d9814f-a274-4807-8d72-8a813d65c52a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:14.750871 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a6d9814f-a274-4807-8d72-8a813d65c52a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:14.751585 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a6d9814f-a274-4807-8d72-8a813d65c52a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:14.752038 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a6d9814f-a274-4807-8d72-8a813d65c52a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:14.752458 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a6d9814f-a274-4807-8d72-8a813d65c52a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:14.843300 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-38988a61-da95-45e2-9d1d-bff37aace91d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "DELETE /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments/8d5112d7-7c9b-4c4c-ac48-633e2324b7c5" status: 202 len: 0 microversion: 2.1 time: 0.467499 Aug 10 12:45:14.843910 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 249/500] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 10 12:45:14 2022] DELETE /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments/8d5112d7-7c9b-4c4c-ac48-633e2324b7c5 => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 12:45:14.853696 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e7a2c4a6-d041-4c54-ab29-0a2fed143bcb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:14.853696 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e7a2c4a6-d041-4c54-ab29-0a2fed143bcb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:14.857629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e7a2c4a6-d041-4c54-ab29-0a2fed143bcb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:14.858123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e7a2c4a6-d041-4c54-ab29-0a2fed143bcb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:14.858597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e7a2c4a6-d041-4c54-ab29-0a2fed143bcb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:14.859341 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e7a2c4a6-d041-4c54-ab29-0a2fed143bcb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:14.859857 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e7a2c4a6-d041-4c54-ab29-0a2fed143bcb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:14.860285 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e7a2c4a6-d041-4c54-ab29-0a2fed143bcb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:15.037565 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a6d9814f-a274-4807-8d72-8a813d65c52a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:15.046264 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a6d9814f-a274-4807-8d72-8a813d65c52a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1682 microversion: 2.1 time: 0.308111 Aug 10 12:45:15.047150 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 252/501] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:14 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1682 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:45:15.080636 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e7a2c4a6-d041-4c54-ab29-0a2fed143bcb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:15.088898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e7a2c4a6-d041-4c54-ab29-0a2fed143bcb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.243803 Aug 10 12:45:15.089470 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 250/502] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:14 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:15.466867 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [req-effda353-6061-4f07-b39b-2e21101ea62a req-d542eb75-7cb9-42d6-b939-e8f592dbcac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d0315a8-29f9-4d6e-9298-f5a1d0d69e36", "name": "network-vif-deleted", "tag": "ed664c7d-23bb-4772-ac75-7b70d3de4c8d"}]} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:45:15.477778 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-effda353-6061-4f07-b39b-2e21101ea62a req-d542eb75-7cb9-42d6-b939-e8f592dbcac0 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:15.478613 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-effda353-6061-4f07-b39b-2e21101ea62a req-d542eb75-7cb9-42d6-b939-e8f592dbcac0 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:15.479134 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-effda353-6061-4f07-b39b-2e21101ea62a req-d542eb75-7cb9-42d6-b939-e8f592dbcac0 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:15.492675 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.compute.server_external_events [req-effda353-6061-4f07-b39b-2e21101ea62a req-d542eb75-7cb9-42d6-b939-e8f592dbcac0 service nova] Creating event network-vif-deleted:ed664c7d-23bb-4772-ac75-7b70d3de4c8d for instance 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 on hv-cinder-85199 Aug 10 12:45:15.497830 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [req-effda353-6061-4f07-b39b-2e21101ea62a req-d542eb75-7cb9-42d6-b939-e8f592dbcac0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035152 Aug 10 12:45:15.498739 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 253/503] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:45:16.068273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3067762a-e67f-4f06-930a-2927e75ed5f2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:16.068841 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3067762a-e67f-4f06-930a-2927e75ed5f2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:16.075519 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3067762a-e67f-4f06-930a-2927e75ed5f2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:16.075989 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3067762a-e67f-4f06-930a-2927e75ed5f2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:16.076428 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3067762a-e67f-4f06-930a-2927e75ed5f2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:16.077137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3067762a-e67f-4f06-930a-2927e75ed5f2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:16.077587 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3067762a-e67f-4f06-930a-2927e75ed5f2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:16.078012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3067762a-e67f-4f06-930a-2927e75ed5f2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:16.111486 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1661618e-a78a-4be8-8f12-fd5d4655456b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:16.113151 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1661618e-a78a-4be8-8f12-fd5d4655456b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:16.120776 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1661618e-a78a-4be8-8f12-fd5d4655456b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:16.121688 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1661618e-a78a-4be8-8f12-fd5d4655456b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:16.122280 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1661618e-a78a-4be8-8f12-fd5d4655456b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:16.123133 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1661618e-a78a-4be8-8f12-fd5d4655456b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:16.123828 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1661618e-a78a-4be8-8f12-fd5d4655456b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:16.124250 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1661618e-a78a-4be8-8f12-fd5d4655456b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:16.146423 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3067762a-e67f-4f06-930a-2927e75ed5f2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:16.154889 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3067762a-e67f-4f06-930a-2927e75ed5f2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1614 microversion: 2.1 time: 0.090477 Aug 10 12:45:16.158132 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 251/504] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:16 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1614 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:16.297550 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-1661618e-a78a-4be8-8f12-fd5d4655456b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:16.306925 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1661618e-a78a-4be8-8f12-fd5d4655456b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.199678 Aug 10 12:45:16.307957 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 254/505] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:16 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:45:17.176597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8d312878-4dba-4776-9052-2916e525b35c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:17.177200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8d312878-4dba-4776-9052-2916e525b35c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:17.184283 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d312878-4dba-4776-9052-2916e525b35c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:17.184760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d312878-4dba-4776-9052-2916e525b35c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:17.185183 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d312878-4dba-4776-9052-2916e525b35c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:17.185873 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d312878-4dba-4776-9052-2916e525b35c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:17.186324 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d312878-4dba-4776-9052-2916e525b35c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:17.186738 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d312878-4dba-4776-9052-2916e525b35c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:17.259963 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8d312878-4dba-4776-9052-2916e525b35c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:17.273436 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8d312878-4dba-4776-9052-2916e525b35c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1614 microversion: 2.1 time: 0.100643 Aug 10 12:45:17.274951 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 252/506] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:17 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1614 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:17.329829 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-83da6462-78c8-43ca-8524-6093b6329bd0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:17.331022 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-83da6462-78c8-43ca-8524-6093b6329bd0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:17.339541 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83da6462-78c8-43ca-8524-6093b6329bd0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:17.340032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83da6462-78c8-43ca-8524-6093b6329bd0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:17.340466 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83da6462-78c8-43ca-8524-6093b6329bd0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:17.341166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83da6462-78c8-43ca-8524-6093b6329bd0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:17.341613 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83da6462-78c8-43ca-8524-6093b6329bd0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:17.342034 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83da6462-78c8-43ca-8524-6093b6329bd0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:17.478366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-83da6462-78c8-43ca-8524-6093b6329bd0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:17.487110 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-83da6462-78c8-43ca-8524-6093b6329bd0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.161217 Aug 10 12:45:17.487961 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 255/507] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:17 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:18.295708 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c9afb746-2912-43d7-8af7-87a1cc3f067b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:18.296311 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c9afb746-2912-43d7-8af7-87a1cc3f067b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:18.303188 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9afb746-2912-43d7-8af7-87a1cc3f067b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:18.304529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9afb746-2912-43d7-8af7-87a1cc3f067b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:18.305103 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9afb746-2912-43d7-8af7-87a1cc3f067b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:18.305803 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9afb746-2912-43d7-8af7-87a1cc3f067b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:18.306249 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9afb746-2912-43d7-8af7-87a1cc3f067b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:18.306670 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9afb746-2912-43d7-8af7-87a1cc3f067b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:18.377663 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c9afb746-2912-43d7-8af7-87a1cc3f067b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:18.385457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c9afb746-2912-43d7-8af7-87a1cc3f067b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.093456 Aug 10 12:45:18.385939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 253/508] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:18 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:18.509557 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1666a17c-e7a6-45a4-ada3-b49811a9889e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:18.510281 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1666a17c-e7a6-45a4-ada3-b49811a9889e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:18.517078 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1666a17c-e7a6-45a4-ada3-b49811a9889e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:18.517581 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1666a17c-e7a6-45a4-ada3-b49811a9889e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:18.518008 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1666a17c-e7a6-45a4-ada3-b49811a9889e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:18.518694 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1666a17c-e7a6-45a4-ada3-b49811a9889e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:18.519138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1666a17c-e7a6-45a4-ada3-b49811a9889e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:18.519583 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1666a17c-e7a6-45a4-ada3-b49811a9889e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:18.660241 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-1666a17c-e7a6-45a4-ada3-b49811a9889e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:18.669008 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1666a17c-e7a6-45a4-ada3-b49811a9889e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.163741 Aug 10 12:45:18.669889 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 256/509] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:18 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:19.408214 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-04e20a14-b086-4daa-8fe0-97ef42a49f84 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:19.408731 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-04e20a14-b086-4daa-8fe0-97ef42a49f84 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:19.415612 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04e20a14-b086-4daa-8fe0-97ef42a49f84 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:19.416085 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04e20a14-b086-4daa-8fe0-97ef42a49f84 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:19.416508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04e20a14-b086-4daa-8fe0-97ef42a49f84 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:19.417181 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04e20a14-b086-4daa-8fe0-97ef42a49f84 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:19.417626 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04e20a14-b086-4daa-8fe0-97ef42a49f84 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:19.418039 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04e20a14-b086-4daa-8fe0-97ef42a49f84 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:19.478894 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-04e20a14-b086-4daa-8fe0-97ef42a49f84 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:19.486574 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-04e20a14-b086-4daa-8fe0-97ef42a49f84 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.082184 Aug 10 12:45:19.487135 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 254/510] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:19 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:19.689881 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e3dd6ed9-b710-488d-8fa8-cde5ad2084c5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:19.690446 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e3dd6ed9-b710-488d-8fa8-cde5ad2084c5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:19.696779 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e3dd6ed9-b710-488d-8fa8-cde5ad2084c5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:19.697251 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e3dd6ed9-b710-488d-8fa8-cde5ad2084c5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:19.697680 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e3dd6ed9-b710-488d-8fa8-cde5ad2084c5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:19.698356 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e3dd6ed9-b710-488d-8fa8-cde5ad2084c5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:19.698802 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e3dd6ed9-b710-488d-8fa8-cde5ad2084c5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:19.699245 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e3dd6ed9-b710-488d-8fa8-cde5ad2084c5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:19.824906 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e3dd6ed9-b710-488d-8fa8-cde5ad2084c5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:19.832676 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e3dd6ed9-b710-488d-8fa8-cde5ad2084c5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.146709 Aug 10 12:45:19.833242 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 257/511] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:19 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:20.513151 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-06596a9b-361c-4f11-9c09-0d689ed71901 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:20.513151 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-06596a9b-361c-4f11-9c09-0d689ed71901 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:20.513151 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=48 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:45:20.516231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-06596a9b-361c-4f11-9c09-0d689ed71901 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:20.516711 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-06596a9b-361c-4f11-9c09-0d689ed71901 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:20.517142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-06596a9b-361c-4f11-9c09-0d689ed71901 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:20.517855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-06596a9b-361c-4f11-9c09-0d689ed71901 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:20.518305 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-06596a9b-361c-4f11-9c09-0d689ed71901 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:20.518729 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-06596a9b-361c-4f11-9c09-0d689ed71901 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:20.587247 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-06596a9b-361c-4f11-9c09-0d689ed71901 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:20.594823 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-06596a9b-361c-4f11-9c09-0d689ed71901 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.090963 Aug 10 12:45:20.595423 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 255/512] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:20 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:20.854008 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f23c7a86-f681-4c85-948a-4fa0736f556d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:20.854624 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f23c7a86-f681-4c85-948a-4fa0736f556d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:20.860953 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f23c7a86-f681-4c85-948a-4fa0736f556d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:20.861434 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f23c7a86-f681-4c85-948a-4fa0736f556d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:20.861866 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f23c7a86-f681-4c85-948a-4fa0736f556d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:20.862829 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f23c7a86-f681-4c85-948a-4fa0736f556d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:20.863308 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f23c7a86-f681-4c85-948a-4fa0736f556d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:20.863737 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f23c7a86-f681-4c85-948a-4fa0736f556d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:21.003800 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f23c7a86-f681-4c85-948a-4fa0736f556d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:21.011789 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f23c7a86-f681-4c85-948a-4fa0736f556d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.162179 Aug 10 12:45:21.012361 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 258/513] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:20 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:21.617014 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9db71b0d-65f1-4850-b6a9-36cc338fc8c6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:21.617736 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9db71b0d-65f1-4850-b6a9-36cc338fc8c6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:21.624262 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9db71b0d-65f1-4850-b6a9-36cc338fc8c6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:21.624742 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9db71b0d-65f1-4850-b6a9-36cc338fc8c6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:21.625171 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9db71b0d-65f1-4850-b6a9-36cc338fc8c6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:21.625851 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9db71b0d-65f1-4850-b6a9-36cc338fc8c6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:21.626293 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9db71b0d-65f1-4850-b6a9-36cc338fc8c6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:21.626739 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9db71b0d-65f1-4850-b6a9-36cc338fc8c6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:21.688029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9db71b0d-65f1-4850-b6a9-36cc338fc8c6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:21.695436 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9db71b0d-65f1-4850-b6a9-36cc338fc8c6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.083080 Aug 10 12:45:21.696012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 256/514] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:21 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:22.033117 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f572201a-6bad-405c-93cf-539b19176e94 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:22.033724 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f572201a-6bad-405c-93cf-539b19176e94 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:22.040615 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f572201a-6bad-405c-93cf-539b19176e94 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:22.041090 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f572201a-6bad-405c-93cf-539b19176e94 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:22.041519 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f572201a-6bad-405c-93cf-539b19176e94 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:22.042199 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f572201a-6bad-405c-93cf-539b19176e94 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:22.042645 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f572201a-6bad-405c-93cf-539b19176e94 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:22.043060 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f572201a-6bad-405c-93cf-539b19176e94 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:22.182950 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f572201a-6bad-405c-93cf-539b19176e94 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:22.191124 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f572201a-6bad-405c-93cf-539b19176e94 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.161770 Aug 10 12:45:22.191655 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 259/515] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:22 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:22.716421 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4abb00b4-b175-4837-8997-07c5f5084ba9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:22.717059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4abb00b4-b175-4837-8997-07c5f5084ba9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:22.723632 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4abb00b4-b175-4837-8997-07c5f5084ba9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:22.724111 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4abb00b4-b175-4837-8997-07c5f5084ba9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:22.724544 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4abb00b4-b175-4837-8997-07c5f5084ba9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:22.725230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4abb00b4-b175-4837-8997-07c5f5084ba9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:22.726320 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4abb00b4-b175-4837-8997-07c5f5084ba9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:22.726744 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4abb00b4-b175-4837-8997-07c5f5084ba9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:22.786782 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4abb00b4-b175-4837-8997-07c5f5084ba9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:22.795142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4abb00b4-b175-4837-8997-07c5f5084ba9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.082577 Aug 10 12:45:22.795736 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 257/516] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:22 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:23.212916 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-cf6f5d7c-3139-453b-8027-01fdec36949e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:23.213868 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-cf6f5d7c-3139-453b-8027-01fdec36949e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:23.220378 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf6f5d7c-3139-453b-8027-01fdec36949e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:23.220803 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf6f5d7c-3139-453b-8027-01fdec36949e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:23.221251 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf6f5d7c-3139-453b-8027-01fdec36949e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:23.221927 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf6f5d7c-3139-453b-8027-01fdec36949e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:23.222384 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf6f5d7c-3139-453b-8027-01fdec36949e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:23.222804 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf6f5d7c-3139-453b-8027-01fdec36949e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:23.352868 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-cf6f5d7c-3139-453b-8027-01fdec36949e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:23.360772 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-cf6f5d7c-3139-453b-8027-01fdec36949e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.152511 Aug 10 12:45:23.361341 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 260/517] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:23 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:23.816473 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-56c85453-3f9d-482a-b395-cb00ebdf9444 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:23.817081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-56c85453-3f9d-482a-b395-cb00ebdf9444 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:23.824030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56c85453-3f9d-482a-b395-cb00ebdf9444 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:23.824508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56c85453-3f9d-482a-b395-cb00ebdf9444 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:23.824942 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56c85453-3f9d-482a-b395-cb00ebdf9444 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:23.825620 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56c85453-3f9d-482a-b395-cb00ebdf9444 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:23.826070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56c85453-3f9d-482a-b395-cb00ebdf9444 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:23.826490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56c85453-3f9d-482a-b395-cb00ebdf9444 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:23.889788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-56c85453-3f9d-482a-b395-cb00ebdf9444 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:23.897849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-56c85453-3f9d-482a-b395-cb00ebdf9444 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.084592 Aug 10 12:45:23.898661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 258/518] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:23 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:24.382200 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2af996ca-d334-417e-9137-0486fbece32f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:24.382821 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2af996ca-d334-417e-9137-0486fbece32f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:24.389782 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2af996ca-d334-417e-9137-0486fbece32f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:24.391989 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2af996ca-d334-417e-9137-0486fbece32f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:24.392438 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2af996ca-d334-417e-9137-0486fbece32f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:24.393157 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2af996ca-d334-417e-9137-0486fbece32f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:24.393620 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2af996ca-d334-417e-9137-0486fbece32f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:24.394049 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2af996ca-d334-417e-9137-0486fbece32f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:24.524634 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2af996ca-d334-417e-9137-0486fbece32f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:24.532640 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2af996ca-d334-417e-9137-0486fbece32f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.154466 Aug 10 12:45:24.533212 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 261/519] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:24 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:24.919568 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b2a52527-9ce5-4c0e-a027-fdd05cb4b121 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:24.920171 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b2a52527-9ce5-4c0e-a027-fdd05cb4b121 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:24.926445 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2a52527-9ce5-4c0e-a027-fdd05cb4b121 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:24.926922 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2a52527-9ce5-4c0e-a027-fdd05cb4b121 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:24.927392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2a52527-9ce5-4c0e-a027-fdd05cb4b121 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:24.928073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2a52527-9ce5-4c0e-a027-fdd05cb4b121 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:24.929107 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2a52527-9ce5-4c0e-a027-fdd05cb4b121 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:24.929599 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2a52527-9ce5-4c0e-a027-fdd05cb4b121 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:24.992171 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b2a52527-9ce5-4c0e-a027-fdd05cb4b121 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:24.999442 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b2a52527-9ce5-4c0e-a027-fdd05cb4b121 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.083710 Aug 10 12:45:25.000001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 259/520] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:24 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:25.554078 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-284430f9-3f4c-486e-8169-69001534266f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:25.554685 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-284430f9-3f4c-486e-8169-69001534266f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:25.561075 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-284430f9-3f4c-486e-8169-69001534266f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:25.561570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-284430f9-3f4c-486e-8169-69001534266f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:25.562003 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-284430f9-3f4c-486e-8169-69001534266f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:25.562686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-284430f9-3f4c-486e-8169-69001534266f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:25.563194 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-284430f9-3f4c-486e-8169-69001534266f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:25.563582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-284430f9-3f4c-486e-8169-69001534266f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:25.579158 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:45:25.698358 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-284430f9-3f4c-486e-8169-69001534266f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:25.706511 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-284430f9-3f4c-486e-8169-69001534266f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.156650 Aug 10 12:45:25.707017 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 262/521] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:25 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:26.019707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-acaa3df7-7e17-4bba-9829-71cc0d11a4e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:26.020318 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-acaa3df7-7e17-4bba-9829-71cc0d11a4e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:26.026972 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-acaa3df7-7e17-4bba-9829-71cc0d11a4e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:26.027493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-acaa3df7-7e17-4bba-9829-71cc0d11a4e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:26.027926 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-acaa3df7-7e17-4bba-9829-71cc0d11a4e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:26.028607 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-acaa3df7-7e17-4bba-9829-71cc0d11a4e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:26.029050 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-acaa3df7-7e17-4bba-9829-71cc0d11a4e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:26.029471 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-acaa3df7-7e17-4bba-9829-71cc0d11a4e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:26.091497 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-acaa3df7-7e17-4bba-9829-71cc0d11a4e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:26.099023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-acaa3df7-7e17-4bba-9829-71cc0d11a4e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.083109 Aug 10 12:45:26.099657 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 260/522] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:26 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:26.727988 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e4d7a497-a0d7-406b-b4de-eb585bbec20a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:26.728598 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e4d7a497-a0d7-406b-b4de-eb585bbec20a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:26.734455 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4d7a497-a0d7-406b-b4de-eb585bbec20a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:26.734938 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4d7a497-a0d7-406b-b4de-eb585bbec20a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:26.735416 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4d7a497-a0d7-406b-b4de-eb585bbec20a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:26.736104 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4d7a497-a0d7-406b-b4de-eb585bbec20a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:26.736584 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4d7a497-a0d7-406b-b4de-eb585bbec20a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:26.737273 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4d7a497-a0d7-406b-b4de-eb585bbec20a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:26.862959 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e4d7a497-a0d7-406b-b4de-eb585bbec20a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:26.871372 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e4d7a497-a0d7-406b-b4de-eb585bbec20a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.147648 Aug 10 12:45:26.871939 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 263/523] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:26 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:27.121860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-65189e1a-6545-40cb-815c-83d755fcb3f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:27.122492 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-65189e1a-6545-40cb-815c-83d755fcb3f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:27.129008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-65189e1a-6545-40cb-815c-83d755fcb3f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:27.129511 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-65189e1a-6545-40cb-815c-83d755fcb3f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:27.129935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-65189e1a-6545-40cb-815c-83d755fcb3f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:27.130616 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-65189e1a-6545-40cb-815c-83d755fcb3f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:27.131059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-65189e1a-6545-40cb-815c-83d755fcb3f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:27.132216 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-65189e1a-6545-40cb-815c-83d755fcb3f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:27.196453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-65189e1a-6545-40cb-815c-83d755fcb3f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:27.203848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-65189e1a-6545-40cb-815c-83d755fcb3f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.085834 Aug 10 12:45:27.204409 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 261/524] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:27 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:27.892652 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-cc600d97-a8b8-4f37-b1e3-1a6f494c0663 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:27.893197 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-cc600d97-a8b8-4f37-b1e3-1a6f494c0663 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:27.900164 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc600d97-a8b8-4f37-b1e3-1a6f494c0663 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:27.900644 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc600d97-a8b8-4f37-b1e3-1a6f494c0663 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:27.901077 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc600d97-a8b8-4f37-b1e3-1a6f494c0663 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:27.901763 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc600d97-a8b8-4f37-b1e3-1a6f494c0663 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:27.902213 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc600d97-a8b8-4f37-b1e3-1a6f494c0663 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:27.902638 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc600d97-a8b8-4f37-b1e3-1a6f494c0663 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:28.029633 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-cc600d97-a8b8-4f37-b1e3-1a6f494c0663 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:28.037510 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-cc600d97-a8b8-4f37-b1e3-1a6f494c0663 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.148820 Aug 10 12:45:28.038216 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 264/525] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:27 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:45:28.224532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-195b1b71-d3bc-4cd9-90fb-e14b7214f09f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:28.225053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-195b1b71-d3bc-4cd9-90fb-e14b7214f09f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:28.231873 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-195b1b71-d3bc-4cd9-90fb-e14b7214f09f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:28.232350 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-195b1b71-d3bc-4cd9-90fb-e14b7214f09f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:28.232779 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-195b1b71-d3bc-4cd9-90fb-e14b7214f09f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:28.233463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-195b1b71-d3bc-4cd9-90fb-e14b7214f09f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:28.233913 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-195b1b71-d3bc-4cd9-90fb-e14b7214f09f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:28.234333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-195b1b71-d3bc-4cd9-90fb-e14b7214f09f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:28.297020 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-195b1b71-d3bc-4cd9-90fb-e14b7214f09f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:28.305167 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-195b1b71-d3bc-4cd9-90fb-e14b7214f09f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.084548 Aug 10 12:45:28.305735 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 262/526] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:28 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:29.058748 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0154bfd8-90d7-4e10-9576-0dcd08053f31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:29.059388 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0154bfd8-90d7-4e10-9576-0dcd08053f31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:29.065777 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0154bfd8-90d7-4e10-9576-0dcd08053f31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:29.066256 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0154bfd8-90d7-4e10-9576-0dcd08053f31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:29.066686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0154bfd8-90d7-4e10-9576-0dcd08053f31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:29.067410 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0154bfd8-90d7-4e10-9576-0dcd08053f31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:29.067866 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0154bfd8-90d7-4e10-9576-0dcd08053f31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:29.068287 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0154bfd8-90d7-4e10-9576-0dcd08053f31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:29.200606 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0154bfd8-90d7-4e10-9576-0dcd08053f31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:29.208503 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0154bfd8-90d7-4e10-9576-0dcd08053f31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.153629 Aug 10 12:45:29.209076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 265/527] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:29 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:45:29.326352 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-102c7943-5acd-4d43-bb56-98a1e8584fa1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:29.327265 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-102c7943-5acd-4d43-bb56-98a1e8584fa1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:29.333344 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-102c7943-5acd-4d43-bb56-98a1e8584fa1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:29.339241 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-102c7943-5acd-4d43-bb56-98a1e8584fa1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:29.339241 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-102c7943-5acd-4d43-bb56-98a1e8584fa1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:29.339241 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-102c7943-5acd-4d43-bb56-98a1e8584fa1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:29.339241 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-102c7943-5acd-4d43-bb56-98a1e8584fa1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:29.339576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-102c7943-5acd-4d43-bb56-98a1e8584fa1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:29.398379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-102c7943-5acd-4d43-bb56-98a1e8584fa1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:29.405859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-102c7943-5acd-4d43-bb56-98a1e8584fa1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.083422 Aug 10 12:45:29.406429 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 263/528] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:29 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:30.230520 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-dfb0ca1b-c96c-4ef0-8787-399e3e013edc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:30.231132 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-dfb0ca1b-c96c-4ef0-8787-399e3e013edc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:30.237770 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dfb0ca1b-c96c-4ef0-8787-399e3e013edc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:30.238247 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dfb0ca1b-c96c-4ef0-8787-399e3e013edc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:30.238684 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dfb0ca1b-c96c-4ef0-8787-399e3e013edc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:30.239398 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dfb0ca1b-c96c-4ef0-8787-399e3e013edc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:30.239850 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dfb0ca1b-c96c-4ef0-8787-399e3e013edc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:30.240270 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dfb0ca1b-c96c-4ef0-8787-399e3e013edc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:30.368293 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-dfb0ca1b-c96c-4ef0-8787-399e3e013edc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:30.376252 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-dfb0ca1b-c96c-4ef0-8787-399e3e013edc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.149587 Aug 10 12:45:30.376817 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 266/529] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:30 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:30.427138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e95d011d-0415-4cca-8ae2-19aa050a1bec tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:30.427723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e95d011d-0415-4cca-8ae2-19aa050a1bec tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:30.434931 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e95d011d-0415-4cca-8ae2-19aa050a1bec tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:30.435445 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e95d011d-0415-4cca-8ae2-19aa050a1bec tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:30.435873 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e95d011d-0415-4cca-8ae2-19aa050a1bec tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:30.436578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e95d011d-0415-4cca-8ae2-19aa050a1bec tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:30.437017 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e95d011d-0415-4cca-8ae2-19aa050a1bec tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:30.437429 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e95d011d-0415-4cca-8ae2-19aa050a1bec tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:30.451725 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:45:30.501152 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e95d011d-0415-4cca-8ae2-19aa050a1bec tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:30.508512 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e95d011d-0415-4cca-8ae2-19aa050a1bec tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.085322 Aug 10 12:45:30.509085 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 264/530] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:30 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:31.396809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-42fe97db-9334-498a-8562-736efb392199 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:31.398257 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-42fe97db-9334-498a-8562-736efb392199 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:31.404650 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-42fe97db-9334-498a-8562-736efb392199 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:31.405137 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-42fe97db-9334-498a-8562-736efb392199 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:31.405570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-42fe97db-9334-498a-8562-736efb392199 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:31.406263 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-42fe97db-9334-498a-8562-736efb392199 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:31.406778 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-42fe97db-9334-498a-8562-736efb392199 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:31.407226 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-42fe97db-9334-498a-8562-736efb392199 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:31.528597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6992bad1-a750-4471-986c-5f172f488bfa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:31.529214 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6992bad1-a750-4471-986c-5f172f488bfa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:31.533498 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-42fe97db-9334-498a-8562-736efb392199 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:31.535743 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6992bad1-a750-4471-986c-5f172f488bfa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:31.536227 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6992bad1-a750-4471-986c-5f172f488bfa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:31.536662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6992bad1-a750-4471-986c-5f172f488bfa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:31.537356 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6992bad1-a750-4471-986c-5f172f488bfa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:31.538039 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6992bad1-a750-4471-986c-5f172f488bfa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:31.538628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6992bad1-a750-4471-986c-5f172f488bfa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:31.541517 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-42fe97db-9334-498a-8562-736efb392199 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.148697 Aug 10 12:45:31.542100 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 267/531] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:31 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:31.599739 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6992bad1-a750-4471-986c-5f172f488bfa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:31.607554 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6992bad1-a750-4471-986c-5f172f488bfa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.083055 Aug 10 12:45:31.608126 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 265/532] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:31 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:45:32.563150 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9a48ccce-faea-4785-ae9f-2208e1cd00b1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:32.563790 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9a48ccce-faea-4785-ae9f-2208e1cd00b1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:32.570759 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9a48ccce-faea-4785-ae9f-2208e1cd00b1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:32.571256 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9a48ccce-faea-4785-ae9f-2208e1cd00b1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:32.571722 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9a48ccce-faea-4785-ae9f-2208e1cd00b1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:32.572398 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9a48ccce-faea-4785-ae9f-2208e1cd00b1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:32.572855 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9a48ccce-faea-4785-ae9f-2208e1cd00b1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:32.573275 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9a48ccce-faea-4785-ae9f-2208e1cd00b1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:32.629369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-22ac447d-6474-48b5-b615-8213f601b0d5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:32.630005 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-22ac447d-6474-48b5-b615-8213f601b0d5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:32.637080 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-22ac447d-6474-48b5-b615-8213f601b0d5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:32.637571 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-22ac447d-6474-48b5-b615-8213f601b0d5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:32.638007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-22ac447d-6474-48b5-b615-8213f601b0d5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:32.638700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-22ac447d-6474-48b5-b615-8213f601b0d5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:32.639146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-22ac447d-6474-48b5-b615-8213f601b0d5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:32.639596 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-22ac447d-6474-48b5-b615-8213f601b0d5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:32.706758 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-22ac447d-6474-48b5-b615-8213f601b0d5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:32.714629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-22ac447d-6474-48b5-b615-8213f601b0d5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.089135 Aug 10 12:45:32.715218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 266/533] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:32 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:45:32.728826 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9a48ccce-faea-4785-ae9f-2208e1cd00b1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:32.736666 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9a48ccce-faea-4785-ae9f-2208e1cd00b1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.177392 Aug 10 12:45:32.737490 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 268/534] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:32 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:33.735479 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-02480e40-ed9b-4c94-b9d2-529d65919020 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:33.736079 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-02480e40-ed9b-4c94-b9d2-529d65919020 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:33.743479 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-02480e40-ed9b-4c94-b9d2-529d65919020 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:33.744051 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-02480e40-ed9b-4c94-b9d2-529d65919020 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:33.744521 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-02480e40-ed9b-4c94-b9d2-529d65919020 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:33.745238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-02480e40-ed9b-4c94-b9d2-529d65919020 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:33.745691 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-02480e40-ed9b-4c94-b9d2-529d65919020 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:33.746116 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-02480e40-ed9b-4c94-b9d2-529d65919020 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:33.757687 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-27a92362-0cb6-4cd1-9fb2-efb300d18160 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:33.758920 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-27a92362-0cb6-4cd1-9fb2-efb300d18160 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:33.761250 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:45:33.765844 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-27a92362-0cb6-4cd1-9fb2-efb300d18160 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:33.766332 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-27a92362-0cb6-4cd1-9fb2-efb300d18160 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:33.766769 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-27a92362-0cb6-4cd1-9fb2-efb300d18160 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:33.767494 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-27a92362-0cb6-4cd1-9fb2-efb300d18160 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:33.767955 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-27a92362-0cb6-4cd1-9fb2-efb300d18160 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:33.768385 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-27a92362-0cb6-4cd1-9fb2-efb300d18160 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:33.810088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-02480e40-ed9b-4c94-b9d2-529d65919020 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:33.817641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-02480e40-ed9b-4c94-b9d2-529d65919020 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.086025 Aug 10 12:45:33.818217 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 267/535] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:33 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:33.901482 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-27a92362-0cb6-4cd1-9fb2-efb300d18160 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:33.910110 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-27a92362-0cb6-4cd1-9fb2-efb300d18160 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.156189 Aug 10 12:45:33.910675 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 269/536] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:33 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:45:34.839761 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-640bbe70-4c3f-471b-b2a0-fcfd95f0b319 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:34.840367 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-640bbe70-4c3f-471b-b2a0-fcfd95f0b319 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:34.846698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-640bbe70-4c3f-471b-b2a0-fcfd95f0b319 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:34.847193 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-640bbe70-4c3f-471b-b2a0-fcfd95f0b319 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:34.847624 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-640bbe70-4c3f-471b-b2a0-fcfd95f0b319 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:34.848300 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-640bbe70-4c3f-471b-b2a0-fcfd95f0b319 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:34.848743 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-640bbe70-4c3f-471b-b2a0-fcfd95f0b319 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:34.849160 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-640bbe70-4c3f-471b-b2a0-fcfd95f0b319 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:34.914801 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-640bbe70-4c3f-471b-b2a0-fcfd95f0b319 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:34.922358 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-640bbe70-4c3f-471b-b2a0-fcfd95f0b319 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.087344 Aug 10 12:45:34.922927 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 268/537] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:34 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:34.932016 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f058802c-c06f-4e1b-b60a-932732fd6724 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:34.932783 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f058802c-c06f-4e1b-b60a-932732fd6724 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:34.939206 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f058802c-c06f-4e1b-b60a-932732fd6724 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:34.939706 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f058802c-c06f-4e1b-b60a-932732fd6724 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:34.940144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f058802c-c06f-4e1b-b60a-932732fd6724 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:34.940837 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f058802c-c06f-4e1b-b60a-932732fd6724 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:34.941292 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f058802c-c06f-4e1b-b60a-932732fd6724 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:34.941719 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f058802c-c06f-4e1b-b60a-932732fd6724 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:35.071171 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f058802c-c06f-4e1b-b60a-932732fd6724 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:35.079042 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f058802c-c06f-4e1b-b60a-932732fd6724 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.151059 Aug 10 12:45:35.079656 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 270/538] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:34 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:35.943421 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4c5bf171-4e61-49e9-9529-894fa34ebcab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:35.943964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4c5bf171-4e61-49e9-9529-894fa34ebcab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:35.950428 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4c5bf171-4e61-49e9-9529-894fa34ebcab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:35.950908 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4c5bf171-4e61-49e9-9529-894fa34ebcab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:35.951379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4c5bf171-4e61-49e9-9529-894fa34ebcab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:35.952070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4c5bf171-4e61-49e9-9529-894fa34ebcab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:35.952524 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4c5bf171-4e61-49e9-9529-894fa34ebcab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:35.952953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4c5bf171-4e61-49e9-9529-894fa34ebcab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:36.013493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4c5bf171-4e61-49e9-9529-894fa34ebcab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:36.021008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4c5bf171-4e61-49e9-9529-894fa34ebcab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.081515 Aug 10 12:45:36.021599 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 269/539] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:35 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:36.049144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e556abfc-4be5-4df6-b131-3d2723efebfd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:36.049642 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e556abfc-4be5-4df6-b131-3d2723efebfd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:36.056124 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e556abfc-4be5-4df6-b131-3d2723efebfd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:36.056610 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e556abfc-4be5-4df6-b131-3d2723efebfd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:36.057160 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e556abfc-4be5-4df6-b131-3d2723efebfd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:36.063282 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e556abfc-4be5-4df6-b131-3d2723efebfd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:36.063282 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e556abfc-4be5-4df6-b131-3d2723efebfd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:36.063282 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e556abfc-4be5-4df6-b131-3d2723efebfd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:36.089589 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e556abfc-4be5-4df6-b131-3d2723efebfd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments/ff851858-628d-4652-8179-bd9f8b05eb25" status: 200 len: 194 microversion: 2.20 time: 0.044352 Aug 10 12:45:36.090169 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 271/540] 10.222.0.49 () {60 vars in 1454 bytes} [Wed Aug 10 12:45:36 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments/ff851858-628d-4652-8179-bd9f8b05eb25 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:45:36.100997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a18e23bf-a7dd-4209-9d2a-5d900ef11e4c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:36.101670 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a18e23bf-a7dd-4209-9d2a-5d900ef11e4c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:36.108339 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a18e23bf-a7dd-4209-9d2a-5d900ef11e4c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:36.108824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a18e23bf-a7dd-4209-9d2a-5d900ef11e4c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:36.109259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a18e23bf-a7dd-4209-9d2a-5d900ef11e4c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:36.109980 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a18e23bf-a7dd-4209-9d2a-5d900ef11e4c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:36.110429 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a18e23bf-a7dd-4209-9d2a-5d900ef11e4c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:36.110858 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a18e23bf-a7dd-4209-9d2a-5d900ef11e4c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:36.157818 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-43a7887f-92f1-4a9a-8baa-465e9e0b6162 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:36.158311 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-43a7887f-92f1-4a9a-8baa-465e9e0b6162 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:36.164165 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-43a7887f-92f1-4a9a-8baa-465e9e0b6162 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:36.165244 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-43a7887f-92f1-4a9a-8baa-465e9e0b6162 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:36.165669 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-43a7887f-92f1-4a9a-8baa-465e9e0b6162 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:36.166359 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-43a7887f-92f1-4a9a-8baa-465e9e0b6162 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:36.166813 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-43a7887f-92f1-4a9a-8baa-465e9e0b6162 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:36.167258 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-43a7887f-92f1-4a9a-8baa-465e9e0b6162 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:36.241928 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a18e23bf-a7dd-4209-9d2a-5d900ef11e4c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:36.250019 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a18e23bf-a7dd-4209-9d2a-5d900ef11e4c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.152904 Aug 10 12:45:36.250592 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 270/541] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:36 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:36.301266 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.objects.instance [None req-43a7887f-92f1-4a9a-8baa-465e9e0b6162 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lazy-loading 'services' on Instance uuid 572a91d2-8a56-4616-97e4-b0d48cc57ea5 {{(pid=124642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:45:36.567318 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-43a7887f-92f1-4a9a-8baa-465e9e0b6162 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "DELETE /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments/ff851858-628d-4652-8179-bd9f8b05eb25" status: 202 len: 0 microversion: 2.20 time: 0.413263 Aug 10 12:45:36.567914 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 272/542] 10.222.0.49 () {60 vars in 1457 bytes} [Wed Aug 10 12:45:36 2022] DELETE /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments/ff851858-628d-4652-8179-bd9f8b05eb25 => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 10 12:45:36.579413 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-be81c6b8-d9fc-4d11-a379-0ab8025f66f7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:36.581648 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-be81c6b8-d9fc-4d11-a379-0ab8025f66f7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:36.588431 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be81c6b8-d9fc-4d11-a379-0ab8025f66f7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:36.588926 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be81c6b8-d9fc-4d11-a379-0ab8025f66f7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:36.589362 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be81c6b8-d9fc-4d11-a379-0ab8025f66f7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:36.590102 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be81c6b8-d9fc-4d11-a379-0ab8025f66f7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:36.590553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be81c6b8-d9fc-4d11-a379-0ab8025f66f7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:36.590973 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be81c6b8-d9fc-4d11-a379-0ab8025f66f7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:36.620019 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-be81c6b8-d9fc-4d11-a379-0ab8025f66f7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044573 Aug 10 12:45:36.620591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 271/543] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:45:36 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:45:37.042838 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-aef78de8-11a6-4efa-a2fd-2d6e809906c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:37.043592 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-aef78de8-11a6-4efa-a2fd-2d6e809906c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:37.049985 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aef78de8-11a6-4efa-a2fd-2d6e809906c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:37.050525 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aef78de8-11a6-4efa-a2fd-2d6e809906c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:37.050898 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aef78de8-11a6-4efa-a2fd-2d6e809906c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:37.051625 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aef78de8-11a6-4efa-a2fd-2d6e809906c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:37.052078 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aef78de8-11a6-4efa-a2fd-2d6e809906c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:37.052503 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aef78de8-11a6-4efa-a2fd-2d6e809906c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:37.123370 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-aef78de8-11a6-4efa-a2fd-2d6e809906c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:37.126379 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-aef78de8-11a6-4efa-a2fd-2d6e809906c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.086984 Aug 10 12:45:37.126379 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 273/544] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:37 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:37.271672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-09805b1a-8f79-4180-b6a9-8e3e7f25f90d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:37.272276 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-09805b1a-8f79-4180-b6a9-8e3e7f25f90d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:37.278980 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-09805b1a-8f79-4180-b6a9-8e3e7f25f90d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:37.279490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-09805b1a-8f79-4180-b6a9-8e3e7f25f90d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:37.279921 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-09805b1a-8f79-4180-b6a9-8e3e7f25f90d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:37.280609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-09805b1a-8f79-4180-b6a9-8e3e7f25f90d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:37.281052 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-09805b1a-8f79-4180-b6a9-8e3e7f25f90d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:37.281468 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-09805b1a-8f79-4180-b6a9-8e3e7f25f90d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:37.408853 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-09805b1a-8f79-4180-b6a9-8e3e7f25f90d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:37.417912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-09805b1a-8f79-4180-b6a9-8e3e7f25f90d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.150100 Aug 10 12:45:37.418478 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 272/545] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:37 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:37.631489 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4934eded-de6a-470f-b508-796c4281a0a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:37.633754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4934eded-de6a-470f-b508-796c4281a0a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:37.639777 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4934eded-de6a-470f-b508-796c4281a0a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:37.640249 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4934eded-de6a-470f-b508-796c4281a0a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:37.640674 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4934eded-de6a-470f-b508-796c4281a0a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:37.641348 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4934eded-de6a-470f-b508-796c4281a0a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:37.641791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4934eded-de6a-470f-b508-796c4281a0a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:37.642204 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4934eded-de6a-470f-b508-796c4281a0a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:37.671126 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4934eded-de6a-470f-b508-796c4281a0a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043590 Aug 10 12:45:37.671704 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 274/546] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:45:37 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:45:38.146061 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a93e9f3e-a9da-4185-a679-753e30cef462 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:38.146867 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a93e9f3e-a9da-4185-a679-753e30cef462 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:38.153497 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a93e9f3e-a9da-4185-a679-753e30cef462 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:38.153975 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a93e9f3e-a9da-4185-a679-753e30cef462 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:38.154405 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a93e9f3e-a9da-4185-a679-753e30cef462 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:38.155082 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a93e9f3e-a9da-4185-a679-753e30cef462 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:38.155553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a93e9f3e-a9da-4185-a679-753e30cef462 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:38.155971 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a93e9f3e-a9da-4185-a679-753e30cef462 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:38.220088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a93e9f3e-a9da-4185-a679-753e30cef462 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:38.228569 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a93e9f3e-a9da-4185-a679-753e30cef462 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.085872 Aug 10 12:45:38.229158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 273/547] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:38 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:38.438356 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b19ad4c1-5435-4204-bd43-1e23c124710e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:38.438967 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b19ad4c1-5435-4204-bd43-1e23c124710e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:38.445344 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b19ad4c1-5435-4204-bd43-1e23c124710e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:38.445827 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b19ad4c1-5435-4204-bd43-1e23c124710e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:38.446461 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b19ad4c1-5435-4204-bd43-1e23c124710e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:38.447154 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b19ad4c1-5435-4204-bd43-1e23c124710e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:38.447638 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b19ad4c1-5435-4204-bd43-1e23c124710e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:38.448063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b19ad4c1-5435-4204-bd43-1e23c124710e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:38.575960 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b19ad4c1-5435-4204-bd43-1e23c124710e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:38.584706 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b19ad4c1-5435-4204-bd43-1e23c124710e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.150040 Aug 10 12:45:38.585303 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 275/548] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:38 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:38.683600 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-aabce6ad-5e0c-4d71-b3fb-63a043abb10b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:38.685725 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-aabce6ad-5e0c-4d71-b3fb-63a043abb10b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:38.691973 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aabce6ad-5e0c-4d71-b3fb-63a043abb10b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:38.692447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aabce6ad-5e0c-4d71-b3fb-63a043abb10b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:38.692878 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aabce6ad-5e0c-4d71-b3fb-63a043abb10b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:38.693555 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aabce6ad-5e0c-4d71-b3fb-63a043abb10b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:38.693999 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aabce6ad-5e0c-4d71-b3fb-63a043abb10b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:38.694417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aabce6ad-5e0c-4d71-b3fb-63a043abb10b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:38.723254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-aabce6ad-5e0c-4d71-b3fb-63a043abb10b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043811 Aug 10 12:45:38.723792 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 274/549] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:45:38 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:45:39.249975 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4373dc51-b41f-4391-aec7-d7b57a14219c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:39.250612 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4373dc51-b41f-4391-aec7-d7b57a14219c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:39.256562 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4373dc51-b41f-4391-aec7-d7b57a14219c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:39.257041 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4373dc51-b41f-4391-aec7-d7b57a14219c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:39.257478 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4373dc51-b41f-4391-aec7-d7b57a14219c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:39.258168 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4373dc51-b41f-4391-aec7-d7b57a14219c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:39.259256 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4373dc51-b41f-4391-aec7-d7b57a14219c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:39.259854 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4373dc51-b41f-4391-aec7-d7b57a14219c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:39.323314 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4373dc51-b41f-4391-aec7-d7b57a14219c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:39.330645 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4373dc51-b41f-4391-aec7-d7b57a14219c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.084454 Aug 10 12:45:39.331231 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 276/550] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:39 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:39.606132 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-dd7ca64d-1cea-4cb0-86d4-98e893580cac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:39.606749 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-dd7ca64d-1cea-4cb0-86d4-98e893580cac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:39.613119 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd7ca64d-1cea-4cb0-86d4-98e893580cac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:39.613605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd7ca64d-1cea-4cb0-86d4-98e893580cac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:39.614041 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd7ca64d-1cea-4cb0-86d4-98e893580cac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:39.614732 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd7ca64d-1cea-4cb0-86d4-98e893580cac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:39.615204 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd7ca64d-1cea-4cb0-86d4-98e893580cac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:39.615992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd7ca64d-1cea-4cb0-86d4-98e893580cac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:39.735793 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-34ccb751-07cc-4a88-80ba-bd69c7185ae3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:39.738256 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-34ccb751-07cc-4a88-80ba-bd69c7185ae3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:39.745481 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34ccb751-07cc-4a88-80ba-bd69c7185ae3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:39.746260 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34ccb751-07cc-4a88-80ba-bd69c7185ae3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:39.746583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-dd7ca64d-1cea-4cb0-86d4-98e893580cac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:39.747039 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34ccb751-07cc-4a88-80ba-bd69c7185ae3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:39.747434 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34ccb751-07cc-4a88-80ba-bd69c7185ae3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:39.747882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34ccb751-07cc-4a88-80ba-bd69c7185ae3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:39.748296 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34ccb751-07cc-4a88-80ba-bd69c7185ae3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:39.754482 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-dd7ca64d-1cea-4cb0-86d4-98e893580cac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.152377 Aug 10 12:45:39.755050 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 275/551] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:39 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:39.777217 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-34ccb751-07cc-4a88-80ba-bd69c7185ae3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045553 Aug 10 12:45:39.777772 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 277/552] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:45:39 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:45:40.351064 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-78d7eaa3-8b02-481b-b044-f4ba97ea773e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:40.351722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-78d7eaa3-8b02-481b-b044-f4ba97ea773e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:40.358339 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-78d7eaa3-8b02-481b-b044-f4ba97ea773e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:40.358813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-78d7eaa3-8b02-481b-b044-f4ba97ea773e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:40.359271 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-78d7eaa3-8b02-481b-b044-f4ba97ea773e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:40.359952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-78d7eaa3-8b02-481b-b044-f4ba97ea773e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:40.360395 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-78d7eaa3-8b02-481b-b044-f4ba97ea773e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:40.360813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-78d7eaa3-8b02-481b-b044-f4ba97ea773e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:40.421966 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-78d7eaa3-8b02-481b-b044-f4ba97ea773e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:40.429368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-78d7eaa3-8b02-481b-b044-f4ba97ea773e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.082146 Aug 10 12:45:40.429931 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 276/553] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:40 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:40.775800 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-722fdac4-f8eb-447e-8b13-29cd902b3811 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:40.776407 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-722fdac4-f8eb-447e-8b13-29cd902b3811 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:40.782689 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-722fdac4-f8eb-447e-8b13-29cd902b3811 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:40.783169 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-722fdac4-f8eb-447e-8b13-29cd902b3811 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:40.783626 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-722fdac4-f8eb-447e-8b13-29cd902b3811 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:40.784320 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-722fdac4-f8eb-447e-8b13-29cd902b3811 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:40.784772 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-722fdac4-f8eb-447e-8b13-29cd902b3811 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:40.785192 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-722fdac4-f8eb-447e-8b13-29cd902b3811 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:40.789326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-410873e0-fec1-4313-b45c-6c819b7634a7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:40.791567 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-410873e0-fec1-4313-b45c-6c819b7634a7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:40.797810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-410873e0-fec1-4313-b45c-6c819b7634a7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:40.798286 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-410873e0-fec1-4313-b45c-6c819b7634a7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:40.798711 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-410873e0-fec1-4313-b45c-6c819b7634a7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:40.799420 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-410873e0-fec1-4313-b45c-6c819b7634a7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:40.799867 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-410873e0-fec1-4313-b45c-6c819b7634a7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:40.800280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-410873e0-fec1-4313-b45c-6c819b7634a7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:40.800401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:45:40.832128 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-410873e0-fec1-4313-b45c-6c819b7634a7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046629 Aug 10 12:45:40.833931 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 277/554] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:45:40 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:45:40.916696 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-722fdac4-f8eb-447e-8b13-29cd902b3811 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:40.924679 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-722fdac4-f8eb-447e-8b13-29cd902b3811 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.153267 Aug 10 12:45:40.925250 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 278/555] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:40 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:41.450834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2ec848be-4995-4365-8875-a47dd792c022 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:41.451470 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2ec848be-4995-4365-8875-a47dd792c022 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:41.457356 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2ec848be-4995-4365-8875-a47dd792c022 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:41.457837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2ec848be-4995-4365-8875-a47dd792c022 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:41.458270 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2ec848be-4995-4365-8875-a47dd792c022 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:41.458955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2ec848be-4995-4365-8875-a47dd792c022 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:41.459432 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2ec848be-4995-4365-8875-a47dd792c022 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:41.459855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2ec848be-4995-4365-8875-a47dd792c022 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:41.525401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2ec848be-4995-4365-8875-a47dd792c022 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:41.533078 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2ec848be-4995-4365-8875-a47dd792c022 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.086686 Aug 10 12:45:41.533576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 278/556] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:41 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:41.844511 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ad2ddec5-a15b-47e4-9c3e-43ccd6595118 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:41.846528 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ad2ddec5-a15b-47e4-9c3e-43ccd6595118 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:41.853976 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad2ddec5-a15b-47e4-9c3e-43ccd6595118 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:41.854451 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad2ddec5-a15b-47e4-9c3e-43ccd6595118 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:41.854878 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad2ddec5-a15b-47e4-9c3e-43ccd6595118 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:41.855580 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad2ddec5-a15b-47e4-9c3e-43ccd6595118 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:41.856026 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad2ddec5-a15b-47e4-9c3e-43ccd6595118 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:41.856441 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad2ddec5-a15b-47e4-9c3e-43ccd6595118 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:41.885028 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ad2ddec5-a15b-47e4-9c3e-43ccd6595118 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044577 Aug 10 12:45:41.885571 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 279/557] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:45:41 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:45:41.944962 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3208632f-c934-4b0d-a707-d6e50c7bd62f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:41.945584 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3208632f-c934-4b0d-a707-d6e50c7bd62f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:41.952032 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3208632f-c934-4b0d-a707-d6e50c7bd62f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:41.952512 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3208632f-c934-4b0d-a707-d6e50c7bd62f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:41.952940 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3208632f-c934-4b0d-a707-d6e50c7bd62f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:41.953623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3208632f-c934-4b0d-a707-d6e50c7bd62f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:41.954073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3208632f-c934-4b0d-a707-d6e50c7bd62f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:41.954494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3208632f-c934-4b0d-a707-d6e50c7bd62f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:42.080399 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3208632f-c934-4b0d-a707-d6e50c7bd62f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:42.088855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3208632f-c934-4b0d-a707-d6e50c7bd62f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.147692 Aug 10 12:45:42.089422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 279/558] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:41 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:42.554216 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0f2a0a9e-2ce7-4e91-ad2d-4942dee58a23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:42.554764 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0f2a0a9e-2ce7-4e91-ad2d-4942dee58a23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:42.561201 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f2a0a9e-2ce7-4e91-ad2d-4942dee58a23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:42.561680 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f2a0a9e-2ce7-4e91-ad2d-4942dee58a23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:42.562111 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f2a0a9e-2ce7-4e91-ad2d-4942dee58a23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:42.562797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f2a0a9e-2ce7-4e91-ad2d-4942dee58a23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:42.563278 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f2a0a9e-2ce7-4e91-ad2d-4942dee58a23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:42.563702 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f2a0a9e-2ce7-4e91-ad2d-4942dee58a23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:42.625427 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0f2a0a9e-2ce7-4e91-ad2d-4942dee58a23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:42.632821 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0f2a0a9e-2ce7-4e91-ad2d-4942dee58a23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.082505 Aug 10 12:45:42.633478 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 280/559] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:42 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:42.897408 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-cc8b4ddc-ec3f-4878-a187-875c3ec38472 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:42.899737 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-cc8b4ddc-ec3f-4878-a187-875c3ec38472 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:42.905618 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cc8b4ddc-ec3f-4878-a187-875c3ec38472 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:42.906121 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cc8b4ddc-ec3f-4878-a187-875c3ec38472 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:42.906556 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cc8b4ddc-ec3f-4878-a187-875c3ec38472 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:42.907273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cc8b4ddc-ec3f-4878-a187-875c3ec38472 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:42.907765 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cc8b4ddc-ec3f-4878-a187-875c3ec38472 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:42.908195 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cc8b4ddc-ec3f-4878-a187-875c3ec38472 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:42.936861 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-cc8b4ddc-ec3f-4878-a187-875c3ec38472 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043573 Aug 10 12:45:42.937414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 280/560] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:45:42 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:45:43.109479 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-01618532-6211-4f5a-b6d9-85d00b0d4cf6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:43.110104 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-01618532-6211-4f5a-b6d9-85d00b0d4cf6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:43.116691 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01618532-6211-4f5a-b6d9-85d00b0d4cf6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:43.117164 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01618532-6211-4f5a-b6d9-85d00b0d4cf6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:43.117588 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01618532-6211-4f5a-b6d9-85d00b0d4cf6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:43.119071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01618532-6211-4f5a-b6d9-85d00b0d4cf6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:43.119539 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01618532-6211-4f5a-b6d9-85d00b0d4cf6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:43.119958 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01618532-6211-4f5a-b6d9-85d00b0d4cf6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:43.248397 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-01618532-6211-4f5a-b6d9-85d00b0d4cf6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:43.256235 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-01618532-6211-4f5a-b6d9-85d00b0d4cf6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.150616 Aug 10 12:45:43.256809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 281/561] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:43 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:43.653568 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-42b0f138-1931-4d1b-a5a3-b867cbd5671a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:43.654173 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-42b0f138-1931-4d1b-a5a3-b867cbd5671a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:43.660559 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-42b0f138-1931-4d1b-a5a3-b867cbd5671a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:43.661039 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-42b0f138-1931-4d1b-a5a3-b867cbd5671a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:43.661473 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-42b0f138-1931-4d1b-a5a3-b867cbd5671a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:43.662154 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-42b0f138-1931-4d1b-a5a3-b867cbd5671a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:43.662603 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-42b0f138-1931-4d1b-a5a3-b867cbd5671a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:43.663023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-42b0f138-1931-4d1b-a5a3-b867cbd5671a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:43.667047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:45:43.723642 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-42b0f138-1931-4d1b-a5a3-b867cbd5671a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:43.731875 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-42b0f138-1931-4d1b-a5a3-b867cbd5671a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.082108 Aug 10 12:45:43.732535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 281/562] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:43 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:43.949091 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-89634231-6c6c-4659-8f64-5760d2567b38 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:43.951241 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-89634231-6c6c-4659-8f64-5760d2567b38 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:43.957221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-89634231-6c6c-4659-8f64-5760d2567b38 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:43.957702 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-89634231-6c6c-4659-8f64-5760d2567b38 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:43.958140 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-89634231-6c6c-4659-8f64-5760d2567b38 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:43.958834 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-89634231-6c6c-4659-8f64-5760d2567b38 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:43.959315 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-89634231-6c6c-4659-8f64-5760d2567b38 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:43.959741 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-89634231-6c6c-4659-8f64-5760d2567b38 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:43.988433 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-89634231-6c6c-4659-8f64-5760d2567b38 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043239 Aug 10 12:45:43.988921 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 282/563] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:45:43 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:45:44.277465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ce864802-b1b4-4272-8150-39258364919a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:44.278178 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ce864802-b1b4-4272-8150-39258364919a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:44.284420 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce864802-b1b4-4272-8150-39258364919a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:44.284902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce864802-b1b4-4272-8150-39258364919a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:44.285391 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce864802-b1b4-4272-8150-39258364919a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:44.286071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce864802-b1b4-4272-8150-39258364919a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:44.286522 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce864802-b1b4-4272-8150-39258364919a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:44.286945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce864802-b1b4-4272-8150-39258364919a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:44.414639 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ce864802-b1b4-4272-8150-39258364919a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:44.422629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ce864802-b1b4-4272-8150-39258364919a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.149276 Aug 10 12:45:44.426297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 282/564] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:44 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:44.753588 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9cc168db-2765-4c4a-9385-1a5684d0675e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:44.754202 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9cc168db-2765-4c4a-9385-1a5684d0675e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:44.761184 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9cc168db-2765-4c4a-9385-1a5684d0675e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:44.761732 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9cc168db-2765-4c4a-9385-1a5684d0675e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:44.762735 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9cc168db-2765-4c4a-9385-1a5684d0675e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:44.763459 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9cc168db-2765-4c4a-9385-1a5684d0675e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:44.763915 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9cc168db-2765-4c4a-9385-1a5684d0675e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:44.764349 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9cc168db-2765-4c4a-9385-1a5684d0675e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:44.828306 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9cc168db-2765-4c4a-9385-1a5684d0675e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:44.835850 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9cc168db-2765-4c4a-9385-1a5684d0675e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.086097 Aug 10 12:45:44.836983 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 283/565] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:44 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:45.001472 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-10e2f07e-dcb9-4bb6-b199-e1badf7575ac tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:45.003626 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-10e2f07e-dcb9-4bb6-b199-e1badf7575ac tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:45.010720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-10e2f07e-dcb9-4bb6-b199-e1badf7575ac tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:45.011211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-10e2f07e-dcb9-4bb6-b199-e1badf7575ac tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:45.015501 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-10e2f07e-dcb9-4bb6-b199-e1badf7575ac tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:45.015501 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-10e2f07e-dcb9-4bb6-b199-e1badf7575ac tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:45.015501 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-10e2f07e-dcb9-4bb6-b199-e1badf7575ac tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:45.015501 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-10e2f07e-dcb9-4bb6-b199-e1badf7575ac tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:45.042023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-10e2f07e-dcb9-4bb6-b199-e1badf7575ac tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044609 Aug 10 12:45:45.042580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 283/566] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:45:44 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:45:45.445064 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0f6a6a5e-6733-4b7f-bf11-3d9fb0a26e98 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:45.445711 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0f6a6a5e-6733-4b7f-bf11-3d9fb0a26e98 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:45.452371 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f6a6a5e-6733-4b7f-bf11-3d9fb0a26e98 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:45.452847 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f6a6a5e-6733-4b7f-bf11-3d9fb0a26e98 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:45.453275 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f6a6a5e-6733-4b7f-bf11-3d9fb0a26e98 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:45.453952 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f6a6a5e-6733-4b7f-bf11-3d9fb0a26e98 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:45.454439 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f6a6a5e-6733-4b7f-bf11-3d9fb0a26e98 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:45.454859 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f6a6a5e-6733-4b7f-bf11-3d9fb0a26e98 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:45.585598 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0f6a6a5e-6733-4b7f-bf11-3d9fb0a26e98 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:45.594448 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0f6a6a5e-6733-4b7f-bf11-3d9fb0a26e98 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.153337 Aug 10 12:45:45.595209 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 284/567] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:45 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:45.857084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e0014c60-cd5b-4728-9084-19f3dd3b2f0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:45.857681 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e0014c60-cd5b-4728-9084-19f3dd3b2f0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:45.863766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0014c60-cd5b-4728-9084-19f3dd3b2f0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:45.864237 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0014c60-cd5b-4728-9084-19f3dd3b2f0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:45.864662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0014c60-cd5b-4728-9084-19f3dd3b2f0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:45.865331 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0014c60-cd5b-4728-9084-19f3dd3b2f0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:45.865773 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0014c60-cd5b-4728-9084-19f3dd3b2f0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:45.866187 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0014c60-cd5b-4728-9084-19f3dd3b2f0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:45.925658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e0014c60-cd5b-4728-9084-19f3dd3b2f0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:45.933507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e0014c60-cd5b-4728-9084-19f3dd3b2f0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.080429 Aug 10 12:45:45.934064 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 284/568] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:45 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:46.054234 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d9b97f9d-47ff-423a-9b70-bd1a9986de90 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:46.056601 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d9b97f9d-47ff-423a-9b70-bd1a9986de90 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:46.062928 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d9b97f9d-47ff-423a-9b70-bd1a9986de90 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:46.063440 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d9b97f9d-47ff-423a-9b70-bd1a9986de90 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:46.063872 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d9b97f9d-47ff-423a-9b70-bd1a9986de90 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:46.064555 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d9b97f9d-47ff-423a-9b70-bd1a9986de90 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:46.065005 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d9b97f9d-47ff-423a-9b70-bd1a9986de90 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:46.065422 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d9b97f9d-47ff-423a-9b70-bd1a9986de90 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:46.094211 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d9b97f9d-47ff-423a-9b70-bd1a9986de90 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043999 Aug 10 12:45:46.094764 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 285/569] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:45:46 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:45:46.615828 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1cc7aced-4bb5-440f-a788-502660c725ab tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:46.616443 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1cc7aced-4bb5-440f-a788-502660c725ab tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:46.624737 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cc7aced-4bb5-440f-a788-502660c725ab tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:46.624737 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cc7aced-4bb5-440f-a788-502660c725ab tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:46.625097 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cc7aced-4bb5-440f-a788-502660c725ab tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:46.625861 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cc7aced-4bb5-440f-a788-502660c725ab tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:46.626373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cc7aced-4bb5-440f-a788-502660c725ab tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:46.626799 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cc7aced-4bb5-440f-a788-502660c725ab tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:46.772771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1cc7aced-4bb5-440f-a788-502660c725ab tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:46.781226 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1cc7aced-4bb5-440f-a788-502660c725ab tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.169608 Aug 10 12:45:46.781795 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 285/570] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:46 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:46.955121 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f5633040-3cd8-40e2-8a40-77fdf33aa3b2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:46.955750 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f5633040-3cd8-40e2-8a40-77fdf33aa3b2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:46.962004 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5633040-3cd8-40e2-8a40-77fdf33aa3b2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:46.963155 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5633040-3cd8-40e2-8a40-77fdf33aa3b2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:46.963612 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5633040-3cd8-40e2-8a40-77fdf33aa3b2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:46.964342 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5633040-3cd8-40e2-8a40-77fdf33aa3b2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:46.964789 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5633040-3cd8-40e2-8a40-77fdf33aa3b2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:46.965206 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5633040-3cd8-40e2-8a40-77fdf33aa3b2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:47.033299 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f5633040-3cd8-40e2-8a40-77fdf33aa3b2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:47.043125 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f5633040-3cd8-40e2-8a40-77fdf33aa3b2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.091842 Aug 10 12:45:47.043727 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 286/571] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:46 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:47.107079 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a054126b-b17d-4ed7-96e7-ca309ebeb9ae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:47.109239 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a054126b-b17d-4ed7-96e7-ca309ebeb9ae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:47.115949 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a054126b-b17d-4ed7-96e7-ca309ebeb9ae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:47.116434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a054126b-b17d-4ed7-96e7-ca309ebeb9ae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:47.116868 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a054126b-b17d-4ed7-96e7-ca309ebeb9ae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:47.119641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a054126b-b17d-4ed7-96e7-ca309ebeb9ae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:47.119641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a054126b-b17d-4ed7-96e7-ca309ebeb9ae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:47.119641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a054126b-b17d-4ed7-96e7-ca309ebeb9ae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:47.152785 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a054126b-b17d-4ed7-96e7-ca309ebeb9ae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050451 Aug 10 12:45:47.153539 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 286/572] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:45:47 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:45:47.803054 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-57c5bff4-81db-4726-bc63-667c2eb6ce9a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:47.803730 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-57c5bff4-81db-4726-bc63-667c2eb6ce9a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:47.810226 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57c5bff4-81db-4726-bc63-667c2eb6ce9a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:47.810712 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57c5bff4-81db-4726-bc63-667c2eb6ce9a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:47.811144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57c5bff4-81db-4726-bc63-667c2eb6ce9a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:47.811854 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57c5bff4-81db-4726-bc63-667c2eb6ce9a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:47.812306 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57c5bff4-81db-4726-bc63-667c2eb6ce9a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:47.812724 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57c5bff4-81db-4726-bc63-667c2eb6ce9a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:47.941021 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-57c5bff4-81db-4726-bc63-667c2eb6ce9a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:47.949529 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-57c5bff4-81db-4726-bc63-667c2eb6ce9a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.150342 Aug 10 12:45:47.950079 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 287/573] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:47 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:48.064523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-99d1ec50-ce58-40ed-919f-594a68cd7391 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:48.065153 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-99d1ec50-ce58-40ed-919f-594a68cd7391 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:48.071565 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99d1ec50-ce58-40ed-919f-594a68cd7391 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:48.072559 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99d1ec50-ce58-40ed-919f-594a68cd7391 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:48.073068 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99d1ec50-ce58-40ed-919f-594a68cd7391 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:48.073748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99d1ec50-ce58-40ed-919f-594a68cd7391 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:48.074193 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99d1ec50-ce58-40ed-919f-594a68cd7391 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:48.074611 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99d1ec50-ce58-40ed-919f-594a68cd7391 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:48.138482 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-99d1ec50-ce58-40ed-919f-594a68cd7391 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:48.145969 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-99d1ec50-ce58-40ed-919f-594a68cd7391 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.085241 Aug 10 12:45:48.146478 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 287/574] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:48 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:48.165203 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-397bf6a8-9c67-4e3d-af03-dc6e0c130132 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:48.167371 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-397bf6a8-9c67-4e3d-af03-dc6e0c130132 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:48.173303 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-397bf6a8-9c67-4e3d-af03-dc6e0c130132 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:48.173777 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-397bf6a8-9c67-4e3d-af03-dc6e0c130132 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:48.174211 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-397bf6a8-9c67-4e3d-af03-dc6e0c130132 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:48.174895 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-397bf6a8-9c67-4e3d-af03-dc6e0c130132 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:48.175378 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-397bf6a8-9c67-4e3d-af03-dc6e0c130132 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:48.175798 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-397bf6a8-9c67-4e3d-af03-dc6e0c130132 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:48.205142 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-397bf6a8-9c67-4e3d-af03-dc6e0c130132 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043846 Aug 10 12:45:48.205694 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 288/575] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:45:48 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:45:48.970828 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-57dda8bf-3a14-42b7-aacb-37d4a8314383 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:48.971408 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-57dda8bf-3a14-42b7-aacb-37d4a8314383 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:48.977469 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-57dda8bf-3a14-42b7-aacb-37d4a8314383 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:48.978616 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-57dda8bf-3a14-42b7-aacb-37d4a8314383 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:48.979029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-57dda8bf-3a14-42b7-aacb-37d4a8314383 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:48.979739 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-57dda8bf-3a14-42b7-aacb-37d4a8314383 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:48.980190 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-57dda8bf-3a14-42b7-aacb-37d4a8314383 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:48.980612 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-57dda8bf-3a14-42b7-aacb-37d4a8314383 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:49.106341 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-57dda8bf-3a14-42b7-aacb-37d4a8314383 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:49.114485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-57dda8bf-3a14-42b7-aacb-37d4a8314383 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.147548 Aug 10 12:45:49.115055 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 288/576] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:48 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:49.167319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fbc8bac5-bf1b-4a28-99e5-398e324f994d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:49.167924 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fbc8bac5-bf1b-4a28-99e5-398e324f994d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:49.174180 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fbc8bac5-bf1b-4a28-99e5-398e324f994d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:49.174650 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fbc8bac5-bf1b-4a28-99e5-398e324f994d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:49.175072 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fbc8bac5-bf1b-4a28-99e5-398e324f994d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:49.175770 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fbc8bac5-bf1b-4a28-99e5-398e324f994d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:49.176212 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fbc8bac5-bf1b-4a28-99e5-398e324f994d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:49.176629 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fbc8bac5-bf1b-4a28-99e5-398e324f994d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:49.217447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c4c3fa4a-3088-42fa-a897-c67cf83cc944 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:49.219618 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c4c3fa4a-3088-42fa-a897-c67cf83cc944 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:49.225447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4c3fa4a-3088-42fa-a897-c67cf83cc944 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:49.225862 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4c3fa4a-3088-42fa-a897-c67cf83cc944 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:49.226294 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4c3fa4a-3088-42fa-a897-c67cf83cc944 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:49.226979 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4c3fa4a-3088-42fa-a897-c67cf83cc944 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:49.227451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4c3fa4a-3088-42fa-a897-c67cf83cc944 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:49.228379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4c3fa4a-3088-42fa-a897-c67cf83cc944 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:49.237777 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fbc8bac5-bf1b-4a28-99e5-398e324f994d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:49.246270 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fbc8bac5-bf1b-4a28-99e5-398e324f994d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.083486 Aug 10 12:45:49.246893 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 289/577] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:49 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:49.258126 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c4c3fa4a-3088-42fa-a897-c67cf83cc944 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044555 Aug 10 12:45:49.258843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 289/578] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:45:49 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:45:50.136205 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-38456a3f-b198-4d8e-bc6f-6c3c2c5e70c0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:50.136781 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-38456a3f-b198-4d8e-bc6f-6c3c2c5e70c0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:50.142630 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-38456a3f-b198-4d8e-bc6f-6c3c2c5e70c0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:50.143104 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-38456a3f-b198-4d8e-bc6f-6c3c2c5e70c0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:50.143564 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-38456a3f-b198-4d8e-bc6f-6c3c2c5e70c0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:50.144246 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-38456a3f-b198-4d8e-bc6f-6c3c2c5e70c0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:50.144692 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-38456a3f-b198-4d8e-bc6f-6c3c2c5e70c0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:50.145107 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-38456a3f-b198-4d8e-bc6f-6c3c2c5e70c0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:50.269030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-488210b6-c0df-4db8-88bc-5ce6c1078d22 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:50.269798 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-488210b6-c0df-4db8-88bc-5ce6c1078d22 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:50.275319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-38456a3f-b198-4d8e-bc6f-6c3c2c5e70c0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:50.277258 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-488210b6-c0df-4db8-88bc-5ce6c1078d22 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:50.277750 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-488210b6-c0df-4db8-88bc-5ce6c1078d22 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:50.278187 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-488210b6-c0df-4db8-88bc-5ce6c1078d22 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:50.278885 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-488210b6-c0df-4db8-88bc-5ce6c1078d22 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:50.279532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-488210b6-c0df-4db8-88bc-5ce6c1078d22 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:50.280199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-488210b6-c0df-4db8-88bc-5ce6c1078d22 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:50.283941 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-38456a3f-b198-4d8e-bc6f-6c3c2c5e70c0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.152747 Aug 10 12:45:50.284650 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 290/579] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:50 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:50.289193 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d1bf6796-ce86-4bf1-b2c0-8d1e4259198f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:50.291572 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d1bf6796-ce86-4bf1-b2c0-8d1e4259198f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:50.297241 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1bf6796-ce86-4bf1-b2c0-8d1e4259198f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:50.297717 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1bf6796-ce86-4bf1-b2c0-8d1e4259198f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:50.298148 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1bf6796-ce86-4bf1-b2c0-8d1e4259198f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:50.298831 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1bf6796-ce86-4bf1-b2c0-8d1e4259198f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:50.299301 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1bf6796-ce86-4bf1-b2c0-8d1e4259198f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:50.299717 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1bf6796-ce86-4bf1-b2c0-8d1e4259198f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:50.329588 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d1bf6796-ce86-4bf1-b2c0-8d1e4259198f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043887 Aug 10 12:45:50.330156 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 291/580] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:45:50 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:45:50.344017 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-488210b6-c0df-4db8-88bc-5ce6c1078d22 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:50.351510 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-488210b6-c0df-4db8-88bc-5ce6c1078d22 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.088446 Aug 10 12:45:50.352116 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 290/581] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:50 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:51.305660 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6a17c1f8-3e6e-458d-8e88-aff264369aae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:51.306761 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6a17c1f8-3e6e-458d-8e88-aff264369aae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:51.312965 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a17c1f8-3e6e-458d-8e88-aff264369aae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:51.313445 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a17c1f8-3e6e-458d-8e88-aff264369aae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:51.313876 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a17c1f8-3e6e-458d-8e88-aff264369aae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:51.314563 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a17c1f8-3e6e-458d-8e88-aff264369aae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:51.315019 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a17c1f8-3e6e-458d-8e88-aff264369aae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:51.315480 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a17c1f8-3e6e-458d-8e88-aff264369aae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:51.342756 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2af1d3b3-d733-429d-88e6-466bcb28469f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:51.344905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2af1d3b3-d733-429d-88e6-466bcb28469f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:51.347348 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=72 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:45:51.351985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2af1d3b3-d733-429d-88e6-466bcb28469f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:51.352461 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2af1d3b3-d733-429d-88e6-466bcb28469f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:51.352888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2af1d3b3-d733-429d-88e6-466bcb28469f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:51.353882 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2af1d3b3-d733-429d-88e6-466bcb28469f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:51.354331 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2af1d3b3-d733-429d-88e6-466bcb28469f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:51.354752 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2af1d3b3-d733-429d-88e6-466bcb28469f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:51.385980 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2af1d3b3-d733-429d-88e6-466bcb28469f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047166 Aug 10 12:45:51.386549 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 291/582] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:45:51 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:45:51.391544 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ef17654d-9e5f-4c1f-87c1-278703dcf988 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:51.392140 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ef17654d-9e5f-4c1f-87c1-278703dcf988 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:51.397721 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef17654d-9e5f-4c1f-87c1-278703dcf988 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:51.398194 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef17654d-9e5f-4c1f-87c1-278703dcf988 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:51.398619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef17654d-9e5f-4c1f-87c1-278703dcf988 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:51.399336 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef17654d-9e5f-4c1f-87c1-278703dcf988 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:51.400811 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef17654d-9e5f-4c1f-87c1-278703dcf988 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:51.401409 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef17654d-9e5f-4c1f-87c1-278703dcf988 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:51.455115 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6a17c1f8-3e6e-458d-8e88-aff264369aae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:51.463857 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6a17c1f8-3e6e-458d-8e88-aff264369aae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.162052 Aug 10 12:45:51.464546 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 292/583] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:51 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:45:51.471535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ef17654d-9e5f-4c1f-87c1-278703dcf988 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:51.479806 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ef17654d-9e5f-4c1f-87c1-278703dcf988 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.091911 Aug 10 12:45:51.480372 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 292/584] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:51 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:52.398057 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4e883265-e7c1-43c4-bbe1-1483a632aac7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:52.400452 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4e883265-e7c1-43c4-bbe1-1483a632aac7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:52.406823 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4e883265-e7c1-43c4-bbe1-1483a632aac7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:52.407334 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4e883265-e7c1-43c4-bbe1-1483a632aac7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:52.407776 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4e883265-e7c1-43c4-bbe1-1483a632aac7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:52.408464 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4e883265-e7c1-43c4-bbe1-1483a632aac7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:52.408920 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4e883265-e7c1-43c4-bbe1-1483a632aac7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:52.409343 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4e883265-e7c1-43c4-bbe1-1483a632aac7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:52.439282 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4e883265-e7c1-43c4-bbe1-1483a632aac7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045180 Aug 10 12:45:52.439836 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 293/585] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:45:52 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:45:52.484943 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3c3eba1f-9487-44f4-ba92-9744a993cf3c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:52.485543 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3c3eba1f-9487-44f4-ba92-9744a993cf3c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:52.492150 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c3eba1f-9487-44f4-ba92-9744a993cf3c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:52.492622 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c3eba1f-9487-44f4-ba92-9744a993cf3c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:52.493055 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c3eba1f-9487-44f4-ba92-9744a993cf3c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:52.494265 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c3eba1f-9487-44f4-ba92-9744a993cf3c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:52.494819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c3eba1f-9487-44f4-ba92-9744a993cf3c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:52.495266 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c3eba1f-9487-44f4-ba92-9744a993cf3c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:52.499920 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0447c01d-b33d-4a71-aa7d-3111c9638a14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:52.506358 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0447c01d-b33d-4a71-aa7d-3111c9638a14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:52.506736 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0447c01d-b33d-4a71-aa7d-3111c9638a14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:52.507253 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0447c01d-b33d-4a71-aa7d-3111c9638a14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:52.507688 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0447c01d-b33d-4a71-aa7d-3111c9638a14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:52.508409 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0447c01d-b33d-4a71-aa7d-3111c9638a14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:52.508860 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0447c01d-b33d-4a71-aa7d-3111c9638a14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:52.509864 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0447c01d-b33d-4a71-aa7d-3111c9638a14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:52.592212 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0447c01d-b33d-4a71-aa7d-3111c9638a14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:52.599580 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0447c01d-b33d-4a71-aa7d-3111c9638a14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.103435 Aug 10 12:45:52.600148 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 294/586] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:52 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:45:52.650609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3c3eba1f-9487-44f4-ba92-9744a993cf3c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:52.658474 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3c3eba1f-9487-44f4-ba92-9744a993cf3c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.177358 Aug 10 12:45:52.659039 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 293/587] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:52 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:53.452866 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-801dddf6-b504-408c-8c83-7961f9d2fa67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:53.455074 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-801dddf6-b504-408c-8c83-7961f9d2fa67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:53.461388 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-801dddf6-b504-408c-8c83-7961f9d2fa67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:53.461860 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-801dddf6-b504-408c-8c83-7961f9d2fa67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:53.462290 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-801dddf6-b504-408c-8c83-7961f9d2fa67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:53.463005 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-801dddf6-b504-408c-8c83-7961f9d2fa67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:53.463799 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-801dddf6-b504-408c-8c83-7961f9d2fa67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:53.464223 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-801dddf6-b504-408c-8c83-7961f9d2fa67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:53.466510 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:45:53.494228 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-801dddf6-b504-408c-8c83-7961f9d2fa67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045391 Aug 10 12:45:53.495628 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 295/588] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:45:53 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:45:53.621620 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-92b0e774-22c8-4e52-bf12-c723e58bf271 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:53.622235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-92b0e774-22c8-4e52-bf12-c723e58bf271 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:53.628848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-92b0e774-22c8-4e52-bf12-c723e58bf271 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:53.629330 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-92b0e774-22c8-4e52-bf12-c723e58bf271 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:53.629764 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-92b0e774-22c8-4e52-bf12-c723e58bf271 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:53.630459 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-92b0e774-22c8-4e52-bf12-c723e58bf271 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:53.630910 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-92b0e774-22c8-4e52-bf12-c723e58bf271 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:53.631368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-92b0e774-22c8-4e52-bf12-c723e58bf271 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:53.679341 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-53e25f8c-1e36-46e6-934b-4bdeb84a8d72 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:53.679962 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-53e25f8c-1e36-46e6-934b-4bdeb84a8d72 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:53.687008 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53e25f8c-1e36-46e6-934b-4bdeb84a8d72 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:53.687608 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53e25f8c-1e36-46e6-934b-4bdeb84a8d72 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:53.688041 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53e25f8c-1e36-46e6-934b-4bdeb84a8d72 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:53.688740 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53e25f8c-1e36-46e6-934b-4bdeb84a8d72 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:53.689193 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53e25f8c-1e36-46e6-934b-4bdeb84a8d72 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:53.690238 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53e25f8c-1e36-46e6-934b-4bdeb84a8d72 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:53.692249 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-92b0e774-22c8-4e52-bf12-c723e58bf271 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:53.699548 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-92b0e774-22c8-4e52-bf12-c723e58bf271 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.082501 Aug 10 12:45:53.700121 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 294/589] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:53 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:53.824890 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-53e25f8c-1e36-46e6-934b-4bdeb84a8d72 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:53.832872 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-53e25f8c-1e36-46e6-934b-4bdeb84a8d72 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.157403 Aug 10 12:45:53.833452 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 296/590] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:53 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:45:54.507490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-66e313c7-18d6-4170-8c28-489f15e26aaa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:54.509723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-66e313c7-18d6-4170-8c28-489f15e26aaa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:54.516029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-66e313c7-18d6-4170-8c28-489f15e26aaa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:54.516504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-66e313c7-18d6-4170-8c28-489f15e26aaa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:54.516930 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-66e313c7-18d6-4170-8c28-489f15e26aaa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:54.517612 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-66e313c7-18d6-4170-8c28-489f15e26aaa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:54.518059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-66e313c7-18d6-4170-8c28-489f15e26aaa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:54.518478 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-66e313c7-18d6-4170-8c28-489f15e26aaa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:54.547271 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-66e313c7-18d6-4170-8c28-489f15e26aaa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043784 Aug 10 12:45:54.547911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 295/591] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:45:54 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:45:54.720364 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-17b3408c-04f5-4e62-8eed-bb94e0bd601e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:54.721002 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-17b3408c-04f5-4e62-8eed-bb94e0bd601e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:54.727395 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17b3408c-04f5-4e62-8eed-bb94e0bd601e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:54.727872 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17b3408c-04f5-4e62-8eed-bb94e0bd601e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:54.728304 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17b3408c-04f5-4e62-8eed-bb94e0bd601e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:54.729870 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17b3408c-04f5-4e62-8eed-bb94e0bd601e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:54.730320 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17b3408c-04f5-4e62-8eed-bb94e0bd601e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:54.730744 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17b3408c-04f5-4e62-8eed-bb94e0bd601e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:54.791929 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-17b3408c-04f5-4e62-8eed-bb94e0bd601e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:54.799269 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-17b3408c-04f5-4e62-8eed-bb94e0bd601e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.082716 Aug 10 12:45:54.799843 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 297/592] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:54 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:54.855950 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-167d7e44-7b38-4138-816b-cc4649307277 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:54.856559 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-167d7e44-7b38-4138-816b-cc4649307277 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:54.863360 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-167d7e44-7b38-4138-816b-cc4649307277 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:54.863843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-167d7e44-7b38-4138-816b-cc4649307277 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:54.864274 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-167d7e44-7b38-4138-816b-cc4649307277 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:54.864965 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-167d7e44-7b38-4138-816b-cc4649307277 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:54.865410 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-167d7e44-7b38-4138-816b-cc4649307277 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:54.865862 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-167d7e44-7b38-4138-816b-cc4649307277 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:54.993810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-167d7e44-7b38-4138-816b-cc4649307277 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:55.002319 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-167d7e44-7b38-4138-816b-cc4649307277 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.151105 Aug 10 12:45:55.002881 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 296/593] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:54 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:45:55.560341 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-95377a67-8432-4a5b-b346-80dd2497234c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:55.562447 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-95377a67-8432-4a5b-b346-80dd2497234c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:55.568567 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-95377a67-8432-4a5b-b346-80dd2497234c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:55.569039 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-95377a67-8432-4a5b-b346-80dd2497234c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:55.569467 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-95377a67-8432-4a5b-b346-80dd2497234c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:55.570142 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-95377a67-8432-4a5b-b346-80dd2497234c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:55.570582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-95377a67-8432-4a5b-b346-80dd2497234c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:55.571055 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-95377a67-8432-4a5b-b346-80dd2497234c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:55.600403 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-95377a67-8432-4a5b-b346-80dd2497234c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044354 Aug 10 12:45:55.600956 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 298/594] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:45:55 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:45:55.820473 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2fd2b8f3-2b71-4e8a-a209-4017d5e46e1b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:55.821002 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2fd2b8f3-2b71-4e8a-a209-4017d5e46e1b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:55.827029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2fd2b8f3-2b71-4e8a-a209-4017d5e46e1b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:55.827532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2fd2b8f3-2b71-4e8a-a209-4017d5e46e1b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:55.827964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2fd2b8f3-2b71-4e8a-a209-4017d5e46e1b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:55.828644 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2fd2b8f3-2b71-4e8a-a209-4017d5e46e1b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:55.829091 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2fd2b8f3-2b71-4e8a-a209-4017d5e46e1b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:55.829511 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2fd2b8f3-2b71-4e8a-a209-4017d5e46e1b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:55.892470 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2fd2b8f3-2b71-4e8a-a209-4017d5e46e1b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:55.894770 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:45:55.901075 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2fd2b8f3-2b71-4e8a-a209-4017d5e46e1b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.084265 Aug 10 12:45:55.905915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 297/595] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:55 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:56.024057 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-936723cb-3df9-43b1-aacf-63cc0d5f0149 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:56.024662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-936723cb-3df9-43b1-aacf-63cc0d5f0149 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:56.031150 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-936723cb-3df9-43b1-aacf-63cc0d5f0149 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:56.031665 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-936723cb-3df9-43b1-aacf-63cc0d5f0149 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:56.032092 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-936723cb-3df9-43b1-aacf-63cc0d5f0149 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:56.032777 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-936723cb-3df9-43b1-aacf-63cc0d5f0149 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:56.033223 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-936723cb-3df9-43b1-aacf-63cc0d5f0149 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:56.033640 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-936723cb-3df9-43b1-aacf-63cc0d5f0149 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:56.164863 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-936723cb-3df9-43b1-aacf-63cc0d5f0149 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:56.173430 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-936723cb-3df9-43b1-aacf-63cc0d5f0149 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.153235 Aug 10 12:45:56.173991 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 299/596] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:56 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:56.614504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0e9f746b-af73-4c36-aa86-1183620099fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:56.616720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0e9f746b-af73-4c36-aa86-1183620099fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:56.623109 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e9f746b-af73-4c36-aa86-1183620099fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:56.626771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e9f746b-af73-4c36-aa86-1183620099fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:56.626771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e9f746b-af73-4c36-aa86-1183620099fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:56.626771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e9f746b-af73-4c36-aa86-1183620099fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:56.626771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e9f746b-af73-4c36-aa86-1183620099fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:56.627152 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e9f746b-af73-4c36-aa86-1183620099fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:56.655802 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0e9f746b-af73-4c36-aa86-1183620099fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046164 Aug 10 12:45:56.656347 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 298/597] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:45:56 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:45:56.924837 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-46eefce5-41fb-41eb-a93b-759e1acb6202 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:56.925483 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-46eefce5-41fb-41eb-a93b-759e1acb6202 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:56.932150 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46eefce5-41fb-41eb-a93b-759e1acb6202 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:56.932738 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46eefce5-41fb-41eb-a93b-759e1acb6202 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:56.933203 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46eefce5-41fb-41eb-a93b-759e1acb6202 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:56.933889 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46eefce5-41fb-41eb-a93b-759e1acb6202 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:56.934331 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46eefce5-41fb-41eb-a93b-759e1acb6202 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:56.934747 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46eefce5-41fb-41eb-a93b-759e1acb6202 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:56.994977 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-46eefce5-41fb-41eb-a93b-759e1acb6202 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:57.002526 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-46eefce5-41fb-41eb-a93b-759e1acb6202 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.081465 Aug 10 12:45:57.003089 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 300/598] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:56 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:57.193771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d4c69ae4-361d-4217-b504-bc1d99a288e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:57.194381 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d4c69ae4-361d-4217-b504-bc1d99a288e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:57.201343 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d4c69ae4-361d-4217-b504-bc1d99a288e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:57.202006 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d4c69ae4-361d-4217-b504-bc1d99a288e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:57.202451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d4c69ae4-361d-4217-b504-bc1d99a288e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:57.203146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d4c69ae4-361d-4217-b504-bc1d99a288e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:57.203623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d4c69ae4-361d-4217-b504-bc1d99a288e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:57.204123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d4c69ae4-361d-4217-b504-bc1d99a288e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:57.334163 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d4c69ae4-361d-4217-b504-bc1d99a288e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:57.342778 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d4c69ae4-361d-4217-b504-bc1d99a288e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.152833 Aug 10 12:45:57.343373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 299/599] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:57 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:57.668625 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-23ca38cc-f3a8-4611-9b86-2765c8bf473f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:57.670774 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-23ca38cc-f3a8-4611-9b86-2765c8bf473f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:57.676640 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23ca38cc-f3a8-4611-9b86-2765c8bf473f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:57.677111 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23ca38cc-f3a8-4611-9b86-2765c8bf473f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:57.677537 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23ca38cc-f3a8-4611-9b86-2765c8bf473f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:57.678213 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23ca38cc-f3a8-4611-9b86-2765c8bf473f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:57.678656 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23ca38cc-f3a8-4611-9b86-2765c8bf473f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:57.679070 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23ca38cc-f3a8-4611-9b86-2765c8bf473f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:57.708054 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-23ca38cc-f3a8-4611-9b86-2765c8bf473f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043543 Aug 10 12:45:57.708604 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 301/600] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:45:57 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:45:58.023130 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8f24d9ec-5e38-4a58-9ad0-27ee8f6ed79d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:58.023761 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8f24d9ec-5e38-4a58-9ad0-27ee8f6ed79d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:58.029611 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f24d9ec-5e38-4a58-9ad0-27ee8f6ed79d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:58.030091 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f24d9ec-5e38-4a58-9ad0-27ee8f6ed79d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:58.030522 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f24d9ec-5e38-4a58-9ad0-27ee8f6ed79d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:58.031228 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f24d9ec-5e38-4a58-9ad0-27ee8f6ed79d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:58.031678 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f24d9ec-5e38-4a58-9ad0-27ee8f6ed79d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:58.032097 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f24d9ec-5e38-4a58-9ad0-27ee8f6ed79d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:58.091482 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8f24d9ec-5e38-4a58-9ad0-27ee8f6ed79d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:58.098799 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8f24d9ec-5e38-4a58-9ad0-27ee8f6ed79d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.079508 Aug 10 12:45:58.099480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 300/601] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:58 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:58.364049 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2bd444cc-419e-41bc-afac-5b8077595eb9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:58.364662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2bd444cc-419e-41bc-afac-5b8077595eb9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:58.371292 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bd444cc-419e-41bc-afac-5b8077595eb9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:58.371778 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bd444cc-419e-41bc-afac-5b8077595eb9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:58.372212 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bd444cc-419e-41bc-afac-5b8077595eb9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:58.372924 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bd444cc-419e-41bc-afac-5b8077595eb9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:58.373360 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bd444cc-419e-41bc-afac-5b8077595eb9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:58.373789 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bd444cc-419e-41bc-afac-5b8077595eb9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:58.500664 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2bd444cc-419e-41bc-afac-5b8077595eb9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:58.508524 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2bd444cc-419e-41bc-afac-5b8077595eb9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.148571 Aug 10 12:45:58.509104 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 302/602] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:58 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:58.720176 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d5b7b5c2-3fc6-466a-a13e-f71f5aabd763 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:58.722308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d5b7b5c2-3fc6-466a-a13e-f71f5aabd763 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:58.728638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d5b7b5c2-3fc6-466a-a13e-f71f5aabd763 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:58.729118 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d5b7b5c2-3fc6-466a-a13e-f71f5aabd763 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:58.729549 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d5b7b5c2-3fc6-466a-a13e-f71f5aabd763 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:58.730234 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d5b7b5c2-3fc6-466a-a13e-f71f5aabd763 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:58.730684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d5b7b5c2-3fc6-466a-a13e-f71f5aabd763 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:58.731105 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d5b7b5c2-3fc6-466a-a13e-f71f5aabd763 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:58.759436 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d5b7b5c2-3fc6-466a-a13e-f71f5aabd763 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043169 Aug 10 12:45:58.760533 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 301/603] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:45:58 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:45:59.120490 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-962e7353-4b89-45f6-80f9-ee9154f30d89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:59.121052 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-962e7353-4b89-45f6-80f9-ee9154f30d89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:59.126867 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-962e7353-4b89-45f6-80f9-ee9154f30d89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:59.127529 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-962e7353-4b89-45f6-80f9-ee9154f30d89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:59.127969 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-962e7353-4b89-45f6-80f9-ee9154f30d89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:59.128648 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-962e7353-4b89-45f6-80f9-ee9154f30d89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:59.129095 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-962e7353-4b89-45f6-80f9-ee9154f30d89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:59.129515 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-962e7353-4b89-45f6-80f9-ee9154f30d89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:59.192255 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-962e7353-4b89-45f6-80f9-ee9154f30d89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:59.199752 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-962e7353-4b89-45f6-80f9-ee9154f30d89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.083216 Aug 10 12:45:59.200319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 303/604] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:59 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:59.530377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0850dd93-9c31-41fc-8af7-2374824271a0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:59.530992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0850dd93-9c31-41fc-8af7-2374824271a0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:59.536936 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0850dd93-9c31-41fc-8af7-2374824271a0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:59.537423 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0850dd93-9c31-41fc-8af7-2374824271a0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:59.537860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0850dd93-9c31-41fc-8af7-2374824271a0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:59.538548 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0850dd93-9c31-41fc-8af7-2374824271a0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:59.539009 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0850dd93-9c31-41fc-8af7-2374824271a0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:59.539462 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0850dd93-9c31-41fc-8af7-2374824271a0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:59.664814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0850dd93-9c31-41fc-8af7-2374824271a0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:45:59.673055 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0850dd93-9c31-41fc-8af7-2374824271a0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.146702 Aug 10 12:45:59.673819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 302/605] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:45:59 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:45:59.772228 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-11bc27bd-aca1-4279-97de-626200815997 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:45:59.774361 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-11bc27bd-aca1-4279-97de-626200815997 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:45:59.781499 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11bc27bd-aca1-4279-97de-626200815997 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:59.781923 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11bc27bd-aca1-4279-97de-626200815997 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:59.782360 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11bc27bd-aca1-4279-97de-626200815997 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:59.783051 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11bc27bd-aca1-4279-97de-626200815997 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:45:59.783540 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11bc27bd-aca1-4279-97de-626200815997 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:45:59.783966 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11bc27bd-aca1-4279-97de-626200815997 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:45:59.812273 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-11bc27bd-aca1-4279-97de-626200815997 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043988 Aug 10 12:45:59.812830 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 304/606] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:45:59 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:00.220871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3069c96b-ed56-4e45-ad30-88217ec33ba3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:00.221484 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3069c96b-ed56-4e45-ad30-88217ec33ba3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:00.227811 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3069c96b-ed56-4e45-ad30-88217ec33ba3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:00.228809 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3069c96b-ed56-4e45-ad30-88217ec33ba3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:00.229263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3069c96b-ed56-4e45-ad30-88217ec33ba3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:00.229954 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3069c96b-ed56-4e45-ad30-88217ec33ba3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:00.230404 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3069c96b-ed56-4e45-ad30-88217ec33ba3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:00.230827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3069c96b-ed56-4e45-ad30-88217ec33ba3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:00.292332 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3069c96b-ed56-4e45-ad30-88217ec33ba3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:46:00.299929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3069c96b-ed56-4e45-ad30-88217ec33ba3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.082842 Aug 10 12:46:00.300493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 303/607] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:46:00 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:46:00.694251 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-22cc6303-a914-4856-819f-9b5139a2879d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:00.694917 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-22cc6303-a914-4856-819f-9b5139a2879d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:00.701115 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22cc6303-a914-4856-819f-9b5139a2879d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:00.701596 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22cc6303-a914-4856-819f-9b5139a2879d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:00.702031 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22cc6303-a914-4856-819f-9b5139a2879d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:00.702720 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22cc6303-a914-4856-819f-9b5139a2879d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:00.703203 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22cc6303-a914-4856-819f-9b5139a2879d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:00.703646 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22cc6303-a914-4856-819f-9b5139a2879d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:00.824956 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-329b7148-01cd-459a-a63b-5bd2e801abf3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:00.826969 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-329b7148-01cd-459a-a63b-5bd2e801abf3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:00.832095 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-22cc6303-a914-4856-819f-9b5139a2879d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:46:00.833851 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-329b7148-01cd-459a-a63b-5bd2e801abf3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:00.834540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-329b7148-01cd-459a-a63b-5bd2e801abf3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:00.834980 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-329b7148-01cd-459a-a63b-5bd2e801abf3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:00.836263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-329b7148-01cd-459a-a63b-5bd2e801abf3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:00.836720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-329b7148-01cd-459a-a63b-5bd2e801abf3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:00.837147 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-329b7148-01cd-459a-a63b-5bd2e801abf3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:00.840753 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-22cc6303-a914-4856-819f-9b5139a2879d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.150295 Aug 10 12:46:00.846775 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 305/608] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:46:00 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:46:00.867654 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-329b7148-01cd-459a-a63b-5bd2e801abf3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046925 Aug 10 12:46:00.869877 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 304/609] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:00 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:46:01.321241 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8c57e625-dbd2-4d72-87fe-23d158dcbf68 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:01.321856 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8c57e625-dbd2-4d72-87fe-23d158dcbf68 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:01.328504 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8c57e625-dbd2-4d72-87fe-23d158dcbf68 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:01.328985 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8c57e625-dbd2-4d72-87fe-23d158dcbf68 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:01.329419 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8c57e625-dbd2-4d72-87fe-23d158dcbf68 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:01.330102 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8c57e625-dbd2-4d72-87fe-23d158dcbf68 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:01.330551 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8c57e625-dbd2-4d72-87fe-23d158dcbf68 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:01.330973 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8c57e625-dbd2-4d72-87fe-23d158dcbf68 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:01.392357 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-8c57e625-dbd2-4d72-87fe-23d158dcbf68 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:46:01.399763 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8c57e625-dbd2-4d72-87fe-23d158dcbf68 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.082331 Aug 10 12:46:01.400468 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 306/610] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:46:01 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:46:01.863500 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-56739ad6-3c75-47dd-b969-69902c442d6e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:01.864110 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-56739ad6-3c75-47dd-b969-69902c442d6e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:01.871161 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56739ad6-3c75-47dd-b969-69902c442d6e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:01.871671 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56739ad6-3c75-47dd-b969-69902c442d6e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:01.872108 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56739ad6-3c75-47dd-b969-69902c442d6e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:01.872794 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56739ad6-3c75-47dd-b969-69902c442d6e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:01.873249 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56739ad6-3c75-47dd-b969-69902c442d6e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:01.873669 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56739ad6-3c75-47dd-b969-69902c442d6e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:01.880441 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d686e802-c94d-4019-8423-10c29b776a6f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:01.882468 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d686e802-c94d-4019-8423-10c29b776a6f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:01.888845 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d686e802-c94d-4019-8423-10c29b776a6f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:01.889319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d686e802-c94d-4019-8423-10c29b776a6f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:01.889744 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d686e802-c94d-4019-8423-10c29b776a6f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:01.890433 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d686e802-c94d-4019-8423-10c29b776a6f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:01.890880 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d686e802-c94d-4019-8423-10c29b776a6f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:01.891319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d686e802-c94d-4019-8423-10c29b776a6f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:01.920290 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d686e802-c94d-4019-8423-10c29b776a6f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043937 Aug 10 12:46:01.920869 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 307/611] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:01 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:46:02.002482 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-56739ad6-3c75-47dd-b969-69902c442d6e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:46:02.010554 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-56739ad6-3c75-47dd-b969-69902c442d6e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.151258 Aug 10 12:46:02.011124 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 305/612] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:46:01 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:46:02.421181 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0a6e2082-ffef-425d-b69a-2c45f9d70740 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:02.421785 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0a6e2082-ffef-425d-b69a-2c45f9d70740 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:02.427779 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0a6e2082-ffef-425d-b69a-2c45f9d70740 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:02.428247 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0a6e2082-ffef-425d-b69a-2c45f9d70740 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:02.428670 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0a6e2082-ffef-425d-b69a-2c45f9d70740 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:02.429348 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0a6e2082-ffef-425d-b69a-2c45f9d70740 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:02.429790 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0a6e2082-ffef-425d-b69a-2c45f9d70740 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:02.430204 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0a6e2082-ffef-425d-b69a-2c45f9d70740 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:02.494700 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0a6e2082-ffef-425d-b69a-2c45f9d70740 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:46:02.502424 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0a6e2082-ffef-425d-b69a-2c45f9d70740 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.085643 Aug 10 12:46:02.502994 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 308/613] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:46:02 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:46:02.933311 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6649c8c7-c8f5-4ee6-81f4-b125920a2e4b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:02.935560 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6649c8c7-c8f5-4ee6-81f4-b125920a2e4b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:02.941912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6649c8c7-c8f5-4ee6-81f4-b125920a2e4b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:02.942398 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6649c8c7-c8f5-4ee6-81f4-b125920a2e4b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:02.942833 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6649c8c7-c8f5-4ee6-81f4-b125920a2e4b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:02.944071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6649c8c7-c8f5-4ee6-81f4-b125920a2e4b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:02.944071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6649c8c7-c8f5-4ee6-81f4-b125920a2e4b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:02.944409 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6649c8c7-c8f5-4ee6-81f4-b125920a2e4b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:02.974793 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6649c8c7-c8f5-4ee6-81f4-b125920a2e4b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046007 Aug 10 12:46:02.975389 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 306/614] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:02 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:03.032225 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1306ef25-86e2-40dd-80bb-c3b8e99d4bb3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:03.032890 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1306ef25-86e2-40dd-80bb-c3b8e99d4bb3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:03.039646 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1306ef25-86e2-40dd-80bb-c3b8e99d4bb3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:03.040127 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1306ef25-86e2-40dd-80bb-c3b8e99d4bb3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:03.040566 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1306ef25-86e2-40dd-80bb-c3b8e99d4bb3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:03.042027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1306ef25-86e2-40dd-80bb-c3b8e99d4bb3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:03.043053 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1306ef25-86e2-40dd-80bb-c3b8e99d4bb3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:03.043530 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1306ef25-86e2-40dd-80bb-c3b8e99d4bb3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:03.385720 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-1306ef25-86e2-40dd-80bb-c3b8e99d4bb3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:46:03.393543 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1306ef25-86e2-40dd-80bb-c3b8e99d4bb3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.365306 Aug 10 12:46:03.394111 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 309/615] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:46:03 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:46:03.523325 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-891fe47e-771f-4026-89e8-ed0da4fa84f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:03.523932 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-891fe47e-771f-4026-89e8-ed0da4fa84f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:03.530142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-891fe47e-771f-4026-89e8-ed0da4fa84f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:03.530619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-891fe47e-771f-4026-89e8-ed0da4fa84f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:03.531074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-891fe47e-771f-4026-89e8-ed0da4fa84f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:03.531795 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-891fe47e-771f-4026-89e8-ed0da4fa84f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:03.532238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-891fe47e-771f-4026-89e8-ed0da4fa84f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:03.532658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-891fe47e-771f-4026-89e8-ed0da4fa84f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:03.594393 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-891fe47e-771f-4026-89e8-ed0da4fa84f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:46:03.601727 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-891fe47e-771f-4026-89e8-ed0da4fa84f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.082267 Aug 10 12:46:03.602290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 307/616] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:46:03 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:46:03.988305 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-818b7e01-a203-4f11-a23a-6b7ed12ae6bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:03.990352 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-818b7e01-a203-4f11-a23a-6b7ed12ae6bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:03.992216 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=82 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:46:03.996989 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-818b7e01-a203-4f11-a23a-6b7ed12ae6bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:03.997571 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-818b7e01-a203-4f11-a23a-6b7ed12ae6bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:03.998004 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-818b7e01-a203-4f11-a23a-6b7ed12ae6bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:03.998681 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-818b7e01-a203-4f11-a23a-6b7ed12ae6bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:03.999248 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-818b7e01-a203-4f11-a23a-6b7ed12ae6bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:03.999664 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-818b7e01-a203-4f11-a23a-6b7ed12ae6bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:04.029939 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-818b7e01-a203-4f11-a23a-6b7ed12ae6bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045930 Aug 10 12:46:04.030491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 310/617] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:03 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:04.413751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d36d8825-e39e-496f-b604-50e77947f099 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:04.414361 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d36d8825-e39e-496f-b604-50e77947f099 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:04.421351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d36d8825-e39e-496f-b604-50e77947f099 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:04.421826 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d36d8825-e39e-496f-b604-50e77947f099 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:04.422255 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d36d8825-e39e-496f-b604-50e77947f099 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:04.422969 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d36d8825-e39e-496f-b604-50e77947f099 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:04.423448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d36d8825-e39e-496f-b604-50e77947f099 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:04.423872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d36d8825-e39e-496f-b604-50e77947f099 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:04.558388 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d36d8825-e39e-496f-b604-50e77947f099 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:46:04.566454 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d36d8825-e39e-496f-b604-50e77947f099 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.156602 Aug 10 12:46:04.567027 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 308/618] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:46:04 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:46:04.623436 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fbf7a7fd-0038-4155-9672-26c791117f33 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:04.624048 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fbf7a7fd-0038-4155-9672-26c791117f33 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:04.630328 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fbf7a7fd-0038-4155-9672-26c791117f33 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:04.630807 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fbf7a7fd-0038-4155-9672-26c791117f33 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:04.631266 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fbf7a7fd-0038-4155-9672-26c791117f33 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:04.631950 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fbf7a7fd-0038-4155-9672-26c791117f33 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:04.632460 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fbf7a7fd-0038-4155-9672-26c791117f33 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:04.632815 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fbf7a7fd-0038-4155-9672-26c791117f33 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:04.693681 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fbf7a7fd-0038-4155-9672-26c791117f33 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:46:04.695847 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:46:04.702359 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fbf7a7fd-0038-4155-9672-26c791117f33 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1326 microversion: 2.1 time: 0.082825 Aug 10 12:46:04.710605 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 311/619] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:46:04 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1326 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:46:05.041487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bd823cb9-3033-407d-b517-52df2e542e6e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:05.043667 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bd823cb9-3033-407d-b517-52df2e542e6e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:05.049714 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd823cb9-3033-407d-b517-52df2e542e6e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:05.050199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd823cb9-3033-407d-b517-52df2e542e6e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:05.050636 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd823cb9-3033-407d-b517-52df2e542e6e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:05.051360 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd823cb9-3033-407d-b517-52df2e542e6e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:05.051812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd823cb9-3033-407d-b517-52df2e542e6e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:05.052239 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd823cb9-3033-407d-b517-52df2e542e6e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:05.080712 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bd823cb9-3033-407d-b517-52df2e542e6e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043304 Aug 10 12:46:05.081267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 309/620] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:05 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:05.588760 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-56d52f18-b1bf-492b-a063-03d6c1696a38 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:05.589298 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-56d52f18-b1bf-492b-a063-03d6c1696a38 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:05.595411 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56d52f18-b1bf-492b-a063-03d6c1696a38 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:05.595887 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56d52f18-b1bf-492b-a063-03d6c1696a38 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:05.596312 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56d52f18-b1bf-492b-a063-03d6c1696a38 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:05.596992 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56d52f18-b1bf-492b-a063-03d6c1696a38 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:05.597435 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56d52f18-b1bf-492b-a063-03d6c1696a38 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:05.597851 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56d52f18-b1bf-492b-a063-03d6c1696a38 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:05.730273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-afabd594-2595-4d80-a07a-56f89ae5ac26 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:05.730946 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-afabd594-2595-4d80-a07a-56f89ae5ac26 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:05.731927 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-56d52f18-b1bf-492b-a063-03d6c1696a38 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:46:05.737825 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-afabd594-2595-4d80-a07a-56f89ae5ac26 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:05.738375 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-afabd594-2595-4d80-a07a-56f89ae5ac26 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:05.738872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-afabd594-2595-4d80-a07a-56f89ae5ac26 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:05.739689 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-afabd594-2595-4d80-a07a-56f89ae5ac26 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:05.740082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-56d52f18-b1bf-492b-a063-03d6c1696a38 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.155970 Aug 10 12:46:05.740259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-afabd594-2595-4d80-a07a-56f89ae5ac26 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:05.740651 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 312/621] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:46:05 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:46:05.740758 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-afabd594-2595-4d80-a07a-56f89ae5ac26 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:05.771476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-afabd594-2595-4d80-a07a-56f89ae5ac26 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:05.771946 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-afabd594-2595-4d80-a07a-56f89ae5ac26 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:05.772372 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-afabd594-2595-4d80-a07a-56f89ae5ac26 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:05.772812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.objects.instance [None req-afabd594-2595-4d80-a07a-56f89ae5ac26 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lazy-loading 'fault' on Instance uuid 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 {{(pid=124643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:46:05.813737 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-afabd594-2595-4d80-a07a-56f89ae5ac26 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:46:05.821371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-afabd594-2595-4d80-a07a-56f89ae5ac26 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1331 microversion: 2.1 time: 0.095139 Aug 10 12:46:05.821974 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 310/622] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:46:05 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:46:06.093559 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-24e42429-1bf4-4db6-9e87-409787d8f5d9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:06.095680 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-24e42429-1bf4-4db6-9e87-409787d8f5d9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:06.101654 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24e42429-1bf4-4db6-9e87-409787d8f5d9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:06.102128 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24e42429-1bf4-4db6-9e87-409787d8f5d9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:06.102555 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24e42429-1bf4-4db6-9e87-409787d8f5d9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:06.104068 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24e42429-1bf4-4db6-9e87-409787d8f5d9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:06.104568 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24e42429-1bf4-4db6-9e87-409787d8f5d9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:06.104985 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24e42429-1bf4-4db6-9e87-409787d8f5d9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:06.132980 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-24e42429-1bf4-4db6-9e87-409787d8f5d9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043444 Aug 10 12:46:06.133517 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 313/623] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:06 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:06.762633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-37eca3e6-d360-44b5-bacc-ceb42b1db464 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:06.763289 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-37eca3e6-d360-44b5-bacc-ceb42b1db464 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:06.773142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-37eca3e6-d360-44b5-bacc-ceb42b1db464 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:06.773638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-37eca3e6-d360-44b5-bacc-ceb42b1db464 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:06.774064 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-37eca3e6-d360-44b5-bacc-ceb42b1db464 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:06.774807 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-37eca3e6-d360-44b5-bacc-ceb42b1db464 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:06.775956 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-37eca3e6-d360-44b5-bacc-ceb42b1db464 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:06.776381 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-37eca3e6-d360-44b5-bacc-ceb42b1db464 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:06.843085 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a777a02f-3ccb-4d9a-9d36-97428748a6db tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:06.843752 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a777a02f-3ccb-4d9a-9d36-97428748a6db tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:06.850022 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a777a02f-3ccb-4d9a-9d36-97428748a6db tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:06.850529 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a777a02f-3ccb-4d9a-9d36-97428748a6db tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:06.850976 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a777a02f-3ccb-4d9a-9d36-97428748a6db tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:06.851686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a777a02f-3ccb-4d9a-9d36-97428748a6db tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:06.852131 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a777a02f-3ccb-4d9a-9d36-97428748a6db tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:06.852545 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a777a02f-3ccb-4d9a-9d36-97428748a6db tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:06.884523 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a777a02f-3ccb-4d9a-9d36-97428748a6db tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:06.885009 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a777a02f-3ccb-4d9a-9d36-97428748a6db tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:06.885433 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a777a02f-3ccb-4d9a-9d36-97428748a6db tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:06.885878 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.objects.instance [None req-a777a02f-3ccb-4d9a-9d36-97428748a6db tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lazy-loading 'fault' on Instance uuid 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 {{(pid=124642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:46:06.992118 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a777a02f-3ccb-4d9a-9d36-97428748a6db tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:46:06.999547 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a777a02f-3ccb-4d9a-9d36-97428748a6db tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 200 len: 1331 microversion: 2.1 time: 0.160237 Aug 10 12:46:07.000133 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 314/624] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:46:06 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 1331 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:46:07.075953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-37eca3e6-d360-44b5-bacc-ceb42b1db464 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:46:07.084853 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-37eca3e6-d360-44b5-bacc-ceb42b1db464 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.327445 Aug 10 12:46:07.085583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 311/625] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:46:06 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:46:07.145855 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6192feff-9282-4f33-b840-849d5ea91ec4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:07.148044 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6192feff-9282-4f33-b840-849d5ea91ec4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:07.154642 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6192feff-9282-4f33-b840-849d5ea91ec4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:07.157268 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6192feff-9282-4f33-b840-849d5ea91ec4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:07.157268 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6192feff-9282-4f33-b840-849d5ea91ec4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:07.157268 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6192feff-9282-4f33-b840-849d5ea91ec4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:07.157268 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6192feff-9282-4f33-b840-849d5ea91ec4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:07.157759 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6192feff-9282-4f33-b840-849d5ea91ec4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:07.186197 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6192feff-9282-4f33-b840-849d5ea91ec4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044410 Aug 10 12:46:07.186724 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 315/626] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:07 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:08.021949 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4beb7fbb-4784-481c-b742-f35a55afe081 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:08.022558 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4beb7fbb-4784-481c-b742-f35a55afe081 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:08.029084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4beb7fbb-4784-481c-b742-f35a55afe081 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:08.029564 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4beb7fbb-4784-481c-b742-f35a55afe081 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:08.029994 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4beb7fbb-4784-481c-b742-f35a55afe081 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:08.030685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4beb7fbb-4784-481c-b742-f35a55afe081 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:08.031133 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4beb7fbb-4784-481c-b742-f35a55afe081 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:08.031581 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4beb7fbb-4784-481c-b742-f35a55afe081 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:08.045304 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-4beb7fbb-4784-481c-b742-f35a55afe081 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] HTTP exception thrown: Instance 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 could not be found. Aug 10 12:46:08.046945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4beb7fbb-4784-481c-b742-f35a55afe081 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Request method failure captured: Aug 10 12:46:08.046945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 HTTP/1.1 Aug 10 12:46:08.046945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 12:46:08.046945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 12:46:08.046945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 12:46:08.046945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 12:46:08.046945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 12:46:08.046945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 12:46:08.046945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 12:46:08.046945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 12:46:08.046945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86eGBGdgG-u30FY8ayuf9_oWfGm9Ue4wmiSD5HqZh9YFv6FZKb_K68ZxcABXBS1rsdBpDNgeZy47c1LKjpCTnjQZpQhdzFdsloDzIBkPWEMNrwJi0km_Dv-TGwCe6OdPlftNtoByFeD3k29rbgMXrfvFX26pc9GnUHHvgZESD2gvxTQ Aug 10 12:46:08.046945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 12:46:08.046945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 12:46:08.046945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 12:46:08.046945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 12:46:08.046945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 12:46:08.046945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 12:46:08.046945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: a2857015013f466d95f3a9037925c6fc Aug 10 12:46:08.046945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 12:46:08.046945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 12:46:08.046945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 12:46:08.048493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2857015013f466d95f3a9037925c6fc", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 12:46:08.048493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 12:46:08.048493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: a2857015013f466d95f3a9037925c6fc Aug 10 12:46:08.048493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 12:46:08.048493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-AttachVolumeNegativeTest-1707265238-project Aug 10 12:46:08.048493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 12:46:08.048493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 12:46:08.048493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 570c2a77b862411083b9444f8292192b Aug 10 12:46:08.048493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-AttachVolumeNegativeTest-1707265238-project Aug 10 12:46:08.048493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 12:46:08.048493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 could not be found. Aug 10 12:46:08.048493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': '9d0315a8-29f9-4d6e-9298-f5a1d0d69e36'} Aug 10 12:46:08.049317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:46:08.049317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:46:08.049317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 12:46:08.049317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 12:46:08.049317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 12:46:08.049317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 12:46:08.049317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 12:46:08.049317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 12:46:08.049317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 12:46:08.049317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 12:46:08.049317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 could not be found. Aug 10 12:46:08.049317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:46:08.049317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:46:08.049317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:46:08.049317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:46:08.049317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:46:08.049317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:46:08.049317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:46:08.049317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:46:08.049317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:46:08.050733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:46:08.050733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 12:46:08.050733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 12:46:08.050733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 12:46:08.050733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 12:46:08.050733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 12:46:08.050733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 12:46:08.050733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 could not be found. Aug 10 12:46:08.050733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:46:08.050733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:46:08.050733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:46:08.050733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:46:08.050733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:46:08.050733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:46:08.050733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:46:08.050733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:46:08.050733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 could not be found. Aug 10 12:46:08.050733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 12:46:08.052065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4beb7fbb-4784-481c-b742-f35a55afe081 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Returning 404 to user: Instance 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:46:08.052065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4beb7fbb-4784-481c-b742-f35a55afe081 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 404 len: 111 microversion: 2.1 time: 0.030281 Aug 10 12:46:08.052065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 312/627] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:46:08 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 12:46:08.057781 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9a2c7354-5448-4bdc-b6a6-35edd2baa86c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '.version_select at 0x7fb826919820>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:08.108916 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-584e22e2-ccbe-45ce-b02c-267f3ff69d73 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:08.109523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-584e22e2-ccbe-45ce-b02c-267f3ff69d73 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:08.115772 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-584e22e2-ccbe-45ce-b02c-267f3ff69d73 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:08.116255 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-584e22e2-ccbe-45ce-b02c-267f3ff69d73 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:08.116666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-584e22e2-ccbe-45ce-b02c-267f3ff69d73 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:08.117347 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-584e22e2-ccbe-45ce-b02c-267f3ff69d73 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:08.117798 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-584e22e2-ccbe-45ce-b02c-267f3ff69d73 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:08.118217 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-584e22e2-ccbe-45ce-b02c-267f3ff69d73 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:08.134302 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9a2c7354-5448-4bdc-b6a6-35edd2baa86c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1990573583" status: 202 len: 0 microversion: 2.1 time: 0.080751 Aug 10 12:46:08.134932 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 316/628] 10.222.0.49 () {58 vars in 1221 bytes} [Wed Aug 10 12:46:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1990573583 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:46:08.199037 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a8996c49-86bd-47ee-b502-b75b6bdb616f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:08.201245 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a8996c49-86bd-47ee-b502-b75b6bdb616f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:08.209016 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a8996c49-86bd-47ee-b502-b75b6bdb616f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:08.209618 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a8996c49-86bd-47ee-b502-b75b6bdb616f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:08.210284 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a8996c49-86bd-47ee-b502-b75b6bdb616f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:08.211315 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a8996c49-86bd-47ee-b502-b75b6bdb616f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:08.211924 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a8996c49-86bd-47ee-b502-b75b6bdb616f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:08.213169 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a8996c49-86bd-47ee-b502-b75b6bdb616f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:08.270636 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a8996c49-86bd-47ee-b502-b75b6bdb616f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076611 Aug 10 12:46:08.271336 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 317/629] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:08 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:46:08.280148 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-584e22e2-ccbe-45ce-b02c-267f3ff69d73 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:46:08.285984 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-584e22e2-ccbe-45ce-b02c-267f3ff69d73 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.180743 Aug 10 12:46:08.286565 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 313/630] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:46:08 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:46:08.911109 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f19f3a02-c1df-40c5-8c75-702c9600f48c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:08.911632 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f19f3a02-c1df-40c5-8c75-702c9600f48c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:08.918185 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f19f3a02-c1df-40c5-8c75-702c9600f48c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:08.918698 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f19f3a02-c1df-40c5-8c75-702c9600f48c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:08.919114 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f19f3a02-c1df-40c5-8c75-702c9600f48c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:08.921787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f19f3a02-c1df-40c5-8c75-702c9600f48c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:08.921787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f19f3a02-c1df-40c5-8c75-702c9600f48c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:08.921787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f19f3a02-c1df-40c5-8c75-702c9600f48c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:09.000459 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.objects.instance [None req-f19f3a02-c1df-40c5-8c75-702c9600f48c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lazy-loading 'services' on Instance uuid fad49521-8b28-4a9f-a4a0-88e41b5a1566 {{(pid=124642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:46:09.205197 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f19f3a02-c1df-40c5-8c75-702c9600f48c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments/71d6da2e-35ff-4038-9ec8-9618a65cf0cf" status: 202 len: 0 microversion: 2.1 time: 0.297996 Aug 10 12:46:09.205890 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 318/631] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 10 12:46:08 2022] DELETE /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments/71d6da2e-35ff-4038-9ec8-9618a65cf0cf => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:46:09.215399 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-78208481-d447-4092-b289-16c1d416a966 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:09.217531 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-78208481-d447-4092-b289-16c1d416a966 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:09.223992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-78208481-d447-4092-b289-16c1d416a966 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:09.224473 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-78208481-d447-4092-b289-16c1d416a966 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:09.224906 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-78208481-d447-4092-b289-16c1d416a966 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:09.225588 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-78208481-d447-4092-b289-16c1d416a966 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:09.226034 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-78208481-d447-4092-b289-16c1d416a966 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:09.226451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-78208481-d447-4092-b289-16c1d416a966 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:09.251835 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:46:09.256444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-78208481-d447-4092-b289-16c1d416a966 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046243 Aug 10 12:46:09.257191 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 314/632] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:09 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:09.289261 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ea3661ba-435e-41fe-9e55-fb9e6934212e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:09.291750 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ea3661ba-435e-41fe-9e55-fb9e6934212e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:09.297925 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ea3661ba-435e-41fe-9e55-fb9e6934212e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:09.298427 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ea3661ba-435e-41fe-9e55-fb9e6934212e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:09.298865 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ea3661ba-435e-41fe-9e55-fb9e6934212e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:09.299581 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ea3661ba-435e-41fe-9e55-fb9e6934212e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:09.300039 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ea3661ba-435e-41fe-9e55-fb9e6934212e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:09.300460 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ea3661ba-435e-41fe-9e55-fb9e6934212e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:09.309256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-23929a01-a913-4f70-9a0a-2736b8c5479f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:09.309867 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-23929a01-a913-4f70-9a0a-2736b8c5479f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:09.315948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23929a01-a913-4f70-9a0a-2736b8c5479f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:09.316439 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23929a01-a913-4f70-9a0a-2736b8c5479f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:09.316876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23929a01-a913-4f70-9a0a-2736b8c5479f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:09.317571 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23929a01-a913-4f70-9a0a-2736b8c5479f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:09.318042 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23929a01-a913-4f70-9a0a-2736b8c5479f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:09.318464 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23929a01-a913-4f70-9a0a-2736b8c5479f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:09.332790 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ea3661ba-435e-41fe-9e55-fb9e6934212e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047826 Aug 10 12:46:09.336299 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 319/633] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:09 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:09.456557 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-23929a01-a913-4f70-9a0a-2736b8c5479f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:46:09.467196 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-23929a01-a913-4f70-9a0a-2736b8c5479f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1716 microversion: 2.1 time: 0.162906 Aug 10 12:46:09.467811 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 315/634] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:46:09 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1716 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:46:09.700858 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b2582cbd-380b-4389-bc42-aa1039d4b000 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:09.701392 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b2582cbd-380b-4389-bc42-aa1039d4b000 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:09.707155 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2582cbd-380b-4389-bc42-aa1039d4b000 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:09.707656 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2582cbd-380b-4389-bc42-aa1039d4b000 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:09.708085 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2582cbd-380b-4389-bc42-aa1039d4b000 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:09.708788 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2582cbd-380b-4389-bc42-aa1039d4b000 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:09.709233 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2582cbd-380b-4389-bc42-aa1039d4b000 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:09.709650 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2582cbd-380b-4389-bc42-aa1039d4b000 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:09.787029 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.wsgi [None req-b2582cbd-380b-4389-bc42-aa1039d4b000 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] HTTP exception thrown: Cannot 'detach_volume' instance 3181426f-eb81-4712-97c6-8c92b61f53a0 while it is in vm_state rescued Aug 10 12:46:09.788662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b2582cbd-380b-4389-bc42-aa1039d4b000 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Request method failure captured: Aug 10 12:46:09.788662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: request: DELETE /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments/9d435d52-7025-4eb5-97f9-cd775f5c3424 HTTP/1.1 Aug 10 12:46:09.788662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Accept: application/json Aug 10 12:46:09.788662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Accept-Encoding: identity Aug 10 12:46:09.788662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Connection: close Aug 10 12:46:09.788662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Content-Length: 0 Aug 10 12:46:09.788662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Content-Type: application/json Aug 10 12:46:09.788662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Host: 10.222.0.49 Aug 10 12:46:09.788662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Openstack-System-Scope: None Aug 10 12:46:09.788662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: User-Agent: python-urllib3/1.26.11 Aug 10 12:46:09.788662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Auth-Token: gAAAAABi86d8V7Brrx6jOFb99Co-FDZwmEvtyDVeYnH8_iANB7J0NxUN2f-snlAn2yDbwcWxDSfsOagaBhqRjhpuGGTJmnsBdXVXFojbAKSvab6i25pKG57S3rU9tOP4hLmZxjdwtg8aiJEX4QrfavtV7g9rCLVXL55K3jqoDXD9Uxp38OaL_Fg Aug 10 12:46:09.788662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Domain-Id: None Aug 10 12:46:09.788662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Domain-Name: None Aug 10 12:46:09.788662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Identity-Status: Confirmed Aug 10 12:46:09.788662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Is-Admin-Project: True Aug 10 12:46:09.788662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Project-Domain-Id: default Aug 10 12:46:09.788662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Project-Domain-Name: Default Aug 10 12:46:09.788662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Project-Id: e41d5b8acbce44248a45678d1e4f6b71 Aug 10 12:46:09.788662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1112223756 Aug 10 12:46:09.788662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Role: reader,member Aug 10 12:46:09.788662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Roles: reader,member Aug 10 12:46:09.790222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e41d5b8acbce44248a45678d1e4f6b71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e41d5b8acbce44248a45678d1e4f6b71", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e41d5b8acbce44248a45678d1e4f6b71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e41d5b8acbce44248a45678d1e4f6b71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 12:46:09.790222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1112223756 Aug 10 12:46:09.790222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Tenant-Id: e41d5b8acbce44248a45678d1e4f6b71 Aug 10 12:46:09.790222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1112223756 Aug 10 12:46:09.790222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User: tempest-ServerRescueNegativeTestJSON-1112223756-project Aug 10 12:46:09.790222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User-Domain-Id: default Aug 10 12:46:09.790222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User-Domain-Name: Default Aug 10 12:46:09.790222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User-Id: 39cb7e0c86b3460dbd17c58dc13ef0d9 Aug 10 12:46:09.790222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1112223756-project Aug 10 12:46:09.790222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: method: > Aug 10 12:46:09.790222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: exception: Cannot 'detach_volume' instance 3181426f-eb81-4712-97c6-8c92b61f53a0 while it is in vm_state rescued Aug 10 12:46:09.791796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: action_args: {'server_id': '3181426f-eb81-4712-97c6-8c92b61f53a0', 'id': '9d435d52-7025-4eb5-97f9-cd775f5c3424'} Aug 10 12:46:09.791796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 12:46:09.791796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:46:09.791796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 10 12:46:09.791796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 10 12:46:09.791796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 12:46:09.791796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 12:46:09.791796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 12:46:09.791796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 12:46:09.791796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3181426f-eb81-4712-97c6-8c92b61f53a0 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 10 12:46:09.791796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:46:09.791796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:46:09.791796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:46:09.791796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:46:09.791796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:46:09.791796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:46:09.791796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 12:46:09.791796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 12:46:09.791796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 12:46:09.791796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 12:46:09.793221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 10 12:46:09.793221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 12:46:09.793221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 12:46:09.793221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 12:46:09.793221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3181426f-eb81-4712-97c6-8c92b61f53a0 while it is in vm_state rescued Aug 10 12:46:09.793221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:46:09.793221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 12:46:09.793221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:46:09.793221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 12:46:09.793221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 12:46:09.793221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 12:46:09.793221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 12:46:09.793221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 12:46:09.793221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3181426f-eb81-4712-97c6-8c92b61f53a0 while it is in vm_state rescued Aug 10 12:46:09.793221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: ERROR nova.api.openstack.wsgi Aug 10 12:46:09.793221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b2582cbd-380b-4389-bc42-aa1039d4b000 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Returning 409 to user: Cannot 'detach_volume' instance 3181426f-eb81-4712-97c6-8c92b61f53a0 while it is in vm_state rescued {{(pid=124642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 12:46:09.794683 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b2582cbd-380b-4389-bc42-aa1039d4b000 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments/9d435d52-7025-4eb5-97f9-cd775f5c3424" status: 409 len: 152 microversion: 2.1 time: 0.093917 Aug 10 12:46:09.794683 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 320/635] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 10 12:46:09 2022] DELETE /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments/9d435d52-7025-4eb5-97f9-cd775f5c3424 => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 12:46:09.799508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7d68ff55-5dff-4534-8214-e46e0ae5f945 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:46:09.800041 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7d68ff55-5dff-4534-8214-e46e0ae5f945 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:09.805855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d68ff55-5dff-4534-8214-e46e0ae5f945 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:09.806388 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d68ff55-5dff-4534-8214-e46e0ae5f945 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:09.806990 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d68ff55-5dff-4534-8214-e46e0ae5f945 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:09.807707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d68ff55-5dff-4534-8214-e46e0ae5f945 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:09.808153 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d68ff55-5dff-4534-8214-e46e0ae5f945 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:09.808574 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d68ff55-5dff-4534-8214-e46e0ae5f945 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:09.965448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7d68ff55-5dff-4534-8214-e46e0ae5f945 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "POST /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/action" status: 202 len: 0 microversion: 2.1 time: 0.169582 Aug 10 12:46:09.966090 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 316/636] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 10 12:46:09 2022] POST /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:46:09.974344 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9102c578-3cbd-424a-8574-fe507af85cd1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:09.974939 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9102c578-3cbd-424a-8574-fe507af85cd1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:09.980966 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9102c578-3cbd-424a-8574-fe507af85cd1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:09.981497 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9102c578-3cbd-424a-8574-fe507af85cd1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:09.981886 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9102c578-3cbd-424a-8574-fe507af85cd1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:09.982573 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9102c578-3cbd-424a-8574-fe507af85cd1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:09.983017 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9102c578-3cbd-424a-8574-fe507af85cd1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:09.983464 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9102c578-3cbd-424a-8574-fe507af85cd1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:10.193864 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9102c578-3cbd-424a-8574-fe507af85cd1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:46:10.202641 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9102c578-3cbd-424a-8574-fe507af85cd1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1724 microversion: 2.1 time: 0.232084 Aug 10 12:46:10.203228 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 321/637] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:46:09 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:46:10.270717 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b06c68e9-1a1d-4cfd-92e9-623052e189fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:10.272989 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b06c68e9-1a1d-4cfd-92e9-623052e189fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:10.280176 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b06c68e9-1a1d-4cfd-92e9-623052e189fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:10.280672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b06c68e9-1a1d-4cfd-92e9-623052e189fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:10.281102 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b06c68e9-1a1d-4cfd-92e9-623052e189fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:10.281978 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b06c68e9-1a1d-4cfd-92e9-623052e189fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:10.282435 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b06c68e9-1a1d-4cfd-92e9-623052e189fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:10.282861 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b06c68e9-1a1d-4cfd-92e9-623052e189fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:10.316536 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b06c68e9-1a1d-4cfd-92e9-623052e189fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050810 Aug 10 12:46:10.317100 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 317/638] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:10 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:10.345325 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-cc8e8d67-b413-4f20-9328-23809d655130 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:10.347643 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-cc8e8d67-b413-4f20-9328-23809d655130 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:10.354584 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc8e8d67-b413-4f20-9328-23809d655130 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:10.355056 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc8e8d67-b413-4f20-9328-23809d655130 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:10.355523 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc8e8d67-b413-4f20-9328-23809d655130 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:10.356209 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc8e8d67-b413-4f20-9328-23809d655130 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:10.356651 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc8e8d67-b413-4f20-9328-23809d655130 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:10.357063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc8e8d67-b413-4f20-9328-23809d655130 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:10.386374 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-cc8e8d67-b413-4f20-9328-23809d655130 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044913 Aug 10 12:46:10.386948 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 322/639] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:10 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:11.224202 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7c7f1422-f3ab-48ae-9703-ac9322f626a6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:11.224723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7c7f1422-f3ab-48ae-9703-ac9322f626a6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:11.230688 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c7f1422-f3ab-48ae-9703-ac9322f626a6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:11.231166 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c7f1422-f3ab-48ae-9703-ac9322f626a6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:11.231628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c7f1422-f3ab-48ae-9703-ac9322f626a6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:11.232310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c7f1422-f3ab-48ae-9703-ac9322f626a6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:11.232764 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c7f1422-f3ab-48ae-9703-ac9322f626a6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:11.233187 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c7f1422-f3ab-48ae-9703-ac9322f626a6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:11.330374 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-19ecffe2-357e-48c4-b0f3-92bcdd997fbf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:11.332779 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-19ecffe2-357e-48c4-b0f3-92bcdd997fbf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:11.339737 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19ecffe2-357e-48c4-b0f3-92bcdd997fbf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:11.340085 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19ecffe2-357e-48c4-b0f3-92bcdd997fbf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:11.340749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19ecffe2-357e-48c4-b0f3-92bcdd997fbf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:11.341456 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19ecffe2-357e-48c4-b0f3-92bcdd997fbf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:11.341905 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19ecffe2-357e-48c4-b0f3-92bcdd997fbf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:11.342321 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19ecffe2-357e-48c4-b0f3-92bcdd997fbf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:11.368258 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7c7f1422-f3ab-48ae-9703-ac9322f626a6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:46:11.372715 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-19ecffe2-357e-48c4-b0f3-92bcdd997fbf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046461 Aug 10 12:46:11.373279 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 323/640] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:11 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:46:11.376908 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7c7f1422-f3ab-48ae-9703-ac9322f626a6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1724 microversion: 2.1 time: 0.156680 Aug 10 12:46:11.377468 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 318/641] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:46:11 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:46:11.397601 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b896d38e-645a-4f7a-899d-f25d2d78a5ee tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:11.399781 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b896d38e-645a-4f7a-899d-f25d2d78a5ee tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:11.405671 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b896d38e-645a-4f7a-899d-f25d2d78a5ee tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:11.406143 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b896d38e-645a-4f7a-899d-f25d2d78a5ee tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:11.406569 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b896d38e-645a-4f7a-899d-f25d2d78a5ee tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:11.407600 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b896d38e-645a-4f7a-899d-f25d2d78a5ee tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:11.408045 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b896d38e-645a-4f7a-899d-f25d2d78a5ee tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:11.408467 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b896d38e-645a-4f7a-899d-f25d2d78a5ee tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:11.436582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b896d38e-645a-4f7a-899d-f25d2d78a5ee tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042741 Aug 10 12:46:11.437133 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 324/642] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:11 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:12.384689 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-64638833-1404-4387-9a20-acf1d95b35d4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:12.387285 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-64638833-1404-4387-9a20-acf1d95b35d4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:12.393775 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64638833-1404-4387-9a20-acf1d95b35d4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:12.394251 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64638833-1404-4387-9a20-acf1d95b35d4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:12.394675 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64638833-1404-4387-9a20-acf1d95b35d4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:12.395389 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64638833-1404-4387-9a20-acf1d95b35d4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:12.395836 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64638833-1404-4387-9a20-acf1d95b35d4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:12.396250 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64638833-1404-4387-9a20-acf1d95b35d4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:12.397822 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2200c7b1-ff44-4a9b-af62-cb012e7ec0a9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:12.398727 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2200c7b1-ff44-4a9b-af62-cb012e7ec0a9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:12.405929 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2200c7b1-ff44-4a9b-af62-cb012e7ec0a9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:12.406413 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2200c7b1-ff44-4a9b-af62-cb012e7ec0a9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:12.406851 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2200c7b1-ff44-4a9b-af62-cb012e7ec0a9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:12.407639 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2200c7b1-ff44-4a9b-af62-cb012e7ec0a9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:12.408308 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2200c7b1-ff44-4a9b-af62-cb012e7ec0a9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:12.408515 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2200c7b1-ff44-4a9b-af62-cb012e7ec0a9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:12.426551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-64638833-1404-4387-9a20-acf1d95b35d4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046276 Aug 10 12:46:12.427199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 319/643] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:12 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:12.449647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ac4d300c-1bd8-49a8-88ea-35044412528a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:12.451808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ac4d300c-1bd8-49a8-88ea-35044412528a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:12.457664 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac4d300c-1bd8-49a8-88ea-35044412528a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:12.458145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac4d300c-1bd8-49a8-88ea-35044412528a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:12.458578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac4d300c-1bd8-49a8-88ea-35044412528a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:12.459296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac4d300c-1bd8-49a8-88ea-35044412528a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:12.459750 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac4d300c-1bd8-49a8-88ea-35044412528a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:12.460175 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac4d300c-1bd8-49a8-88ea-35044412528a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:12.489888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ac4d300c-1bd8-49a8-88ea-35044412528a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044705 Aug 10 12:46:12.490456 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 320/644] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:12 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:46:12.538625 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2200c7b1-ff44-4a9b-af62-cb012e7ec0a9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:46:12.548023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2200c7b1-ff44-4a9b-af62-cb012e7ec0a9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1724 microversion: 2.1 time: 0.153914 Aug 10 12:46:12.554560 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 325/645] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:46:12 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:46:13.438091 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3925fe81-362a-4629-b2ec-fd7d0d25936e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:13.440278 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3925fe81-362a-4629-b2ec-fd7d0d25936e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:13.446681 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3925fe81-362a-4629-b2ec-fd7d0d25936e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:13.447136 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3925fe81-362a-4629-b2ec-fd7d0d25936e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:13.447597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3925fe81-362a-4629-b2ec-fd7d0d25936e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:13.448277 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3925fe81-362a-4629-b2ec-fd7d0d25936e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:13.448753 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3925fe81-362a-4629-b2ec-fd7d0d25936e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:13.449168 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3925fe81-362a-4629-b2ec-fd7d0d25936e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:13.477391 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3925fe81-362a-4629-b2ec-fd7d0d25936e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043393 Aug 10 12:46:13.477929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 321/646] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:13 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:13.502150 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ebccfefb-05bb-4a80-970a-427968cf1f3a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:13.504289 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ebccfefb-05bb-4a80-970a-427968cf1f3a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:13.510571 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebccfefb-05bb-4a80-970a-427968cf1f3a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:13.511040 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebccfefb-05bb-4a80-970a-427968cf1f3a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:13.511504 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebccfefb-05bb-4a80-970a-427968cf1f3a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:13.512198 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebccfefb-05bb-4a80-970a-427968cf1f3a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:13.512624 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebccfefb-05bb-4a80-970a-427968cf1f3a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:13.513041 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebccfefb-05bb-4a80-970a-427968cf1f3a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:13.541066 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ebccfefb-05bb-4a80-970a-427968cf1f3a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042798 Aug 10 12:46:13.542124 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 326/647] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:13 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:13.574092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7787f417-aa9e-4b22-b259-cd51d87790ba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:13.574767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7787f417-aa9e-4b22-b259-cd51d87790ba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:13.580693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7787f417-aa9e-4b22-b259-cd51d87790ba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:13.581171 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7787f417-aa9e-4b22-b259-cd51d87790ba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:13.581605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7787f417-aa9e-4b22-b259-cd51d87790ba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:13.582285 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7787f417-aa9e-4b22-b259-cd51d87790ba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:13.582731 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7787f417-aa9e-4b22-b259-cd51d87790ba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:13.583154 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7787f417-aa9e-4b22-b259-cd51d87790ba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:13.709711 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7787f417-aa9e-4b22-b259-cd51d87790ba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:46:13.717817 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7787f417-aa9e-4b22-b259-cd51d87790ba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1730 microversion: 2.1 time: 0.147923 Aug 10 12:46:13.718385 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 322/648] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:46:13 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:46:13.738701 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-724f88d6-513c-48b6-b8ec-0c17ed9420b6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:13.739209 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-724f88d6-513c-48b6-b8ec-0c17ed9420b6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:13.745666 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-724f88d6-513c-48b6-b8ec-0c17ed9420b6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:13.746134 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-724f88d6-513c-48b6-b8ec-0c17ed9420b6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:13.746563 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-724f88d6-513c-48b6-b8ec-0c17ed9420b6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:13.747263 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-724f88d6-513c-48b6-b8ec-0c17ed9420b6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:13.747711 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-724f88d6-513c-48b6-b8ec-0c17ed9420b6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:13.748132 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-724f88d6-513c-48b6-b8ec-0c17ed9420b6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:13.827110 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-724f88d6-513c-48b6-b8ec-0c17ed9420b6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092417 Aug 10 12:46:13.827750 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 327/649] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 10 12:46:13 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:14.490494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2979a698-3248-44e5-aea1-55b4184990c0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:14.492707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2979a698-3248-44e5-aea1-55b4184990c0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:14.500105 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2979a698-3248-44e5-aea1-55b4184990c0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:14.500588 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2979a698-3248-44e5-aea1-55b4184990c0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:14.501016 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2979a698-3248-44e5-aea1-55b4184990c0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:14.501706 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2979a698-3248-44e5-aea1-55b4184990c0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:14.502154 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2979a698-3248-44e5-aea1-55b4184990c0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:14.502579 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2979a698-3248-44e5-aea1-55b4184990c0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:14.532633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2979a698-3248-44e5-aea1-55b4184990c0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046156 Aug 10 12:46:14.533206 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 323/650] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:14 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:14.554133 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d91c57ee-e113-4984-a8e5-9810cd28a3bb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:14.556313 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d91c57ee-e113-4984-a8e5-9810cd28a3bb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:14.562757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d91c57ee-e113-4984-a8e5-9810cd28a3bb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:14.563261 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d91c57ee-e113-4984-a8e5-9810cd28a3bb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:14.563694 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d91c57ee-e113-4984-a8e5-9810cd28a3bb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:14.564383 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d91c57ee-e113-4984-a8e5-9810cd28a3bb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:14.564825 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d91c57ee-e113-4984-a8e5-9810cd28a3bb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:14.565239 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d91c57ee-e113-4984-a8e5-9810cd28a3bb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:14.591103 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:46:14.596042 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d91c57ee-e113-4984-a8e5-9810cd28a3bb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046421 Aug 10 12:46:14.596725 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 328/651] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:14 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:14.767066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-335fa780-93df-4225-b9d8-0f698d66a0ec req-3716b6e0-8946-4d7e-bb56-b26dc13d14b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3181426f-eb81-4712-97c6-8c92b61f53a0", "tag": "bd12d9c9-bde7-4a2b-92de-b4401e6328ab"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:46:14.777076 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-335fa780-93df-4225-b9d8-0f698d66a0ec req-3716b6e0-8946-4d7e-bb56-b26dc13d14b9 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:14.777798 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-335fa780-93df-4225-b9d8-0f698d66a0ec req-3716b6e0-8946-4d7e-bb56-b26dc13d14b9 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:14.778236 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-335fa780-93df-4225-b9d8-0f698d66a0ec req-3716b6e0-8946-4d7e-bb56-b26dc13d14b9 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:14.790499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-335fa780-93df-4225-b9d8-0f698d66a0ec req-3716b6e0-8946-4d7e-bb56-b26dc13d14b9 service nova] Creating event network-changed:bd12d9c9-bde7-4a2b-92de-b4401e6328ab for instance 3181426f-eb81-4712-97c6-8c92b61f53a0 on hv-cinder-85199 Aug 10 12:46:14.795743 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-335fa780-93df-4225-b9d8-0f698d66a0ec req-3716b6e0-8946-4d7e-bb56-b26dc13d14b9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032202 Aug 10 12:46:14.796325 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 324/652] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:15.545579 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3e2d9d91-94e6-4488-a2bb-cc8a2bdc7211 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:15.548126 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3e2d9d91-94e6-4488-a2bb-cc8a2bdc7211 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:15.555283 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e2d9d91-94e6-4488-a2bb-cc8a2bdc7211 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:15.555896 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e2d9d91-94e6-4488-a2bb-cc8a2bdc7211 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:15.556228 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e2d9d91-94e6-4488-a2bb-cc8a2bdc7211 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:15.557491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e2d9d91-94e6-4488-a2bb-cc8a2bdc7211 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:15.558281 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e2d9d91-94e6-4488-a2bb-cc8a2bdc7211 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:15.558707 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e2d9d91-94e6-4488-a2bb-cc8a2bdc7211 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:15.589501 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3e2d9d91-94e6-4488-a2bb-cc8a2bdc7211 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048391 Aug 10 12:46:15.590076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 329/653] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:15 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:15.618598 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a95c0c85-59c5-4b39-aa2a-d22cdf51b447 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:15.621487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a95c0c85-59c5-4b39-aa2a-d22cdf51b447 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:15.627924 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a95c0c85-59c5-4b39-aa2a-d22cdf51b447 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:15.628589 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a95c0c85-59c5-4b39-aa2a-d22cdf51b447 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:15.629036 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a95c0c85-59c5-4b39-aa2a-d22cdf51b447 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:15.629734 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a95c0c85-59c5-4b39-aa2a-d22cdf51b447 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:15.630181 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a95c0c85-59c5-4b39-aa2a-d22cdf51b447 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:15.630777 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a95c0c85-59c5-4b39-aa2a-d22cdf51b447 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:15.663641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a95c0c85-59c5-4b39-aa2a-d22cdf51b447 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049810 Aug 10 12:46:15.664210 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 325/654] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:15 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:16.601770 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a982a2cc-60d6-4270-9268-8a3c077b1bb9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:16.604153 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a982a2cc-60d6-4270-9268-8a3c077b1bb9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:16.610855 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a982a2cc-60d6-4270-9268-8a3c077b1bb9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:16.613809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a982a2cc-60d6-4270-9268-8a3c077b1bb9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:16.613809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a982a2cc-60d6-4270-9268-8a3c077b1bb9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:16.613809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a982a2cc-60d6-4270-9268-8a3c077b1bb9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:16.613809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a982a2cc-60d6-4270-9268-8a3c077b1bb9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:16.614160 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a982a2cc-60d6-4270-9268-8a3c077b1bb9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:16.642793 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a982a2cc-60d6-4270-9268-8a3c077b1bb9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044982 Aug 10 12:46:16.643380 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 330/655] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:16 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:16.675310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e2dd2bfa-c7f6-4b29-911b-ff11c92ad16d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:16.677451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e2dd2bfa-c7f6-4b29-911b-ff11c92ad16d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:16.684311 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2dd2bfa-c7f6-4b29-911b-ff11c92ad16d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:16.684792 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2dd2bfa-c7f6-4b29-911b-ff11c92ad16d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:16.685228 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2dd2bfa-c7f6-4b29-911b-ff11c92ad16d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:16.685916 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2dd2bfa-c7f6-4b29-911b-ff11c92ad16d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:16.686370 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2dd2bfa-c7f6-4b29-911b-ff11c92ad16d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:16.686796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2dd2bfa-c7f6-4b29-911b-ff11c92ad16d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:16.715622 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e2dd2bfa-c7f6-4b29-911b-ff11c92ad16d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044135 Aug 10 12:46:16.716105 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 326/656] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:16 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:16.809997 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [req-4a82a2ae-91b4-4541-85b3-b75b76c26447 req-63fabaf8-7cb7-40f0-9847-f8d86265a191 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3181426f-eb81-4712-97c6-8c92b61f53a0", "tag": "bd12d9c9-bde7-4a2b-92de-b4401e6328ab"}]} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:46:16.819106 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-4a82a2ae-91b4-4541-85b3-b75b76c26447 req-63fabaf8-7cb7-40f0-9847-f8d86265a191 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:16.819618 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-4a82a2ae-91b4-4541-85b3-b75b76c26447 req-63fabaf8-7cb7-40f0-9847-f8d86265a191 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:16.820386 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-4a82a2ae-91b4-4541-85b3-b75b76c26447 req-63fabaf8-7cb7-40f0-9847-f8d86265a191 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:16.830995 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.compute.server_external_events [req-4a82a2ae-91b4-4541-85b3-b75b76c26447 req-63fabaf8-7cb7-40f0-9847-f8d86265a191 service nova] Creating event network-changed:bd12d9c9-bde7-4a2b-92de-b4401e6328ab for instance 3181426f-eb81-4712-97c6-8c92b61f53a0 on hv-cinder-85199 Aug 10 12:46:16.836110 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [req-4a82a2ae-91b4-4541-85b3-b75b76c26447 req-63fabaf8-7cb7-40f0-9847-f8d86265a191 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030399 Aug 10 12:46:16.836691 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 331/657] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 12:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:17.654940 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c41f970e-24c6-4b70-ba05-a5ffe5bec731 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:17.657195 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c41f970e-24c6-4b70-ba05-a5ffe5bec731 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:17.663113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c41f970e-24c6-4b70-ba05-a5ffe5bec731 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:17.663620 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c41f970e-24c6-4b70-ba05-a5ffe5bec731 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:17.664054 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c41f970e-24c6-4b70-ba05-a5ffe5bec731 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:17.664795 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c41f970e-24c6-4b70-ba05-a5ffe5bec731 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:17.665246 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c41f970e-24c6-4b70-ba05-a5ffe5bec731 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:17.665667 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c41f970e-24c6-4b70-ba05-a5ffe5bec731 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:17.695651 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c41f970e-24c6-4b70-ba05-a5ffe5bec731 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045532 Aug 10 12:46:17.696661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 327/658] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:17 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:17.729178 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-60838f1f-54f3-4dde-86a6-d6bfbe537073 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:17.731475 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-60838f1f-54f3-4dde-86a6-d6bfbe537073 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:17.737816 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60838f1f-54f3-4dde-86a6-d6bfbe537073 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:17.738295 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60838f1f-54f3-4dde-86a6-d6bfbe537073 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:17.738742 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60838f1f-54f3-4dde-86a6-d6bfbe537073 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:17.739439 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60838f1f-54f3-4dde-86a6-d6bfbe537073 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:17.739890 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60838f1f-54f3-4dde-86a6-d6bfbe537073 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:17.740308 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60838f1f-54f3-4dde-86a6-d6bfbe537073 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:17.769630 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-60838f1f-54f3-4dde-86a6-d6bfbe537073 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045434 Aug 10 12:46:17.770190 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 332/659] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:17 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:18.710594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8830f7c1-e814-4f40-9199-8edcd2e18b96 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:18.710594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8830f7c1-e814-4f40-9199-8edcd2e18b96 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:18.717139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8830f7c1-e814-4f40-9199-8edcd2e18b96 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:18.717620 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8830f7c1-e814-4f40-9199-8edcd2e18b96 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:18.718043 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8830f7c1-e814-4f40-9199-8edcd2e18b96 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:18.718731 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8830f7c1-e814-4f40-9199-8edcd2e18b96 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:18.719185 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8830f7c1-e814-4f40-9199-8edcd2e18b96 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:18.719616 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8830f7c1-e814-4f40-9199-8edcd2e18b96 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:18.749254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8830f7c1-e814-4f40-9199-8edcd2e18b96 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044713 Aug 10 12:46:18.749804 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 328/660] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:18 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:18.781343 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b863ab71-3b3f-4f5d-86e5-1effc98d0ac2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:18.783439 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b863ab71-3b3f-4f5d-86e5-1effc98d0ac2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:18.789744 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b863ab71-3b3f-4f5d-86e5-1effc98d0ac2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:18.790218 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b863ab71-3b3f-4f5d-86e5-1effc98d0ac2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:18.790648 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b863ab71-3b3f-4f5d-86e5-1effc98d0ac2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:18.791380 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b863ab71-3b3f-4f5d-86e5-1effc98d0ac2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:18.791872 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b863ab71-3b3f-4f5d-86e5-1effc98d0ac2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:18.792288 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b863ab71-3b3f-4f5d-86e5-1effc98d0ac2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:18.820548 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b863ab71-3b3f-4f5d-86e5-1effc98d0ac2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043261 Aug 10 12:46:18.821090 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 333/661] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:18 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:19.762604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5ea944e7-7d67-4fbe-97c7-470adc78e775 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:19.764749 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5ea944e7-7d67-4fbe-97c7-470adc78e775 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:19.770991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ea944e7-7d67-4fbe-97c7-470adc78e775 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:19.771501 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ea944e7-7d67-4fbe-97c7-470adc78e775 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:19.771929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ea944e7-7d67-4fbe-97c7-470adc78e775 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:19.772604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ea944e7-7d67-4fbe-97c7-470adc78e775 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:19.773047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ea944e7-7d67-4fbe-97c7-470adc78e775 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:19.773464 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ea944e7-7d67-4fbe-97c7-470adc78e775 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:19.802946 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5ea944e7-7d67-4fbe-97c7-470adc78e775 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045221 Aug 10 12:46:19.803447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 329/662] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:19 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:19.833362 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9ff8110e-a55d-47a9-af39-56daa2828caf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:19.835528 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9ff8110e-a55d-47a9-af39-56daa2828caf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:19.842598 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ff8110e-a55d-47a9-af39-56daa2828caf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:19.843069 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ff8110e-a55d-47a9-af39-56daa2828caf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:19.843523 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ff8110e-a55d-47a9-af39-56daa2828caf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:19.844201 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ff8110e-a55d-47a9-af39-56daa2828caf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:19.844644 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ff8110e-a55d-47a9-af39-56daa2828caf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:19.845056 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ff8110e-a55d-47a9-af39-56daa2828caf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:19.874242 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9ff8110e-a55d-47a9-af39-56daa2828caf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044752 Aug 10 12:46:19.874791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 334/663] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:19 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:20.815458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bc4d0996-d46b-4264-b09d-e4d89558779c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:20.817575 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bc4d0996-d46b-4264-b09d-e4d89558779c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:20.824292 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc4d0996-d46b-4264-b09d-e4d89558779c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:20.824714 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc4d0996-d46b-4264-b09d-e4d89558779c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:20.825150 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc4d0996-d46b-4264-b09d-e4d89558779c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:20.825837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc4d0996-d46b-4264-b09d-e4d89558779c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:20.826285 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc4d0996-d46b-4264-b09d-e4d89558779c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:20.826702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc4d0996-d46b-4264-b09d-e4d89558779c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:20.856907 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bc4d0996-d46b-4264-b09d-e4d89558779c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045370 Aug 10 12:46:20.857474 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 330/664] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:20 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:20.886011 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-60704b17-1d67-4727-8a0e-fd063823956d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:20.888173 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-60704b17-1d67-4727-8a0e-fd063823956d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:20.894724 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60704b17-1d67-4727-8a0e-fd063823956d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:20.895230 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60704b17-1d67-4727-8a0e-fd063823956d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:20.895658 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60704b17-1d67-4727-8a0e-fd063823956d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:20.900990 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60704b17-1d67-4727-8a0e-fd063823956d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:20.900990 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60704b17-1d67-4727-8a0e-fd063823956d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:20.900990 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60704b17-1d67-4727-8a0e-fd063823956d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:20.927024 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-60704b17-1d67-4727-8a0e-fd063823956d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045092 Aug 10 12:46:20.927616 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 335/665] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:20 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:21.869345 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9a7c03af-f6a3-45ce-9574-3f3757372a63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:21.871662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9a7c03af-f6a3-45ce-9574-3f3757372a63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:21.874101 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=82 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:46:21.884599 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a7c03af-f6a3-45ce-9574-3f3757372a63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:21.885242 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a7c03af-f6a3-45ce-9574-3f3757372a63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:21.885684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a7c03af-f6a3-45ce-9574-3f3757372a63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:21.886385 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a7c03af-f6a3-45ce-9574-3f3757372a63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:21.886836 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a7c03af-f6a3-45ce-9574-3f3757372a63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:21.888485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a7c03af-f6a3-45ce-9574-3f3757372a63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:21.890976 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:46:21.918025 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9a7c03af-f6a3-45ce-9574-3f3757372a63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052685 Aug 10 12:46:21.918583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 331/666] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:21 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:21.941966 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-917f856c-619a-4fb6-91bf-63f5ecdf9e67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:21.944179 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-917f856c-619a-4fb6-91bf-63f5ecdf9e67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:21.951014 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-917f856c-619a-4fb6-91bf-63f5ecdf9e67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:21.951522 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-917f856c-619a-4fb6-91bf-63f5ecdf9e67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:21.951955 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-917f856c-619a-4fb6-91bf-63f5ecdf9e67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:21.952637 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-917f856c-619a-4fb6-91bf-63f5ecdf9e67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:21.953082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-917f856c-619a-4fb6-91bf-63f5ecdf9e67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:21.953503 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-917f856c-619a-4fb6-91bf-63f5ecdf9e67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:21.982388 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-917f856c-619a-4fb6-91bf-63f5ecdf9e67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044377 Aug 10 12:46:21.982947 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 336/667] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:21 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:22.930331 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2887662f-b5b8-497d-8e1f-f0318ae0f6af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:22.933136 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2887662f-b5b8-497d-8e1f-f0318ae0f6af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:22.939893 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2887662f-b5b8-497d-8e1f-f0318ae0f6af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:22.940369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2887662f-b5b8-497d-8e1f-f0318ae0f6af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:22.940812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2887662f-b5b8-497d-8e1f-f0318ae0f6af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:22.941480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2887662f-b5b8-497d-8e1f-f0318ae0f6af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:22.942135 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2887662f-b5b8-497d-8e1f-f0318ae0f6af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:22.942554 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2887662f-b5b8-497d-8e1f-f0318ae0f6af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:22.975221 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2887662f-b5b8-497d-8e1f-f0318ae0f6af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049169 Aug 10 12:46:22.975781 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 332/668] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:22 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:22.994023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-977bfe35-bbf3-4af1-a31b-13b53aa41bd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:22.997128 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-977bfe35-bbf3-4af1-a31b-13b53aa41bd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:23.003488 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-977bfe35-bbf3-4af1-a31b-13b53aa41bd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:23.003968 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-977bfe35-bbf3-4af1-a31b-13b53aa41bd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:23.004457 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-977bfe35-bbf3-4af1-a31b-13b53aa41bd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:23.005137 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-977bfe35-bbf3-4af1-a31b-13b53aa41bd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:23.005581 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-977bfe35-bbf3-4af1-a31b-13b53aa41bd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:23.005999 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-977bfe35-bbf3-4af1-a31b-13b53aa41bd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:23.034611 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-977bfe35-bbf3-4af1-a31b-13b53aa41bd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044655 Aug 10 12:46:23.035168 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 337/669] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:22 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:23.988607 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d6d03523-cf05-42a9-acc3-40b9a30c8436 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:23.990719 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d6d03523-cf05-42a9-acc3-40b9a30c8436 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:23.998179 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6d03523-cf05-42a9-acc3-40b9a30c8436 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:23.998656 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6d03523-cf05-42a9-acc3-40b9a30c8436 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:23.999089 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6d03523-cf05-42a9-acc3-40b9a30c8436 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:23.999792 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6d03523-cf05-42a9-acc3-40b9a30c8436 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:24.000241 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6d03523-cf05-42a9-acc3-40b9a30c8436 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:24.000661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6d03523-cf05-42a9-acc3-40b9a30c8436 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:24.029537 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d6d03523-cf05-42a9-acc3-40b9a30c8436 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045213 Aug 10 12:46:24.030093 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 333/670] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:23 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:24.045953 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3950a498-c88c-44d0-913e-da8baf4a25bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:24.048156 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3950a498-c88c-44d0-913e-da8baf4a25bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:24.054461 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3950a498-c88c-44d0-913e-da8baf4a25bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:24.054936 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3950a498-c88c-44d0-913e-da8baf4a25bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:24.055412 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3950a498-c88c-44d0-913e-da8baf4a25bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:24.056086 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3950a498-c88c-44d0-913e-da8baf4a25bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:24.057054 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3950a498-c88c-44d0-913e-da8baf4a25bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:24.057597 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3950a498-c88c-44d0-913e-da8baf4a25bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:24.085825 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3950a498-c88c-44d0-913e-da8baf4a25bf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043888 Aug 10 12:46:24.086362 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 338/671] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:24 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:25.042005 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-50cf830b-dfcd-42da-8903-a73b40365779 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:25.044312 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-50cf830b-dfcd-42da-8903-a73b40365779 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:25.051211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50cf830b-dfcd-42da-8903-a73b40365779 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:25.051693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50cf830b-dfcd-42da-8903-a73b40365779 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:25.052126 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50cf830b-dfcd-42da-8903-a73b40365779 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:25.052839 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50cf830b-dfcd-42da-8903-a73b40365779 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:25.053287 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50cf830b-dfcd-42da-8903-a73b40365779 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:25.053710 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50cf830b-dfcd-42da-8903-a73b40365779 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:25.082281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-50cf830b-dfcd-42da-8903-a73b40365779 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044284 Aug 10 12:46:25.082829 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 334/672] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:25 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:25.097956 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-209f2a91-33ac-484c-9759-06656e9267b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:25.100211 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-209f2a91-33ac-484c-9759-06656e9267b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:25.106853 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-209f2a91-33ac-484c-9759-06656e9267b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:25.107370 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-209f2a91-33ac-484c-9759-06656e9267b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:25.107802 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-209f2a91-33ac-484c-9759-06656e9267b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:25.108485 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-209f2a91-33ac-484c-9759-06656e9267b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:25.108932 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-209f2a91-33ac-484c-9759-06656e9267b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:25.109351 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-209f2a91-33ac-484c-9759-06656e9267b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:25.138999 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-209f2a91-33ac-484c-9759-06656e9267b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045011 Aug 10 12:46:25.139580 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 339/673] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:25 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:26.094424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-170ccf45-422c-4f10-8ded-c06e05620bd0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:26.096562 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-170ccf45-422c-4f10-8ded-c06e05620bd0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:26.102877 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-170ccf45-422c-4f10-8ded-c06e05620bd0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:26.104036 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-170ccf45-422c-4f10-8ded-c06e05620bd0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:26.104618 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-170ccf45-422c-4f10-8ded-c06e05620bd0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:26.105309 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-170ccf45-422c-4f10-8ded-c06e05620bd0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:26.105761 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-170ccf45-422c-4f10-8ded-c06e05620bd0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:26.106186 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-170ccf45-422c-4f10-8ded-c06e05620bd0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:26.135715 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-170ccf45-422c-4f10-8ded-c06e05620bd0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045015 Aug 10 12:46:26.136278 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 335/674] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:26 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:26.151759 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e79d7b92-0b00-4fd8-a91a-301ae786e91e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:26.153823 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e79d7b92-0b00-4fd8-a91a-301ae786e91e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:26.160205 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e79d7b92-0b00-4fd8-a91a-301ae786e91e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:26.160686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e79d7b92-0b00-4fd8-a91a-301ae786e91e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:26.161124 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e79d7b92-0b00-4fd8-a91a-301ae786e91e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:26.161813 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e79d7b92-0b00-4fd8-a91a-301ae786e91e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:26.162343 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e79d7b92-0b00-4fd8-a91a-301ae786e91e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:26.162769 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e79d7b92-0b00-4fd8-a91a-301ae786e91e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:26.191370 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e79d7b92-0b00-4fd8-a91a-301ae786e91e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044346 Aug 10 12:46:26.191922 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 340/675] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:26 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:27.148418 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e9fb1270-4b8a-4cef-bece-de50dcf08bf3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:27.150707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e9fb1270-4b8a-4cef-bece-de50dcf08bf3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:27.157006 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9fb1270-4b8a-4cef-bece-de50dcf08bf3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:27.157489 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9fb1270-4b8a-4cef-bece-de50dcf08bf3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:27.157922 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9fb1270-4b8a-4cef-bece-de50dcf08bf3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:27.158644 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9fb1270-4b8a-4cef-bece-de50dcf08bf3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:27.159094 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9fb1270-4b8a-4cef-bece-de50dcf08bf3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:27.159631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9fb1270-4b8a-4cef-bece-de50dcf08bf3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:27.189353 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e9fb1270-4b8a-4cef-bece-de50dcf08bf3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044992 Aug 10 12:46:27.189905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 336/676] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:27 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:27.203751 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d98520a1-1ae2-4531-8737-36577ba4cce9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:27.205880 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d98520a1-1ae2-4531-8737-36577ba4cce9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:27.211842 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d98520a1-1ae2-4531-8737-36577ba4cce9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:27.212316 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d98520a1-1ae2-4531-8737-36577ba4cce9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:27.212783 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d98520a1-1ae2-4531-8737-36577ba4cce9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:27.213466 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d98520a1-1ae2-4531-8737-36577ba4cce9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:27.213914 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d98520a1-1ae2-4531-8737-36577ba4cce9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:27.214333 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d98520a1-1ae2-4531-8737-36577ba4cce9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:27.242846 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d98520a1-1ae2-4531-8737-36577ba4cce9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043215 Aug 10 12:46:27.243419 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 341/677] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:27 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:28.201863 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7c6dc814-d5b0-4828-88e2-0f07e6e2421f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:28.203984 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7c6dc814-d5b0-4828-88e2-0f07e6e2421f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:28.210342 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c6dc814-d5b0-4828-88e2-0f07e6e2421f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:28.210762 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c6dc814-d5b0-4828-88e2-0f07e6e2421f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:28.211206 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c6dc814-d5b0-4828-88e2-0f07e6e2421f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:28.211887 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c6dc814-d5b0-4828-88e2-0f07e6e2421f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:28.212332 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c6dc814-d5b0-4828-88e2-0f07e6e2421f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:28.213397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c6dc814-d5b0-4828-88e2-0f07e6e2421f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:28.241444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7c6dc814-d5b0-4828-88e2-0f07e6e2421f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044070 Aug 10 12:46:28.241989 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 337/678] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:28 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:28.255708 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3432d981-dd7b-43a4-904a-485300271a00 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:28.257864 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3432d981-dd7b-43a4-904a-485300271a00 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:28.267752 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3432d981-dd7b-43a4-904a-485300271a00 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:28.268546 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3432d981-dd7b-43a4-904a-485300271a00 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:28.269265 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3432d981-dd7b-43a4-904a-485300271a00 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:28.270409 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3432d981-dd7b-43a4-904a-485300271a00 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:28.271168 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3432d981-dd7b-43a4-904a-485300271a00 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:28.271901 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3432d981-dd7b-43a4-904a-485300271a00 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:28.302301 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3432d981-dd7b-43a4-904a-485300271a00 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050525 Aug 10 12:46:28.302857 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 342/679] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:28 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:46:29.254283 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6f221661-f354-4620-a0f4-bb908ed311eb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:29.256489 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6f221661-f354-4620-a0f4-bb908ed311eb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:29.262900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f221661-f354-4620-a0f4-bb908ed311eb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:29.263417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f221661-f354-4620-a0f4-bb908ed311eb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:29.263853 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f221661-f354-4620-a0f4-bb908ed311eb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:29.264536 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f221661-f354-4620-a0f4-bb908ed311eb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:29.264987 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f221661-f354-4620-a0f4-bb908ed311eb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:29.265406 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f221661-f354-4620-a0f4-bb908ed311eb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:29.295072 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6f221661-f354-4620-a0f4-bb908ed311eb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044973 Aug 10 12:46:29.295668 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 338/680] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:29 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:29.315121 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5ae9b2f6-624a-46d0-9b29-074d39bf57f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:29.317340 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5ae9b2f6-624a-46d0-9b29-074d39bf57f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:29.323754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5ae9b2f6-624a-46d0-9b29-074d39bf57f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:29.324235 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5ae9b2f6-624a-46d0-9b29-074d39bf57f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:29.324675 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5ae9b2f6-624a-46d0-9b29-074d39bf57f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:29.325363 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5ae9b2f6-624a-46d0-9b29-074d39bf57f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:29.325815 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5ae9b2f6-624a-46d0-9b29-074d39bf57f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:29.326239 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5ae9b2f6-624a-46d0-9b29-074d39bf57f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:29.355394 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5ae9b2f6-624a-46d0-9b29-074d39bf57f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044243 Aug 10 12:46:29.355941 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 343/681] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:29 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:30.308353 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-608c1750-bb4e-4601-8860-e31d13fd1ba9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:30.310458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-608c1750-bb4e-4601-8860-e31d13fd1ba9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:30.316746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-608c1750-bb4e-4601-8860-e31d13fd1ba9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:30.317224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-608c1750-bb4e-4601-8860-e31d13fd1ba9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:30.317649 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-608c1750-bb4e-4601-8860-e31d13fd1ba9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:30.318329 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-608c1750-bb4e-4601-8860-e31d13fd1ba9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:30.318775 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-608c1750-bb4e-4601-8860-e31d13fd1ba9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:30.319212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-608c1750-bb4e-4601-8860-e31d13fd1ba9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:30.348046 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-608c1750-bb4e-4601-8860-e31d13fd1ba9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044706 Aug 10 12:46:30.348600 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 339/682] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:30 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:30.367528 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f6965670-aa8d-4e31-9cce-84538f1291b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:30.370386 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f6965670-aa8d-4e31-9cce-84538f1291b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:30.376673 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f6965670-aa8d-4e31-9cce-84538f1291b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:30.377154 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f6965670-aa8d-4e31-9cce-84538f1291b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:30.377597 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f6965670-aa8d-4e31-9cce-84538f1291b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:30.378312 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f6965670-aa8d-4e31-9cce-84538f1291b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:30.378767 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f6965670-aa8d-4e31-9cce-84538f1291b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:30.379197 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f6965670-aa8d-4e31-9cce-84538f1291b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:30.413645 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f6965670-aa8d-4e31-9cce-84538f1291b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050076 Aug 10 12:46:30.414223 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 344/683] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:30 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:31.360863 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e850391b-ed7e-4421-8412-46b3116e54ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:31.362995 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e850391b-ed7e-4421-8412-46b3116e54ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:31.369910 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e850391b-ed7e-4421-8412-46b3116e54ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:31.370386 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e850391b-ed7e-4421-8412-46b3116e54ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:31.370819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e850391b-ed7e-4421-8412-46b3116e54ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:31.371537 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e850391b-ed7e-4421-8412-46b3116e54ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:31.371990 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e850391b-ed7e-4421-8412-46b3116e54ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:31.372412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e850391b-ed7e-4421-8412-46b3116e54ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:31.401170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e850391b-ed7e-4421-8412-46b3116e54ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044524 Aug 10 12:46:31.401723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 340/684] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:31 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:31.426027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b9261d95-b333-4fe1-8c91-993b1d8fccec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:31.428209 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b9261d95-b333-4fe1-8c91-993b1d8fccec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:31.435055 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b9261d95-b333-4fe1-8c91-993b1d8fccec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:31.435609 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b9261d95-b333-4fe1-8c91-993b1d8fccec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:31.436047 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b9261d95-b333-4fe1-8c91-993b1d8fccec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:31.436735 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b9261d95-b333-4fe1-8c91-993b1d8fccec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:31.437189 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b9261d95-b333-4fe1-8c91-993b1d8fccec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:31.437613 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b9261d95-b333-4fe1-8c91-993b1d8fccec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:31.466436 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b9261d95-b333-4fe1-8c91-993b1d8fccec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044515 Aug 10 12:46:31.466995 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 345/685] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:31 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:32.413039 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e10d017d-8e42-4579-b168-fc01d6cb9930 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:32.415248 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e10d017d-8e42-4579-b168-fc01d6cb9930 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:32.422359 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e10d017d-8e42-4579-b168-fc01d6cb9930 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:32.422834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e10d017d-8e42-4579-b168-fc01d6cb9930 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:32.423296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e10d017d-8e42-4579-b168-fc01d6cb9930 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:32.423980 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e10d017d-8e42-4579-b168-fc01d6cb9930 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:32.424425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e10d017d-8e42-4579-b168-fc01d6cb9930 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:32.424840 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e10d017d-8e42-4579-b168-fc01d6cb9930 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:32.453798 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e10d017d-8e42-4579-b168-fc01d6cb9930 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044735 Aug 10 12:46:32.454344 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 341/686] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:32 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:32.477869 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-516ca395-60a7-4847-9056-655e3f0b056e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:32.480509 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-516ca395-60a7-4847-9056-655e3f0b056e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:32.486974 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-516ca395-60a7-4847-9056-655e3f0b056e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:32.487471 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-516ca395-60a7-4847-9056-655e3f0b056e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:32.487899 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-516ca395-60a7-4847-9056-655e3f0b056e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:32.488574 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-516ca395-60a7-4847-9056-655e3f0b056e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:32.489015 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-516ca395-60a7-4847-9056-655e3f0b056e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:32.489431 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-516ca395-60a7-4847-9056-655e3f0b056e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:32.491890 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:46:32.519308 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-516ca395-60a7-4847-9056-655e3f0b056e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045362 Aug 10 12:46:32.519857 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 346/687] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:32 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:33.466374 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-94917cc7-82b6-4902-af5c-9fc4daf8e95b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:33.468502 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-94917cc7-82b6-4902-af5c-9fc4daf8e95b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:33.474813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94917cc7-82b6-4902-af5c-9fc4daf8e95b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:33.475322 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94917cc7-82b6-4902-af5c-9fc4daf8e95b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:33.475757 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94917cc7-82b6-4902-af5c-9fc4daf8e95b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:33.476471 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94917cc7-82b6-4902-af5c-9fc4daf8e95b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:33.476921 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94917cc7-82b6-4902-af5c-9fc4daf8e95b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:33.477348 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94917cc7-82b6-4902-af5c-9fc4daf8e95b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:33.507822 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-94917cc7-82b6-4902-af5c-9fc4daf8e95b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045545 Aug 10 12:46:33.511515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 342/688] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:33 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:33.534008 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7cc50bed-ea2f-4376-a888-6793c54c0719 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:33.536171 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7cc50bed-ea2f-4376-a888-6793c54c0719 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:33.543783 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7cc50bed-ea2f-4376-a888-6793c54c0719 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:33.548511 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7cc50bed-ea2f-4376-a888-6793c54c0719 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:33.548511 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7cc50bed-ea2f-4376-a888-6793c54c0719 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:33.548511 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7cc50bed-ea2f-4376-a888-6793c54c0719 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:33.548511 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7cc50bed-ea2f-4376-a888-6793c54c0719 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:33.548852 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7cc50bed-ea2f-4376-a888-6793c54c0719 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:33.574916 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7cc50bed-ea2f-4376-a888-6793c54c0719 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044977 Aug 10 12:46:33.575507 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 347/689] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:33 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:34.521884 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-608af365-8ba8-4390-a7ea-779bd0828aa4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:34.524086 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-608af365-8ba8-4390-a7ea-779bd0828aa4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:34.530585 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-608af365-8ba8-4390-a7ea-779bd0828aa4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:34.531064 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-608af365-8ba8-4390-a7ea-779bd0828aa4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:34.531531 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-608af365-8ba8-4390-a7ea-779bd0828aa4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:34.532253 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-608af365-8ba8-4390-a7ea-779bd0828aa4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:34.532699 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-608af365-8ba8-4390-a7ea-779bd0828aa4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:34.533114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-608af365-8ba8-4390-a7ea-779bd0828aa4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:34.562467 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-608af365-8ba8-4390-a7ea-779bd0828aa4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044463 Aug 10 12:46:34.563029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 343/690] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:34 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:46:34.587356 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2fee1825-8237-4f13-916c-076a27492317 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:34.589573 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2fee1825-8237-4f13-916c-076a27492317 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:34.591890 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:46:34.596609 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2fee1825-8237-4f13-916c-076a27492317 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:34.597103 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2fee1825-8237-4f13-916c-076a27492317 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:34.597539 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2fee1825-8237-4f13-916c-076a27492317 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:34.598236 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2fee1825-8237-4f13-916c-076a27492317 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:34.598704 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2fee1825-8237-4f13-916c-076a27492317 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:34.599100 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2fee1825-8237-4f13-916c-076a27492317 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:34.629762 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2fee1825-8237-4f13-916c-076a27492317 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046383 Aug 10 12:46:34.630341 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 348/691] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:34 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:34.818471 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:46:34.818654 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Wed Aug 10 12:46:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 12:46:35.574550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-97e230d4-ce20-4532-aa2f-eba39c6088f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:35.576839 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-97e230d4-ce20-4532-aa2f-eba39c6088f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:35.583309 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97e230d4-ce20-4532-aa2f-eba39c6088f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:35.583787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97e230d4-ce20-4532-aa2f-eba39c6088f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:35.584219 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97e230d4-ce20-4532-aa2f-eba39c6088f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:35.584899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97e230d4-ce20-4532-aa2f-eba39c6088f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:35.585348 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97e230d4-ce20-4532-aa2f-eba39c6088f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:35.585762 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97e230d4-ce20-4532-aa2f-eba39c6088f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:35.614878 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-97e230d4-ce20-4532-aa2f-eba39c6088f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044813 Aug 10 12:46:35.615451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 344/692] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:35 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:35.642059 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-22cde816-f5c2-4458-bd4d-09c3a62ca2d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:35.644361 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-22cde816-f5c2-4458-bd4d-09c3a62ca2d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:35.652398 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22cde816-f5c2-4458-bd4d-09c3a62ca2d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:35.652879 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22cde816-f5c2-4458-bd4d-09c3a62ca2d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:35.653313 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22cde816-f5c2-4458-bd4d-09c3a62ca2d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:35.654001 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22cde816-f5c2-4458-bd4d-09c3a62ca2d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:35.654451 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22cde816-f5c2-4458-bd4d-09c3a62ca2d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:35.654873 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22cde816-f5c2-4458-bd4d-09c3a62ca2d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:35.683090 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-22cde816-f5c2-4458-bd4d-09c3a62ca2d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045131 Aug 10 12:46:35.683679 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 349/693] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:35 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:36.627431 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3ec6579f-ffa9-478d-a3c8-d1a95deca198 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:36.629494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3ec6579f-ffa9-478d-a3c8-d1a95deca198 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:36.636350 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ec6579f-ffa9-478d-a3c8-d1a95deca198 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:36.636831 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ec6579f-ffa9-478d-a3c8-d1a95deca198 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:36.637281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ec6579f-ffa9-478d-a3c8-d1a95deca198 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:36.637983 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ec6579f-ffa9-478d-a3c8-d1a95deca198 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:36.638430 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ec6579f-ffa9-478d-a3c8-d1a95deca198 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:36.638854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ec6579f-ffa9-478d-a3c8-d1a95deca198 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:36.669188 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3ec6579f-ffa9-478d-a3c8-d1a95deca198 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045839 Aug 10 12:46:36.669745 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 345/694] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:36 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:36.695420 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-839f501f-bfb8-4d98-96fe-72c4636c6246 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:36.697779 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-839f501f-bfb8-4d98-96fe-72c4636c6246 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:36.704115 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-839f501f-bfb8-4d98-96fe-72c4636c6246 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:36.704598 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-839f501f-bfb8-4d98-96fe-72c4636c6246 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:36.705030 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-839f501f-bfb8-4d98-96fe-72c4636c6246 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:36.705717 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-839f501f-bfb8-4d98-96fe-72c4636c6246 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:36.706170 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-839f501f-bfb8-4d98-96fe-72c4636c6246 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:36.706599 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-839f501f-bfb8-4d98-96fe-72c4636c6246 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:36.736041 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-839f501f-bfb8-4d98-96fe-72c4636c6246 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044700 Aug 10 12:46:36.736569 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 350/695] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:36 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:37.681520 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-73c79a22-cd20-4488-b939-2aa837ec1db2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:37.683607 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-73c79a22-cd20-4488-b939-2aa837ec1db2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:37.689920 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73c79a22-cd20-4488-b939-2aa837ec1db2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:37.690392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73c79a22-cd20-4488-b939-2aa837ec1db2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:37.690820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73c79a22-cd20-4488-b939-2aa837ec1db2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:37.691518 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73c79a22-cd20-4488-b939-2aa837ec1db2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:37.691960 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73c79a22-cd20-4488-b939-2aa837ec1db2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:37.692374 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73c79a22-cd20-4488-b939-2aa837ec1db2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:37.721306 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-73c79a22-cd20-4488-b939-2aa837ec1db2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043874 Aug 10 12:46:37.721848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 346/696] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:37 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:37.748720 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-15695c8a-49ec-4887-9090-a18ef0051e89 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:37.750830 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-15695c8a-49ec-4887-9090-a18ef0051e89 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:37.757182 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15695c8a-49ec-4887-9090-a18ef0051e89 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:37.757653 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15695c8a-49ec-4887-9090-a18ef0051e89 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:37.758079 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15695c8a-49ec-4887-9090-a18ef0051e89 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:37.758754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15695c8a-49ec-4887-9090-a18ef0051e89 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:37.759738 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15695c8a-49ec-4887-9090-a18ef0051e89 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:37.760566 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15695c8a-49ec-4887-9090-a18ef0051e89 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:37.789618 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-15695c8a-49ec-4887-9090-a18ef0051e89 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044867 Aug 10 12:46:37.790165 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 351/697] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:37 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:38.480996 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:46:38.481171 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Wed Aug 10 12:46:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 12:46:38.733676 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d448b410-cd35-4b72-aabc-ff10422e237e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:38.736063 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d448b410-cd35-4b72-aabc-ff10422e237e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:38.744427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d448b410-cd35-4b72-aabc-ff10422e237e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:38.744904 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d448b410-cd35-4b72-aabc-ff10422e237e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:38.745334 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d448b410-cd35-4b72-aabc-ff10422e237e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:38.746013 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d448b410-cd35-4b72-aabc-ff10422e237e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:38.746459 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d448b410-cd35-4b72-aabc-ff10422e237e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:38.746876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d448b410-cd35-4b72-aabc-ff10422e237e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:38.770968 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:46:38.776296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d448b410-cd35-4b72-aabc-ff10422e237e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046335 Aug 10 12:46:38.776854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 347/698] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:38 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:38.802233 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4cb5274c-2e0a-4fa2-b3a6-a2c43f7cd05d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:38.804490 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4cb5274c-2e0a-4fa2-b3a6-a2c43f7cd05d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:38.811299 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4cb5274c-2e0a-4fa2-b3a6-a2c43f7cd05d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:38.811796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4cb5274c-2e0a-4fa2-b3a6-a2c43f7cd05d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:38.812211 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4cb5274c-2e0a-4fa2-b3a6-a2c43f7cd05d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:38.812895 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4cb5274c-2e0a-4fa2-b3a6-a2c43f7cd05d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:38.813343 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4cb5274c-2e0a-4fa2-b3a6-a2c43f7cd05d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:38.813762 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4cb5274c-2e0a-4fa2-b3a6-a2c43f7cd05d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:38.842199 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4cb5274c-2e0a-4fa2-b3a6-a2c43f7cd05d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043923 Aug 10 12:46:38.842745 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 352/699] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:38 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:39.794648 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e03cb109-ef91-46b7-b10a-eddc243db8a2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:39.796832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e03cb109-ef91-46b7-b10a-eddc243db8a2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:39.803578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e03cb109-ef91-46b7-b10a-eddc243db8a2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:39.804090 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e03cb109-ef91-46b7-b10a-eddc243db8a2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:39.804524 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e03cb109-ef91-46b7-b10a-eddc243db8a2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:39.805211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e03cb109-ef91-46b7-b10a-eddc243db8a2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:39.805661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e03cb109-ef91-46b7-b10a-eddc243db8a2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:39.806659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e03cb109-ef91-46b7-b10a-eddc243db8a2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:39.835569 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e03cb109-ef91-46b7-b10a-eddc243db8a2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045580 Aug 10 12:46:39.836130 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 348/700] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:39 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:39.854590 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f4ca2dbc-5693-40db-8278-a331109d994a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:39.856789 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f4ca2dbc-5693-40db-8278-a331109d994a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:39.863413 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f4ca2dbc-5693-40db-8278-a331109d994a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:39.863894 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f4ca2dbc-5693-40db-8278-a331109d994a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:39.864327 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f4ca2dbc-5693-40db-8278-a331109d994a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:39.865020 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f4ca2dbc-5693-40db-8278-a331109d994a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:39.865470 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f4ca2dbc-5693-40db-8278-a331109d994a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:39.865891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f4ca2dbc-5693-40db-8278-a331109d994a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:39.895321 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f4ca2dbc-5693-40db-8278-a331109d994a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045322 Aug 10 12:46:39.895885 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 353/701] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:39 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:40.848144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-947a80b5-7493-48b9-b003-203131632436 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:40.850512 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-947a80b5-7493-48b9-b003-203131632436 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:40.857292 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-947a80b5-7493-48b9-b003-203131632436 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:40.857768 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-947a80b5-7493-48b9-b003-203131632436 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:40.858196 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-947a80b5-7493-48b9-b003-203131632436 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:40.858868 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-947a80b5-7493-48b9-b003-203131632436 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:40.859343 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-947a80b5-7493-48b9-b003-203131632436 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:40.859759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-947a80b5-7493-48b9-b003-203131632436 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:40.889798 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-947a80b5-7493-48b9-b003-203131632436 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045596 Aug 10 12:46:40.890348 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 349/702] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:40 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:41.067971 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9e8bb436-53b6-4d65-a415-a12e66cfcae8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:41.070326 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9e8bb436-53b6-4d65-a415-a12e66cfcae8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:41.076879 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e8bb436-53b6-4d65-a415-a12e66cfcae8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:41.077360 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e8bb436-53b6-4d65-a415-a12e66cfcae8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:41.077793 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e8bb436-53b6-4d65-a415-a12e66cfcae8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:41.078481 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e8bb436-53b6-4d65-a415-a12e66cfcae8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:41.078969 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e8bb436-53b6-4d65-a415-a12e66cfcae8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:41.079415 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e8bb436-53b6-4d65-a415-a12e66cfcae8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:41.107632 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9e8bb436-53b6-4d65-a415-a12e66cfcae8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.203969 Aug 10 12:46:41.108122 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 354/703] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:40 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:41.432129 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:46:41.432293 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Wed Aug 10 12:46:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 12:46:41.902146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1078f207-456c-4b95-9e25-5dce2032c5ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:41.904278 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1078f207-456c-4b95-9e25-5dce2032c5ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:41.910486 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1078f207-456c-4b95-9e25-5dce2032c5ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:41.910958 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1078f207-456c-4b95-9e25-5dce2032c5ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:41.911414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1078f207-456c-4b95-9e25-5dce2032c5ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:41.912092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1078f207-456c-4b95-9e25-5dce2032c5ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:41.912533 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1078f207-456c-4b95-9e25-5dce2032c5ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:41.912947 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1078f207-456c-4b95-9e25-5dce2032c5ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:41.943004 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1078f207-456c-4b95-9e25-5dce2032c5ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044947 Aug 10 12:46:41.943496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 350/704] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:41 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:42.120659 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5c34614f-be5a-45c9-a9e9-abc926e9720d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:42.122763 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5c34614f-be5a-45c9-a9e9-abc926e9720d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:42.129127 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c34614f-be5a-45c9-a9e9-abc926e9720d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:42.129616 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c34614f-be5a-45c9-a9e9-abc926e9720d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:42.130053 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c34614f-be5a-45c9-a9e9-abc926e9720d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:42.130748 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c34614f-be5a-45c9-a9e9-abc926e9720d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:42.131224 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c34614f-be5a-45c9-a9e9-abc926e9720d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:42.131657 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c34614f-be5a-45c9-a9e9-abc926e9720d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:42.161764 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5c34614f-be5a-45c9-a9e9-abc926e9720d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045665 Aug 10 12:46:42.162702 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 355/705] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:42 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:43.063549 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c09f165d-8829-41c1-b3aa-d3961ab83797 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:43.065799 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c09f165d-8829-41c1-b3aa-d3961ab83797 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:43.072449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c09f165d-8829-41c1-b3aa-d3961ab83797 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:43.072940 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c09f165d-8829-41c1-b3aa-d3961ab83797 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:43.073377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c09f165d-8829-41c1-b3aa-d3961ab83797 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:43.074075 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c09f165d-8829-41c1-b3aa-d3961ab83797 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:43.074526 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c09f165d-8829-41c1-b3aa-d3961ab83797 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:43.074948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c09f165d-8829-41c1-b3aa-d3961ab83797 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:43.104977 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c09f165d-8829-41c1-b3aa-d3961ab83797 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152567 Aug 10 12:46:43.105550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 351/706] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:42 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:43.173994 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-513fa194-4021-4460-8fc8-b35887fb3600 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:43.176154 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-513fa194-4021-4460-8fc8-b35887fb3600 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:43.182639 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-513fa194-4021-4460-8fc8-b35887fb3600 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:43.183149 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-513fa194-4021-4460-8fc8-b35887fb3600 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:43.183621 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-513fa194-4021-4460-8fc8-b35887fb3600 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:43.184310 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-513fa194-4021-4460-8fc8-b35887fb3600 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:43.184763 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-513fa194-4021-4460-8fc8-b35887fb3600 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:43.185188 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-513fa194-4021-4460-8fc8-b35887fb3600 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:43.214355 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-513fa194-4021-4460-8fc8-b35887fb3600 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044276 Aug 10 12:46:43.214834 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 356/707] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:43 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:44.116793 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-06efeb18-1e94-4944-9d5e-5967595c03b2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:44.119295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-06efeb18-1e94-4944-9d5e-5967595c03b2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:44.125585 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-06efeb18-1e94-4944-9d5e-5967595c03b2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:44.126054 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-06efeb18-1e94-4944-9d5e-5967595c03b2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:44.126478 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-06efeb18-1e94-4944-9d5e-5967595c03b2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:44.127150 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-06efeb18-1e94-4944-9d5e-5967595c03b2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:44.127614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-06efeb18-1e94-4944-9d5e-5967595c03b2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:44.128030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-06efeb18-1e94-4944-9d5e-5967595c03b2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:44.157134 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-06efeb18-1e94-4944-9d5e-5967595c03b2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044265 Aug 10 12:46:44.157672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 352/708] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:44 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:44.226479 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d09cf9ce-e62c-4277-b52d-16f97648e7c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:44.229337 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d09cf9ce-e62c-4277-b52d-16f97648e7c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:44.235921 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d09cf9ce-e62c-4277-b52d-16f97648e7c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:44.236400 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d09cf9ce-e62c-4277-b52d-16f97648e7c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:44.236836 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d09cf9ce-e62c-4277-b52d-16f97648e7c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:44.237520 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d09cf9ce-e62c-4277-b52d-16f97648e7c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:44.237968 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d09cf9ce-e62c-4277-b52d-16f97648e7c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:44.238388 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d09cf9ce-e62c-4277-b52d-16f97648e7c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:44.266920 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d09cf9ce-e62c-4277-b52d-16f97648e7c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044329 Aug 10 12:46:44.267526 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 357/709] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:44 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:45.170472 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-549ef221-1b1f-4831-855e-c6cadd985020 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:45.172613 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-549ef221-1b1f-4831-855e-c6cadd985020 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:45.178854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-549ef221-1b1f-4831-855e-c6cadd985020 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:45.179357 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-549ef221-1b1f-4831-855e-c6cadd985020 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:45.179783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-549ef221-1b1f-4831-855e-c6cadd985020 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:45.180457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-549ef221-1b1f-4831-855e-c6cadd985020 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:45.181740 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-549ef221-1b1f-4831-855e-c6cadd985020 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:45.182340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-549ef221-1b1f-4831-855e-c6cadd985020 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:45.211322 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-549ef221-1b1f-4831-855e-c6cadd985020 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045781 Aug 10 12:46:45.211871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 353/710] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:45 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:46:45.279630 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-219d07a3-20b3-41f7-9b13-29db90c9a09c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:45.281761 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-219d07a3-20b3-41f7-9b13-29db90c9a09c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:45.288100 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-219d07a3-20b3-41f7-9b13-29db90c9a09c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:45.288587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-219d07a3-20b3-41f7-9b13-29db90c9a09c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:45.289024 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-219d07a3-20b3-41f7-9b13-29db90c9a09c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:45.289722 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-219d07a3-20b3-41f7-9b13-29db90c9a09c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:45.290762 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-219d07a3-20b3-41f7-9b13-29db90c9a09c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:45.291386 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-219d07a3-20b3-41f7-9b13-29db90c9a09c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:45.319968 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-219d07a3-20b3-41f7-9b13-29db90c9a09c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044599 Aug 10 12:46:45.320532 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 358/711] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:45 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:46.223774 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2b5510c2-e59b-464d-9740-c61c2b23c3a6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:46.225821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2b5510c2-e59b-464d-9740-c61c2b23c3a6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:46.232351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b5510c2-e59b-464d-9740-c61c2b23c3a6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:46.232832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b5510c2-e59b-464d-9740-c61c2b23c3a6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:46.233267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b5510c2-e59b-464d-9740-c61c2b23c3a6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:46.233953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b5510c2-e59b-464d-9740-c61c2b23c3a6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:46.234404 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b5510c2-e59b-464d-9740-c61c2b23c3a6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:46.235096 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b5510c2-e59b-464d-9740-c61c2b23c3a6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:46.264188 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2b5510c2-e59b-464d-9740-c61c2b23c3a6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044396 Aug 10 12:46:46.264748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 354/712] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:46 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:46.344613 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-08306d28-f1d6-4a46-97a7-48a24ee22be0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:46.346757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-08306d28-f1d6-4a46-97a7-48a24ee22be0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:46.353955 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08306d28-f1d6-4a46-97a7-48a24ee22be0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:46.354431 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08306d28-f1d6-4a46-97a7-48a24ee22be0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:46.354861 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08306d28-f1d6-4a46-97a7-48a24ee22be0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:46.355571 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08306d28-f1d6-4a46-97a7-48a24ee22be0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:46.356019 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08306d28-f1d6-4a46-97a7-48a24ee22be0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:46.356443 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08306d28-f1d6-4a46-97a7-48a24ee22be0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:46.385068 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-08306d28-f1d6-4a46-97a7-48a24ee22be0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044459 Aug 10 12:46:46.385625 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 359/713] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:46 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:47.170001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b2750f31-0faf-4e18-a28a-7d48903183fd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:47.174038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b2750f31-0faf-4e18-a28a-7d48903183fd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:47.176544 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2750f31-0faf-4e18-a28a-7d48903183fd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:47.176968 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2750f31-0faf-4e18-a28a-7d48903183fd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:47.177404 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2750f31-0faf-4e18-a28a-7d48903183fd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:47.178101 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2750f31-0faf-4e18-a28a-7d48903183fd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:47.178556 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2750f31-0faf-4e18-a28a-7d48903183fd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:47.178984 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2750f31-0faf-4e18-a28a-7d48903183fd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:47.276752 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1271b095-3be4-4127-bf62-de038d51cc16 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:47.278888 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1271b095-3be4-4127-bf62-de038d51cc16 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:47.284827 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1271b095-3be4-4127-bf62-de038d51cc16 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:47.285308 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1271b095-3be4-4127-bf62-de038d51cc16 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:47.285747 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1271b095-3be4-4127-bf62-de038d51cc16 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:47.286455 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1271b095-3be4-4127-bf62-de038d51cc16 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:47.286890 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1271b095-3be4-4127-bf62-de038d51cc16 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:47.287414 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1271b095-3be4-4127-bf62-de038d51cc16 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:47.308780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.objects.instance [None req-b2750f31-0faf-4e18-a28a-7d48903183fd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lazy-loading 'services' on Instance uuid 3181426f-eb81-4712-97c6-8c92b61f53a0 {{(pid=124643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:46:47.316632 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1271b095-3be4-4127-bf62-de038d51cc16 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044370 Aug 10 12:46:47.317195 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 360/714] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:47 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:46:47.397286 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b36c206c-2cd0-4e57-9d30-b38720ddcae0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:47.399430 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b36c206c-2cd0-4e57-9d30-b38720ddcae0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:47.406634 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b36c206c-2cd0-4e57-9d30-b38720ddcae0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:47.407115 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b36c206c-2cd0-4e57-9d30-b38720ddcae0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:47.407584 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b36c206c-2cd0-4e57-9d30-b38720ddcae0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:47.408307 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b36c206c-2cd0-4e57-9d30-b38720ddcae0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:47.408758 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b36c206c-2cd0-4e57-9d30-b38720ddcae0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:47.409202 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b36c206c-2cd0-4e57-9d30-b38720ddcae0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:47.438532 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b36c206c-2cd0-4e57-9d30-b38720ddcae0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045104 Aug 10 12:46:47.439022 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 361/715] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:47 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:46:47.514009 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b2750f31-0faf-4e18-a28a-7d48903183fd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments/9d435d52-7025-4eb5-97f9-cd775f5c3424" status: 202 len: 0 microversion: 2.1 time: 0.348481 Aug 10 12:46:47.514740 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 355/716] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 10 12:46:47 2022] DELETE /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments/9d435d52-7025-4eb5-97f9-cd775f5c3424 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:46:47.523233 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0db66465-85b3-4e7b-ab1f-30f2eaeb88b9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:47.526152 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0db66465-85b3-4e7b-ab1f-30f2eaeb88b9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:47.532178 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0db66465-85b3-4e7b-ab1f-30f2eaeb88b9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:47.532653 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0db66465-85b3-4e7b-ab1f-30f2eaeb88b9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:47.533086 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0db66465-85b3-4e7b-ab1f-30f2eaeb88b9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:47.533773 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0db66465-85b3-4e7b-ab1f-30f2eaeb88b9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:47.534221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0db66465-85b3-4e7b-ab1f-30f2eaeb88b9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:47.534641 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0db66465-85b3-4e7b-ab1f-30f2eaeb88b9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:47.561437 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:46:47.566019 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0db66465-85b3-4e7b-ab1f-30f2eaeb88b9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046824 Aug 10 12:46:47.566582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 362/717] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:47 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:48.330452 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-39782afb-4ed7-4ba2-b273-bb41fcee9b9c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:48.332748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-39782afb-4ed7-4ba2-b273-bb41fcee9b9c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:48.338813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-39782afb-4ed7-4ba2-b273-bb41fcee9b9c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:48.339326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-39782afb-4ed7-4ba2-b273-bb41fcee9b9c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:48.339759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-39782afb-4ed7-4ba2-b273-bb41fcee9b9c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:48.340440 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-39782afb-4ed7-4ba2-b273-bb41fcee9b9c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:48.340885 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-39782afb-4ed7-4ba2-b273-bb41fcee9b9c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:48.341306 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-39782afb-4ed7-4ba2-b273-bb41fcee9b9c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:48.371431 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-39782afb-4ed7-4ba2-b273-bb41fcee9b9c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045890 Aug 10 12:46:48.371957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 356/718] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:48 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:48.452892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-39e81bd4-d3cc-4809-9d33-a48d65812d40 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:48.455013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-39e81bd4-d3cc-4809-9d33-a48d65812d40 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:48.462020 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-39e81bd4-d3cc-4809-9d33-a48d65812d40 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:48.463547 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-39e81bd4-d3cc-4809-9d33-a48d65812d40 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:48.464053 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-39e81bd4-d3cc-4809-9d33-a48d65812d40 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:48.464777 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-39e81bd4-d3cc-4809-9d33-a48d65812d40 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:48.465226 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-39e81bd4-d3cc-4809-9d33-a48d65812d40 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:48.465644 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-39e81bd4-d3cc-4809-9d33-a48d65812d40 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:48.498784 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-39e81bd4-d3cc-4809-9d33-a48d65812d40 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050685 Aug 10 12:46:48.499416 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 363/719] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:48 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:48.579046 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6ff48a83-21e7-4901-9d08-79d7508120d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:48.581059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6ff48a83-21e7-4901-9d08-79d7508120d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:48.587814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ff48a83-21e7-4901-9d08-79d7508120d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:48.588293 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ff48a83-21e7-4901-9d08-79d7508120d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:48.588715 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ff48a83-21e7-4901-9d08-79d7508120d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:48.589394 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ff48a83-21e7-4901-9d08-79d7508120d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:48.589839 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ff48a83-21e7-4901-9d08-79d7508120d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:48.590257 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ff48a83-21e7-4901-9d08-79d7508120d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:48.622355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6ff48a83-21e7-4901-9d08-79d7508120d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047299 Aug 10 12:46:48.622943 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 357/720] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:48 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:49.385103 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5e49b16f-7b7c-42dc-bf4f-023d0d510794 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:49.387286 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5e49b16f-7b7c-42dc-bf4f-023d0d510794 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:49.393160 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e49b16f-7b7c-42dc-bf4f-023d0d510794 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:49.393640 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e49b16f-7b7c-42dc-bf4f-023d0d510794 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:49.394073 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e49b16f-7b7c-42dc-bf4f-023d0d510794 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:49.394754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e49b16f-7b7c-42dc-bf4f-023d0d510794 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:49.395234 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e49b16f-7b7c-42dc-bf4f-023d0d510794 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:49.395660 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e49b16f-7b7c-42dc-bf4f-023d0d510794 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:49.423666 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5e49b16f-7b7c-42dc-bf4f-023d0d510794 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043185 Aug 10 12:46:49.424231 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 364/721] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:49 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:49.512423 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-32b1b55b-95c6-4486-be42-3e78a38e275e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:49.514548 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-32b1b55b-95c6-4486-be42-3e78a38e275e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:49.520902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-32b1b55b-95c6-4486-be42-3e78a38e275e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:49.521411 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-32b1b55b-95c6-4486-be42-3e78a38e275e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:49.521808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-32b1b55b-95c6-4486-be42-3e78a38e275e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:49.522497 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-32b1b55b-95c6-4486-be42-3e78a38e275e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:49.522951 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-32b1b55b-95c6-4486-be42-3e78a38e275e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:49.523410 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-32b1b55b-95c6-4486-be42-3e78a38e275e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:49.551562 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-32b1b55b-95c6-4486-be42-3e78a38e275e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043911 Aug 10 12:46:49.552116 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 358/722] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:49 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:49.636490 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0e840fb4-b0fb-405d-97eb-9df28bcdcee8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:49.638525 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0e840fb4-b0fb-405d-97eb-9df28bcdcee8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:49.644812 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e840fb4-b0fb-405d-97eb-9df28bcdcee8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:49.645292 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e840fb4-b0fb-405d-97eb-9df28bcdcee8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:49.645723 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e840fb4-b0fb-405d-97eb-9df28bcdcee8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:49.646403 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e840fb4-b0fb-405d-97eb-9df28bcdcee8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:49.646861 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e840fb4-b0fb-405d-97eb-9df28bcdcee8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:49.647287 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e840fb4-b0fb-405d-97eb-9df28bcdcee8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:49.676304 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0e840fb4-b0fb-405d-97eb-9df28bcdcee8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044642 Aug 10 12:46:49.676864 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 365/723] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:49 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:50.436038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4ba8d1a0-2fe8-4a99-872b-bbeefa46264d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:50.438145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4ba8d1a0-2fe8-4a99-872b-bbeefa46264d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:50.444139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ba8d1a0-2fe8-4a99-872b-bbeefa46264d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:50.444620 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ba8d1a0-2fe8-4a99-872b-bbeefa46264d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:50.445049 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ba8d1a0-2fe8-4a99-872b-bbeefa46264d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:50.445727 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ba8d1a0-2fe8-4a99-872b-bbeefa46264d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:50.446173 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ba8d1a0-2fe8-4a99-872b-bbeefa46264d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:50.447100 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ba8d1a0-2fe8-4a99-872b-bbeefa46264d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:50.475945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4ba8d1a0-2fe8-4a99-872b-bbeefa46264d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043941 Aug 10 12:46:50.476490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 359/724] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:50 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:50.564759 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8001d67a-1fc4-4dc4-822c-b686c188fffa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:50.566847 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8001d67a-1fc4-4dc4-822c-b686c188fffa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:50.573470 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8001d67a-1fc4-4dc4-822c-b686c188fffa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:50.573950 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8001d67a-1fc4-4dc4-822c-b686c188fffa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:50.574384 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8001d67a-1fc4-4dc4-822c-b686c188fffa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:50.575074 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8001d67a-1fc4-4dc4-822c-b686c188fffa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:50.575556 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8001d67a-1fc4-4dc4-822c-b686c188fffa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:50.575980 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8001d67a-1fc4-4dc4-822c-b686c188fffa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:50.604665 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8001d67a-1fc4-4dc4-822c-b686c188fffa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044032 Aug 10 12:46:50.605220 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 366/725] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:50 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:50.688442 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bc9ee612-01f6-4016-8870-12434a961cb7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:50.690566 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bc9ee612-01f6-4016-8870-12434a961cb7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:50.697418 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc9ee612-01f6-4016-8870-12434a961cb7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:50.697894 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc9ee612-01f6-4016-8870-12434a961cb7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:50.698323 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc9ee612-01f6-4016-8870-12434a961cb7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:50.699008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc9ee612-01f6-4016-8870-12434a961cb7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:50.699494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc9ee612-01f6-4016-8870-12434a961cb7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:50.699915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc9ee612-01f6-4016-8870-12434a961cb7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:50.728505 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bc9ee612-01f6-4016-8870-12434a961cb7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043979 Aug 10 12:46:50.729052 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 360/726] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:50 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:51.488916 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-094aeb51-8fa4-41d4-a979-1dfe249d7b3f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:51.491066 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-094aeb51-8fa4-41d4-a979-1dfe249d7b3f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:51.498155 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-094aeb51-8fa4-41d4-a979-1dfe249d7b3f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:51.498639 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-094aeb51-8fa4-41d4-a979-1dfe249d7b3f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:51.499076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-094aeb51-8fa4-41d4-a979-1dfe249d7b3f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:51.499794 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-094aeb51-8fa4-41d4-a979-1dfe249d7b3f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:51.500247 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-094aeb51-8fa4-41d4-a979-1dfe249d7b3f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:51.500672 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-094aeb51-8fa4-41d4-a979-1dfe249d7b3f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:51.529239 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-094aeb51-8fa4-41d4-a979-1dfe249d7b3f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044631 Aug 10 12:46:51.529789 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 367/727] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:51 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:51.617082 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-887f8227-e9c6-44a2-94bf-21e6aafb4dd2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:51.619203 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-887f8227-e9c6-44a2-94bf-21e6aafb4dd2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:51.625047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-887f8227-e9c6-44a2-94bf-21e6aafb4dd2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:51.625523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-887f8227-e9c6-44a2-94bf-21e6aafb4dd2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:51.625958 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-887f8227-e9c6-44a2-94bf-21e6aafb4dd2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:51.626647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-887f8227-e9c6-44a2-94bf-21e6aafb4dd2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:51.627095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-887f8227-e9c6-44a2-94bf-21e6aafb4dd2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:51.627539 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-887f8227-e9c6-44a2-94bf-21e6aafb4dd2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:51.656403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-887f8227-e9c6-44a2-94bf-21e6aafb4dd2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043279 Aug 10 12:46:51.656996 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 361/728] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:51 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:51.741055 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9097896b-b0a2-4003-bb2f-8afba20f72aa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:51.743131 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9097896b-b0a2-4003-bb2f-8afba20f72aa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:51.749078 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9097896b-b0a2-4003-bb2f-8afba20f72aa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:51.749560 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9097896b-b0a2-4003-bb2f-8afba20f72aa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:51.749993 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9097896b-b0a2-4003-bb2f-8afba20f72aa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:51.750676 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9097896b-b0a2-4003-bb2f-8afba20f72aa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:51.751127 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9097896b-b0a2-4003-bb2f-8afba20f72aa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:51.751572 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9097896b-b0a2-4003-bb2f-8afba20f72aa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:51.779640 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9097896b-b0a2-4003-bb2f-8afba20f72aa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042639 Aug 10 12:46:51.780195 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 368/729] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:51 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:52.541627 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-750d6900-74f5-4b98-9acd-913506474c4d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:52.543752 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-750d6900-74f5-4b98-9acd-913506474c4d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:52.546138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=62 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:46:52.550716 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-750d6900-74f5-4b98-9acd-913506474c4d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:52.557728 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-750d6900-74f5-4b98-9acd-913506474c4d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:52.557728 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-750d6900-74f5-4b98-9acd-913506474c4d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:52.557728 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-750d6900-74f5-4b98-9acd-913506474c4d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:52.557728 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-750d6900-74f5-4b98-9acd-913506474c4d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:52.558120 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-750d6900-74f5-4b98-9acd-913506474c4d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:52.583898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-750d6900-74f5-4b98-9acd-913506474c4d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046335 Aug 10 12:46:52.584470 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 362/730] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:52 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:52.669607 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-48e5d0e2-b4d4-4e21-9ffc-957c722b889f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:52.671865 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-48e5d0e2-b4d4-4e21-9ffc-957c722b889f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:52.678107 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-48e5d0e2-b4d4-4e21-9ffc-957c722b889f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:52.678582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-48e5d0e2-b4d4-4e21-9ffc-957c722b889f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:52.679010 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-48e5d0e2-b4d4-4e21-9ffc-957c722b889f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:52.679721 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-48e5d0e2-b4d4-4e21-9ffc-957c722b889f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:52.680168 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-48e5d0e2-b4d4-4e21-9ffc-957c722b889f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:52.680586 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-48e5d0e2-b4d4-4e21-9ffc-957c722b889f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:52.708956 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-48e5d0e2-b4d4-4e21-9ffc-957c722b889f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043910 Aug 10 12:46:52.709502 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 369/731] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:52 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:52.792041 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-aa5f008b-84d3-4915-a65b-555c34aa097f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:52.794105 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-aa5f008b-84d3-4915-a65b-555c34aa097f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:52.799873 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa5f008b-84d3-4915-a65b-555c34aa097f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:52.800347 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa5f008b-84d3-4915-a65b-555c34aa097f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:52.800776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa5f008b-84d3-4915-a65b-555c34aa097f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:52.801450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa5f008b-84d3-4915-a65b-555c34aa097f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:52.801893 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa5f008b-84d3-4915-a65b-555c34aa097f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:52.802306 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa5f008b-84d3-4915-a65b-555c34aa097f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:52.826786 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:46:52.831091 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-aa5f008b-84d3-4915-a65b-555c34aa097f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043642 Aug 10 12:46:52.831664 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 363/732] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:52 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:53.596250 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-228de225-da94-48c2-bed6-5b50f0f478f5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:53.598333 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-228de225-da94-48c2-bed6-5b50f0f478f5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:53.604465 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-228de225-da94-48c2-bed6-5b50f0f478f5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:53.604949 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-228de225-da94-48c2-bed6-5b50f0f478f5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:53.605386 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-228de225-da94-48c2-bed6-5b50f0f478f5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:53.606073 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-228de225-da94-48c2-bed6-5b50f0f478f5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:53.606526 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-228de225-da94-48c2-bed6-5b50f0f478f5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:53.606951 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-228de225-da94-48c2-bed6-5b50f0f478f5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:53.635457 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-228de225-da94-48c2-bed6-5b50f0f478f5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043217 Aug 10 12:46:53.636015 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 370/733] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:53 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:53.721510 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4eeb640b-79fe-4ca1-a1b1-2af78ce67d5e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:53.723665 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4eeb640b-79fe-4ca1-a1b1-2af78ce67d5e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:53.730387 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4eeb640b-79fe-4ca1-a1b1-2af78ce67d5e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:53.730857 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4eeb640b-79fe-4ca1-a1b1-2af78ce67d5e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:53.731317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4eeb640b-79fe-4ca1-a1b1-2af78ce67d5e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:53.731997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4eeb640b-79fe-4ca1-a1b1-2af78ce67d5e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:53.732705 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4eeb640b-79fe-4ca1-a1b1-2af78ce67d5e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:53.733128 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4eeb640b-79fe-4ca1-a1b1-2af78ce67d5e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:53.762751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4eeb640b-79fe-4ca1-a1b1-2af78ce67d5e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045570 Aug 10 12:46:53.763331 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 364/734] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:53 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:53.844027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-33276efa-ad4f-420a-95b2-027029f24880 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:53.846177 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-33276efa-ad4f-420a-95b2-027029f24880 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:53.852591 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-33276efa-ad4f-420a-95b2-027029f24880 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:53.853640 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-33276efa-ad4f-420a-95b2-027029f24880 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:53.854100 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-33276efa-ad4f-420a-95b2-027029f24880 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:53.854780 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-33276efa-ad4f-420a-95b2-027029f24880 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:53.855261 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-33276efa-ad4f-420a-95b2-027029f24880 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:53.855706 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-33276efa-ad4f-420a-95b2-027029f24880 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:53.885777 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-33276efa-ad4f-420a-95b2-027029f24880 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045666 Aug 10 12:46:53.886323 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 371/735] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:53 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:54.647878 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b8be5517-2001-4db9-8012-464fc2e926cf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:54.650030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b8be5517-2001-4db9-8012-464fc2e926cf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:54.655937 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8be5517-2001-4db9-8012-464fc2e926cf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:54.656417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8be5517-2001-4db9-8012-464fc2e926cf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:54.656851 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8be5517-2001-4db9-8012-464fc2e926cf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:54.657567 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8be5517-2001-4db9-8012-464fc2e926cf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:54.658019 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8be5517-2001-4db9-8012-464fc2e926cf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:54.658446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8be5517-2001-4db9-8012-464fc2e926cf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:54.687388 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b8be5517-2001-4db9-8012-464fc2e926cf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043509 Aug 10 12:46:54.687944 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 365/736] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:54 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:54.775043 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-77ba1154-6f78-4b09-bb24-d2e54aa887b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:54.777184 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-77ba1154-6f78-4b09-bb24-d2e54aa887b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:54.783057 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-77ba1154-6f78-4b09-bb24-d2e54aa887b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:54.783562 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-77ba1154-6f78-4b09-bb24-d2e54aa887b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:54.783995 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-77ba1154-6f78-4b09-bb24-d2e54aa887b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:54.784677 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-77ba1154-6f78-4b09-bb24-d2e54aa887b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:54.785124 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-77ba1154-6f78-4b09-bb24-d2e54aa887b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:54.785543 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-77ba1154-6f78-4b09-bb24-d2e54aa887b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:54.814020 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-77ba1154-6f78-4b09-bb24-d2e54aa887b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043425 Aug 10 12:46:54.814572 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 372/737] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:54 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:54.897774 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-48a3ebe5-bb1b-49d4-a9ca-ca29e795ea33 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:54.900622 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-48a3ebe5-bb1b-49d4-a9ca-ca29e795ea33 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:54.906917 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-48a3ebe5-bb1b-49d4-a9ca-ca29e795ea33 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:54.907428 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-48a3ebe5-bb1b-49d4-a9ca-ca29e795ea33 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:54.907857 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-48a3ebe5-bb1b-49d4-a9ca-ca29e795ea33 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:54.908532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-48a3ebe5-bb1b-49d4-a9ca-ca29e795ea33 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:54.908975 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-48a3ebe5-bb1b-49d4-a9ca-ca29e795ea33 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:54.909392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-48a3ebe5-bb1b-49d4-a9ca-ca29e795ea33 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:54.937877 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-48a3ebe5-bb1b-49d4-a9ca-ca29e795ea33 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044022 Aug 10 12:46:54.938426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 366/738] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:54 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:55.699772 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7283cd30-1160-4264-90af-cf97c35f9395 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:55.701887 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7283cd30-1160-4264-90af-cf97c35f9395 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:55.708183 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7283cd30-1160-4264-90af-cf97c35f9395 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:55.708654 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7283cd30-1160-4264-90af-cf97c35f9395 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:55.709084 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7283cd30-1160-4264-90af-cf97c35f9395 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:55.709757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7283cd30-1160-4264-90af-cf97c35f9395 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:55.710200 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7283cd30-1160-4264-90af-cf97c35f9395 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:55.710612 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7283cd30-1160-4264-90af-cf97c35f9395 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:55.739195 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7283cd30-1160-4264-90af-cf97c35f9395 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043542 Aug 10 12:46:55.739757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 373/739] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:55 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:55.826361 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ac7da308-4897-4e20-8c9a-9028352ffb4a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:55.828502 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ac7da308-4897-4e20-8c9a-9028352ffb4a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:55.834355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac7da308-4897-4e20-8c9a-9028352ffb4a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:55.834852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac7da308-4897-4e20-8c9a-9028352ffb4a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:55.835331 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac7da308-4897-4e20-8c9a-9028352ffb4a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:55.836019 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac7da308-4897-4e20-8c9a-9028352ffb4a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:55.836469 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac7da308-4897-4e20-8c9a-9028352ffb4a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:55.836890 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac7da308-4897-4e20-8c9a-9028352ffb4a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:55.866212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ac7da308-4897-4e20-8c9a-9028352ffb4a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043901 Aug 10 12:46:55.866803 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 367/740] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:55 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:55.950053 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-84fb409e-901f-46b9-a7ab-c2adbff22f39 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:55.952188 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-84fb409e-901f-46b9-a7ab-c2adbff22f39 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:55.958020 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-84fb409e-901f-46b9-a7ab-c2adbff22f39 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:55.958500 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-84fb409e-901f-46b9-a7ab-c2adbff22f39 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:55.958936 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-84fb409e-901f-46b9-a7ab-c2adbff22f39 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:55.959727 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-84fb409e-901f-46b9-a7ab-c2adbff22f39 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:55.960182 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-84fb409e-901f-46b9-a7ab-c2adbff22f39 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:55.960606 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-84fb409e-901f-46b9-a7ab-c2adbff22f39 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:55.989789 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-84fb409e-901f-46b9-a7ab-c2adbff22f39 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043804 Aug 10 12:46:55.990350 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 374/741] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:55 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:56.752152 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2419c5d0-e241-45ad-b775-c5579ccd49e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:56.754166 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2419c5d0-e241-45ad-b775-c5579ccd49e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:56.761028 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2419c5d0-e241-45ad-b775-c5579ccd49e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:56.761510 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2419c5d0-e241-45ad-b775-c5579ccd49e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:56.761935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2419c5d0-e241-45ad-b775-c5579ccd49e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:56.762611 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2419c5d0-e241-45ad-b775-c5579ccd49e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:56.763054 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2419c5d0-e241-45ad-b775-c5579ccd49e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:56.763499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2419c5d0-e241-45ad-b775-c5579ccd49e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:56.793428 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2419c5d0-e241-45ad-b775-c5579ccd49e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045304 Aug 10 12:46:56.793991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 368/742] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:56 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:56.879309 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d9a37584-8d18-46a7-89eb-b56c4bff5094 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:56.881469 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d9a37584-8d18-46a7-89eb-b56c4bff5094 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:56.888048 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d9a37584-8d18-46a7-89eb-b56c4bff5094 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:56.888520 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d9a37584-8d18-46a7-89eb-b56c4bff5094 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:56.888950 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d9a37584-8d18-46a7-89eb-b56c4bff5094 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:56.889651 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d9a37584-8d18-46a7-89eb-b56c4bff5094 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:56.890094 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d9a37584-8d18-46a7-89eb-b56c4bff5094 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:56.890507 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d9a37584-8d18-46a7-89eb-b56c4bff5094 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:56.918563 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d9a37584-8d18-46a7-89eb-b56c4bff5094 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043383 Aug 10 12:46:56.919112 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 375/743] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:56 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:57.002688 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a3b17a58-809f-4b39-8cc0-622bd3754634 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:57.004760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a3b17a58-809f-4b39-8cc0-622bd3754634 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:57.011340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3b17a58-809f-4b39-8cc0-622bd3754634 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:57.011822 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3b17a58-809f-4b39-8cc0-622bd3754634 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:57.012257 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3b17a58-809f-4b39-8cc0-622bd3754634 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:57.012943 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3b17a58-809f-4b39-8cc0-622bd3754634 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:57.013394 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3b17a58-809f-4b39-8cc0-622bd3754634 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:57.013823 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3b17a58-809f-4b39-8cc0-622bd3754634 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:57.043629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a3b17a58-809f-4b39-8cc0-622bd3754634 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044816 Aug 10 12:46:57.044263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 369/744] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:56 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:57.805821 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-44b11eb6-77ac-4f0f-b05d-d4acaed93824 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:57.807992 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-44b11eb6-77ac-4f0f-b05d-d4acaed93824 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:57.813937 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-44b11eb6-77ac-4f0f-b05d-d4acaed93824 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:57.814417 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-44b11eb6-77ac-4f0f-b05d-d4acaed93824 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:57.814851 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-44b11eb6-77ac-4f0f-b05d-d4acaed93824 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:57.815563 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-44b11eb6-77ac-4f0f-b05d-d4acaed93824 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:57.816014 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-44b11eb6-77ac-4f0f-b05d-d4acaed93824 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:57.816439 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-44b11eb6-77ac-4f0f-b05d-d4acaed93824 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:57.845620 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-44b11eb6-77ac-4f0f-b05d-d4acaed93824 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043876 Aug 10 12:46:57.846168 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 376/745] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:57 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:57.930635 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-97e00268-48e2-4556-b5b9-f4a075ae5727 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:57.932828 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-97e00268-48e2-4556-b5b9-f4a075ae5727 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:57.939196 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97e00268-48e2-4556-b5b9-f4a075ae5727 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:57.939701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97e00268-48e2-4556-b5b9-f4a075ae5727 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:57.940140 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97e00268-48e2-4556-b5b9-f4a075ae5727 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:57.940833 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97e00268-48e2-4556-b5b9-f4a075ae5727 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:57.941286 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97e00268-48e2-4556-b5b9-f4a075ae5727 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:57.941709 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97e00268-48e2-4556-b5b9-f4a075ae5727 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:57.971150 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-97e00268-48e2-4556-b5b9-f4a075ae5727 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044508 Aug 10 12:46:57.971741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 370/746] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:57 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:58.056171 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-22a5f739-0b96-4a84-9dac-9760ca118818 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:58.058240 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-22a5f739-0b96-4a84-9dac-9760ca118818 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:58.064465 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22a5f739-0b96-4a84-9dac-9760ca118818 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:58.064945 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22a5f739-0b96-4a84-9dac-9760ca118818 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:58.065373 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22a5f739-0b96-4a84-9dac-9760ca118818 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:58.066052 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22a5f739-0b96-4a84-9dac-9760ca118818 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:58.066496 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22a5f739-0b96-4a84-9dac-9760ca118818 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:58.066913 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22a5f739-0b96-4a84-9dac-9760ca118818 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:58.096342 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-22a5f739-0b96-4a84-9dac-9760ca118818 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044132 Aug 10 12:46:58.096912 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 377/747] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:58 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:58.858588 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-49f96c61-931d-49e2-8ca4-ee2c87d5d8f6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:58.860940 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-49f96c61-931d-49e2-8ca4-ee2c87d5d8f6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:58.866921 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49f96c61-931d-49e2-8ca4-ee2c87d5d8f6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:58.867435 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49f96c61-931d-49e2-8ca4-ee2c87d5d8f6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:58.867870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49f96c61-931d-49e2-8ca4-ee2c87d5d8f6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:58.869444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49f96c61-931d-49e2-8ca4-ee2c87d5d8f6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:58.869907 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49f96c61-931d-49e2-8ca4-ee2c87d5d8f6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:58.870333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49f96c61-931d-49e2-8ca4-ee2c87d5d8f6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:58.898201 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-49f96c61-931d-49e2-8ca4-ee2c87d5d8f6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043614 Aug 10 12:46:58.898744 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 371/748] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:58 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:58.983952 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-29254cab-99a0-4d11-9aff-8d6dbebb0881 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:58.986317 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-29254cab-99a0-4d11-9aff-8d6dbebb0881 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:58.992219 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-29254cab-99a0-4d11-9aff-8d6dbebb0881 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:58.992692 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-29254cab-99a0-4d11-9aff-8d6dbebb0881 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:58.993166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-29254cab-99a0-4d11-9aff-8d6dbebb0881 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:58.994416 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-29254cab-99a0-4d11-9aff-8d6dbebb0881 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:58.994858 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-29254cab-99a0-4d11-9aff-8d6dbebb0881 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:58.995297 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-29254cab-99a0-4d11-9aff-8d6dbebb0881 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:59.022575 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-29254cab-99a0-4d11-9aff-8d6dbebb0881 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042558 Aug 10 12:46:59.023115 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 378/749] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:46:58 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:46:59.109189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0eb072ab-df13-4ead-a8de-cbcb3fda7916 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:59.111530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0eb072ab-df13-4ead-a8de-cbcb3fda7916 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:59.117838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0eb072ab-df13-4ead-a8de-cbcb3fda7916 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:59.118324 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0eb072ab-df13-4ead-a8de-cbcb3fda7916 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:59.118760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0eb072ab-df13-4ead-a8de-cbcb3fda7916 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:59.119479 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0eb072ab-df13-4ead-a8de-cbcb3fda7916 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:59.119936 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0eb072ab-df13-4ead-a8de-cbcb3fda7916 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:59.120360 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0eb072ab-df13-4ead-a8de-cbcb3fda7916 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:59.148351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0eb072ab-df13-4ead-a8de-cbcb3fda7916 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043201 Aug 10 12:46:59.148903 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 372/750] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:59 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:46:59.910329 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-01b9d761-d7f3-4e39-b7dd-b57321a2448d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:46:59.912430 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-01b9d761-d7f3-4e39-b7dd-b57321a2448d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:46:59.918919 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01b9d761-d7f3-4e39-b7dd-b57321a2448d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:59.919427 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01b9d761-d7f3-4e39-b7dd-b57321a2448d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:59.919857 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01b9d761-d7f3-4e39-b7dd-b57321a2448d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:59.920538 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01b9d761-d7f3-4e39-b7dd-b57321a2448d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:46:59.920987 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01b9d761-d7f3-4e39-b7dd-b57321a2448d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:46:59.921407 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01b9d761-d7f3-4e39-b7dd-b57321a2448d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:46:59.935687 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:46:59.951380 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-01b9d761-d7f3-4e39-b7dd-b57321a2448d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045054 Aug 10 12:46:59.953921 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 379/751] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:46:59 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:00.034771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d14c2d96-68cf-4cca-aa89-44a2b463eb0f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:00.036934 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d14c2d96-68cf-4cca-aa89-44a2b463eb0f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:00.043145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d14c2d96-68cf-4cca-aa89-44a2b463eb0f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:00.043655 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d14c2d96-68cf-4cca-aa89-44a2b463eb0f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:00.044097 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d14c2d96-68cf-4cca-aa89-44a2b463eb0f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:00.044783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d14c2d96-68cf-4cca-aa89-44a2b463eb0f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:00.045237 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d14c2d96-68cf-4cca-aa89-44a2b463eb0f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:00.045662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d14c2d96-68cf-4cca-aa89-44a2b463eb0f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:00.074781 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d14c2d96-68cf-4cca-aa89-44a2b463eb0f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044020 Aug 10 12:47:00.075368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 373/752] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:00 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:00.161543 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0641ee74-9004-49d6-b96f-248358bfaf2f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:00.163640 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0641ee74-9004-49d6-b96f-248358bfaf2f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:00.170394 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0641ee74-9004-49d6-b96f-248358bfaf2f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:00.170873 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0641ee74-9004-49d6-b96f-248358bfaf2f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:00.171333 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0641ee74-9004-49d6-b96f-248358bfaf2f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:00.172015 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0641ee74-9004-49d6-b96f-248358bfaf2f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:00.172465 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0641ee74-9004-49d6-b96f-248358bfaf2f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:00.172885 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0641ee74-9004-49d6-b96f-248358bfaf2f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:00.201657 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0641ee74-9004-49d6-b96f-248358bfaf2f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044431 Aug 10 12:47:00.202207 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 380/753] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:00 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:00.965418 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f89deafb-360f-4835-8af7-37d719200567 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:00.967592 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f89deafb-360f-4835-8af7-37d719200567 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:00.974004 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f89deafb-360f-4835-8af7-37d719200567 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:00.974483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f89deafb-360f-4835-8af7-37d719200567 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:00.974918 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f89deafb-360f-4835-8af7-37d719200567 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:00.975637 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f89deafb-360f-4835-8af7-37d719200567 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:00.976087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f89deafb-360f-4835-8af7-37d719200567 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:00.976507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f89deafb-360f-4835-8af7-37d719200567 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:01.005230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f89deafb-360f-4835-8af7-37d719200567 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044793 Aug 10 12:47:01.005782 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 374/754] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:00 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:47:01.088177 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ff9430ac-33c8-4178-8395-3ea485a06a7d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:01.090197 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ff9430ac-33c8-4178-8395-3ea485a06a7d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:01.096567 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ff9430ac-33c8-4178-8395-3ea485a06a7d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:01.097047 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ff9430ac-33c8-4178-8395-3ea485a06a7d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:01.097480 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ff9430ac-33c8-4178-8395-3ea485a06a7d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:01.098165 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ff9430ac-33c8-4178-8395-3ea485a06a7d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:01.098617 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ff9430ac-33c8-4178-8395-3ea485a06a7d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:01.099036 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ff9430ac-33c8-4178-8395-3ea485a06a7d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:01.127484 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ff9430ac-33c8-4178-8395-3ea485a06a7d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044395 Aug 10 12:47:01.128034 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 381/755] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:01 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:01.215208 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-370febc3-c522-4053-9e42-f1dcf6ca3291 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:01.217354 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-370febc3-c522-4053-9e42-f1dcf6ca3291 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:01.223099 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-370febc3-c522-4053-9e42-f1dcf6ca3291 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:01.223613 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-370febc3-c522-4053-9e42-f1dcf6ca3291 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:01.224040 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-370febc3-c522-4053-9e42-f1dcf6ca3291 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:01.224717 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-370febc3-c522-4053-9e42-f1dcf6ca3291 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:01.225225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-370febc3-c522-4053-9e42-f1dcf6ca3291 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:01.225644 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-370febc3-c522-4053-9e42-f1dcf6ca3291 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:01.255109 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-370febc3-c522-4053-9e42-f1dcf6ca3291 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045314 Aug 10 12:47:01.255935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 375/756] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:01 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:02.018399 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b72ab0c0-e52c-4d76-8188-a0fd1ef67aa4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:02.020530 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b72ab0c0-e52c-4d76-8188-a0fd1ef67aa4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:02.026474 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b72ab0c0-e52c-4d76-8188-a0fd1ef67aa4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:02.026952 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b72ab0c0-e52c-4d76-8188-a0fd1ef67aa4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:02.027424 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b72ab0c0-e52c-4d76-8188-a0fd1ef67aa4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:02.028106 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b72ab0c0-e52c-4d76-8188-a0fd1ef67aa4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:02.028575 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b72ab0c0-e52c-4d76-8188-a0fd1ef67aa4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:02.028992 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b72ab0c0-e52c-4d76-8188-a0fd1ef67aa4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:02.058018 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b72ab0c0-e52c-4d76-8188-a0fd1ef67aa4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043961 Aug 10 12:47:02.058560 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 382/757] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:02 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:02.139901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-19d134ce-8363-4739-a6bf-1dd6f207f3ce tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:02.142063 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-19d134ce-8363-4739-a6bf-1dd6f207f3ce tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:02.148519 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19d134ce-8363-4739-a6bf-1dd6f207f3ce tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:02.149018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19d134ce-8363-4739-a6bf-1dd6f207f3ce tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:02.150028 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19d134ce-8363-4739-a6bf-1dd6f207f3ce tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:02.150729 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19d134ce-8363-4739-a6bf-1dd6f207f3ce tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:02.151199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19d134ce-8363-4739-a6bf-1dd6f207f3ce tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:02.151629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19d134ce-8363-4739-a6bf-1dd6f207f3ce tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:02.181123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-19d134ce-8363-4739-a6bf-1dd6f207f3ce tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045054 Aug 10 12:47:02.181683 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 376/758] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:02 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:02.267968 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8b93c37a-5424-44fb-8c88-7f207ba5c0e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:02.270156 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8b93c37a-5424-44fb-8c88-7f207ba5c0e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:02.277567 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b93c37a-5424-44fb-8c88-7f207ba5c0e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:02.278055 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b93c37a-5424-44fb-8c88-7f207ba5c0e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:02.278491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b93c37a-5424-44fb-8c88-7f207ba5c0e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:02.279206 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b93c37a-5424-44fb-8c88-7f207ba5c0e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:02.279665 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b93c37a-5424-44fb-8c88-7f207ba5c0e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:02.280086 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b93c37a-5424-44fb-8c88-7f207ba5c0e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:02.309069 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8b93c37a-5424-44fb-8c88-7f207ba5c0e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045089 Aug 10 12:47:02.309629 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 383/759] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:02 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:03.069464 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2c55eb73-228a-4dd4-9fb5-db3ed94b8fa9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:03.072201 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2c55eb73-228a-4dd4-9fb5-db3ed94b8fa9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:03.078183 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c55eb73-228a-4dd4-9fb5-db3ed94b8fa9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:03.078656 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c55eb73-228a-4dd4-9fb5-db3ed94b8fa9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:03.079091 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c55eb73-228a-4dd4-9fb5-db3ed94b8fa9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:03.079792 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c55eb73-228a-4dd4-9fb5-db3ed94b8fa9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:03.080236 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c55eb73-228a-4dd4-9fb5-db3ed94b8fa9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:03.080652 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c55eb73-228a-4dd4-9fb5-db3ed94b8fa9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:03.108726 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2c55eb73-228a-4dd4-9fb5-db3ed94b8fa9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043289 Aug 10 12:47:03.109542 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 377/760] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:03 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:03.193445 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-457bdd5f-f8c9-4b47-9810-81ef7230618b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:03.195646 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-457bdd5f-f8c9-4b47-9810-81ef7230618b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:03.201724 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-457bdd5f-f8c9-4b47-9810-81ef7230618b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:03.202202 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-457bdd5f-f8c9-4b47-9810-81ef7230618b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:03.202634 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-457bdd5f-f8c9-4b47-9810-81ef7230618b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:03.203349 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-457bdd5f-f8c9-4b47-9810-81ef7230618b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:03.203805 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-457bdd5f-f8c9-4b47-9810-81ef7230618b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:03.204229 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-457bdd5f-f8c9-4b47-9810-81ef7230618b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:03.232891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-457bdd5f-f8c9-4b47-9810-81ef7230618b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043460 Aug 10 12:47:03.233440 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 384/761] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:03 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:03.321588 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-21ae1957-a6d2-4cb4-a349-0c78bb20fe7b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:03.323808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-21ae1957-a6d2-4cb4-a349-0c78bb20fe7b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:03.330057 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-21ae1957-a6d2-4cb4-a349-0c78bb20fe7b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:03.330534 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-21ae1957-a6d2-4cb4-a349-0c78bb20fe7b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:03.330964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-21ae1957-a6d2-4cb4-a349-0c78bb20fe7b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:03.331665 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-21ae1957-a6d2-4cb4-a349-0c78bb20fe7b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:03.332144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-21ae1957-a6d2-4cb4-a349-0c78bb20fe7b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:03.332563 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-21ae1957-a6d2-4cb4-a349-0c78bb20fe7b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:03.361404 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-21ae1957-a6d2-4cb4-a349-0c78bb20fe7b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044075 Aug 10 12:47:03.361940 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 378/762] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:03 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:04.121414 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d3f4e455-6341-47b4-9085-bf28f4224dce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:04.123578 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d3f4e455-6341-47b4-9085-bf28f4224dce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:04.129855 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d3f4e455-6341-47b4-9085-bf28f4224dce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:04.130328 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d3f4e455-6341-47b4-9085-bf28f4224dce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:04.130758 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d3f4e455-6341-47b4-9085-bf28f4224dce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:04.131468 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d3f4e455-6341-47b4-9085-bf28f4224dce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:04.131915 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d3f4e455-6341-47b4-9085-bf28f4224dce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:04.132328 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d3f4e455-6341-47b4-9085-bf28f4224dce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:04.161339 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d3f4e455-6341-47b4-9085-bf28f4224dce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044146 Aug 10 12:47:04.161879 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 385/763] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:04 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:04.245546 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7f43185f-d733-4e4b-85ee-ca0d32f4da36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:04.247714 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7f43185f-d733-4e4b-85ee-ca0d32f4da36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:04.253561 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f43185f-d733-4e4b-85ee-ca0d32f4da36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:04.254039 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f43185f-d733-4e4b-85ee-ca0d32f4da36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:04.254525 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f43185f-d733-4e4b-85ee-ca0d32f4da36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:04.255230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f43185f-d733-4e4b-85ee-ca0d32f4da36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:04.255683 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f43185f-d733-4e4b-85ee-ca0d32f4da36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:04.256108 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f43185f-d733-4e4b-85ee-ca0d32f4da36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:04.286772 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7f43185f-d733-4e4b-85ee-ca0d32f4da36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045354 Aug 10 12:47:04.287402 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 379/764] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:04 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:04.374189 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0ca78bc5-6cee-45ed-9f44-f73b80cff180 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:04.376273 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0ca78bc5-6cee-45ed-9f44-f73b80cff180 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:04.382104 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ca78bc5-6cee-45ed-9f44-f73b80cff180 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:04.382590 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ca78bc5-6cee-45ed-9f44-f73b80cff180 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:04.383025 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ca78bc5-6cee-45ed-9f44-f73b80cff180 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:04.383874 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ca78bc5-6cee-45ed-9f44-f73b80cff180 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:04.384343 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ca78bc5-6cee-45ed-9f44-f73b80cff180 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:04.384771 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ca78bc5-6cee-45ed-9f44-f73b80cff180 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:04.413537 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0ca78bc5-6cee-45ed-9f44-f73b80cff180 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043332 Aug 10 12:47:04.414093 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 386/765] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:04 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:05.174187 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-77c20d09-1fed-4715-a549-34f7fd184ae7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:05.175602 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-77c20d09-1fed-4715-a549-34f7fd184ae7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:05.182152 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-77c20d09-1fed-4715-a549-34f7fd184ae7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:05.182628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-77c20d09-1fed-4715-a549-34f7fd184ae7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:05.183055 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-77c20d09-1fed-4715-a549-34f7fd184ae7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:05.183762 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-77c20d09-1fed-4715-a549-34f7fd184ae7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:05.184209 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-77c20d09-1fed-4715-a549-34f7fd184ae7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:05.184628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-77c20d09-1fed-4715-a549-34f7fd184ae7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:05.199142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:47:05.215335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-77c20d09-1fed-4715-a549-34f7fd184ae7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046115 Aug 10 12:47:05.215888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 380/766] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:05 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:05.299998 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d2a1a111-29cd-483e-b878-747e31ade0be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:05.302172 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d2a1a111-29cd-483e-b878-747e31ade0be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:05.309116 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d2a1a111-29cd-483e-b878-747e31ade0be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:05.309590 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d2a1a111-29cd-483e-b878-747e31ade0be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:05.310019 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d2a1a111-29cd-483e-b878-747e31ade0be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:05.310697 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d2a1a111-29cd-483e-b878-747e31ade0be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:05.311146 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d2a1a111-29cd-483e-b878-747e31ade0be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:05.311594 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d2a1a111-29cd-483e-b878-747e31ade0be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:05.340462 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d2a1a111-29cd-483e-b878-747e31ade0be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044463 Aug 10 12:47:05.341016 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 387/767] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:05 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:05.426748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bdd6105e-1c0d-4017-a885-b68fd00d2c5b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:05.428816 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bdd6105e-1c0d-4017-a885-b68fd00d2c5b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:05.434755 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bdd6105e-1c0d-4017-a885-b68fd00d2c5b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:05.435259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bdd6105e-1c0d-4017-a885-b68fd00d2c5b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:05.435692 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bdd6105e-1c0d-4017-a885-b68fd00d2c5b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:05.436371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bdd6105e-1c0d-4017-a885-b68fd00d2c5b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:05.436816 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bdd6105e-1c0d-4017-a885-b68fd00d2c5b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:05.437242 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bdd6105e-1c0d-4017-a885-b68fd00d2c5b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:05.466376 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bdd6105e-1c0d-4017-a885-b68fd00d2c5b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043926 Aug 10 12:47:05.466911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 381/768] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:05 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:06.227990 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e40857a6-36cf-4e08-a681-a6b449431ec2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:06.230636 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e40857a6-36cf-4e08-a681-a6b449431ec2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:06.232516 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=80 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:47:06.237378 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e40857a6-36cf-4e08-a681-a6b449431ec2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:06.237860 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e40857a6-36cf-4e08-a681-a6b449431ec2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:06.238294 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e40857a6-36cf-4e08-a681-a6b449431ec2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:06.238987 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e40857a6-36cf-4e08-a681-a6b449431ec2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:06.239465 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e40857a6-36cf-4e08-a681-a6b449431ec2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:06.239893 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e40857a6-36cf-4e08-a681-a6b449431ec2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:06.268941 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e40857a6-36cf-4e08-a681-a6b449431ec2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044899 Aug 10 12:47:06.269502 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 388/769] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:06 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:06.352741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-040f93bb-ec4d-428c-ac80-d9c6e055841d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:06.355412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-040f93bb-ec4d-428c-ac80-d9c6e055841d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:06.361923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-040f93bb-ec4d-428c-ac80-d9c6e055841d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:06.362394 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-040f93bb-ec4d-428c-ac80-d9c6e055841d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:06.362821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-040f93bb-ec4d-428c-ac80-d9c6e055841d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:06.363523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-040f93bb-ec4d-428c-ac80-d9c6e055841d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:06.363967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-040f93bb-ec4d-428c-ac80-d9c6e055841d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:06.364387 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-040f93bb-ec4d-428c-ac80-d9c6e055841d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:06.393326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-040f93bb-ec4d-428c-ac80-d9c6e055841d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044532 Aug 10 12:47:06.393875 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 382/770] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:06 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:06.478734 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-08a03740-1f13-4dd6-9820-474658aa729b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:06.481343 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-08a03740-1f13-4dd6-9820-474658aa729b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:06.488517 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08a03740-1f13-4dd6-9820-474658aa729b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:06.489008 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08a03740-1f13-4dd6-9820-474658aa729b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:06.489492 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08a03740-1f13-4dd6-9820-474658aa729b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:06.490199 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08a03740-1f13-4dd6-9820-474658aa729b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:06.490654 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08a03740-1f13-4dd6-9820-474658aa729b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:06.491083 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08a03740-1f13-4dd6-9820-474658aa729b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:06.520062 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-08a03740-1f13-4dd6-9820-474658aa729b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045623 Aug 10 12:47:06.520627 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 389/771] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:06 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:07.281684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-471f2ce4-d3db-47e4-8aaa-df0ae22e8a82 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:07.283821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-471f2ce4-d3db-47e4-8aaa-df0ae22e8a82 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:07.289776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-471f2ce4-d3db-47e4-8aaa-df0ae22e8a82 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:07.290248 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-471f2ce4-d3db-47e4-8aaa-df0ae22e8a82 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:07.290677 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-471f2ce4-d3db-47e4-8aaa-df0ae22e8a82 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:07.291429 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-471f2ce4-d3db-47e4-8aaa-df0ae22e8a82 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:07.292198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-471f2ce4-d3db-47e4-8aaa-df0ae22e8a82 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:07.292649 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-471f2ce4-d3db-47e4-8aaa-df0ae22e8a82 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:07.321231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-471f2ce4-d3db-47e4-8aaa-df0ae22e8a82 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043881 Aug 10 12:47:07.321901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 383/772] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:07 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:07.405819 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4fb75afc-de8e-4999-97a2-fe9f58c63cd8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:07.407940 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4fb75afc-de8e-4999-97a2-fe9f58c63cd8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:07.413748 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4fb75afc-de8e-4999-97a2-fe9f58c63cd8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:07.414246 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4fb75afc-de8e-4999-97a2-fe9f58c63cd8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:07.414672 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4fb75afc-de8e-4999-97a2-fe9f58c63cd8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:07.415456 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4fb75afc-de8e-4999-97a2-fe9f58c63cd8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:07.415898 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4fb75afc-de8e-4999-97a2-fe9f58c63cd8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:07.416363 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4fb75afc-de8e-4999-97a2-fe9f58c63cd8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:07.444874 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4fb75afc-de8e-4999-97a2-fe9f58c63cd8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043047 Aug 10 12:47:07.445425 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 390/773] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:07 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:07.532353 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3c1e4e01-9b92-48ab-82e6-949806041f56 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:07.534471 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3c1e4e01-9b92-48ab-82e6-949806041f56 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:07.540879 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c1e4e01-9b92-48ab-82e6-949806041f56 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:07.541369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c1e4e01-9b92-48ab-82e6-949806041f56 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:07.541897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c1e4e01-9b92-48ab-82e6-949806041f56 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:07.542685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c1e4e01-9b92-48ab-82e6-949806041f56 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:07.543138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c1e4e01-9b92-48ab-82e6-949806041f56 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:07.543580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c1e4e01-9b92-48ab-82e6-949806041f56 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:07.574071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3c1e4e01-9b92-48ab-82e6-949806041f56 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045645 Aug 10 12:47:07.574623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 384/774] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:07 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:08.339122 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f06ffa20-9939-452c-9807-9af0ee81e1a7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:08.341347 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f06ffa20-9939-452c-9807-9af0ee81e1a7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:08.347678 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f06ffa20-9939-452c-9807-9af0ee81e1a7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:08.348155 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f06ffa20-9939-452c-9807-9af0ee81e1a7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:08.348581 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f06ffa20-9939-452c-9807-9af0ee81e1a7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:08.349261 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f06ffa20-9939-452c-9807-9af0ee81e1a7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:08.349703 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f06ffa20-9939-452c-9807-9af0ee81e1a7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:08.350120 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f06ffa20-9939-452c-9807-9af0ee81e1a7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:08.378902 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f06ffa20-9939-452c-9807-9af0ee81e1a7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044381 Aug 10 12:47:08.379473 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 391/775] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:08 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:08.457691 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2d11d007-ce5f-46c6-bc12-a29eebd23279 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:08.459833 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2d11d007-ce5f-46c6-bc12-a29eebd23279 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:08.467321 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2d11d007-ce5f-46c6-bc12-a29eebd23279 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:08.467796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2d11d007-ce5f-46c6-bc12-a29eebd23279 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:08.468224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2d11d007-ce5f-46c6-bc12-a29eebd23279 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:08.468930 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2d11d007-ce5f-46c6-bc12-a29eebd23279 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:08.469376 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2d11d007-ce5f-46c6-bc12-a29eebd23279 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:08.469792 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2d11d007-ce5f-46c6-bc12-a29eebd23279 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:08.499301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2d11d007-ce5f-46c6-bc12-a29eebd23279 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045532 Aug 10 12:47:08.499866 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 385/776] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:08 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:08.586053 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f286a2cd-621f-418b-bd10-321a01c026cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:08.589295 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f286a2cd-621f-418b-bd10-321a01c026cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:08.595167 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f286a2cd-621f-418b-bd10-321a01c026cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:08.595678 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f286a2cd-621f-418b-bd10-321a01c026cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:08.596114 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f286a2cd-621f-418b-bd10-321a01c026cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:08.596808 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f286a2cd-621f-418b-bd10-321a01c026cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:08.597261 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f286a2cd-621f-418b-bd10-321a01c026cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:08.597685 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f286a2cd-621f-418b-bd10-321a01c026cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:08.626095 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f286a2cd-621f-418b-bd10-321a01c026cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043997 Aug 10 12:47:08.626676 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 392/777] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:08 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:09.390765 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-83a5f984-710f-4115-b00c-c73c3a27e769 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:09.392853 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-83a5f984-710f-4115-b00c-c73c3a27e769 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:09.399314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83a5f984-710f-4115-b00c-c73c3a27e769 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:09.399793 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83a5f984-710f-4115-b00c-c73c3a27e769 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:09.400227 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83a5f984-710f-4115-b00c-c73c3a27e769 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:09.400942 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83a5f984-710f-4115-b00c-c73c3a27e769 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:09.401394 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83a5f984-710f-4115-b00c-c73c3a27e769 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:09.401817 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83a5f984-710f-4115-b00c-c73c3a27e769 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:09.430355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-83a5f984-710f-4115-b00c-c73c3a27e769 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043610 Aug 10 12:47:09.430906 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 386/778] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:09 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:09.512708 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6d3e99a9-63a0-479e-bc08-3452201ead85 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:09.514831 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6d3e99a9-63a0-479e-bc08-3452201ead85 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:09.521253 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6d3e99a9-63a0-479e-bc08-3452201ead85 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:09.521727 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6d3e99a9-63a0-479e-bc08-3452201ead85 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:09.522162 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6d3e99a9-63a0-479e-bc08-3452201ead85 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:09.522845 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6d3e99a9-63a0-479e-bc08-3452201ead85 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:09.523388 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6d3e99a9-63a0-479e-bc08-3452201ead85 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:09.523808 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6d3e99a9-63a0-479e-bc08-3452201ead85 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:09.553063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6d3e99a9-63a0-479e-bc08-3452201ead85 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044759 Aug 10 12:47:09.553610 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 393/779] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:09 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:09.638266 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fbdd36e2-678e-4930-a3e1-600582a25c59 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:09.640397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fbdd36e2-678e-4930-a3e1-600582a25c59 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:09.646263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fbdd36e2-678e-4930-a3e1-600582a25c59 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:09.646694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fbdd36e2-678e-4930-a3e1-600582a25c59 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:09.647122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fbdd36e2-678e-4930-a3e1-600582a25c59 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:09.647832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fbdd36e2-678e-4930-a3e1-600582a25c59 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:09.648290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fbdd36e2-678e-4930-a3e1-600582a25c59 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:09.648703 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fbdd36e2-678e-4930-a3e1-600582a25c59 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:09.678424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fbdd36e2-678e-4930-a3e1-600582a25c59 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044058 Aug 10 12:47:09.678979 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 387/780] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:09 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:10.443295 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7e1072ea-9aa0-4d39-a9a7-ba36206525f2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:10.445343 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7e1072ea-9aa0-4d39-a9a7-ba36206525f2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:10.452167 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7e1072ea-9aa0-4d39-a9a7-ba36206525f2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:10.452644 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7e1072ea-9aa0-4d39-a9a7-ba36206525f2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:10.453076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7e1072ea-9aa0-4d39-a9a7-ba36206525f2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:10.453759 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7e1072ea-9aa0-4d39-a9a7-ba36206525f2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:10.454207 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7e1072ea-9aa0-4d39-a9a7-ba36206525f2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:10.454626 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7e1072ea-9aa0-4d39-a9a7-ba36206525f2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:10.483276 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7e1072ea-9aa0-4d39-a9a7-ba36206525f2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043972 Aug 10 12:47:10.483829 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 394/781] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:10 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:10.565481 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c96f1b5b-b44d-4d24-ba54-5a3d3063482f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:10.567631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c96f1b5b-b44d-4d24-ba54-5a3d3063482f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:10.574658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c96f1b5b-b44d-4d24-ba54-5a3d3063482f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:10.575126 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c96f1b5b-b44d-4d24-ba54-5a3d3063482f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:10.575580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c96f1b5b-b44d-4d24-ba54-5a3d3063482f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:10.576255 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c96f1b5b-b44d-4d24-ba54-5a3d3063482f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:10.576699 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c96f1b5b-b44d-4d24-ba54-5a3d3063482f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:10.577131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c96f1b5b-b44d-4d24-ba54-5a3d3063482f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:10.605558 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c96f1b5b-b44d-4d24-ba54-5a3d3063482f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044100 Aug 10 12:47:10.606111 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 388/782] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:10 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:10.689949 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d5597ff2-c86e-4545-9b0b-a9579d2ce963 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:10.692281 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d5597ff2-c86e-4545-9b0b-a9579d2ce963 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:10.698745 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d5597ff2-c86e-4545-9b0b-a9579d2ce963 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:10.699163 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d5597ff2-c86e-4545-9b0b-a9579d2ce963 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:10.699625 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d5597ff2-c86e-4545-9b0b-a9579d2ce963 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:10.700309 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d5597ff2-c86e-4545-9b0b-a9579d2ce963 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:10.700764 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d5597ff2-c86e-4545-9b0b-a9579d2ce963 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:10.701186 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d5597ff2-c86e-4545-9b0b-a9579d2ce963 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:10.729388 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d5597ff2-c86e-4545-9b0b-a9579d2ce963 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042847 Aug 10 12:47:10.729933 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 395/783] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:10 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:11.495428 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-25b65a77-3098-45be-bd47-0feccc38f1f2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:11.497516 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-25b65a77-3098-45be-bd47-0feccc38f1f2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:11.503490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25b65a77-3098-45be-bd47-0feccc38f1f2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:11.509282 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25b65a77-3098-45be-bd47-0feccc38f1f2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:11.509282 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25b65a77-3098-45be-bd47-0feccc38f1f2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:11.509282 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25b65a77-3098-45be-bd47-0feccc38f1f2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:11.509282 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25b65a77-3098-45be-bd47-0feccc38f1f2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:11.509633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25b65a77-3098-45be-bd47-0feccc38f1f2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:11.535889 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-25b65a77-3098-45be-bd47-0feccc38f1f2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044681 Aug 10 12:47:11.536440 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 389/784] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:11 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:11.618237 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-12811b19-0679-4822-a1b3-333af81cb221 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:11.620413 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-12811b19-0679-4822-a1b3-333af81cb221 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:11.626316 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-12811b19-0679-4822-a1b3-333af81cb221 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:11.626781 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-12811b19-0679-4822-a1b3-333af81cb221 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:11.627249 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-12811b19-0679-4822-a1b3-333af81cb221 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:11.627938 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-12811b19-0679-4822-a1b3-333af81cb221 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:11.628390 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-12811b19-0679-4822-a1b3-333af81cb221 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:11.628814 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-12811b19-0679-4822-a1b3-333af81cb221 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:11.632369 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:47:11.658467 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-12811b19-0679-4822-a1b3-333af81cb221 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044076 Aug 10 12:47:11.659027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 396/785] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:11 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:11.741616 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-61fc1a59-2f22-4fd1-bb71-0737780be3fe tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:11.743770 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-61fc1a59-2f22-4fd1-bb71-0737780be3fe tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:11.750759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61fc1a59-2f22-4fd1-bb71-0737780be3fe tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:11.751197 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61fc1a59-2f22-4fd1-bb71-0737780be3fe tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:11.751643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61fc1a59-2f22-4fd1-bb71-0737780be3fe tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:11.752324 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61fc1a59-2f22-4fd1-bb71-0737780be3fe tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:11.752773 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61fc1a59-2f22-4fd1-bb71-0737780be3fe tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:11.753193 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61fc1a59-2f22-4fd1-bb71-0737780be3fe tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:11.782698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-61fc1a59-2f22-4fd1-bb71-0737780be3fe tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045028 Aug 10 12:47:11.783270 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 390/786] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:11 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:12.548894 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-654fd4db-3701-420d-b2e5-619aad06a074 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:12.550938 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-654fd4db-3701-420d-b2e5-619aad06a074 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:12.557711 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-654fd4db-3701-420d-b2e5-619aad06a074 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:12.558185 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-654fd4db-3701-420d-b2e5-619aad06a074 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:12.558616 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-654fd4db-3701-420d-b2e5-619aad06a074 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:12.559333 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-654fd4db-3701-420d-b2e5-619aad06a074 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:12.559787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-654fd4db-3701-420d-b2e5-619aad06a074 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:12.560210 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-654fd4db-3701-420d-b2e5-619aad06a074 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:12.588576 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-654fd4db-3701-420d-b2e5-619aad06a074 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043147 Aug 10 12:47:12.589130 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 397/787] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:12 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:12.672432 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-25a0a59c-14d8-4d41-afd3-a709fc9d044a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:12.674568 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-25a0a59c-14d8-4d41-afd3-a709fc9d044a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:12.680493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25a0a59c-14d8-4d41-afd3-a709fc9d044a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:12.680971 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25a0a59c-14d8-4d41-afd3-a709fc9d044a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:12.681405 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25a0a59c-14d8-4d41-afd3-a709fc9d044a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:12.682315 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25a0a59c-14d8-4d41-afd3-a709fc9d044a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:12.682764 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25a0a59c-14d8-4d41-afd3-a709fc9d044a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:12.683207 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25a0a59c-14d8-4d41-afd3-a709fc9d044a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:12.711262 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-25a0a59c-14d8-4d41-afd3-a709fc9d044a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042899 Aug 10 12:47:12.711813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 391/788] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:12 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:12.794532 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b554e9f3-3dec-44eb-88ca-a6d96734b1e0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:12.796669 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b554e9f3-3dec-44eb-88ca-a6d96734b1e0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:12.802460 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b554e9f3-3dec-44eb-88ca-a6d96734b1e0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:12.802877 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b554e9f3-3dec-44eb-88ca-a6d96734b1e0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:12.803345 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b554e9f3-3dec-44eb-88ca-a6d96734b1e0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:12.804027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b554e9f3-3dec-44eb-88ca-a6d96734b1e0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:12.804471 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b554e9f3-3dec-44eb-88ca-a6d96734b1e0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:12.804886 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b554e9f3-3dec-44eb-88ca-a6d96734b1e0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:12.832453 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b554e9f3-3dec-44eb-88ca-a6d96734b1e0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042428 Aug 10 12:47:12.832997 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 398/789] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:12 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:13.600767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-204e1294-3589-4db4-84ee-696bcaca5f8c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:13.602844 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-204e1294-3589-4db4-84ee-696bcaca5f8c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:13.609513 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-204e1294-3589-4db4-84ee-696bcaca5f8c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:13.609984 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-204e1294-3589-4db4-84ee-696bcaca5f8c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:13.610410 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-204e1294-3589-4db4-84ee-696bcaca5f8c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:13.611083 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-204e1294-3589-4db4-84ee-696bcaca5f8c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:13.611554 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-204e1294-3589-4db4-84ee-696bcaca5f8c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:13.611969 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-204e1294-3589-4db4-84ee-696bcaca5f8c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:13.641250 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-204e1294-3589-4db4-84ee-696bcaca5f8c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044471 Aug 10 12:47:13.641793 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 392/790] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:13 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:13.723571 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9c1455f1-1167-46d9-97ac-23ac5c8a62e6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:13.725736 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9c1455f1-1167-46d9-97ac-23ac5c8a62e6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:13.732604 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9c1455f1-1167-46d9-97ac-23ac5c8a62e6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:13.733075 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9c1455f1-1167-46d9-97ac-23ac5c8a62e6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:13.733506 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9c1455f1-1167-46d9-97ac-23ac5c8a62e6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:13.734435 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9c1455f1-1167-46d9-97ac-23ac5c8a62e6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:13.734879 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9c1455f1-1167-46d9-97ac-23ac5c8a62e6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:13.735326 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9c1455f1-1167-46d9-97ac-23ac5c8a62e6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:13.764306 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9c1455f1-1167-46d9-97ac-23ac5c8a62e6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044858 Aug 10 12:47:13.764844 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 399/791] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:13 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:13.844527 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-85ddfb2d-ff51-4e29-92eb-72e659331105 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:13.846647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-85ddfb2d-ff51-4e29-92eb-72e659331105 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:13.852655 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-85ddfb2d-ff51-4e29-92eb-72e659331105 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:13.853082 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-85ddfb2d-ff51-4e29-92eb-72e659331105 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:13.853516 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-85ddfb2d-ff51-4e29-92eb-72e659331105 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:13.854710 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-85ddfb2d-ff51-4e29-92eb-72e659331105 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:13.855164 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-85ddfb2d-ff51-4e29-92eb-72e659331105 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:13.855625 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-85ddfb2d-ff51-4e29-92eb-72e659331105 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:13.884412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-85ddfb2d-ff51-4e29-92eb-72e659331105 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043816 Aug 10 12:47:13.885016 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 393/792] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:13 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:14.654205 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1543a2d3-9096-4d46-b940-dde3b21d320b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:14.656314 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1543a2d3-9096-4d46-b940-dde3b21d320b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:14.662175 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1543a2d3-9096-4d46-b940-dde3b21d320b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:14.662651 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1543a2d3-9096-4d46-b940-dde3b21d320b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:14.663087 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1543a2d3-9096-4d46-b940-dde3b21d320b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:14.663796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1543a2d3-9096-4d46-b940-dde3b21d320b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:14.664246 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1543a2d3-9096-4d46-b940-dde3b21d320b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:14.664669 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1543a2d3-9096-4d46-b940-dde3b21d320b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:14.692669 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1543a2d3-9096-4d46-b940-dde3b21d320b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043212 Aug 10 12:47:14.693217 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 400/793] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:14 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:14.775632 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-aa387553-9129-45b5-b7c5-5ae91a88bf18 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:14.777933 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-aa387553-9129-45b5-b7c5-5ae91a88bf18 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:14.784239 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa387553-9129-45b5-b7c5-5ae91a88bf18 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:14.784716 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa387553-9129-45b5-b7c5-5ae91a88bf18 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:14.785147 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa387553-9129-45b5-b7c5-5ae91a88bf18 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:14.785824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa387553-9129-45b5-b7c5-5ae91a88bf18 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:14.786267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa387553-9129-45b5-b7c5-5ae91a88bf18 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:14.786684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa387553-9129-45b5-b7c5-5ae91a88bf18 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:14.815890 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-aa387553-9129-45b5-b7c5-5ae91a88bf18 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044344 Aug 10 12:47:14.816446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 394/794] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:14 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:14.895840 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3121ee1c-7079-4e76-a857-abf4b32f5199 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:14.897963 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3121ee1c-7079-4e76-a857-abf4b32f5199 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:14.904383 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3121ee1c-7079-4e76-a857-abf4b32f5199 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:14.904801 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3121ee1c-7079-4e76-a857-abf4b32f5199 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:14.905231 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3121ee1c-7079-4e76-a857-abf4b32f5199 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:14.905915 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3121ee1c-7079-4e76-a857-abf4b32f5199 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:14.906364 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3121ee1c-7079-4e76-a857-abf4b32f5199 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:14.906783 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3121ee1c-7079-4e76-a857-abf4b32f5199 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:14.935298 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3121ee1c-7079-4e76-a857-abf4b32f5199 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043426 Aug 10 12:47:14.935851 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 401/795] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:14 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:15.704862 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f3b2b2e4-aff9-4748-8526-833052561965 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:15.706942 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f3b2b2e4-aff9-4748-8526-833052561965 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:15.713457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3b2b2e4-aff9-4748-8526-833052561965 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:15.713934 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3b2b2e4-aff9-4748-8526-833052561965 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:15.714388 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3b2b2e4-aff9-4748-8526-833052561965 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:15.715051 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3b2b2e4-aff9-4748-8526-833052561965 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:15.715538 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3b2b2e4-aff9-4748-8526-833052561965 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:15.715959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3b2b2e4-aff9-4748-8526-833052561965 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:15.744813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f3b2b2e4-aff9-4748-8526-833052561965 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043942 Aug 10 12:47:15.745363 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 395/796] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:15 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:15.828633 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3f1f9c64-a539-4df1-a496-b8264fd0b23c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:15.830780 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3f1f9c64-a539-4df1-a496-b8264fd0b23c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:15.838963 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3f1f9c64-a539-4df1-a496-b8264fd0b23c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:15.839170 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3f1f9c64-a539-4df1-a496-b8264fd0b23c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:15.852574 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3f1f9c64-a539-4df1-a496-b8264fd0b23c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:15.852574 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3f1f9c64-a539-4df1-a496-b8264fd0b23c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:15.852574 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3f1f9c64-a539-4df1-a496-b8264fd0b23c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:15.852574 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3f1f9c64-a539-4df1-a496-b8264fd0b23c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:15.869733 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3f1f9c64-a539-4df1-a496-b8264fd0b23c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045174 Aug 10 12:47:15.870336 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 402/797] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:15 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:15.946914 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6294beee-faa1-49c7-8d07-f3c8777eff5e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:15.949644 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6294beee-faa1-49c7-8d07-f3c8777eff5e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:15.955927 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6294beee-faa1-49c7-8d07-f3c8777eff5e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:15.956347 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6294beee-faa1-49c7-8d07-f3c8777eff5e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:15.956773 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6294beee-faa1-49c7-8d07-f3c8777eff5e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:15.957449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6294beee-faa1-49c7-8d07-f3c8777eff5e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:15.957893 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6294beee-faa1-49c7-8d07-f3c8777eff5e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:15.958311 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6294beee-faa1-49c7-8d07-f3c8777eff5e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:15.987146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6294beee-faa1-49c7-8d07-f3c8777eff5e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044144 Aug 10 12:47:15.987725 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 396/798] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:15 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:16.756785 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-79588926-dcc1-43a3-b7bf-0a1596756a13 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:16.758897 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-79588926-dcc1-43a3-b7bf-0a1596756a13 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:16.765672 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-79588926-dcc1-43a3-b7bf-0a1596756a13 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:16.766148 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-79588926-dcc1-43a3-b7bf-0a1596756a13 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:16.766575 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-79588926-dcc1-43a3-b7bf-0a1596756a13 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:16.767284 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-79588926-dcc1-43a3-b7bf-0a1596756a13 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:16.767732 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-79588926-dcc1-43a3-b7bf-0a1596756a13 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:16.768148 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-79588926-dcc1-43a3-b7bf-0a1596756a13 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:16.797676 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-79588926-dcc1-43a3-b7bf-0a1596756a13 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044787 Aug 10 12:47:16.798164 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 403/799] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:16 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:16.881115 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-28adada6-e651-4b57-b5b2-d8fb9ecb6d4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:16.883371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-28adada6-e651-4b57-b5b2-d8fb9ecb6d4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:16.889728 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28adada6-e651-4b57-b5b2-d8fb9ecb6d4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:16.890210 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28adada6-e651-4b57-b5b2-d8fb9ecb6d4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:16.890640 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28adada6-e651-4b57-b5b2-d8fb9ecb6d4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:16.891361 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28adada6-e651-4b57-b5b2-d8fb9ecb6d4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:16.891813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28adada6-e651-4b57-b5b2-d8fb9ecb6d4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:16.892258 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28adada6-e651-4b57-b5b2-d8fb9ecb6d4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:16.895749 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:47:16.921563 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-28adada6-e651-4b57-b5b2-d8fb9ecb6d4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044412 Aug 10 12:47:16.922115 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 397/800] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:16 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:16.999779 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f651b34e-3e0d-490d-8eed-c06d61a4f846 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:17.001892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f651b34e-3e0d-490d-8eed-c06d61a4f846 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:17.007790 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f651b34e-3e0d-490d-8eed-c06d61a4f846 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:17.008267 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f651b34e-3e0d-490d-8eed-c06d61a4f846 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:17.008696 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f651b34e-3e0d-490d-8eed-c06d61a4f846 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:17.009370 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f651b34e-3e0d-490d-8eed-c06d61a4f846 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:17.010416 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f651b34e-3e0d-490d-8eed-c06d61a4f846 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:17.010861 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f651b34e-3e0d-490d-8eed-c06d61a4f846 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:17.038440 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f651b34e-3e0d-490d-8eed-c06d61a4f846 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042598 Aug 10 12:47:17.038981 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 404/801] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:16 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:47:17.810052 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-23fb33eb-a2f5-4101-9a05-9dce36586502 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:17.812129 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-23fb33eb-a2f5-4101-9a05-9dce36586502 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:17.818967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23fb33eb-a2f5-4101-9a05-9dce36586502 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:17.819467 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23fb33eb-a2f5-4101-9a05-9dce36586502 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:17.819903 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23fb33eb-a2f5-4101-9a05-9dce36586502 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:17.820587 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23fb33eb-a2f5-4101-9a05-9dce36586502 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:17.821096 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23fb33eb-a2f5-4101-9a05-9dce36586502 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:17.821520 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23fb33eb-a2f5-4101-9a05-9dce36586502 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:17.849936 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-23fb33eb-a2f5-4101-9a05-9dce36586502 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043922 Aug 10 12:47:17.850490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 398/802] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:17 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:17.933902 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2f40fb5d-67fc-4526-b1f8-83cdf50cbdee tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:17.936026 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2f40fb5d-67fc-4526-b1f8-83cdf50cbdee tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:17.942321 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2f40fb5d-67fc-4526-b1f8-83cdf50cbdee tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:17.942797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2f40fb5d-67fc-4526-b1f8-83cdf50cbdee tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:17.943260 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2f40fb5d-67fc-4526-b1f8-83cdf50cbdee tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:17.943946 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2f40fb5d-67fc-4526-b1f8-83cdf50cbdee tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:17.944395 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2f40fb5d-67fc-4526-b1f8-83cdf50cbdee tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:17.944816 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2f40fb5d-67fc-4526-b1f8-83cdf50cbdee tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:17.973217 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2f40fb5d-67fc-4526-b1f8-83cdf50cbdee tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043418 Aug 10 12:47:17.973767 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 405/803] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:17 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:18.050100 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-999627e7-7485-48f1-870a-65eafaab2364 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:18.052276 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-999627e7-7485-48f1-870a-65eafaab2364 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:18.058091 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-999627e7-7485-48f1-870a-65eafaab2364 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:18.058572 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-999627e7-7485-48f1-870a-65eafaab2364 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:18.059029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-999627e7-7485-48f1-870a-65eafaab2364 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:18.059722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-999627e7-7485-48f1-870a-65eafaab2364 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:18.060230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-999627e7-7485-48f1-870a-65eafaab2364 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:18.060604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-999627e7-7485-48f1-870a-65eafaab2364 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:18.090272 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-999627e7-7485-48f1-870a-65eafaab2364 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044128 Aug 10 12:47:18.090823 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 399/804] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:18 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:18.862679 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c3748ee8-fb6e-4387-957e-2921083b06c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:18.864948 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c3748ee8-fb6e-4387-957e-2921083b06c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:18.871656 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3748ee8-fb6e-4387-957e-2921083b06c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:18.872142 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3748ee8-fb6e-4387-957e-2921083b06c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:18.872577 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3748ee8-fb6e-4387-957e-2921083b06c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:18.873271 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3748ee8-fb6e-4387-957e-2921083b06c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:18.873728 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3748ee8-fb6e-4387-957e-2921083b06c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:18.874151 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3748ee8-fb6e-4387-957e-2921083b06c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:18.904148 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c3748ee8-fb6e-4387-957e-2921083b06c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045806 Aug 10 12:47:18.904719 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 406/805] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:18 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:18.986018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-32a28dea-7b68-4509-8cea-c0ab46ce96a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:18.988215 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-32a28dea-7b68-4509-8cea-c0ab46ce96a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:18.994896 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-32a28dea-7b68-4509-8cea-c0ab46ce96a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:18.995393 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-32a28dea-7b68-4509-8cea-c0ab46ce96a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:18.995821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-32a28dea-7b68-4509-8cea-c0ab46ce96a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:18.996493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-32a28dea-7b68-4509-8cea-c0ab46ce96a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:18.996945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-32a28dea-7b68-4509-8cea-c0ab46ce96a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:18.997357 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-32a28dea-7b68-4509-8cea-c0ab46ce96a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:19.025037 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-32a28dea-7b68-4509-8cea-c0ab46ce96a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043348 Aug 10 12:47:19.025771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 400/806] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:18 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:19.101992 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-374531be-3816-4b40-947f-19e53bc7ce7a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:19.104770 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-374531be-3816-4b40-947f-19e53bc7ce7a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:19.111417 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-374531be-3816-4b40-947f-19e53bc7ce7a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:19.111898 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-374531be-3816-4b40-947f-19e53bc7ce7a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:19.112330 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-374531be-3816-4b40-947f-19e53bc7ce7a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:19.113011 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-374531be-3816-4b40-947f-19e53bc7ce7a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:19.113462 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-374531be-3816-4b40-947f-19e53bc7ce7a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:19.113884 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-374531be-3816-4b40-947f-19e53bc7ce7a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:19.142406 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-374531be-3816-4b40-947f-19e53bc7ce7a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044303 Aug 10 12:47:19.142887 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 407/807] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:19 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:19.916841 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e231cd46-175f-446a-99b8-6adeda5e1995 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:19.919311 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e231cd46-175f-446a-99b8-6adeda5e1995 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:19.925199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e231cd46-175f-446a-99b8-6adeda5e1995 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:19.925677 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e231cd46-175f-446a-99b8-6adeda5e1995 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:19.926105 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e231cd46-175f-446a-99b8-6adeda5e1995 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:19.926782 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e231cd46-175f-446a-99b8-6adeda5e1995 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:19.927252 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e231cd46-175f-446a-99b8-6adeda5e1995 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:19.927674 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e231cd46-175f-446a-99b8-6adeda5e1995 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:19.959597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e231cd46-175f-446a-99b8-6adeda5e1995 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046930 Aug 10 12:47:19.960163 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 401/808] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:19 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:20.037099 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2e254690-6782-4e6b-a805-cb4c34fc243a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:20.039369 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2e254690-6782-4e6b-a805-cb4c34fc243a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:20.045562 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2e254690-6782-4e6b-a805-cb4c34fc243a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:20.046039 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2e254690-6782-4e6b-a805-cb4c34fc243a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:20.046468 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2e254690-6782-4e6b-a805-cb4c34fc243a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:20.047149 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2e254690-6782-4e6b-a805-cb4c34fc243a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:20.047620 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2e254690-6782-4e6b-a805-cb4c34fc243a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:20.048039 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2e254690-6782-4e6b-a805-cb4c34fc243a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:20.076963 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2e254690-6782-4e6b-a805-cb4c34fc243a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043833 Aug 10 12:47:20.077520 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 408/809] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:20 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:20.154574 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d2a60f73-62e3-46fc-b987-22ef8ccb1203 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:20.156717 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d2a60f73-62e3-46fc-b987-22ef8ccb1203 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:20.162951 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d2a60f73-62e3-46fc-b987-22ef8ccb1203 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:20.163462 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d2a60f73-62e3-46fc-b987-22ef8ccb1203 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:20.163896 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d2a60f73-62e3-46fc-b987-22ef8ccb1203 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:20.164579 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d2a60f73-62e3-46fc-b987-22ef8ccb1203 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:20.165030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d2a60f73-62e3-46fc-b987-22ef8ccb1203 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:20.165452 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d2a60f73-62e3-46fc-b987-22ef8ccb1203 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:20.193932 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d2a60f73-62e3-46fc-b987-22ef8ccb1203 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043554 Aug 10 12:47:20.194482 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 402/810] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:20 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:20.972786 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5f785223-99cd-4e91-af12-c60b4df71831 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:20.974894 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5f785223-99cd-4e91-af12-c60b4df71831 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:20.981455 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5f785223-99cd-4e91-af12-c60b4df71831 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:20.981945 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5f785223-99cd-4e91-af12-c60b4df71831 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:20.982380 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5f785223-99cd-4e91-af12-c60b4df71831 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:20.983070 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5f785223-99cd-4e91-af12-c60b4df71831 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:20.983559 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5f785223-99cd-4e91-af12-c60b4df71831 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:20.984316 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5f785223-99cd-4e91-af12-c60b4df71831 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:21.013401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5f785223-99cd-4e91-af12-c60b4df71831 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044719 Aug 10 12:47:21.013958 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 409/811] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:20 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:21.089601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ff6524f2-b38c-4cd8-b319-5e5a9ac45b09 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:21.091739 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ff6524f2-b38c-4cd8-b319-5e5a9ac45b09 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:21.097582 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff6524f2-b38c-4cd8-b319-5e5a9ac45b09 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:21.098059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff6524f2-b38c-4cd8-b319-5e5a9ac45b09 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:21.098492 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff6524f2-b38c-4cd8-b319-5e5a9ac45b09 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:21.099195 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff6524f2-b38c-4cd8-b319-5e5a9ac45b09 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:21.099649 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff6524f2-b38c-4cd8-b319-5e5a9ac45b09 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:21.100070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff6524f2-b38c-4cd8-b319-5e5a9ac45b09 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:21.129182 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ff6524f2-b38c-4cd8-b319-5e5a9ac45b09 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043737 Aug 10 12:47:21.129766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 403/812] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:21 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:21.206343 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-59cb8fa5-7f86-4027-8e67-4f8bcaeaeb52 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:21.208483 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-59cb8fa5-7f86-4027-8e67-4f8bcaeaeb52 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:21.214377 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-59cb8fa5-7f86-4027-8e67-4f8bcaeaeb52 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:21.214855 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-59cb8fa5-7f86-4027-8e67-4f8bcaeaeb52 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:21.215325 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-59cb8fa5-7f86-4027-8e67-4f8bcaeaeb52 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:21.216016 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-59cb8fa5-7f86-4027-8e67-4f8bcaeaeb52 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:21.216471 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-59cb8fa5-7f86-4027-8e67-4f8bcaeaeb52 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:21.216894 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-59cb8fa5-7f86-4027-8e67-4f8bcaeaeb52 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:21.246935 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-59cb8fa5-7f86-4027-8e67-4f8bcaeaeb52 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044485 Aug 10 12:47:21.247457 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 410/813] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:21 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:22.026240 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e16798a4-adfe-4091-83f7-cd2cdb441efb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:22.028468 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e16798a4-adfe-4091-83f7-cd2cdb441efb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:22.034867 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e16798a4-adfe-4091-83f7-cd2cdb441efb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:22.035396 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e16798a4-adfe-4091-83f7-cd2cdb441efb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:22.035838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e16798a4-adfe-4091-83f7-cd2cdb441efb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:22.036531 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e16798a4-adfe-4091-83f7-cd2cdb441efb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:22.036985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e16798a4-adfe-4091-83f7-cd2cdb441efb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:22.037413 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e16798a4-adfe-4091-83f7-cd2cdb441efb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:22.065996 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e16798a4-adfe-4091-83f7-cd2cdb441efb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044342 Aug 10 12:47:22.066545 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 404/814] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:22 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:22.141646 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0b5ae28b-8b30-49a7-a340-e141246aa60f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:22.143805 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0b5ae28b-8b30-49a7-a340-e141246aa60f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:22.150288 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0b5ae28b-8b30-49a7-a340-e141246aa60f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:22.151734 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0b5ae28b-8b30-49a7-a340-e141246aa60f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:22.152184 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0b5ae28b-8b30-49a7-a340-e141246aa60f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:22.152889 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0b5ae28b-8b30-49a7-a340-e141246aa60f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:22.153338 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0b5ae28b-8b30-49a7-a340-e141246aa60f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:22.153756 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0b5ae28b-8b30-49a7-a340-e141246aa60f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:22.182465 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0b5ae28b-8b30-49a7-a340-e141246aa60f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044448 Aug 10 12:47:22.183039 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 411/815] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:22 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:22.259087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e4597a95-8f49-43dc-80ea-a2b98a9da613 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:22.261937 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e4597a95-8f49-43dc-80ea-a2b98a9da613 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:22.267843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e4597a95-8f49-43dc-80ea-a2b98a9da613 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:22.268331 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e4597a95-8f49-43dc-80ea-a2b98a9da613 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:22.268768 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e4597a95-8f49-43dc-80ea-a2b98a9da613 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:22.269460 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e4597a95-8f49-43dc-80ea-a2b98a9da613 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:22.269912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e4597a95-8f49-43dc-80ea-a2b98a9da613 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:22.270337 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e4597a95-8f49-43dc-80ea-a2b98a9da613 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:22.298835 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e4597a95-8f49-43dc-80ea-a2b98a9da613 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043655 Aug 10 12:47:22.299417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 405/816] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:22 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:23.078259 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-77f44942-483b-452c-a74f-501812d8ff80 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:23.081202 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-77f44942-483b-452c-a74f-501812d8ff80 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:23.087162 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-77f44942-483b-452c-a74f-501812d8ff80 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:23.094586 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-77f44942-483b-452c-a74f-501812d8ff80 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:23.094586 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-77f44942-483b-452c-a74f-501812d8ff80 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:23.094586 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-77f44942-483b-452c-a74f-501812d8ff80 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:23.094586 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-77f44942-483b-452c-a74f-501812d8ff80 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:23.094980 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-77f44942-483b-452c-a74f-501812d8ff80 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:23.114959 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:47:23.119344 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-77f44942-483b-452c-a74f-501812d8ff80 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045336 Aug 10 12:47:23.119908 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 412/817] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:23 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:23.193862 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-71369879-d1d0-46ec-ad6d-6dded775b333 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:23.195995 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-71369879-d1d0-46ec-ad6d-6dded775b333 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:23.198321 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=88 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:47:23.202876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71369879-d1d0-46ec-ad6d-6dded775b333 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:23.208900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71369879-d1d0-46ec-ad6d-6dded775b333 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:23.208900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71369879-d1d0-46ec-ad6d-6dded775b333 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:23.208900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71369879-d1d0-46ec-ad6d-6dded775b333 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:23.208900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71369879-d1d0-46ec-ad6d-6dded775b333 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:23.209333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71369879-d1d0-46ec-ad6d-6dded775b333 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:23.234964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-71369879-d1d0-46ec-ad6d-6dded775b333 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045016 Aug 10 12:47:23.235531 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 406/818] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:23 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:23.310825 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-72b2d727-8b13-49cc-9c57-bc8f8921fb8d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:23.313008 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-72b2d727-8b13-49cc-9c57-bc8f8921fb8d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:23.319479 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72b2d727-8b13-49cc-9c57-bc8f8921fb8d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:23.319957 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72b2d727-8b13-49cc-9c57-bc8f8921fb8d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:23.320386 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72b2d727-8b13-49cc-9c57-bc8f8921fb8d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:23.321073 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72b2d727-8b13-49cc-9c57-bc8f8921fb8d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:23.321521 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72b2d727-8b13-49cc-9c57-bc8f8921fb8d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:23.321941 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72b2d727-8b13-49cc-9c57-bc8f8921fb8d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:23.350249 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-72b2d727-8b13-49cc-9c57-bc8f8921fb8d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043892 Aug 10 12:47:23.350728 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 413/819] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:23 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:24.131817 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5be22ad1-10dd-4194-ac20-0742620af477 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:24.133917 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5be22ad1-10dd-4194-ac20-0742620af477 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:24.140521 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5be22ad1-10dd-4194-ac20-0742620af477 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:24.140999 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5be22ad1-10dd-4194-ac20-0742620af477 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:24.141431 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5be22ad1-10dd-4194-ac20-0742620af477 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:24.142114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5be22ad1-10dd-4194-ac20-0742620af477 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:24.142561 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5be22ad1-10dd-4194-ac20-0742620af477 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:24.142983 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5be22ad1-10dd-4194-ac20-0742620af477 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:24.171037 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5be22ad1-10dd-4194-ac20-0742620af477 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043127 Aug 10 12:47:24.171549 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 407/820] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:24 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:24.247879 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-cab81cb7-b074-464a-a1bc-c73ee92aaa8a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:24.250000 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-cab81cb7-b074-464a-a1bc-c73ee92aaa8a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:24.256330 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cab81cb7-b074-464a-a1bc-c73ee92aaa8a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:24.256812 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cab81cb7-b074-464a-a1bc-c73ee92aaa8a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:24.257250 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cab81cb7-b074-464a-a1bc-c73ee92aaa8a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:24.257942 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cab81cb7-b074-464a-a1bc-c73ee92aaa8a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:24.258394 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cab81cb7-b074-464a-a1bc-c73ee92aaa8a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:24.258815 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cab81cb7-b074-464a-a1bc-c73ee92aaa8a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:24.288797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-cab81cb7-b074-464a-a1bc-c73ee92aaa8a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045554 Aug 10 12:47:24.294690 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 414/821] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:24 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:24.362756 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-34055d25-aca5-48c0-bdef-65d3edd6352a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:24.364941 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-34055d25-aca5-48c0-bdef-65d3edd6352a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:24.372562 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34055d25-aca5-48c0-bdef-65d3edd6352a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:24.373418 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34055d25-aca5-48c0-bdef-65d3edd6352a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:24.373854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34055d25-aca5-48c0-bdef-65d3edd6352a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:24.374536 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34055d25-aca5-48c0-bdef-65d3edd6352a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:24.374986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34055d25-aca5-48c0-bdef-65d3edd6352a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:24.375428 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34055d25-aca5-48c0-bdef-65d3edd6352a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:24.404573 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-34055d25-aca5-48c0-bdef-65d3edd6352a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046016 Aug 10 12:47:24.405120 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 408/822] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:24 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:25.182760 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9836e43d-7bf0-4854-8ab0-a4a9a7f72c89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:25.184956 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9836e43d-7bf0-4854-8ab0-a4a9a7f72c89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:25.191334 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9836e43d-7bf0-4854-8ab0-a4a9a7f72c89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:25.191821 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9836e43d-7bf0-4854-8ab0-a4a9a7f72c89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:25.192260 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9836e43d-7bf0-4854-8ab0-a4a9a7f72c89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:25.192948 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9836e43d-7bf0-4854-8ab0-a4a9a7f72c89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:25.193401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9836e43d-7bf0-4854-8ab0-a4a9a7f72c89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:25.193828 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9836e43d-7bf0-4854-8ab0-a4a9a7f72c89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:25.224299 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9836e43d-7bf0-4854-8ab0-a4a9a7f72c89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045344 Aug 10 12:47:25.224771 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 415/823] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:25 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:25.304655 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d27f4810-8ab3-4164-aaab-e6e51cd51022 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:25.306911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d27f4810-8ab3-4164-aaab-e6e51cd51022 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:25.312814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d27f4810-8ab3-4164-aaab-e6e51cd51022 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:25.313290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d27f4810-8ab3-4164-aaab-e6e51cd51022 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:25.313754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d27f4810-8ab3-4164-aaab-e6e51cd51022 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:25.314433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d27f4810-8ab3-4164-aaab-e6e51cd51022 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:25.314882 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d27f4810-8ab3-4164-aaab-e6e51cd51022 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:25.315334 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d27f4810-8ab3-4164-aaab-e6e51cd51022 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:25.343567 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d27f4810-8ab3-4164-aaab-e6e51cd51022 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042939 Aug 10 12:47:25.344117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 409/824] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:25 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:25.417723 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-dc6308df-402a-4d9b-8ada-26bec665b3ec tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:25.419889 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-dc6308df-402a-4d9b-8ada-26bec665b3ec tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:25.425699 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc6308df-402a-4d9b-8ada-26bec665b3ec tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:25.426182 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc6308df-402a-4d9b-8ada-26bec665b3ec tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:25.426618 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc6308df-402a-4d9b-8ada-26bec665b3ec tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:25.427348 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc6308df-402a-4d9b-8ada-26bec665b3ec tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:25.427804 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc6308df-402a-4d9b-8ada-26bec665b3ec tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:25.428228 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc6308df-402a-4d9b-8ada-26bec665b3ec tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:25.456334 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-dc6308df-402a-4d9b-8ada-26bec665b3ec tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043560 Aug 10 12:47:25.456878 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 416/825] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:25 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:26.237042 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d17fe628-cd5a-4368-addb-f23773d57f46 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:26.239161 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d17fe628-cd5a-4368-addb-f23773d57f46 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:26.246110 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d17fe628-cd5a-4368-addb-f23773d57f46 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:26.246590 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d17fe628-cd5a-4368-addb-f23773d57f46 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:26.247024 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d17fe628-cd5a-4368-addb-f23773d57f46 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:26.247769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d17fe628-cd5a-4368-addb-f23773d57f46 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:26.248220 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d17fe628-cd5a-4368-addb-f23773d57f46 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:26.248643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d17fe628-cd5a-4368-addb-f23773d57f46 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:26.278419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d17fe628-cd5a-4368-addb-f23773d57f46 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045550 Aug 10 12:47:26.278902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 410/826] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:26 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:26.355792 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e54b6ea4-b00e-42c1-81aa-e9f1afd917ec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:26.357924 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e54b6ea4-b00e-42c1-81aa-e9f1afd917ec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:26.364552 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e54b6ea4-b00e-42c1-81aa-e9f1afd917ec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:26.365029 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e54b6ea4-b00e-42c1-81aa-e9f1afd917ec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:26.365463 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e54b6ea4-b00e-42c1-81aa-e9f1afd917ec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:26.366144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e54b6ea4-b00e-42c1-81aa-e9f1afd917ec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:26.366594 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e54b6ea4-b00e-42c1-81aa-e9f1afd917ec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:26.367017 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e54b6ea4-b00e-42c1-81aa-e9f1afd917ec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:26.396284 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e54b6ea4-b00e-42c1-81aa-e9f1afd917ec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044501 Aug 10 12:47:26.396832 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 417/827] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:26 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:26.468724 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c2353d52-197b-4f3a-8484-08378d7c720f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:26.470834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c2353d52-197b-4f3a-8484-08378d7c720f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:26.476672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2353d52-197b-4f3a-8484-08378d7c720f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:26.477153 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2353d52-197b-4f3a-8484-08378d7c720f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:26.477585 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2353d52-197b-4f3a-8484-08378d7c720f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:26.478879 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2353d52-197b-4f3a-8484-08378d7c720f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:26.479251 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2353d52-197b-4f3a-8484-08378d7c720f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:26.479676 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2353d52-197b-4f3a-8484-08378d7c720f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:26.509151 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c2353d52-197b-4f3a-8484-08378d7c720f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044313 Aug 10 12:47:26.509697 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 411/828] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:26 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:27.289962 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f77ecb04-c1fd-4451-b93a-7a61f169b821 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:27.292538 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f77ecb04-c1fd-4451-b93a-7a61f169b821 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:27.298608 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f77ecb04-c1fd-4451-b93a-7a61f169b821 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:27.299092 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f77ecb04-c1fd-4451-b93a-7a61f169b821 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:27.299562 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f77ecb04-c1fd-4451-b93a-7a61f169b821 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:27.300605 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f77ecb04-c1fd-4451-b93a-7a61f169b821 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:27.301063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f77ecb04-c1fd-4451-b93a-7a61f169b821 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:27.301489 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f77ecb04-c1fd-4451-b93a-7a61f169b821 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:27.330425 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f77ecb04-c1fd-4451-b93a-7a61f169b821 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044404 Aug 10 12:47:27.330973 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 418/829] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:27 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:27.408880 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5ed1f314-57cc-474d-8e44-66f0d6665541 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:27.410928 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5ed1f314-57cc-474d-8e44-66f0d6665541 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:27.418139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ed1f314-57cc-474d-8e44-66f0d6665541 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:27.418605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ed1f314-57cc-474d-8e44-66f0d6665541 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:27.419029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ed1f314-57cc-474d-8e44-66f0d6665541 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:27.419730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ed1f314-57cc-474d-8e44-66f0d6665541 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:27.420173 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ed1f314-57cc-474d-8e44-66f0d6665541 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:27.420613 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ed1f314-57cc-474d-8e44-66f0d6665541 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:27.448783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5ed1f314-57cc-474d-8e44-66f0d6665541 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043964 Aug 10 12:47:27.449327 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 412/830] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:27 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:27.521386 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2b158c88-1b5c-46ac-8ed9-a5b34f724938 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:27.523516 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2b158c88-1b5c-46ac-8ed9-a5b34f724938 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:27.529455 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b158c88-1b5c-46ac-8ed9-a5b34f724938 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:27.529931 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b158c88-1b5c-46ac-8ed9-a5b34f724938 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:27.530358 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b158c88-1b5c-46ac-8ed9-a5b34f724938 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:27.531035 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b158c88-1b5c-46ac-8ed9-a5b34f724938 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:27.531502 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b158c88-1b5c-46ac-8ed9-a5b34f724938 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:27.531922 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b158c88-1b5c-46ac-8ed9-a5b34f724938 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:27.561150 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2b158c88-1b5c-46ac-8ed9-a5b34f724938 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043640 Aug 10 12:47:27.561720 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 419/831] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:27 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:28.342703 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3af1a7f0-896f-47c6-adf3-6839b6282cc8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:28.344882 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3af1a7f0-896f-47c6-adf3-6839b6282cc8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:28.350897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3af1a7f0-896f-47c6-adf3-6839b6282cc8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:28.351415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3af1a7f0-896f-47c6-adf3-6839b6282cc8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:28.351860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3af1a7f0-896f-47c6-adf3-6839b6282cc8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:28.352545 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3af1a7f0-896f-47c6-adf3-6839b6282cc8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:28.352999 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3af1a7f0-896f-47c6-adf3-6839b6282cc8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:28.353426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3af1a7f0-896f-47c6-adf3-6839b6282cc8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:28.378186 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:47:28.382532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3af1a7f0-896f-47c6-adf3-6839b6282cc8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043858 Aug 10 12:47:28.383088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 413/832] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:28 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:47:28.461093 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-41cc183f-379c-431f-8a6e-8f7be229cd6e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:28.463505 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-41cc183f-379c-431f-8a6e-8f7be229cd6e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:28.469799 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-41cc183f-379c-431f-8a6e-8f7be229cd6e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:28.470276 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-41cc183f-379c-431f-8a6e-8f7be229cd6e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:28.470711 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-41cc183f-379c-431f-8a6e-8f7be229cd6e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:28.471427 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-41cc183f-379c-431f-8a6e-8f7be229cd6e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:28.471879 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-41cc183f-379c-431f-8a6e-8f7be229cd6e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:28.472300 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-41cc183f-379c-431f-8a6e-8f7be229cd6e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:28.501061 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-41cc183f-379c-431f-8a6e-8f7be229cd6e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043957 Aug 10 12:47:28.508122 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 420/833] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:28 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:28.574003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-365940eb-50c7-4b16-ab5a-2c3c76da2d39 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:28.576176 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-365940eb-50c7-4b16-ab5a-2c3c76da2d39 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:28.582818 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-365940eb-50c7-4b16-ab5a-2c3c76da2d39 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:28.583337 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-365940eb-50c7-4b16-ab5a-2c3c76da2d39 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:28.583774 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-365940eb-50c7-4b16-ab5a-2c3c76da2d39 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:28.584456 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-365940eb-50c7-4b16-ab5a-2c3c76da2d39 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:28.584909 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-365940eb-50c7-4b16-ab5a-2c3c76da2d39 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:28.585327 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-365940eb-50c7-4b16-ab5a-2c3c76da2d39 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:28.613879 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-365940eb-50c7-4b16-ab5a-2c3c76da2d39 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044478 Aug 10 12:47:28.614431 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 414/834] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:28 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:29.405722 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e7d16a79-8633-4b3e-a7e3-a918794120cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:29.407889 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e7d16a79-8633-4b3e-a7e3-a918794120cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:29.413776 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e7d16a79-8633-4b3e-a7e3-a918794120cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:29.414254 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e7d16a79-8633-4b3e-a7e3-a918794120cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:29.414682 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e7d16a79-8633-4b3e-a7e3-a918794120cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:29.415393 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e7d16a79-8633-4b3e-a7e3-a918794120cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:29.416032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e7d16a79-8633-4b3e-a7e3-a918794120cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:29.416469 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e7d16a79-8633-4b3e-a7e3-a918794120cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:29.444613 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e7d16a79-8633-4b3e-a7e3-a918794120cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042809 Aug 10 12:47:29.445101 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 421/835] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:29 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:29.518685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-005430db-2a4f-4c85-ac09-574e78427bf4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:29.520812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-005430db-2a4f-4c85-ac09-574e78427bf4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:29.527391 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-005430db-2a4f-4c85-ac09-574e78427bf4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:29.527874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-005430db-2a4f-4c85-ac09-574e78427bf4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:29.528309 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-005430db-2a4f-4c85-ac09-574e78427bf4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:29.528995 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-005430db-2a4f-4c85-ac09-574e78427bf4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:29.529448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-005430db-2a4f-4c85-ac09-574e78427bf4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:29.529871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-005430db-2a4f-4c85-ac09-574e78427bf4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:29.557912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-005430db-2a4f-4c85-ac09-574e78427bf4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043138 Aug 10 12:47:29.558467 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 415/836] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:29 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:29.626008 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9bc36286-2bc3-46f7-b81b-3c4cd8a37f14 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:29.628213 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9bc36286-2bc3-46f7-b81b-3c4cd8a37f14 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:29.635090 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9bc36286-2bc3-46f7-b81b-3c4cd8a37f14 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:29.635611 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9bc36286-2bc3-46f7-b81b-3c4cd8a37f14 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:29.636051 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9bc36286-2bc3-46f7-b81b-3c4cd8a37f14 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:29.636743 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9bc36286-2bc3-46f7-b81b-3c4cd8a37f14 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:29.637200 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9bc36286-2bc3-46f7-b81b-3c4cd8a37f14 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:29.637624 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9bc36286-2bc3-46f7-b81b-3c4cd8a37f14 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:29.666078 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9bc36286-2bc3-46f7-b81b-3c4cd8a37f14 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043995 Aug 10 12:47:29.666769 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 422/837] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:29 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:30.457348 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6b45a1a3-0809-48fe-a1ac-b90663c771f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:30.459494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6b45a1a3-0809-48fe-a1ac-b90663c771f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:30.466453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b45a1a3-0809-48fe-a1ac-b90663c771f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:30.466929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b45a1a3-0809-48fe-a1ac-b90663c771f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:30.467395 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b45a1a3-0809-48fe-a1ac-b90663c771f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:30.468084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b45a1a3-0809-48fe-a1ac-b90663c771f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:30.468531 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b45a1a3-0809-48fe-a1ac-b90663c771f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:30.468954 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b45a1a3-0809-48fe-a1ac-b90663c771f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:30.498806 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6b45a1a3-0809-48fe-a1ac-b90663c771f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045282 Aug 10 12:47:30.499315 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 416/838] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:30 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:30.570005 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c58f5781-2d19-4220-9a18-181b6ff942d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:30.572835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c58f5781-2d19-4220-9a18-181b6ff942d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:30.578860 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c58f5781-2d19-4220-9a18-181b6ff942d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:30.579389 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c58f5781-2d19-4220-9a18-181b6ff942d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:30.579825 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c58f5781-2d19-4220-9a18-181b6ff942d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:30.580512 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c58f5781-2d19-4220-9a18-181b6ff942d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:30.580964 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c58f5781-2d19-4220-9a18-181b6ff942d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:30.581386 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c58f5781-2d19-4220-9a18-181b6ff942d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:30.610163 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c58f5781-2d19-4220-9a18-181b6ff942d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044183 Aug 10 12:47:30.610714 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 423/839] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:30 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:30.677912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-804f1b5f-c937-4f26-9cff-9c640210d42b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:30.680040 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-804f1b5f-c937-4f26-9cff-9c640210d42b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:30.686359 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-804f1b5f-c937-4f26-9cff-9c640210d42b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:30.686837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-804f1b5f-c937-4f26-9cff-9c640210d42b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:30.687345 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-804f1b5f-c937-4f26-9cff-9c640210d42b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:30.688043 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-804f1b5f-c937-4f26-9cff-9c640210d42b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:30.688498 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-804f1b5f-c937-4f26-9cff-9c640210d42b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:30.688920 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-804f1b5f-c937-4f26-9cff-9c640210d42b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:30.717869 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-804f1b5f-c937-4f26-9cff-9c640210d42b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043846 Aug 10 12:47:30.718416 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 417/840] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:30 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:31.510082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e7d8d040-9dea-4b29-a5e4-64c3ce156144 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:31.512249 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e7d8d040-9dea-4b29-a5e4-64c3ce156144 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:31.518731 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e7d8d040-9dea-4b29-a5e4-64c3ce156144 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:31.519251 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e7d8d040-9dea-4b29-a5e4-64c3ce156144 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:31.519691 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e7d8d040-9dea-4b29-a5e4-64c3ce156144 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:31.520387 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e7d8d040-9dea-4b29-a5e4-64c3ce156144 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:31.520840 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e7d8d040-9dea-4b29-a5e4-64c3ce156144 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:31.521266 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e7d8d040-9dea-4b29-a5e4-64c3ce156144 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:31.550778 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e7d8d040-9dea-4b29-a5e4-64c3ce156144 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044749 Aug 10 12:47:31.551285 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 424/841] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:31 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:31.622026 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-732d3dca-d3ee-4484-b31d-5f004131bf61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:31.624182 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-732d3dca-d3ee-4484-b31d-5f004131bf61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:31.630579 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-732d3dca-d3ee-4484-b31d-5f004131bf61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:31.631058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-732d3dca-d3ee-4484-b31d-5f004131bf61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:31.631523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-732d3dca-d3ee-4484-b31d-5f004131bf61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:31.632208 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-732d3dca-d3ee-4484-b31d-5f004131bf61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:31.632655 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-732d3dca-d3ee-4484-b31d-5f004131bf61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:31.633074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-732d3dca-d3ee-4484-b31d-5f004131bf61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:31.662741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-732d3dca-d3ee-4484-b31d-5f004131bf61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044789 Aug 10 12:47:31.663349 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 418/842] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:31 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:31.729877 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-02d0963e-0448-4767-8afa-f9d59f06c00a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:31.732051 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-02d0963e-0448-4767-8afa-f9d59f06c00a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:31.738144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-02d0963e-0448-4767-8afa-f9d59f06c00a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:31.738627 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-02d0963e-0448-4767-8afa-f9d59f06c00a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:31.739060 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-02d0963e-0448-4767-8afa-f9d59f06c00a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:31.739785 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-02d0963e-0448-4767-8afa-f9d59f06c00a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:31.740239 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-02d0963e-0448-4767-8afa-f9d59f06c00a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:31.740660 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-02d0963e-0448-4767-8afa-f9d59f06c00a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:31.769700 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-02d0963e-0448-4767-8afa-f9d59f06c00a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043751 Aug 10 12:47:31.770262 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 425/843] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:31 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:32.563383 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-da1529f5-6659-4818-84f1-14e11e6f9849 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:32.565424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-da1529f5-6659-4818-84f1-14e11e6f9849 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:32.571415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-da1529f5-6659-4818-84f1-14e11e6f9849 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:32.572415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-da1529f5-6659-4818-84f1-14e11e6f9849 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:32.572910 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-da1529f5-6659-4818-84f1-14e11e6f9849 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:32.573638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-da1529f5-6659-4818-84f1-14e11e6f9849 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:32.574093 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-da1529f5-6659-4818-84f1-14e11e6f9849 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:32.574519 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-da1529f5-6659-4818-84f1-14e11e6f9849 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:32.603469 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-da1529f5-6659-4818-84f1-14e11e6f9849 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044095 Aug 10 12:47:32.604017 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 419/844] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:32 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:32.674684 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c10f5ac3-4154-4013-b381-8e53a375e957 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:32.676859 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c10f5ac3-4154-4013-b381-8e53a375e957 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:32.683247 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c10f5ac3-4154-4013-b381-8e53a375e957 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:32.683731 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c10f5ac3-4154-4013-b381-8e53a375e957 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:32.684164 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c10f5ac3-4154-4013-b381-8e53a375e957 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:32.684848 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c10f5ac3-4154-4013-b381-8e53a375e957 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:32.685298 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c10f5ac3-4154-4013-b381-8e53a375e957 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:32.685718 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c10f5ac3-4154-4013-b381-8e53a375e957 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:32.716699 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c10f5ac3-4154-4013-b381-8e53a375e957 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045937 Aug 10 12:47:32.717249 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 426/845] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:32 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:32.784557 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-dcd07a28-aac2-4793-a835-7f922e7151cd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:32.786658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-dcd07a28-aac2-4793-a835-7f922e7151cd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:32.793136 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dcd07a28-aac2-4793-a835-7f922e7151cd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:32.793615 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dcd07a28-aac2-4793-a835-7f922e7151cd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:32.794046 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dcd07a28-aac2-4793-a835-7f922e7151cd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:32.794724 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dcd07a28-aac2-4793-a835-7f922e7151cd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:32.795192 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dcd07a28-aac2-4793-a835-7f922e7151cd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:32.795614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dcd07a28-aac2-4793-a835-7f922e7151cd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:32.824430 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-dcd07a28-aac2-4793-a835-7f922e7151cd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043741 Aug 10 12:47:32.824906 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 420/846] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:32 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:33.615530 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-07abf693-fb8a-4db1-9e93-11524025771a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:33.617662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-07abf693-fb8a-4db1-9e93-11524025771a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:33.623568 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-07abf693-fb8a-4db1-9e93-11524025771a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:33.624042 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-07abf693-fb8a-4db1-9e93-11524025771a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:33.624468 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-07abf693-fb8a-4db1-9e93-11524025771a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:33.625145 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-07abf693-fb8a-4db1-9e93-11524025771a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:33.625589 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-07abf693-fb8a-4db1-9e93-11524025771a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:33.626001 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-07abf693-fb8a-4db1-9e93-11524025771a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:33.654972 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-07abf693-fb8a-4db1-9e93-11524025771a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043451 Aug 10 12:47:33.655548 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 427/847] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:33 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:33.729736 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2c888a63-a902-44be-bc9f-41a826406042 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:33.731914 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2c888a63-a902-44be-bc9f-41a826406042 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:33.738087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c888a63-a902-44be-bc9f-41a826406042 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:33.738566 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c888a63-a902-44be-bc9f-41a826406042 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:33.739002 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c888a63-a902-44be-bc9f-41a826406042 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:33.739718 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c888a63-a902-44be-bc9f-41a826406042 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:33.740175 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c888a63-a902-44be-bc9f-41a826406042 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:33.740597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c888a63-a902-44be-bc9f-41a826406042 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:33.769159 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2c888a63-a902-44be-bc9f-41a826406042 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044014 Aug 10 12:47:33.769712 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 421/848] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:33 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:33.836415 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-537ed6b5-c302-4e10-9c09-48f48b3de6ed tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:33.839072 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-537ed6b5-c302-4e10-9c09-48f48b3de6ed tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:33.845349 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-537ed6b5-c302-4e10-9c09-48f48b3de6ed tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:33.845829 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-537ed6b5-c302-4e10-9c09-48f48b3de6ed tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:33.846263 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-537ed6b5-c302-4e10-9c09-48f48b3de6ed tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:33.846945 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-537ed6b5-c302-4e10-9c09-48f48b3de6ed tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:33.847429 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-537ed6b5-c302-4e10-9c09-48f48b3de6ed tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:33.847851 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-537ed6b5-c302-4e10-9c09-48f48b3de6ed tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:33.876913 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-537ed6b5-c302-4e10-9c09-48f48b3de6ed tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044311 Aug 10 12:47:33.877395 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 428/849] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:33 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:34.667147 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-94d03805-7364-4515-835a-962cf9f65e40 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:34.669553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-94d03805-7364-4515-835a-962cf9f65e40 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:34.676551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94d03805-7364-4515-835a-962cf9f65e40 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:34.677037 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94d03805-7364-4515-835a-962cf9f65e40 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:34.677472 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94d03805-7364-4515-835a-962cf9f65e40 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:34.678171 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94d03805-7364-4515-835a-962cf9f65e40 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:34.678623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94d03805-7364-4515-835a-962cf9f65e40 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:34.679047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94d03805-7364-4515-835a-962cf9f65e40 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:34.709344 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-94d03805-7364-4515-835a-962cf9f65e40 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046799 Aug 10 12:47:34.709920 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 422/850] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:34 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:34.781537 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e5bd7b99-65a7-46a8-bd51-45d2c7953b7c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:34.783781 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e5bd7b99-65a7-46a8-bd51-45d2c7953b7c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:34.789805 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5bd7b99-65a7-46a8-bd51-45d2c7953b7c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:34.790305 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5bd7b99-65a7-46a8-bd51-45d2c7953b7c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:34.791450 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5bd7b99-65a7-46a8-bd51-45d2c7953b7c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:34.792148 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5bd7b99-65a7-46a8-bd51-45d2c7953b7c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:34.792601 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5bd7b99-65a7-46a8-bd51-45d2c7953b7c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:34.793027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5bd7b99-65a7-46a8-bd51-45d2c7953b7c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:34.807383 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:47:34.822801 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e5bd7b99-65a7-46a8-bd51-45d2c7953b7c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045188 Aug 10 12:47:34.823463 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 429/851] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:34 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:34.888990 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7d980c4a-c537-4e51-bfd2-6566b7dacbb0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:34.891161 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7d980c4a-c537-4e51-bfd2-6566b7dacbb0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:34.896953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d980c4a-c537-4e51-bfd2-6566b7dacbb0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:34.897435 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d980c4a-c537-4e51-bfd2-6566b7dacbb0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:34.897872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d980c4a-c537-4e51-bfd2-6566b7dacbb0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:34.898588 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d980c4a-c537-4e51-bfd2-6566b7dacbb0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:34.899040 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d980c4a-c537-4e51-bfd2-6566b7dacbb0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:34.899488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d980c4a-c537-4e51-bfd2-6566b7dacbb0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:34.929028 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7d980c4a-c537-4e51-bfd2-6566b7dacbb0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044019 Aug 10 12:47:34.929604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 423/852] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:34 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:35.721389 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-eba2780b-7ad4-4299-8963-3572f465d7b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:35.723551 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-eba2780b-7ad4-4299-8963-3572f465d7b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:35.730283 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eba2780b-7ad4-4299-8963-3572f465d7b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:35.730787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eba2780b-7ad4-4299-8963-3572f465d7b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:35.731243 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eba2780b-7ad4-4299-8963-3572f465d7b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:35.731927 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eba2780b-7ad4-4299-8963-3572f465d7b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:35.732379 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eba2780b-7ad4-4299-8963-3572f465d7b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:35.732801 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eba2780b-7ad4-4299-8963-3572f465d7b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:35.762169 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-eba2780b-7ad4-4299-8963-3572f465d7b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044624 Aug 10 12:47:35.762728 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 430/853] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:35 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:35.834820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4dce2b33-5c57-4d1c-ac32-430d4a9fc448 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:35.836893 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4dce2b33-5c57-4d1c-ac32-430d4a9fc448 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:35.843426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4dce2b33-5c57-4d1c-ac32-430d4a9fc448 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:35.843902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4dce2b33-5c57-4d1c-ac32-430d4a9fc448 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:35.844327 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4dce2b33-5c57-4d1c-ac32-430d4a9fc448 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:35.845000 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4dce2b33-5c57-4d1c-ac32-430d4a9fc448 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:35.845443 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4dce2b33-5c57-4d1c-ac32-430d4a9fc448 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:35.845859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4dce2b33-5c57-4d1c-ac32-430d4a9fc448 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:35.874314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4dce2b33-5c57-4d1c-ac32-430d4a9fc448 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043494 Aug 10 12:47:35.874849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 424/854] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:35 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:35.941010 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-60e56f3d-0d3c-49d2-8414-d986cac1cfd1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:35.943167 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-60e56f3d-0d3c-49d2-8414-d986cac1cfd1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:35.950087 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60e56f3d-0d3c-49d2-8414-d986cac1cfd1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:35.950564 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60e56f3d-0d3c-49d2-8414-d986cac1cfd1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:35.950991 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60e56f3d-0d3c-49d2-8414-d986cac1cfd1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:35.951701 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60e56f3d-0d3c-49d2-8414-d986cac1cfd1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:35.952148 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60e56f3d-0d3c-49d2-8414-d986cac1cfd1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:35.952562 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60e56f3d-0d3c-49d2-8414-d986cac1cfd1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:35.981359 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-60e56f3d-0d3c-49d2-8414-d986cac1cfd1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044244 Aug 10 12:47:35.981907 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 431/855] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:35 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:36.774255 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d0b83f19-6c9f-41a9-9c80-2a1f0a5bdd41 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:36.777212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d0b83f19-6c9f-41a9-9c80-2a1f0a5bdd41 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:36.783093 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0b83f19-6c9f-41a9-9c80-2a1f0a5bdd41 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:36.783597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0b83f19-6c9f-41a9-9c80-2a1f0a5bdd41 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:36.784024 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0b83f19-6c9f-41a9-9c80-2a1f0a5bdd41 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:36.784706 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0b83f19-6c9f-41a9-9c80-2a1f0a5bdd41 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:36.785151 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0b83f19-6c9f-41a9-9c80-2a1f0a5bdd41 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:36.785568 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0b83f19-6c9f-41a9-9c80-2a1f0a5bdd41 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:36.814036 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d0b83f19-6c9f-41a9-9c80-2a1f0a5bdd41 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043651 Aug 10 12:47:36.814582 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 425/856] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:36 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:36.886659 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-70026ebb-e825-4393-8513-70f8d5248824 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:36.888767 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-70026ebb-e825-4393-8513-70f8d5248824 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:36.891040 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=88 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:47:36.895691 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70026ebb-e825-4393-8513-70f8d5248824 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:36.896177 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70026ebb-e825-4393-8513-70f8d5248824 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:36.896631 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70026ebb-e825-4393-8513-70f8d5248824 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:36.897322 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70026ebb-e825-4393-8513-70f8d5248824 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:36.897775 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70026ebb-e825-4393-8513-70f8d5248824 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:36.898200 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70026ebb-e825-4393-8513-70f8d5248824 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:36.927711 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-70026ebb-e825-4393-8513-70f8d5248824 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045678 Aug 10 12:47:36.928259 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 432/857] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:36 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:36.992961 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5d27b861-c52f-4840-8d26-cfa80c02eab7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:36.995227 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5d27b861-c52f-4840-8d26-cfa80c02eab7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:37.001572 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d27b861-c52f-4840-8d26-cfa80c02eab7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:37.002052 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d27b861-c52f-4840-8d26-cfa80c02eab7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:37.002484 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d27b861-c52f-4840-8d26-cfa80c02eab7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:37.003169 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d27b861-c52f-4840-8d26-cfa80c02eab7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:37.003643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d27b861-c52f-4840-8d26-cfa80c02eab7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:37.004067 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d27b861-c52f-4840-8d26-cfa80c02eab7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:37.033135 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5d27b861-c52f-4840-8d26-cfa80c02eab7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044090 Aug 10 12:47:37.033680 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 426/858] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:36 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:37.826096 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-95f58dee-aabb-40b4-89c3-5c2ecbe431b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:37.828254 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-95f58dee-aabb-40b4-89c3-5c2ecbe431b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:37.834308 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-95f58dee-aabb-40b4-89c3-5c2ecbe431b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:37.834787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-95f58dee-aabb-40b4-89c3-5c2ecbe431b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:37.835239 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-95f58dee-aabb-40b4-89c3-5c2ecbe431b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:37.835927 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-95f58dee-aabb-40b4-89c3-5c2ecbe431b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:37.836375 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-95f58dee-aabb-40b4-89c3-5c2ecbe431b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:37.836797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-95f58dee-aabb-40b4-89c3-5c2ecbe431b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:37.866436 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-95f58dee-aabb-40b4-89c3-5c2ecbe431b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044218 Aug 10 12:47:37.866994 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 433/859] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:37 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:37.940590 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3f0cf9e4-cfe9-4016-a914-07e64bccd127 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:37.942639 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3f0cf9e4-cfe9-4016-a914-07e64bccd127 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:37.948614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f0cf9e4-cfe9-4016-a914-07e64bccd127 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:37.949097 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f0cf9e4-cfe9-4016-a914-07e64bccd127 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:37.949535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f0cf9e4-cfe9-4016-a914-07e64bccd127 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:37.950227 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f0cf9e4-cfe9-4016-a914-07e64bccd127 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:37.950683 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f0cf9e4-cfe9-4016-a914-07e64bccd127 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:37.951111 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f0cf9e4-cfe9-4016-a914-07e64bccd127 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:37.979593 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3f0cf9e4-cfe9-4016-a914-07e64bccd127 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043026 Aug 10 12:47:37.980140 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 427/860] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:37 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:38.046234 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c35f6bb7-486d-4183-9e54-a7b57e13591f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:38.048394 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c35f6bb7-486d-4183-9e54-a7b57e13591f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:38.054663 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c35f6bb7-486d-4183-9e54-a7b57e13591f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:38.055145 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c35f6bb7-486d-4183-9e54-a7b57e13591f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:38.055616 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c35f6bb7-486d-4183-9e54-a7b57e13591f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:38.056302 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c35f6bb7-486d-4183-9e54-a7b57e13591f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:38.056758 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c35f6bb7-486d-4183-9e54-a7b57e13591f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:38.057176 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c35f6bb7-486d-4183-9e54-a7b57e13591f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:38.085226 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c35f6bb7-486d-4183-9e54-a7b57e13591f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042903 Aug 10 12:47:38.085770 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 434/861] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:38 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:38.879532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-08c7bfa9-d9cc-4c6d-a179-05c5ea982047 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:38.881654 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-08c7bfa9-d9cc-4c6d-a179-05c5ea982047 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:38.888790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08c7bfa9-d9cc-4c6d-a179-05c5ea982047 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:38.889268 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08c7bfa9-d9cc-4c6d-a179-05c5ea982047 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:38.889701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08c7bfa9-d9cc-4c6d-a179-05c5ea982047 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:38.890530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08c7bfa9-d9cc-4c6d-a179-05c5ea982047 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:38.890983 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08c7bfa9-d9cc-4c6d-a179-05c5ea982047 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:38.891436 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08c7bfa9-d9cc-4c6d-a179-05c5ea982047 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:38.919948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-08c7bfa9-d9cc-4c6d-a179-05c5ea982047 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044421 Aug 10 12:47:38.920499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 428/862] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:38 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:38.992076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8ae954cc-318e-4ece-90b9-e8e7e864d889 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:38.994833 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8ae954cc-318e-4ece-90b9-e8e7e864d889 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:39.000777 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8ae954cc-318e-4ece-90b9-e8e7e864d889 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:39.001252 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8ae954cc-318e-4ece-90b9-e8e7e864d889 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:39.001686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8ae954cc-318e-4ece-90b9-e8e7e864d889 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:39.002375 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8ae954cc-318e-4ece-90b9-e8e7e864d889 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:39.002826 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8ae954cc-318e-4ece-90b9-e8e7e864d889 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:39.003428 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8ae954cc-318e-4ece-90b9-e8e7e864d889 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:39.032182 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8ae954cc-318e-4ece-90b9-e8e7e864d889 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044098 Aug 10 12:47:39.032729 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 435/863] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:38 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:39.097934 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5830cc1f-24aa-4055-9c34-8cc6dce2e967 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:39.100059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5830cc1f-24aa-4055-9c34-8cc6dce2e967 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:39.106039 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5830cc1f-24aa-4055-9c34-8cc6dce2e967 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:39.106522 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5830cc1f-24aa-4055-9c34-8cc6dce2e967 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:39.106956 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5830cc1f-24aa-4055-9c34-8cc6dce2e967 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:39.107671 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5830cc1f-24aa-4055-9c34-8cc6dce2e967 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:39.108125 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5830cc1f-24aa-4055-9c34-8cc6dce2e967 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:39.108818 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5830cc1f-24aa-4055-9c34-8cc6dce2e967 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:39.138205 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5830cc1f-24aa-4055-9c34-8cc6dce2e967 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044184 Aug 10 12:47:39.138749 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 429/864] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:39 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:39.932560 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-63fa5d86-641f-4cd3-ada8-e3a02ff63468 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:39.934687 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-63fa5d86-641f-4cd3-ada8-e3a02ff63468 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:39.941155 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63fa5d86-641f-4cd3-ada8-e3a02ff63468 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:39.941637 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63fa5d86-641f-4cd3-ada8-e3a02ff63468 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:39.942074 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63fa5d86-641f-4cd3-ada8-e3a02ff63468 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:39.942765 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63fa5d86-641f-4cd3-ada8-e3a02ff63468 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:39.943238 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63fa5d86-641f-4cd3-ada8-e3a02ff63468 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:39.943663 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63fa5d86-641f-4cd3-ada8-e3a02ff63468 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:39.972832 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-63fa5d86-641f-4cd3-ada8-e3a02ff63468 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044429 Aug 10 12:47:39.973387 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 436/865] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:39 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:47:40.044624 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f6458697-e9b1-4c17-88e5-93f9ae876aae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:40.046728 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f6458697-e9b1-4c17-88e5-93f9ae876aae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:40.053037 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6458697-e9b1-4c17-88e5-93f9ae876aae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:40.053510 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6458697-e9b1-4c17-88e5-93f9ae876aae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:40.053946 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6458697-e9b1-4c17-88e5-93f9ae876aae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:40.054626 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6458697-e9b1-4c17-88e5-93f9ae876aae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:40.055074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6458697-e9b1-4c17-88e5-93f9ae876aae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:40.055522 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6458697-e9b1-4c17-88e5-93f9ae876aae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:40.069047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:47:40.084517 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f6458697-e9b1-4c17-88e5-93f9ae876aae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044064 Aug 10 12:47:40.085074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 430/866] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:40 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:40.150986 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3600b40a-38ff-47fe-988d-e8d2cf31a870 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:40.153209 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3600b40a-38ff-47fe-988d-e8d2cf31a870 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:40.159063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3600b40a-38ff-47fe-988d-e8d2cf31a870 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:40.159598 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3600b40a-38ff-47fe-988d-e8d2cf31a870 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:40.160034 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3600b40a-38ff-47fe-988d-e8d2cf31a870 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:40.160729 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3600b40a-38ff-47fe-988d-e8d2cf31a870 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:40.161190 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3600b40a-38ff-47fe-988d-e8d2cf31a870 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:40.161611 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3600b40a-38ff-47fe-988d-e8d2cf31a870 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:40.190436 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3600b40a-38ff-47fe-988d-e8d2cf31a870 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044061 Aug 10 12:47:40.190918 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 437/867] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:40 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:40.985477 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4482c882-9d6a-478f-9492-d1c5e2a8ec96 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:40.987626 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4482c882-9d6a-478f-9492-d1c5e2a8ec96 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:40.994602 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4482c882-9d6a-478f-9492-d1c5e2a8ec96 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:40.995080 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4482c882-9d6a-478f-9492-d1c5e2a8ec96 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:40.995534 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4482c882-9d6a-478f-9492-d1c5e2a8ec96 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:40.996212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4482c882-9d6a-478f-9492-d1c5e2a8ec96 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:40.996656 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4482c882-9d6a-478f-9492-d1c5e2a8ec96 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:40.997092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4482c882-9d6a-478f-9492-d1c5e2a8ec96 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:41.026818 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4482c882-9d6a-478f-9492-d1c5e2a8ec96 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046236 Aug 10 12:47:41.027410 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 431/868] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:40 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:41.097437 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a8414247-aa24-4df8-8cd3-7be046b14569 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:41.099524 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a8414247-aa24-4df8-8cd3-7be046b14569 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:41.106065 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a8414247-aa24-4df8-8cd3-7be046b14569 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:41.106542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a8414247-aa24-4df8-8cd3-7be046b14569 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:41.106976 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a8414247-aa24-4df8-8cd3-7be046b14569 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:41.107692 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a8414247-aa24-4df8-8cd3-7be046b14569 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:41.108147 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a8414247-aa24-4df8-8cd3-7be046b14569 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:41.108832 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a8414247-aa24-4df8-8cd3-7be046b14569 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:41.138376 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a8414247-aa24-4df8-8cd3-7be046b14569 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045016 Aug 10 12:47:41.138928 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 438/869] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:41 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:41.202809 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d77381a4-c087-4285-bf06-983107ae6bfc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:41.204986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d77381a4-c087-4285-bf06-983107ae6bfc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:41.211372 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d77381a4-c087-4285-bf06-983107ae6bfc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:41.211847 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d77381a4-c087-4285-bf06-983107ae6bfc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:41.212821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d77381a4-c087-4285-bf06-983107ae6bfc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:41.213488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d77381a4-c087-4285-bf06-983107ae6bfc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:41.213928 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d77381a4-c087-4285-bf06-983107ae6bfc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:41.214342 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d77381a4-c087-4285-bf06-983107ae6bfc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:41.242859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d77381a4-c087-4285-bf06-983107ae6bfc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043776 Aug 10 12:47:41.243438 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 432/870] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:41 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:42.038860 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d5b7cd82-497a-4179-846f-4c4717c0f7c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:42.041895 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d5b7cd82-497a-4179-846f-4c4717c0f7c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:42.047876 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d5b7cd82-497a-4179-846f-4c4717c0f7c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:42.048348 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d5b7cd82-497a-4179-846f-4c4717c0f7c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:42.048783 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d5b7cd82-497a-4179-846f-4c4717c0f7c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:42.049456 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d5b7cd82-497a-4179-846f-4c4717c0f7c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:42.049901 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d5b7cd82-497a-4179-846f-4c4717c0f7c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:42.050341 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d5b7cd82-497a-4179-846f-4c4717c0f7c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:42.079158 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d5b7cd82-497a-4179-846f-4c4717c0f7c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044215 Aug 10 12:47:42.079728 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 439/871] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:42 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:42.150547 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0a102543-43a1-444d-9486-361641afcc7f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:42.152696 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0a102543-43a1-444d-9486-361641afcc7f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:42.158737 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0a102543-43a1-444d-9486-361641afcc7f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:42.159250 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0a102543-43a1-444d-9486-361641afcc7f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:42.159690 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0a102543-43a1-444d-9486-361641afcc7f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:42.160378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0a102543-43a1-444d-9486-361641afcc7f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:42.160833 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0a102543-43a1-444d-9486-361641afcc7f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:42.161262 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0a102543-43a1-444d-9486-361641afcc7f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:42.190412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0a102543-43a1-444d-9486-361641afcc7f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043678 Aug 10 12:47:42.190901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 433/872] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:42 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:42.255195 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-113bb493-72e5-44de-a939-77766646f98e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:42.257325 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-113bb493-72e5-44de-a939-77766646f98e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:42.263774 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-113bb493-72e5-44de-a939-77766646f98e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:42.264269 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-113bb493-72e5-44de-a939-77766646f98e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:42.264686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-113bb493-72e5-44de-a939-77766646f98e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:42.265375 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-113bb493-72e5-44de-a939-77766646f98e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:42.265822 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-113bb493-72e5-44de-a939-77766646f98e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:42.266241 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-113bb493-72e5-44de-a939-77766646f98e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:42.294948 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-113bb493-72e5-44de-a939-77766646f98e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043694 Aug 10 12:47:42.295541 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 440/873] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:42 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:43.092108 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-74af46f1-e861-40f7-8064-2d3908d3485b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:43.094242 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-74af46f1-e861-40f7-8064-2d3908d3485b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:43.100643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-74af46f1-e861-40f7-8064-2d3908d3485b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:43.101119 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-74af46f1-e861-40f7-8064-2d3908d3485b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:43.101547 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-74af46f1-e861-40f7-8064-2d3908d3485b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:43.102225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-74af46f1-e861-40f7-8064-2d3908d3485b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:43.103342 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-74af46f1-e861-40f7-8064-2d3908d3485b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:43.103788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-74af46f1-e861-40f7-8064-2d3908d3485b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:43.132792 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-74af46f1-e861-40f7-8064-2d3908d3485b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045964 Aug 10 12:47:43.133338 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 434/874] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:43 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:43.203207 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-24811a64-93f9-4b01-afe2-6af535002898 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:43.205232 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-24811a64-93f9-4b01-afe2-6af535002898 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:43.211088 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24811a64-93f9-4b01-afe2-6af535002898 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:43.211589 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24811a64-93f9-4b01-afe2-6af535002898 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:43.212037 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24811a64-93f9-4b01-afe2-6af535002898 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:43.213338 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24811a64-93f9-4b01-afe2-6af535002898 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:43.213797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24811a64-93f9-4b01-afe2-6af535002898 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:43.214192 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24811a64-93f9-4b01-afe2-6af535002898 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:43.241910 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-24811a64-93f9-4b01-afe2-6af535002898 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042757 Aug 10 12:47:43.242449 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 441/875] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:43 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:43.307919 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5414b93d-ee87-4a7f-a217-74bb366578ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:43.310064 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5414b93d-ee87-4a7f-a217-74bb366578ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:43.315939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5414b93d-ee87-4a7f-a217-74bb366578ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:43.316422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5414b93d-ee87-4a7f-a217-74bb366578ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:43.316854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5414b93d-ee87-4a7f-a217-74bb366578ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:43.317540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5414b93d-ee87-4a7f-a217-74bb366578ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:43.317990 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5414b93d-ee87-4a7f-a217-74bb366578ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:43.318415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5414b93d-ee87-4a7f-a217-74bb366578ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:43.346850 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5414b93d-ee87-4a7f-a217-74bb366578ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043547 Aug 10 12:47:43.347425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 435/876] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:43 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:44.144909 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ec6e232c-d48b-426e-9313-72fda4f4eebf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:44.147019 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ec6e232c-d48b-426e-9313-72fda4f4eebf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:44.153909 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ec6e232c-d48b-426e-9313-72fda4f4eebf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:44.154387 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ec6e232c-d48b-426e-9313-72fda4f4eebf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:44.154817 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ec6e232c-d48b-426e-9313-72fda4f4eebf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:44.155564 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ec6e232c-d48b-426e-9313-72fda4f4eebf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:44.156013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ec6e232c-d48b-426e-9313-72fda4f4eebf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:44.156434 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ec6e232c-d48b-426e-9313-72fda4f4eebf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:44.185759 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ec6e232c-d48b-426e-9313-72fda4f4eebf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044784 Aug 10 12:47:44.186316 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 442/877] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:44 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:44.254513 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-daa43c70-553e-46ed-8c0a-fc1bdf50236c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:44.256606 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-daa43c70-553e-46ed-8c0a-fc1bdf50236c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:44.263106 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-daa43c70-553e-46ed-8c0a-fc1bdf50236c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:44.263640 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-daa43c70-553e-46ed-8c0a-fc1bdf50236c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:44.264076 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-daa43c70-553e-46ed-8c0a-fc1bdf50236c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:44.264773 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-daa43c70-553e-46ed-8c0a-fc1bdf50236c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:44.265227 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-daa43c70-553e-46ed-8c0a-fc1bdf50236c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:44.265653 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-daa43c70-553e-46ed-8c0a-fc1bdf50236c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:44.295616 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-daa43c70-553e-46ed-8c0a-fc1bdf50236c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045020 Aug 10 12:47:44.297613 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 436/878] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:44 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:44.359880 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b6f9c29c-7679-4fcb-8f52-1b3afe3f7b0d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:44.362073 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b6f9c29c-7679-4fcb-8f52-1b3afe3f7b0d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:44.368124 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b6f9c29c-7679-4fcb-8f52-1b3afe3f7b0d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:44.368754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b6f9c29c-7679-4fcb-8f52-1b3afe3f7b0d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:44.369086 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b6f9c29c-7679-4fcb-8f52-1b3afe3f7b0d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:44.369764 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b6f9c29c-7679-4fcb-8f52-1b3afe3f7b0d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:44.370214 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b6f9c29c-7679-4fcb-8f52-1b3afe3f7b0d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:44.370634 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b6f9c29c-7679-4fcb-8f52-1b3afe3f7b0d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:44.400749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b6f9c29c-7679-4fcb-8f52-1b3afe3f7b0d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044352 Aug 10 12:47:44.401402 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 443/879] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:44 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:45.197959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6e43dc00-d29d-4113-95f5-7ce1186f7537 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:45.200115 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6e43dc00-d29d-4113-95f5-7ce1186f7537 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:45.206072 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6e43dc00-d29d-4113-95f5-7ce1186f7537 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:45.206551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6e43dc00-d29d-4113-95f5-7ce1186f7537 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:45.206988 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6e43dc00-d29d-4113-95f5-7ce1186f7537 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:45.207767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6e43dc00-d29d-4113-95f5-7ce1186f7537 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:45.208214 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6e43dc00-d29d-4113-95f5-7ce1186f7537 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:45.208631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6e43dc00-d29d-4113-95f5-7ce1186f7537 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:45.238522 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6e43dc00-d29d-4113-95f5-7ce1186f7537 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044515 Aug 10 12:47:45.239082 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 437/880] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:45 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:45.308972 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d4fe06e9-1926-4819-aedf-5a8c459113be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:45.311073 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d4fe06e9-1926-4819-aedf-5a8c459113be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:45.317469 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d4fe06e9-1926-4819-aedf-5a8c459113be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:45.317948 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d4fe06e9-1926-4819-aedf-5a8c459113be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:45.318384 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d4fe06e9-1926-4819-aedf-5a8c459113be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:45.319075 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d4fe06e9-1926-4819-aedf-5a8c459113be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:45.319551 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d4fe06e9-1926-4819-aedf-5a8c459113be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:45.323952 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d4fe06e9-1926-4819-aedf-5a8c459113be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:45.348359 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d4fe06e9-1926-4819-aedf-5a8c459113be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044152 Aug 10 12:47:45.348914 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 444/881] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:45 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:45.412799 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-28a91ce4-d726-4bba-aaf2-d51a87ea0f70 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:45.414966 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-28a91ce4-d726-4bba-aaf2-d51a87ea0f70 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:45.421772 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28a91ce4-d726-4bba-aaf2-d51a87ea0f70 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:45.422253 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28a91ce4-d726-4bba-aaf2-d51a87ea0f70 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:45.422686 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28a91ce4-d726-4bba-aaf2-d51a87ea0f70 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:45.423418 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28a91ce4-d726-4bba-aaf2-d51a87ea0f70 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:45.423870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28a91ce4-d726-4bba-aaf2-d51a87ea0f70 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:45.424291 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28a91ce4-d726-4bba-aaf2-d51a87ea0f70 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:45.453180 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-28a91ce4-d726-4bba-aaf2-d51a87ea0f70 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044313 Aug 10 12:47:45.453733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 438/882] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:45 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:46.250811 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-367312fd-81fe-4165-a8aa-f3ed11c90c63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:46.252937 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-367312fd-81fe-4165-a8aa-f3ed11c90c63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:46.259514 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-367312fd-81fe-4165-a8aa-f3ed11c90c63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:46.260017 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-367312fd-81fe-4165-a8aa-f3ed11c90c63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:46.260451 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-367312fd-81fe-4165-a8aa-f3ed11c90c63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:46.261147 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-367312fd-81fe-4165-a8aa-f3ed11c90c63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:46.261595 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-367312fd-81fe-4165-a8aa-f3ed11c90c63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:46.262017 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-367312fd-81fe-4165-a8aa-f3ed11c90c63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:46.290933 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-367312fd-81fe-4165-a8aa-f3ed11c90c63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043948 Aug 10 12:47:46.291542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 445/883] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:46 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:46.362245 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0460b101-6674-4e8e-9807-85023e59ef69 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:46.364372 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0460b101-6674-4e8e-9807-85023e59ef69 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:46.370941 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0460b101-6674-4e8e-9807-85023e59ef69 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:46.371444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0460b101-6674-4e8e-9807-85023e59ef69 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:46.371879 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0460b101-6674-4e8e-9807-85023e59ef69 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:46.372556 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0460b101-6674-4e8e-9807-85023e59ef69 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:46.373005 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0460b101-6674-4e8e-9807-85023e59ef69 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:46.373427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0460b101-6674-4e8e-9807-85023e59ef69 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:46.402203 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0460b101-6674-4e8e-9807-85023e59ef69 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044308 Aug 10 12:47:46.402749 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 439/884] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:46 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:46.465106 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f4915b2e-14c7-4f38-9ea4-2eb344167483 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:46.467254 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f4915b2e-14c7-4f38-9ea4-2eb344167483 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:46.473540 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f4915b2e-14c7-4f38-9ea4-2eb344167483 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:46.474017 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f4915b2e-14c7-4f38-9ea4-2eb344167483 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:46.474447 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f4915b2e-14c7-4f38-9ea4-2eb344167483 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:46.475127 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f4915b2e-14c7-4f38-9ea4-2eb344167483 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:46.475602 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f4915b2e-14c7-4f38-9ea4-2eb344167483 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:46.476046 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f4915b2e-14c7-4f38-9ea4-2eb344167483 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:46.480264 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:47:46.505882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f4915b2e-14c7-4f38-9ea4-2eb344167483 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045198 Aug 10 12:47:46.506441 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 446/885] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:46 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:47.303259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b3695b3a-8bf8-47bc-a8d9-aac0d0555084 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:47.305442 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b3695b3a-8bf8-47bc-a8d9-aac0d0555084 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:47.312470 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b3695b3a-8bf8-47bc-a8d9-aac0d0555084 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:47.312952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b3695b3a-8bf8-47bc-a8d9-aac0d0555084 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:47.313409 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b3695b3a-8bf8-47bc-a8d9-aac0d0555084 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:47.314090 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b3695b3a-8bf8-47bc-a8d9-aac0d0555084 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:47.314537 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b3695b3a-8bf8-47bc-a8d9-aac0d0555084 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:47.314953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b3695b3a-8bf8-47bc-a8d9-aac0d0555084 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:47.344839 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b3695b3a-8bf8-47bc-a8d9-aac0d0555084 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045528 Aug 10 12:47:47.345383 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 440/886] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:47 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:47.414281 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7b3e1b01-968e-4c38-a29f-1b0577523a23 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:47.417342 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7b3e1b01-968e-4c38-a29f-1b0577523a23 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:47.423308 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7b3e1b01-968e-4c38-a29f-1b0577523a23 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:47.423783 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7b3e1b01-968e-4c38-a29f-1b0577523a23 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:47.424209 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7b3e1b01-968e-4c38-a29f-1b0577523a23 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:47.424892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7b3e1b01-968e-4c38-a29f-1b0577523a23 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:47.425334 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7b3e1b01-968e-4c38-a29f-1b0577523a23 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:47.425748 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7b3e1b01-968e-4c38-a29f-1b0577523a23 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:47.454573 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7b3e1b01-968e-4c38-a29f-1b0577523a23 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044611 Aug 10 12:47:47.455123 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 447/887] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:47 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:47.518020 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1ce2c403-f3e6-4aa5-9f6d-a64d3b4ec4bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:47.520145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1ce2c403-f3e6-4aa5-9f6d-a64d3b4ec4bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:47.526033 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1ce2c403-f3e6-4aa5-9f6d-a64d3b4ec4bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:47.526509 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1ce2c403-f3e6-4aa5-9f6d-a64d3b4ec4bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:47.526939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1ce2c403-f3e6-4aa5-9f6d-a64d3b4ec4bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:47.527656 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1ce2c403-f3e6-4aa5-9f6d-a64d3b4ec4bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:47.528100 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1ce2c403-f3e6-4aa5-9f6d-a64d3b4ec4bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:47.528515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1ce2c403-f3e6-4aa5-9f6d-a64d3b4ec4bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:47.558125 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1ce2c403-f3e6-4aa5-9f6d-a64d3b4ec4bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044052 Aug 10 12:47:47.558670 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 441/888] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:47 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:48.357343 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3cc49941-090f-4b3e-a026-1295a7c68bf9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:48.359827 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3cc49941-090f-4b3e-a026-1295a7c68bf9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:48.366182 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3cc49941-090f-4b3e-a026-1295a7c68bf9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:48.366658 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3cc49941-090f-4b3e-a026-1295a7c68bf9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:48.367087 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3cc49941-090f-4b3e-a026-1295a7c68bf9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:48.367793 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3cc49941-090f-4b3e-a026-1295a7c68bf9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:48.369324 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3cc49941-090f-4b3e-a026-1295a7c68bf9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:48.369763 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3cc49941-090f-4b3e-a026-1295a7c68bf9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:48.397429 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3cc49941-090f-4b3e-a026-1295a7c68bf9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044679 Aug 10 12:47:48.397975 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 448/889] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:48 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:48.466097 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4f864c53-05e3-49aa-af00-98829a04b6c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:48.468165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4f864c53-05e3-49aa-af00-98829a04b6c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:48.474152 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f864c53-05e3-49aa-af00-98829a04b6c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:48.474628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f864c53-05e3-49aa-af00-98829a04b6c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:48.475058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f864c53-05e3-49aa-af00-98829a04b6c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:48.475764 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f864c53-05e3-49aa-af00-98829a04b6c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:48.476212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f864c53-05e3-49aa-af00-98829a04b6c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:48.476657 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f864c53-05e3-49aa-af00-98829a04b6c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:48.505716 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4f864c53-05e3-49aa-af00-98829a04b6c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043757 Aug 10 12:47:48.506318 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 442/890] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:48 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:48.569862 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-66357620-3405-4404-b3b7-ba9f68d3059f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:48.572051 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-66357620-3405-4404-b3b7-ba9f68d3059f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:48.577865 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-66357620-3405-4404-b3b7-ba9f68d3059f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:48.578332 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-66357620-3405-4404-b3b7-ba9f68d3059f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:48.578756 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-66357620-3405-4404-b3b7-ba9f68d3059f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:48.579474 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-66357620-3405-4404-b3b7-ba9f68d3059f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:48.579918 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-66357620-3405-4404-b3b7-ba9f68d3059f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:48.580333 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-66357620-3405-4404-b3b7-ba9f68d3059f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:48.610200 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-66357620-3405-4404-b3b7-ba9f68d3059f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044276 Aug 10 12:47:48.610747 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 449/891] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:48 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:49.409887 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c9799f13-9dea-472c-8aae-e5c061156f2e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:49.412063 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c9799f13-9dea-472c-8aae-e5c061156f2e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:49.418988 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9799f13-9dea-472c-8aae-e5c061156f2e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:49.419503 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9799f13-9dea-472c-8aae-e5c061156f2e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:49.419933 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9799f13-9dea-472c-8aae-e5c061156f2e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:49.420615 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9799f13-9dea-472c-8aae-e5c061156f2e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:49.421067 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9799f13-9dea-472c-8aae-e5c061156f2e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:49.421484 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9799f13-9dea-472c-8aae-e5c061156f2e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:49.449933 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c9799f13-9dea-472c-8aae-e5c061156f2e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043971 Aug 10 12:47:49.450472 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 443/892] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:49 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:49.528229 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-73be6191-e34a-4a9d-b0fb-0f96485f4d60 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:49.530618 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-73be6191-e34a-4a9d-b0fb-0f96485f4d60 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:49.537720 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73be6191-e34a-4a9d-b0fb-0f96485f4d60 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:49.538345 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73be6191-e34a-4a9d-b0fb-0f96485f4d60 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:49.538809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73be6191-e34a-4a9d-b0fb-0f96485f4d60 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:49.539518 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73be6191-e34a-4a9d-b0fb-0f96485f4d60 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:49.540587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73be6191-e34a-4a9d-b0fb-0f96485f4d60 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:49.541026 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73be6191-e34a-4a9d-b0fb-0f96485f4d60 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:49.572114 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-73be6191-e34a-4a9d-b0fb-0f96485f4d60 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049806 Aug 10 12:47:49.573179 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 450/893] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:49 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:49.623324 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6724aa13-4f0e-49e0-b934-2913d3108fa2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:49.625576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6724aa13-4f0e-49e0-b934-2913d3108fa2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:49.632174 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6724aa13-4f0e-49e0-b934-2913d3108fa2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:49.632661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6724aa13-4f0e-49e0-b934-2913d3108fa2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:49.633097 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6724aa13-4f0e-49e0-b934-2913d3108fa2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:49.634333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6724aa13-4f0e-49e0-b934-2913d3108fa2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:49.635092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6724aa13-4f0e-49e0-b934-2913d3108fa2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:49.635843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6724aa13-4f0e-49e0-b934-2913d3108fa2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:49.667843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6724aa13-4f0e-49e0-b934-2913d3108fa2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048667 Aug 10 12:47:49.668612 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 444/894] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:49 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:50.462837 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1eea9b0b-e9ab-4ebe-ae61-a075beffc214 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:50.464962 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1eea9b0b-e9ab-4ebe-ae61-a075beffc214 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:50.470796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1eea9b0b-e9ab-4ebe-ae61-a075beffc214 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:50.471298 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1eea9b0b-e9ab-4ebe-ae61-a075beffc214 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:50.471728 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1eea9b0b-e9ab-4ebe-ae61-a075beffc214 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:50.472404 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1eea9b0b-e9ab-4ebe-ae61-a075beffc214 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:50.472850 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1eea9b0b-e9ab-4ebe-ae61-a075beffc214 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:50.473265 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1eea9b0b-e9ab-4ebe-ae61-a075beffc214 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:50.501825 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1eea9b0b-e9ab-4ebe-ae61-a075beffc214 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043602 Aug 10 12:47:50.502380 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 451/895] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:50 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:50.584180 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-905780a2-558b-4f50-a28b-aef332f3f0b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:50.586221 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-905780a2-558b-4f50-a28b-aef332f3f0b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:50.592505 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-905780a2-558b-4f50-a28b-aef332f3f0b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:50.592990 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-905780a2-558b-4f50-a28b-aef332f3f0b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:50.593422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-905780a2-558b-4f50-a28b-aef332f3f0b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:50.594114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-905780a2-558b-4f50-a28b-aef332f3f0b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:50.594564 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-905780a2-558b-4f50-a28b-aef332f3f0b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:50.594985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-905780a2-558b-4f50-a28b-aef332f3f0b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:50.626412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-905780a2-558b-4f50-a28b-aef332f3f0b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046450 Aug 10 12:47:50.627311 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 445/896] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:50 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:50.680330 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c4d9a3d5-2f86-4fae-b445-c8d295e6b33c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:50.683073 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c4d9a3d5-2f86-4fae-b445-c8d295e6b33c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:50.689387 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c4d9a3d5-2f86-4fae-b445-c8d295e6b33c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:50.689865 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c4d9a3d5-2f86-4fae-b445-c8d295e6b33c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:50.690292 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c4d9a3d5-2f86-4fae-b445-c8d295e6b33c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:50.690973 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c4d9a3d5-2f86-4fae-b445-c8d295e6b33c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:50.691447 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c4d9a3d5-2f86-4fae-b445-c8d295e6b33c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:50.691864 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c4d9a3d5-2f86-4fae-b445-c8d295e6b33c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:50.719446 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c4d9a3d5-2f86-4fae-b445-c8d295e6b33c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043008 Aug 10 12:47:50.719984 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 452/897] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:50 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:51.513855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d5407cdc-cff7-4245-a699-30704caeb78d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:51.516034 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d5407cdc-cff7-4245-a699-30704caeb78d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:51.522335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d5407cdc-cff7-4245-a699-30704caeb78d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:51.522815 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d5407cdc-cff7-4245-a699-30704caeb78d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:51.523277 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d5407cdc-cff7-4245-a699-30704caeb78d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:51.523958 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d5407cdc-cff7-4245-a699-30704caeb78d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:51.524924 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d5407cdc-cff7-4245-a699-30704caeb78d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:51.525517 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d5407cdc-cff7-4245-a699-30704caeb78d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:51.554897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d5407cdc-cff7-4245-a699-30704caeb78d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044897 Aug 10 12:47:51.555398 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 446/898] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:51 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:51.638838 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2a15894b-e74d-4b3c-8787-2381c2c6824e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:51.641029 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2a15894b-e74d-4b3c-8787-2381c2c6824e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:51.647117 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a15894b-e74d-4b3c-8787-2381c2c6824e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:51.647626 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a15894b-e74d-4b3c-8787-2381c2c6824e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:51.648060 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a15894b-e74d-4b3c-8787-2381c2c6824e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:51.648744 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a15894b-e74d-4b3c-8787-2381c2c6824e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:51.649195 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a15894b-e74d-4b3c-8787-2381c2c6824e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:51.650114 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a15894b-e74d-4b3c-8787-2381c2c6824e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:51.678841 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2a15894b-e74d-4b3c-8787-2381c2c6824e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043961 Aug 10 12:47:51.679430 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 453/899] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:51 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:51.732088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5b928011-3bfc-47a9-99d0-cba38dd714d6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:51.734435 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5b928011-3bfc-47a9-99d0-cba38dd714d6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:51.740250 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5b928011-3bfc-47a9-99d0-cba38dd714d6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:51.740722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5b928011-3bfc-47a9-99d0-cba38dd714d6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:51.741150 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5b928011-3bfc-47a9-99d0-cba38dd714d6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:51.741821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5b928011-3bfc-47a9-99d0-cba38dd714d6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:51.742262 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5b928011-3bfc-47a9-99d0-cba38dd714d6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:51.742675 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5b928011-3bfc-47a9-99d0-cba38dd714d6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:51.745100 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:47:51.771035 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5b928011-3bfc-47a9-99d0-cba38dd714d6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043552 Aug 10 12:47:51.771618 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 447/900] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:51 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:52.566647 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f5eafc6a-ff26-43a0-a420-8644ca94db59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:52.568735 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f5eafc6a-ff26-43a0-a420-8644ca94db59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:52.575227 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5eafc6a-ff26-43a0-a420-8644ca94db59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:52.575709 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5eafc6a-ff26-43a0-a420-8644ca94db59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:52.576138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5eafc6a-ff26-43a0-a420-8644ca94db59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:52.576820 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5eafc6a-ff26-43a0-a420-8644ca94db59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:52.577260 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5eafc6a-ff26-43a0-a420-8644ca94db59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:52.577672 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5eafc6a-ff26-43a0-a420-8644ca94db59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:52.606289 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f5eafc6a-ff26-43a0-a420-8644ca94db59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043579 Aug 10 12:47:52.606835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 454/901] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:52 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:52.691340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-26970743-853c-4263-b101-4560d5fb33a0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:52.693465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-26970743-853c-4263-b101-4560d5fb33a0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:52.701013 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26970743-853c-4263-b101-4560d5fb33a0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:52.701490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26970743-853c-4263-b101-4560d5fb33a0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:52.701925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26970743-853c-4263-b101-4560d5fb33a0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:52.702609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26970743-853c-4263-b101-4560d5fb33a0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:52.703063 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26970743-853c-4263-b101-4560d5fb33a0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:52.703509 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26970743-853c-4263-b101-4560d5fb33a0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:52.732259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-26970743-853c-4263-b101-4560d5fb33a0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044934 Aug 10 12:47:52.732861 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 448/902] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:52 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:52.783587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e6da35e3-afb8-4f47-baf8-f3b842483cd5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:52.785731 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e6da35e3-afb8-4f47-baf8-f3b842483cd5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:52.791702 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e6da35e3-afb8-4f47-baf8-f3b842483cd5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:52.792214 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e6da35e3-afb8-4f47-baf8-f3b842483cd5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:52.792647 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e6da35e3-afb8-4f47-baf8-f3b842483cd5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:52.793335 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e6da35e3-afb8-4f47-baf8-f3b842483cd5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:52.793787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e6da35e3-afb8-4f47-baf8-f3b842483cd5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:52.794217 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e6da35e3-afb8-4f47-baf8-f3b842483cd5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:52.822950 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e6da35e3-afb8-4f47-baf8-f3b842483cd5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043258 Aug 10 12:47:52.823460 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 455/903] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:52 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:47:53.618589 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d1a0b7fb-a21c-43b6-95bc-1d16f1f62103 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:53.620735 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d1a0b7fb-a21c-43b6-95bc-1d16f1f62103 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:53.622610 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=86 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:47:53.627281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d1a0b7fb-a21c-43b6-95bc-1d16f1f62103 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:53.627780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d1a0b7fb-a21c-43b6-95bc-1d16f1f62103 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:53.628193 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d1a0b7fb-a21c-43b6-95bc-1d16f1f62103 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:53.628874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d1a0b7fb-a21c-43b6-95bc-1d16f1f62103 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:53.629322 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d1a0b7fb-a21c-43b6-95bc-1d16f1f62103 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:53.629741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d1a0b7fb-a21c-43b6-95bc-1d16f1f62103 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:53.659595 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d1a0b7fb-a21c-43b6-95bc-1d16f1f62103 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044926 Aug 10 12:47:53.660144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 449/904] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:53 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:53.745440 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3937a075-63fd-4034-aff8-9976f985fadb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:53.747620 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3937a075-63fd-4034-aff8-9976f985fadb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:53.754135 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3937a075-63fd-4034-aff8-9976f985fadb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:53.754615 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3937a075-63fd-4034-aff8-9976f985fadb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:53.755050 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3937a075-63fd-4034-aff8-9976f985fadb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:53.755770 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3937a075-63fd-4034-aff8-9976f985fadb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:53.756225 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3937a075-63fd-4034-aff8-9976f985fadb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:53.756649 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3937a075-63fd-4034-aff8-9976f985fadb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:53.785059 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3937a075-63fd-4034-aff8-9976f985fadb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043988 Aug 10 12:47:53.785549 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 456/905] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:53 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:53.834811 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d9616b9f-da6f-46a6-b377-aa09966f9fef tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:53.836996 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d9616b9f-da6f-46a6-b377-aa09966f9fef tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:53.843415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d9616b9f-da6f-46a6-b377-aa09966f9fef tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:53.843898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d9616b9f-da6f-46a6-b377-aa09966f9fef tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:53.844330 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d9616b9f-da6f-46a6-b377-aa09966f9fef tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:53.845017 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d9616b9f-da6f-46a6-b377-aa09966f9fef tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:53.845467 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d9616b9f-da6f-46a6-b377-aa09966f9fef tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:53.845891 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d9616b9f-da6f-46a6-b377-aa09966f9fef tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:53.875278 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d9616b9f-da6f-46a6-b377-aa09966f9fef tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044313 Aug 10 12:47:53.875835 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 450/906] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:53 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:54.672440 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-891f41ee-5719-40c7-88c8-43b98a3fbcc3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:54.674561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-891f41ee-5719-40c7-88c8-43b98a3fbcc3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:54.680500 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-891f41ee-5719-40c7-88c8-43b98a3fbcc3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:54.681028 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-891f41ee-5719-40c7-88c8-43b98a3fbcc3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:54.681497 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-891f41ee-5719-40c7-88c8-43b98a3fbcc3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:54.682189 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-891f41ee-5719-40c7-88c8-43b98a3fbcc3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:54.682645 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-891f41ee-5719-40c7-88c8-43b98a3fbcc3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:54.683072 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-891f41ee-5719-40c7-88c8-43b98a3fbcc3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:54.710960 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-891f41ee-5719-40c7-88c8-43b98a3fbcc3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042395 Aug 10 12:47:54.711558 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 457/907] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:54 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:54.797206 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-39beb294-2a84-46c7-8881-be48cc602df3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:54.799333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-39beb294-2a84-46c7-8881-be48cc602df3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:54.805243 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-39beb294-2a84-46c7-8881-be48cc602df3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:54.805662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-39beb294-2a84-46c7-8881-be48cc602df3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:54.806083 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-39beb294-2a84-46c7-8881-be48cc602df3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:54.806758 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-39beb294-2a84-46c7-8881-be48cc602df3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:54.807219 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-39beb294-2a84-46c7-8881-be48cc602df3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:54.807636 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-39beb294-2a84-46c7-8881-be48cc602df3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:54.835155 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-39beb294-2a84-46c7-8881-be48cc602df3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041956 Aug 10 12:47:54.835762 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 451/908] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:54 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:54.888644 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7548b38e-0cb1-400b-8f8f-423cfd2ca378 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:54.890760 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7548b38e-0cb1-400b-8f8f-423cfd2ca378 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:54.897214 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7548b38e-0cb1-400b-8f8f-423cfd2ca378 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:54.897700 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7548b38e-0cb1-400b-8f8f-423cfd2ca378 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:54.898147 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7548b38e-0cb1-400b-8f8f-423cfd2ca378 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:54.898834 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7548b38e-0cb1-400b-8f8f-423cfd2ca378 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:54.900104 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7548b38e-0cb1-400b-8f8f-423cfd2ca378 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:54.900670 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7548b38e-0cb1-400b-8f8f-423cfd2ca378 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:54.928873 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7548b38e-0cb1-400b-8f8f-423cfd2ca378 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044329 Aug 10 12:47:54.929428 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 458/909] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:54 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:55.723550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-abfe7619-58aa-467a-b52d-a8ac27aee640 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:55.725722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-abfe7619-58aa-467a-b52d-a8ac27aee640 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:55.732451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abfe7619-58aa-467a-b52d-a8ac27aee640 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:55.732928 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abfe7619-58aa-467a-b52d-a8ac27aee640 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:55.733622 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abfe7619-58aa-467a-b52d-a8ac27aee640 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:55.734297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abfe7619-58aa-467a-b52d-a8ac27aee640 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:55.734748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abfe7619-58aa-467a-b52d-a8ac27aee640 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:55.735162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abfe7619-58aa-467a-b52d-a8ac27aee640 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:55.764542 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-abfe7619-58aa-467a-b52d-a8ac27aee640 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044919 Aug 10 12:47:55.765082 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 452/910] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:55 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:55.847515 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d08b390a-9e1e-4141-b6ea-c5794393ee14 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:55.849613 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d08b390a-9e1e-4141-b6ea-c5794393ee14 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:55.855954 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d08b390a-9e1e-4141-b6ea-c5794393ee14 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:55.856436 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d08b390a-9e1e-4141-b6ea-c5794393ee14 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:55.856869 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d08b390a-9e1e-4141-b6ea-c5794393ee14 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:55.857552 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d08b390a-9e1e-4141-b6ea-c5794393ee14 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:55.858259 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d08b390a-9e1e-4141-b6ea-c5794393ee14 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:55.858681 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d08b390a-9e1e-4141-b6ea-c5794393ee14 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:55.890795 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d08b390a-9e1e-4141-b6ea-c5794393ee14 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047151 Aug 10 12:47:55.891398 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 459/911] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:55 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:55.941225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7aa9fdf0-ac7a-4474-b54f-91793f1ceebb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:55.943439 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7aa9fdf0-ac7a-4474-b54f-91793f1ceebb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:55.950288 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7aa9fdf0-ac7a-4474-b54f-91793f1ceebb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:55.950796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7aa9fdf0-ac7a-4474-b54f-91793f1ceebb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:55.951251 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7aa9fdf0-ac7a-4474-b54f-91793f1ceebb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:55.952086 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7aa9fdf0-ac7a-4474-b54f-91793f1ceebb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:55.952549 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7aa9fdf0-ac7a-4474-b54f-91793f1ceebb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:55.952996 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7aa9fdf0-ac7a-4474-b54f-91793f1ceebb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:55.984045 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7aa9fdf0-ac7a-4474-b54f-91793f1ceebb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046821 Aug 10 12:47:55.984597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 453/912] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:55 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:56.777008 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4657909a-a298-46e3-afdf-baaa44be1d2e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:56.779166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4657909a-a298-46e3-afdf-baaa44be1d2e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:56.785093 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4657909a-a298-46e3-afdf-baaa44be1d2e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:56.785566 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4657909a-a298-46e3-afdf-baaa44be1d2e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:56.785998 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4657909a-a298-46e3-afdf-baaa44be1d2e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:56.786693 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4657909a-a298-46e3-afdf-baaa44be1d2e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:56.787117 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4657909a-a298-46e3-afdf-baaa44be1d2e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:56.787560 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4657909a-a298-46e3-afdf-baaa44be1d2e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:56.816558 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4657909a-a298-46e3-afdf-baaa44be1d2e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043606 Aug 10 12:47:56.817107 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 460/913] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:56 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:56.903164 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-11d54838-e995-49ad-8266-f783ed4f79cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:56.905297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-11d54838-e995-49ad-8266-f783ed4f79cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:56.911578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11d54838-e995-49ad-8266-f783ed4f79cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:56.912059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11d54838-e995-49ad-8266-f783ed4f79cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:56.912492 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11d54838-e995-49ad-8266-f783ed4f79cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:56.913178 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11d54838-e995-49ad-8266-f783ed4f79cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:56.913626 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11d54838-e995-49ad-8266-f783ed4f79cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:56.914055 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11d54838-e995-49ad-8266-f783ed4f79cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:56.942409 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-11d54838-e995-49ad-8266-f783ed4f79cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043278 Aug 10 12:47:56.942994 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 454/914] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:56 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:56.996614 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9a495e19-cc61-4dda-bbb3-65c9629bc3f5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:56.998774 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9a495e19-cc61-4dda-bbb3-65c9629bc3f5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:57.004547 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9a495e19-cc61-4dda-bbb3-65c9629bc3f5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:57.005018 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9a495e19-cc61-4dda-bbb3-65c9629bc3f5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:57.005445 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9a495e19-cc61-4dda-bbb3-65c9629bc3f5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:57.006121 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9a495e19-cc61-4dda-bbb3-65c9629bc3f5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:57.006564 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9a495e19-cc61-4dda-bbb3-65c9629bc3f5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:57.006979 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9a495e19-cc61-4dda-bbb3-65c9629bc3f5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:57.035931 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9a495e19-cc61-4dda-bbb3-65c9629bc3f5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043753 Aug 10 12:47:57.036480 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 461/915] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:56 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:57.828526 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fef2252f-87c5-400b-8dcd-b58d971dcaf1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:57.830636 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fef2252f-87c5-400b-8dcd-b58d971dcaf1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:57.837127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fef2252f-87c5-400b-8dcd-b58d971dcaf1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:57.837847 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fef2252f-87c5-400b-8dcd-b58d971dcaf1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:57.838284 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fef2252f-87c5-400b-8dcd-b58d971dcaf1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:57.838974 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fef2252f-87c5-400b-8dcd-b58d971dcaf1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:57.839448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fef2252f-87c5-400b-8dcd-b58d971dcaf1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:57.839876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fef2252f-87c5-400b-8dcd-b58d971dcaf1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:57.868786 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fef2252f-87c5-400b-8dcd-b58d971dcaf1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044216 Aug 10 12:47:57.869332 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 455/916] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:57 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:57.955464 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e10f8548-556f-428d-845c-f7ac9d576925 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:57.957493 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e10f8548-556f-428d-845c-f7ac9d576925 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:57.965133 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e10f8548-556f-428d-845c-f7ac9d576925 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:57.965604 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e10f8548-556f-428d-845c-f7ac9d576925 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:57.966031 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e10f8548-556f-428d-845c-f7ac9d576925 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:57.966711 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e10f8548-556f-428d-845c-f7ac9d576925 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:57.967153 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e10f8548-556f-428d-845c-f7ac9d576925 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:57.967590 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e10f8548-556f-428d-845c-f7ac9d576925 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:57.992045 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:47:57.996991 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e10f8548-556f-428d-845c-f7ac9d576925 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045585 Aug 10 12:47:57.997576 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 462/917] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:57 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:58.047928 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5a2df465-0bfa-48d6-b567-d33a140c9dc1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:58.050083 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5a2df465-0bfa-48d6-b567-d33a140c9dc1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:58.056872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a2df465-0bfa-48d6-b567-d33a140c9dc1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:58.057350 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a2df465-0bfa-48d6-b567-d33a140c9dc1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:58.057778 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a2df465-0bfa-48d6-b567-d33a140c9dc1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:58.058464 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a2df465-0bfa-48d6-b567-d33a140c9dc1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:58.058911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a2df465-0bfa-48d6-b567-d33a140c9dc1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:58.059357 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a2df465-0bfa-48d6-b567-d33a140c9dc1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:58.089049 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5a2df465-0bfa-48d6-b567-d33a140c9dc1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044989 Aug 10 12:47:58.089596 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 456/918] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:58 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:58.881126 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9b5570de-54ef-4dfc-b9c6-7c459bd82ee6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:58.883334 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9b5570de-54ef-4dfc-b9c6-7c459bd82ee6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:58.890047 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b5570de-54ef-4dfc-b9c6-7c459bd82ee6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:58.890527 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b5570de-54ef-4dfc-b9c6-7c459bd82ee6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:58.890960 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b5570de-54ef-4dfc-b9c6-7c459bd82ee6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:58.891678 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b5570de-54ef-4dfc-b9c6-7c459bd82ee6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:58.892129 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b5570de-54ef-4dfc-b9c6-7c459bd82ee6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:58.892550 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b5570de-54ef-4dfc-b9c6-7c459bd82ee6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:58.920872 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9b5570de-54ef-4dfc-b9c6-7c459bd82ee6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043967 Aug 10 12:47:58.921415 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 463/919] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:58 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:59.009852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-25e34dbc-6512-4ac9-a313-2a65b3e5f250 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:59.012001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-25e34dbc-6512-4ac9-a313-2a65b3e5f250 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:59.017911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25e34dbc-6512-4ac9-a313-2a65b3e5f250 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:59.018392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25e34dbc-6512-4ac9-a313-2a65b3e5f250 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:59.018829 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25e34dbc-6512-4ac9-a313-2a65b3e5f250 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:59.019540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25e34dbc-6512-4ac9-a313-2a65b3e5f250 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:59.019995 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25e34dbc-6512-4ac9-a313-2a65b3e5f250 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:59.020422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25e34dbc-6512-4ac9-a313-2a65b3e5f250 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:59.048885 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-25e34dbc-6512-4ac9-a313-2a65b3e5f250 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043537 Aug 10 12:47:59.049516 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 457/920] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:47:59 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:47:59.101106 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-87c8f392-5948-449a-9cc6-b0996611ebb9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:59.103888 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-87c8f392-5948-449a-9cc6-b0996611ebb9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:59.110385 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-87c8f392-5948-449a-9cc6-b0996611ebb9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:59.110867 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-87c8f392-5948-449a-9cc6-b0996611ebb9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:59.111327 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-87c8f392-5948-449a-9cc6-b0996611ebb9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:59.112010 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-87c8f392-5948-449a-9cc6-b0996611ebb9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:59.112459 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-87c8f392-5948-449a-9cc6-b0996611ebb9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:59.112879 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-87c8f392-5948-449a-9cc6-b0996611ebb9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:59.140631 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-87c8f392-5948-449a-9cc6-b0996611ebb9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043427 Aug 10 12:47:59.141179 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 464/921] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:59 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:47:59.934022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e3a1ffb8-8892-4e27-affc-fc6832d4a96c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:47:59.936108 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e3a1ffb8-8892-4e27-affc-fc6832d4a96c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:47:59.942472 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e3a1ffb8-8892-4e27-affc-fc6832d4a96c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:59.942956 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e3a1ffb8-8892-4e27-affc-fc6832d4a96c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:59.943427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e3a1ffb8-8892-4e27-affc-fc6832d4a96c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:59.944115 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e3a1ffb8-8892-4e27-affc-fc6832d4a96c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:47:59.944566 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e3a1ffb8-8892-4e27-affc-fc6832d4a96c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:47:59.944992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e3a1ffb8-8892-4e27-affc-fc6832d4a96c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:47:59.974519 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e3a1ffb8-8892-4e27-affc-fc6832d4a96c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045213 Aug 10 12:47:59.975073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 458/922] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:47:59 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:00.061651 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1adc8f75-053d-4f21-8e95-d426a4672c91 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:00.063795 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1adc8f75-053d-4f21-8e95-d426a4672c91 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:00.069634 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1adc8f75-053d-4f21-8e95-d426a4672c91 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:00.070115 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1adc8f75-053d-4f21-8e95-d426a4672c91 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:00.070550 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1adc8f75-053d-4f21-8e95-d426a4672c91 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:00.071843 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1adc8f75-053d-4f21-8e95-d426a4672c91 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:00.072292 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1adc8f75-053d-4f21-8e95-d426a4672c91 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:00.072714 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1adc8f75-053d-4f21-8e95-d426a4672c91 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:00.101571 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1adc8f75-053d-4f21-8e95-d426a4672c91 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043900 Aug 10 12:48:00.102196 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 465/923] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:00 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:00.152103 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-86581e68-5338-46b6-bed8-4bb39e647144 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:00.154233 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-86581e68-5338-46b6-bed8-4bb39e647144 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:00.160117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-86581e68-5338-46b6-bed8-4bb39e647144 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:00.160599 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-86581e68-5338-46b6-bed8-4bb39e647144 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:00.161032 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-86581e68-5338-46b6-bed8-4bb39e647144 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:00.161715 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-86581e68-5338-46b6-bed8-4bb39e647144 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:00.162166 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-86581e68-5338-46b6-bed8-4bb39e647144 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:00.162587 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-86581e68-5338-46b6-bed8-4bb39e647144 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:00.191801 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-86581e68-5338-46b6-bed8-4bb39e647144 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043548 Aug 10 12:48:00.192281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 459/924] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:00 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:00.986095 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4364a0b8-3922-468b-ad0d-be65c24d3559 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:00.988270 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4364a0b8-3922-468b-ad0d-be65c24d3559 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:00.994631 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4364a0b8-3922-468b-ad0d-be65c24d3559 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:00.995111 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4364a0b8-3922-468b-ad0d-be65c24d3559 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:00.995572 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4364a0b8-3922-468b-ad0d-be65c24d3559 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:00.996255 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4364a0b8-3922-468b-ad0d-be65c24d3559 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:00.996704 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4364a0b8-3922-468b-ad0d-be65c24d3559 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:00.997126 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4364a0b8-3922-468b-ad0d-be65c24d3559 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:01.026288 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4364a0b8-3922-468b-ad0d-be65c24d3559 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044308 Aug 10 12:48:01.026842 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 466/925] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:00 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:01.114204 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e5c23303-552c-4356-8d07-b3dbf5102df3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:01.116355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e5c23303-552c-4356-8d07-b3dbf5102df3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:01.123426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e5c23303-552c-4356-8d07-b3dbf5102df3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:01.123907 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e5c23303-552c-4356-8d07-b3dbf5102df3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:01.124341 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e5c23303-552c-4356-8d07-b3dbf5102df3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:01.125026 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e5c23303-552c-4356-8d07-b3dbf5102df3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:01.125476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e5c23303-552c-4356-8d07-b3dbf5102df3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:01.125899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e5c23303-552c-4356-8d07-b3dbf5102df3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:01.154278 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e5c23303-552c-4356-8d07-b3dbf5102df3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044069 Aug 10 12:48:01.154866 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 460/926] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:01 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:01.202990 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a6feedcc-7da8-40d7-b55b-18fdde567747 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:01.205127 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a6feedcc-7da8-40d7-b55b-18fdde567747 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:01.211004 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a6feedcc-7da8-40d7-b55b-18fdde567747 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:01.211544 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a6feedcc-7da8-40d7-b55b-18fdde567747 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:01.212063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a6feedcc-7da8-40d7-b55b-18fdde567747 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:01.212750 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a6feedcc-7da8-40d7-b55b-18fdde567747 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:01.213203 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a6feedcc-7da8-40d7-b55b-18fdde567747 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:01.213624 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a6feedcc-7da8-40d7-b55b-18fdde567747 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:01.242143 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a6feedcc-7da8-40d7-b55b-18fdde567747 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043119 Aug 10 12:48:01.242680 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 467/927] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:01 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:02.037911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-cd33a87e-4a57-4551-8db2-c354c1b0cbb6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:02.040190 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-cd33a87e-4a57-4551-8db2-c354c1b0cbb6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:02.046048 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd33a87e-4a57-4551-8db2-c354c1b0cbb6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:02.046532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd33a87e-4a57-4551-8db2-c354c1b0cbb6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:02.046968 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd33a87e-4a57-4551-8db2-c354c1b0cbb6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:02.047688 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd33a87e-4a57-4551-8db2-c354c1b0cbb6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:02.048172 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd33a87e-4a57-4551-8db2-c354c1b0cbb6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:02.048603 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd33a87e-4a57-4551-8db2-c354c1b0cbb6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:02.078008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-cd33a87e-4a57-4551-8db2-c354c1b0cbb6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044017 Aug 10 12:48:02.078557 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 461/928] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:02 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:02.165608 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-281762d7-8b1b-45ec-a19d-dcf43b4b578a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:02.167813 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-281762d7-8b1b-45ec-a19d-dcf43b4b578a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:02.174206 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-281762d7-8b1b-45ec-a19d-dcf43b4b578a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:02.174682 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-281762d7-8b1b-45ec-a19d-dcf43b4b578a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:02.175112 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-281762d7-8b1b-45ec-a19d-dcf43b4b578a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:02.175814 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-281762d7-8b1b-45ec-a19d-dcf43b4b578a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:02.176263 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-281762d7-8b1b-45ec-a19d-dcf43b4b578a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:02.176683 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-281762d7-8b1b-45ec-a19d-dcf43b4b578a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:02.206168 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-281762d7-8b1b-45ec-a19d-dcf43b4b578a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044441 Aug 10 12:48:02.206958 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 468/929] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:02 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:02.255732 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9b3b6c78-0420-48ce-b701-0eb3c8d8f1f9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:02.257953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9b3b6c78-0420-48ce-b701-0eb3c8d8f1f9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:02.265167 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9b3b6c78-0420-48ce-b701-0eb3c8d8f1f9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:02.265657 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9b3b6c78-0420-48ce-b701-0eb3c8d8f1f9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:02.266096 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9b3b6c78-0420-48ce-b701-0eb3c8d8f1f9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:02.266793 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9b3b6c78-0420-48ce-b701-0eb3c8d8f1f9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:02.267275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9b3b6c78-0420-48ce-b701-0eb3c8d8f1f9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:02.267707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9b3b6c78-0420-48ce-b701-0eb3c8d8f1f9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:02.296581 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9b3b6c78-0420-48ce-b701-0eb3c8d8f1f9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044770 Aug 10 12:48:02.297139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 462/930] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:02 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:03.090650 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fbc933b0-108b-41d2-b2e0-47844a408f5f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:03.092823 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fbc933b0-108b-41d2-b2e0-47844a408f5f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:03.098814 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fbc933b0-108b-41d2-b2e0-47844a408f5f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:03.099337 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fbc933b0-108b-41d2-b2e0-47844a408f5f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:03.099773 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fbc933b0-108b-41d2-b2e0-47844a408f5f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:03.100455 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fbc933b0-108b-41d2-b2e0-47844a408f5f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:03.100907 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fbc933b0-108b-41d2-b2e0-47844a408f5f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:03.101329 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fbc933b0-108b-41d2-b2e0-47844a408f5f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:03.129988 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fbc933b0-108b-41d2-b2e0-47844a408f5f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044032 Aug 10 12:48:03.130538 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 469/931] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:03 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:03.218723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3921bf6a-5f81-4314-a0a2-bcc41fb421ec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:03.220803 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3921bf6a-5f81-4314-a0a2-bcc41fb421ec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:03.226705 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3921bf6a-5f81-4314-a0a2-bcc41fb421ec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:03.227211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3921bf6a-5f81-4314-a0a2-bcc41fb421ec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:03.227713 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3921bf6a-5f81-4314-a0a2-bcc41fb421ec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:03.228392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3921bf6a-5f81-4314-a0a2-bcc41fb421ec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:03.228837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3921bf6a-5f81-4314-a0a2-bcc41fb421ec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:03.229255 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3921bf6a-5f81-4314-a0a2-bcc41fb421ec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:03.253362 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:48:03.257871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3921bf6a-5f81-4314-a0a2-bcc41fb421ec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043147 Aug 10 12:48:03.266986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 463/932] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:03 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:03.309162 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-35addd48-c130-42b5-b78d-12f6678b36c7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:03.311284 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-35addd48-c130-42b5-b78d-12f6678b36c7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:03.317540 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-35addd48-c130-42b5-b78d-12f6678b36c7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:03.318014 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-35addd48-c130-42b5-b78d-12f6678b36c7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:03.318442 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-35addd48-c130-42b5-b78d-12f6678b36c7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:03.319121 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-35addd48-c130-42b5-b78d-12f6678b36c7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:03.319596 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-35addd48-c130-42b5-b78d-12f6678b36c7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:03.320015 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-35addd48-c130-42b5-b78d-12f6678b36c7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:03.349302 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-35addd48-c130-42b5-b78d-12f6678b36c7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044399 Aug 10 12:48:03.349840 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 470/933] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:03 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:04.142006 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7df3e25d-10f9-4d45-b19b-19fd15fde773 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:04.144179 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7df3e25d-10f9-4d45-b19b-19fd15fde773 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:04.151315 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7df3e25d-10f9-4d45-b19b-19fd15fde773 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:04.151799 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7df3e25d-10f9-4d45-b19b-19fd15fde773 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:04.152234 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7df3e25d-10f9-4d45-b19b-19fd15fde773 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:04.152924 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7df3e25d-10f9-4d45-b19b-19fd15fde773 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:04.153371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7df3e25d-10f9-4d45-b19b-19fd15fde773 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:04.153790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7df3e25d-10f9-4d45-b19b-19fd15fde773 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:04.183576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7df3e25d-10f9-4d45-b19b-19fd15fde773 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045547 Aug 10 12:48:04.184123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 464/934] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:04 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:04.271068 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-cdca3b1e-54cd-4582-9da8-b9561768b508 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:04.273301 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-cdca3b1e-54cd-4582-9da8-b9561768b508 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:04.280282 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cdca3b1e-54cd-4582-9da8-b9561768b508 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:04.290328 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cdca3b1e-54cd-4582-9da8-b9561768b508 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:04.290328 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cdca3b1e-54cd-4582-9da8-b9561768b508 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:04.290328 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cdca3b1e-54cd-4582-9da8-b9561768b508 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:04.290328 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cdca3b1e-54cd-4582-9da8-b9561768b508 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:04.291550 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cdca3b1e-54cd-4582-9da8-b9561768b508 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:04.312024 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-cdca3b1e-54cd-4582-9da8-b9561768b508 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044982 Aug 10 12:48:04.312753 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 471/935] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:04 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:04.361975 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-523a075e-2e3d-4a02-9a20-2b2b6c7fe2f8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:04.364082 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-523a075e-2e3d-4a02-9a20-2b2b6c7fe2f8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:04.369991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-523a075e-2e3d-4a02-9a20-2b2b6c7fe2f8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:04.370472 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-523a075e-2e3d-4a02-9a20-2b2b6c7fe2f8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:04.370911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-523a075e-2e3d-4a02-9a20-2b2b6c7fe2f8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:04.371636 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-523a075e-2e3d-4a02-9a20-2b2b6c7fe2f8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:04.372093 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-523a075e-2e3d-4a02-9a20-2b2b6c7fe2f8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:04.372518 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-523a075e-2e3d-4a02-9a20-2b2b6c7fe2f8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:04.401097 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-523a075e-2e3d-4a02-9a20-2b2b6c7fe2f8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043418 Aug 10 12:48:04.401645 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 465/936] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:04 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:05.194917 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-267e13e9-0fb5-471d-a100-1c11324cd3e4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:05.197147 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-267e13e9-0fb5-471d-a100-1c11324cd3e4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:05.203827 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-267e13e9-0fb5-471d-a100-1c11324cd3e4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:05.204307 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-267e13e9-0fb5-471d-a100-1c11324cd3e4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:05.204733 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-267e13e9-0fb5-471d-a100-1c11324cd3e4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:05.205417 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-267e13e9-0fb5-471d-a100-1c11324cd3e4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:05.205883 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-267e13e9-0fb5-471d-a100-1c11324cd3e4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:05.206297 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-267e13e9-0fb5-471d-a100-1c11324cd3e4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:05.235932 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-267e13e9-0fb5-471d-a100-1c11324cd3e4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044961 Aug 10 12:48:05.236481 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 472/937] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:05 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:05.324590 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a9ab7f97-dcf8-4033-bece-183798c2200c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:05.326752 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a9ab7f97-dcf8-4033-bece-183798c2200c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:05.333064 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9ab7f97-dcf8-4033-bece-183798c2200c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:05.333544 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9ab7f97-dcf8-4033-bece-183798c2200c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:05.333976 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9ab7f97-dcf8-4033-bece-183798c2200c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:05.334662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9ab7f97-dcf8-4033-bece-183798c2200c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:05.335115 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9ab7f97-dcf8-4033-bece-183798c2200c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:05.338998 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9ab7f97-dcf8-4033-bece-183798c2200c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:05.365243 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a9ab7f97-dcf8-4033-bece-183798c2200c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044696 Aug 10 12:48:05.365868 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 466/938] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:05 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:05.413353 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f83d0407-682d-40b1-b5be-5a1a68632cf8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:05.415513 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f83d0407-682d-40b1-b5be-5a1a68632cf8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:05.421319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f83d0407-682d-40b1-b5be-5a1a68632cf8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:05.421792 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f83d0407-682d-40b1-b5be-5a1a68632cf8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:05.422218 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f83d0407-682d-40b1-b5be-5a1a68632cf8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:05.422894 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f83d0407-682d-40b1-b5be-5a1a68632cf8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:05.423372 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f83d0407-682d-40b1-b5be-5a1a68632cf8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:05.423789 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f83d0407-682d-40b1-b5be-5a1a68632cf8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:05.452273 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f83d0407-682d-40b1-b5be-5a1a68632cf8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042817 Aug 10 12:48:05.452815 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 473/939] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:05 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:06.248964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-352575c2-3347-4c68-9ef6-7524a09d32d2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:06.251100 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-352575c2-3347-4c68-9ef6-7524a09d32d2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:06.257306 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-352575c2-3347-4c68-9ef6-7524a09d32d2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:06.257798 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-352575c2-3347-4c68-9ef6-7524a09d32d2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:06.258254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-352575c2-3347-4c68-9ef6-7524a09d32d2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:06.259200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-352575c2-3347-4c68-9ef6-7524a09d32d2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:06.259654 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-352575c2-3347-4c68-9ef6-7524a09d32d2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:06.260083 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-352575c2-3347-4c68-9ef6-7524a09d32d2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:06.290272 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-352575c2-3347-4c68-9ef6-7524a09d32d2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044325 Aug 10 12:48:06.290466 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 467/940] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:06 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:06.377556 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5e675144-41ad-4384-8b6a-b0b03c61c537 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:06.379674 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5e675144-41ad-4384-8b6a-b0b03c61c537 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:06.386050 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e675144-41ad-4384-8b6a-b0b03c61c537 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:06.386531 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e675144-41ad-4384-8b6a-b0b03c61c537 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:06.386958 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e675144-41ad-4384-8b6a-b0b03c61c537 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:06.387655 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e675144-41ad-4384-8b6a-b0b03c61c537 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:06.388099 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e675144-41ad-4384-8b6a-b0b03c61c537 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:06.388515 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e675144-41ad-4384-8b6a-b0b03c61c537 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:06.416603 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5e675144-41ad-4384-8b6a-b0b03c61c537 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043100 Aug 10 12:48:06.417208 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 474/941] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:06 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:06.463767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f3e23362-1866-4f64-9610-466e79614feb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:06.465803 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f3e23362-1866-4f64-9610-466e79614feb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:06.472089 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3e23362-1866-4f64-9610-466e79614feb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:06.472561 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3e23362-1866-4f64-9610-466e79614feb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:06.472987 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3e23362-1866-4f64-9610-466e79614feb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:06.473657 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3e23362-1866-4f64-9610-466e79614feb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:06.474100 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3e23362-1866-4f64-9610-466e79614feb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:06.474515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3e23362-1866-4f64-9610-466e79614feb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:06.504283 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f3e23362-1866-4f64-9610-466e79614feb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044375 Aug 10 12:48:06.507803 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 468/942] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:06 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:07.304218 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f51d42b3-a475-4ba4-b0c0-7f643d3c2ea0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:07.306874 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f51d42b3-a475-4ba4-b0c0-7f643d3c2ea0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:07.312864 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f51d42b3-a475-4ba4-b0c0-7f643d3c2ea0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:07.313337 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f51d42b3-a475-4ba4-b0c0-7f643d3c2ea0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:07.313762 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f51d42b3-a475-4ba4-b0c0-7f643d3c2ea0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:07.314508 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f51d42b3-a475-4ba4-b0c0-7f643d3c2ea0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:07.315125 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f51d42b3-a475-4ba4-b0c0-7f643d3c2ea0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:07.315568 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f51d42b3-a475-4ba4-b0c0-7f643d3c2ea0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:07.344795 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f51d42b3-a475-4ba4-b0c0-7f643d3c2ea0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044477 Aug 10 12:48:07.345345 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 475/943] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:07 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:07.428990 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1629e649-8ecf-4e20-a671-53b61a38bfda tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:07.432264 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1629e649-8ecf-4e20-a671-53b61a38bfda tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:07.438067 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1629e649-8ecf-4e20-a671-53b61a38bfda tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:07.438536 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1629e649-8ecf-4e20-a671-53b61a38bfda tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:07.438964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1629e649-8ecf-4e20-a671-53b61a38bfda tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:07.439674 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1629e649-8ecf-4e20-a671-53b61a38bfda tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:07.440117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1629e649-8ecf-4e20-a671-53b61a38bfda tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:07.440534 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1629e649-8ecf-4e20-a671-53b61a38bfda tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:07.470292 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1629e649-8ecf-4e20-a671-53b61a38bfda tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045339 Aug 10 12:48:07.470896 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 469/944] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:07 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:07.518191 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0c0574e6-91eb-4e6a-8449-5715260cfea9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:07.520466 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0c0574e6-91eb-4e6a-8449-5715260cfea9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:07.527195 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0c0574e6-91eb-4e6a-8449-5715260cfea9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:07.527786 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0c0574e6-91eb-4e6a-8449-5715260cfea9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:07.528225 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0c0574e6-91eb-4e6a-8449-5715260cfea9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:07.528914 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0c0574e6-91eb-4e6a-8449-5715260cfea9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:07.529366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0c0574e6-91eb-4e6a-8449-5715260cfea9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:07.529788 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0c0574e6-91eb-4e6a-8449-5715260cfea9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:07.558507 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0c0574e6-91eb-4e6a-8449-5715260cfea9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044563 Aug 10 12:48:07.559061 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 476/945] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:07 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:48:08.357666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1027c358-7ce9-4067-b0b0-06bee7e02f83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:08.360115 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1027c358-7ce9-4067-b0b0-06bee7e02f83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:08.365948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1027c358-7ce9-4067-b0b0-06bee7e02f83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:08.366437 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1027c358-7ce9-4067-b0b0-06bee7e02f83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:08.366876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1027c358-7ce9-4067-b0b0-06bee7e02f83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:08.367598 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1027c358-7ce9-4067-b0b0-06bee7e02f83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:08.368055 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1027c358-7ce9-4067-b0b0-06bee7e02f83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:08.368808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1027c358-7ce9-4067-b0b0-06bee7e02f83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:08.397324 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1027c358-7ce9-4067-b0b0-06bee7e02f83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043635 Aug 10 12:48:08.397875 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 470/946] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:08 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:08.482418 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6d9a7ef8-6734-42bc-9d54-cf4f0a78de36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:08.484834 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6d9a7ef8-6734-42bc-9d54-cf4f0a78de36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:08.486675 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=90 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:48:08.491665 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6d9a7ef8-6734-42bc-9d54-cf4f0a78de36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:08.492147 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6d9a7ef8-6734-42bc-9d54-cf4f0a78de36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:08.492657 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6d9a7ef8-6734-42bc-9d54-cf4f0a78de36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:08.493430 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6d9a7ef8-6734-42bc-9d54-cf4f0a78de36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:08.493888 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6d9a7ef8-6734-42bc-9d54-cf4f0a78de36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:08.494313 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6d9a7ef8-6734-42bc-9d54-cf4f0a78de36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:08.523374 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6d9a7ef8-6734-42bc-9d54-cf4f0a78de36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044862 Aug 10 12:48:08.524609 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 477/947] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:08 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:08.569903 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-83c079f1-986a-491c-9602-55b607c1732c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:08.572567 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-83c079f1-986a-491c-9602-55b607c1732c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:08.578857 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83c079f1-986a-491c-9602-55b607c1732c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:08.579402 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83c079f1-986a-491c-9602-55b607c1732c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:08.579820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83c079f1-986a-491c-9602-55b607c1732c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:08.580509 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83c079f1-986a-491c-9602-55b607c1732c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:08.580963 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83c079f1-986a-491c-9602-55b607c1732c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:08.581384 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83c079f1-986a-491c-9602-55b607c1732c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:08.610214 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-83c079f1-986a-491c-9602-55b607c1732c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044321 Aug 10 12:48:08.610768 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 471/948] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:08 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:09.409775 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b4115fe1-2f09-4ae4-8e5d-eb6f8433e15b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:09.411923 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b4115fe1-2f09-4ae4-8e5d-eb6f8433e15b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:09.418835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b4115fe1-2f09-4ae4-8e5d-eb6f8433e15b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:09.419377 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b4115fe1-2f09-4ae4-8e5d-eb6f8433e15b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:09.419807 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b4115fe1-2f09-4ae4-8e5d-eb6f8433e15b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:09.420489 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b4115fe1-2f09-4ae4-8e5d-eb6f8433e15b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:09.420933 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b4115fe1-2f09-4ae4-8e5d-eb6f8433e15b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:09.421351 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b4115fe1-2f09-4ae4-8e5d-eb6f8433e15b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:09.450207 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b4115fe1-2f09-4ae4-8e5d-eb6f8433e15b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044271 Aug 10 12:48:09.450761 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 478/949] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:09 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:09.536468 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b0d7dc8a-3f6d-46fb-ab90-fae8f1805bab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:09.538654 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b0d7dc8a-3f6d-46fb-ab90-fae8f1805bab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:09.545242 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b0d7dc8a-3f6d-46fb-ab90-fae8f1805bab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:09.550324 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b0d7dc8a-3f6d-46fb-ab90-fae8f1805bab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:09.550324 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b0d7dc8a-3f6d-46fb-ab90-fae8f1805bab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:09.550324 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b0d7dc8a-3f6d-46fb-ab90-fae8f1805bab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:09.550324 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b0d7dc8a-3f6d-46fb-ab90-fae8f1805bab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:09.550700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b0d7dc8a-3f6d-46fb-ab90-fae8f1805bab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:09.576211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b0d7dc8a-3f6d-46fb-ab90-fae8f1805bab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043864 Aug 10 12:48:09.578967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 472/950] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:09 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:09.621822 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-401e9aa2-fe18-4ca4-bfa6-93667ae915b9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:09.624084 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-401e9aa2-fe18-4ca4-bfa6-93667ae915b9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:09.629991 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-401e9aa2-fe18-4ca4-bfa6-93667ae915b9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:09.630476 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-401e9aa2-fe18-4ca4-bfa6-93667ae915b9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:09.630912 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-401e9aa2-fe18-4ca4-bfa6-93667ae915b9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:09.631643 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-401e9aa2-fe18-4ca4-bfa6-93667ae915b9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:09.632100 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-401e9aa2-fe18-4ca4-bfa6-93667ae915b9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:09.632528 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-401e9aa2-fe18-4ca4-bfa6-93667ae915b9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:09.645893 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:48:09.661647 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-401e9aa2-fe18-4ca4-bfa6-93667ae915b9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043751 Aug 10 12:48:09.662239 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 479/951] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:09 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:10.462932 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-12eb8b4a-3410-4a47-a913-b18f9f2f62b6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:10.465180 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-12eb8b4a-3410-4a47-a913-b18f9f2f62b6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:10.471828 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12eb8b4a-3410-4a47-a913-b18f9f2f62b6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:10.472315 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12eb8b4a-3410-4a47-a913-b18f9f2f62b6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:10.472786 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12eb8b4a-3410-4a47-a913-b18f9f2f62b6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:10.473505 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12eb8b4a-3410-4a47-a913-b18f9f2f62b6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:10.473961 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12eb8b4a-3410-4a47-a913-b18f9f2f62b6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:10.474380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12eb8b4a-3410-4a47-a913-b18f9f2f62b6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:10.503702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-12eb8b4a-3410-4a47-a913-b18f9f2f62b6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045681 Aug 10 12:48:10.504250 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 473/952] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:10 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:10.589058 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e068b748-36e7-4e95-a5b8-52c2de820c84 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:10.591103 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e068b748-36e7-4e95-a5b8-52c2de820c84 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:10.597513 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e068b748-36e7-4e95-a5b8-52c2de820c84 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:10.597984 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e068b748-36e7-4e95-a5b8-52c2de820c84 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:10.598406 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e068b748-36e7-4e95-a5b8-52c2de820c84 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:10.599083 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e068b748-36e7-4e95-a5b8-52c2de820c84 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:10.599548 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e068b748-36e7-4e95-a5b8-52c2de820c84 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:10.599966 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e068b748-36e7-4e95-a5b8-52c2de820c84 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:10.628892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e068b748-36e7-4e95-a5b8-52c2de820c84 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044755 Aug 10 12:48:10.629519 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 480/953] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:10 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:10.674429 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-07902dc4-3a53-4a74-8bba-3ebf5433b1f0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:10.676609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-07902dc4-3a53-4a74-8bba-3ebf5433b1f0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:10.682529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07902dc4-3a53-4a74-8bba-3ebf5433b1f0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:10.683018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07902dc4-3a53-4a74-8bba-3ebf5433b1f0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:10.683491 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07902dc4-3a53-4a74-8bba-3ebf5433b1f0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:10.684182 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07902dc4-3a53-4a74-8bba-3ebf5433b1f0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:10.684639 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07902dc4-3a53-4a74-8bba-3ebf5433b1f0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:10.685063 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07902dc4-3a53-4a74-8bba-3ebf5433b1f0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:10.714696 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-07902dc4-3a53-4a74-8bba-3ebf5433b1f0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044265 Aug 10 12:48:10.715273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 474/954] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:10 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:11.516181 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e99614c9-feb7-4a89-8861-76b525cc222a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:11.518375 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e99614c9-feb7-4a89-8861-76b525cc222a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:11.525027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e99614c9-feb7-4a89-8861-76b525cc222a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:11.525514 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e99614c9-feb7-4a89-8861-76b525cc222a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:11.525944 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e99614c9-feb7-4a89-8861-76b525cc222a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:11.526635 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e99614c9-feb7-4a89-8861-76b525cc222a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:11.527079 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e99614c9-feb7-4a89-8861-76b525cc222a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:11.527530 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e99614c9-feb7-4a89-8861-76b525cc222a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:11.558582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e99614c9-feb7-4a89-8861-76b525cc222a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046514 Aug 10 12:48:11.559132 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 481/955] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:11 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:11.641563 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-613d2675-e7ce-4715-8257-276c6849a1b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:11.643755 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-613d2675-e7ce-4715-8257-276c6849a1b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:11.650353 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-613d2675-e7ce-4715-8257-276c6849a1b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:11.650831 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-613d2675-e7ce-4715-8257-276c6849a1b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:11.651287 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-613d2675-e7ce-4715-8257-276c6849a1b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:11.651965 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-613d2675-e7ce-4715-8257-276c6849a1b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:11.652410 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-613d2675-e7ce-4715-8257-276c6849a1b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:11.652832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-613d2675-e7ce-4715-8257-276c6849a1b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:11.681914 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-613d2675-e7ce-4715-8257-276c6849a1b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044254 Aug 10 12:48:11.682507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 475/956] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:11 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:11.727725 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-cffa290e-335b-4365-8447-d15f0b65a77b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:11.729858 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-cffa290e-335b-4365-8447-d15f0b65a77b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:11.736402 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cffa290e-335b-4365-8447-d15f0b65a77b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:11.736876 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cffa290e-335b-4365-8447-d15f0b65a77b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:11.737303 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cffa290e-335b-4365-8447-d15f0b65a77b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:11.737980 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cffa290e-335b-4365-8447-d15f0b65a77b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:11.738426 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cffa290e-335b-4365-8447-d15f0b65a77b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:11.738838 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cffa290e-335b-4365-8447-d15f0b65a77b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:11.767220 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-cffa290e-335b-4365-8447-d15f0b65a77b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043978 Aug 10 12:48:11.767817 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 482/957] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:11 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:12.571730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-94848b19-04e1-4769-904f-f6088033261b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:12.574116 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-94848b19-04e1-4769-904f-f6088033261b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:12.580588 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94848b19-04e1-4769-904f-f6088033261b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:12.581079 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94848b19-04e1-4769-904f-f6088033261b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:12.581514 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94848b19-04e1-4769-904f-f6088033261b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:12.582279 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94848b19-04e1-4769-904f-f6088033261b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:12.582642 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94848b19-04e1-4769-904f-f6088033261b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:12.583064 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94848b19-04e1-4769-904f-f6088033261b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:12.613006 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-94848b19-04e1-4769-904f-f6088033261b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045996 Aug 10 12:48:12.613565 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 476/958] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:12 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:12.694189 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7fe19d59-8ea8-420a-a5d1-57f37ea9dd86 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:12.697071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7fe19d59-8ea8-420a-a5d1-57f37ea9dd86 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:12.703004 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7fe19d59-8ea8-420a-a5d1-57f37ea9dd86 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:12.703518 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7fe19d59-8ea8-420a-a5d1-57f37ea9dd86 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:12.703947 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7fe19d59-8ea8-420a-a5d1-57f37ea9dd86 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:12.704629 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7fe19d59-8ea8-420a-a5d1-57f37ea9dd86 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:12.705076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7fe19d59-8ea8-420a-a5d1-57f37ea9dd86 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:12.705493 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7fe19d59-8ea8-420a-a5d1-57f37ea9dd86 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:12.734742 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7fe19d59-8ea8-420a-a5d1-57f37ea9dd86 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044509 Aug 10 12:48:12.735376 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 483/959] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:12 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:12.779630 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-097bb9f7-4368-480b-b0e2-b4fcb97e06eb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:12.781745 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-097bb9f7-4368-480b-b0e2-b4fcb97e06eb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:12.788071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-097bb9f7-4368-480b-b0e2-b4fcb97e06eb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:12.788552 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-097bb9f7-4368-480b-b0e2-b4fcb97e06eb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:12.788988 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-097bb9f7-4368-480b-b0e2-b4fcb97e06eb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:12.789679 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-097bb9f7-4368-480b-b0e2-b4fcb97e06eb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:12.790132 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-097bb9f7-4368-480b-b0e2-b4fcb97e06eb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:12.790606 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-097bb9f7-4368-480b-b0e2-b4fcb97e06eb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:12.818986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-097bb9f7-4368-480b-b0e2-b4fcb97e06eb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043430 Aug 10 12:48:12.819557 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 477/960] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:12 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:13.625920 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9c6bd12a-51d3-4352-9386-4e8740689f59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:13.628065 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9c6bd12a-51d3-4352-9386-4e8740689f59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:13.634876 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9c6bd12a-51d3-4352-9386-4e8740689f59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:13.635406 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9c6bd12a-51d3-4352-9386-4e8740689f59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:13.635842 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9c6bd12a-51d3-4352-9386-4e8740689f59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:13.636537 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9c6bd12a-51d3-4352-9386-4e8740689f59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:13.636988 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9c6bd12a-51d3-4352-9386-4e8740689f59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:13.637408 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9c6bd12a-51d3-4352-9386-4e8740689f59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:13.666861 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9c6bd12a-51d3-4352-9386-4e8740689f59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044921 Aug 10 12:48:13.667440 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 484/961] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:13 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:13.745946 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-74a833ce-5b2d-4bec-9bd4-a1c00726d558 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:13.748126 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-74a833ce-5b2d-4bec-9bd4-a1c00726d558 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:13.754069 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-74a833ce-5b2d-4bec-9bd4-a1c00726d558 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:13.754546 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-74a833ce-5b2d-4bec-9bd4-a1c00726d558 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:13.754979 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-74a833ce-5b2d-4bec-9bd4-a1c00726d558 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:13.755698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-74a833ce-5b2d-4bec-9bd4-a1c00726d558 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:13.756147 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-74a833ce-5b2d-4bec-9bd4-a1c00726d558 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:13.756605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-74a833ce-5b2d-4bec-9bd4-a1c00726d558 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:13.786270 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-74a833ce-5b2d-4bec-9bd4-a1c00726d558 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044295 Aug 10 12:48:13.786845 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 478/962] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:13 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:13.831970 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-12fc0de6-3b80-47bb-9a4b-dcba19eb0246 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:13.834025 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-12fc0de6-3b80-47bb-9a4b-dcba19eb0246 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:13.841050 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-12fc0de6-3b80-47bb-9a4b-dcba19eb0246 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:13.841529 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-12fc0de6-3b80-47bb-9a4b-dcba19eb0246 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:13.841959 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-12fc0de6-3b80-47bb-9a4b-dcba19eb0246 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:13.842645 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-12fc0de6-3b80-47bb-9a4b-dcba19eb0246 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:13.843100 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-12fc0de6-3b80-47bb-9a4b-dcba19eb0246 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:13.843551 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-12fc0de6-3b80-47bb-9a4b-dcba19eb0246 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:13.872235 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-12fc0de6-3b80-47bb-9a4b-dcba19eb0246 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044236 Aug 10 12:48:13.872786 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 485/963] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:13 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:14.679990 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0a68c428-d34c-4bd7-b3b2-630e61c31d36 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:14.681918 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0a68c428-d34c-4bd7-b3b2-630e61c31d36 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:14.688069 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0a68c428-d34c-4bd7-b3b2-630e61c31d36 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:14.688556 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0a68c428-d34c-4bd7-b3b2-630e61c31d36 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:14.688997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0a68c428-d34c-4bd7-b3b2-630e61c31d36 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:14.689687 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0a68c428-d34c-4bd7-b3b2-630e61c31d36 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:14.690215 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0a68c428-d34c-4bd7-b3b2-630e61c31d36 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:14.690841 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0a68c428-d34c-4bd7-b3b2-630e61c31d36 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:14.721658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0a68c428-d34c-4bd7-b3b2-630e61c31d36 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046402 Aug 10 12:48:14.722218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 479/964] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:14 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:14.797869 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f3b2dec8-33a7-4d9b-8867-a20b81859d62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:14.800021 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f3b2dec8-33a7-4d9b-8867-a20b81859d62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:14.805853 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f3b2dec8-33a7-4d9b-8867-a20b81859d62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:14.806328 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f3b2dec8-33a7-4d9b-8867-a20b81859d62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:14.806789 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f3b2dec8-33a7-4d9b-8867-a20b81859d62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:14.807571 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f3b2dec8-33a7-4d9b-8867-a20b81859d62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:14.808026 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f3b2dec8-33a7-4d9b-8867-a20b81859d62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:14.808445 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f3b2dec8-33a7-4d9b-8867-a20b81859d62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:14.837435 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f3b2dec8-33a7-4d9b-8867-a20b81859d62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043484 Aug 10 12:48:14.838065 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 486/965] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:14 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:14.883931 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-652460d2-5ed9-45d5-a190-9548b95480e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:14.886000 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-652460d2-5ed9-45d5-a190-9548b95480e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:14.892326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-652460d2-5ed9-45d5-a190-9548b95480e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:14.892805 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-652460d2-5ed9-45d5-a190-9548b95480e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:14.893231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-652460d2-5ed9-45d5-a190-9548b95480e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:14.893908 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-652460d2-5ed9-45d5-a190-9548b95480e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:14.894350 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-652460d2-5ed9-45d5-a190-9548b95480e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:14.894765 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-652460d2-5ed9-45d5-a190-9548b95480e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:14.908955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:48:14.924373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-652460d2-5ed9-45d5-a190-9548b95480e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044638 Aug 10 12:48:14.924924 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 480/966] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:14 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:15.734065 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5918ce7c-66d6-40b5-8270-cd61eda2874b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:15.737310 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5918ce7c-66d6-40b5-8270-cd61eda2874b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:15.744349 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5918ce7c-66d6-40b5-8270-cd61eda2874b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:15.744831 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5918ce7c-66d6-40b5-8270-cd61eda2874b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:15.745245 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5918ce7c-66d6-40b5-8270-cd61eda2874b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:15.745961 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5918ce7c-66d6-40b5-8270-cd61eda2874b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:15.746378 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5918ce7c-66d6-40b5-8270-cd61eda2874b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:15.746807 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5918ce7c-66d6-40b5-8270-cd61eda2874b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:15.776470 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5918ce7c-66d6-40b5-8270-cd61eda2874b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046758 Aug 10 12:48:15.777023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 487/967] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:15 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:15.850065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6b3c1e9b-dd99-42d9-a5aa-b466e9744e2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:15.852569 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6b3c1e9b-dd99-42d9-a5aa-b466e9744e2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:15.858728 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b3c1e9b-dd99-42d9-a5aa-b466e9744e2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:15.859220 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b3c1e9b-dd99-42d9-a5aa-b466e9744e2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:15.859650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b3c1e9b-dd99-42d9-a5aa-b466e9744e2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:15.860323 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b3c1e9b-dd99-42d9-a5aa-b466e9744e2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:15.860767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b3c1e9b-dd99-42d9-a5aa-b466e9744e2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:15.861182 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b3c1e9b-dd99-42d9-a5aa-b466e9744e2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:15.891233 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6b3c1e9b-dd99-42d9-a5aa-b466e9744e2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045449 Aug 10 12:48:15.891844 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 481/968] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:15 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:15.937143 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b728b96b-8071-4665-9863-e50137fd6a2c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:15.939198 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b728b96b-8071-4665-9863-e50137fd6a2c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:15.945081 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b728b96b-8071-4665-9863-e50137fd6a2c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:15.945674 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b728b96b-8071-4665-9863-e50137fd6a2c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:15.946377 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b728b96b-8071-4665-9863-e50137fd6a2c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:15.947065 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b728b96b-8071-4665-9863-e50137fd6a2c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:15.947545 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b728b96b-8071-4665-9863-e50137fd6a2c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:15.947970 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b728b96b-8071-4665-9863-e50137fd6a2c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:15.976570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b728b96b-8071-4665-9863-e50137fd6a2c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043432 Aug 10 12:48:15.977680 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 488/969] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:15 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:16.788254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-255668ed-56fb-4774-be7e-fedf4c74af91 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:16.790667 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-255668ed-56fb-4774-be7e-fedf4c74af91 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:16.796942 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-255668ed-56fb-4774-be7e-fedf4c74af91 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:16.797492 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-255668ed-56fb-4774-be7e-fedf4c74af91 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:16.798012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-255668ed-56fb-4774-be7e-fedf4c74af91 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:16.798697 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-255668ed-56fb-4774-be7e-fedf4c74af91 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:16.799166 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-255668ed-56fb-4774-be7e-fedf4c74af91 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:16.799607 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-255668ed-56fb-4774-be7e-fedf4c74af91 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:16.829350 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-255668ed-56fb-4774-be7e-fedf4c74af91 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045107 Aug 10 12:48:16.829903 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 482/970] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:16 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:16.904399 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-21eae03f-2223-468e-89ca-e2fffcf6c932 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:16.906514 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-21eae03f-2223-468e-89ca-e2fffcf6c932 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:16.912882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-21eae03f-2223-468e-89ca-e2fffcf6c932 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:16.913364 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-21eae03f-2223-468e-89ca-e2fffcf6c932 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:16.913797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-21eae03f-2223-468e-89ca-e2fffcf6c932 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:16.914478 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-21eae03f-2223-468e-89ca-e2fffcf6c932 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:16.914930 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-21eae03f-2223-468e-89ca-e2fffcf6c932 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:16.915372 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-21eae03f-2223-468e-89ca-e2fffcf6c932 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:16.942782 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-21eae03f-2223-468e-89ca-e2fffcf6c932 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042437 Aug 10 12:48:16.943374 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 489/971] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:16 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:16.989469 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3e6e67e1-600e-4ec6-8eab-237256d77a55 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:16.991592 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3e6e67e1-600e-4ec6-8eab-237256d77a55 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:16.998617 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3e6e67e1-600e-4ec6-8eab-237256d77a55 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:16.999092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3e6e67e1-600e-4ec6-8eab-237256d77a55 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:16.999862 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3e6e67e1-600e-4ec6-8eab-237256d77a55 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:17.000569 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3e6e67e1-600e-4ec6-8eab-237256d77a55 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:17.001017 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3e6e67e1-600e-4ec6-8eab-237256d77a55 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:17.001434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3e6e67e1-600e-4ec6-8eab-237256d77a55 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:17.031722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3e6e67e1-600e-4ec6-8eab-237256d77a55 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046172 Aug 10 12:48:17.032274 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 483/972] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:16 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:17.841512 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ad89cfdd-4445-4508-85b7-0681b01aefc5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:17.843771 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ad89cfdd-4445-4508-85b7-0681b01aefc5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:17.851071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad89cfdd-4445-4508-85b7-0681b01aefc5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:17.851617 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad89cfdd-4445-4508-85b7-0681b01aefc5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:17.852060 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad89cfdd-4445-4508-85b7-0681b01aefc5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:17.852759 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad89cfdd-4445-4508-85b7-0681b01aefc5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:17.853218 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad89cfdd-4445-4508-85b7-0681b01aefc5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:17.853642 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad89cfdd-4445-4508-85b7-0681b01aefc5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:17.884544 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ad89cfdd-4445-4508-85b7-0681b01aefc5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046973 Aug 10 12:48:17.885108 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 490/973] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:17 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:17.955586 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-50ef58eb-d2f1-424f-80bf-e39dfcbbda4e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:17.957631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-50ef58eb-d2f1-424f-80bf-e39dfcbbda4e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:17.963841 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50ef58eb-d2f1-424f-80bf-e39dfcbbda4e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:17.964314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50ef58eb-d2f1-424f-80bf-e39dfcbbda4e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:17.964738 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50ef58eb-d2f1-424f-80bf-e39dfcbbda4e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:17.965415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50ef58eb-d2f1-424f-80bf-e39dfcbbda4e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:17.965857 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50ef58eb-d2f1-424f-80bf-e39dfcbbda4e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:17.966275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50ef58eb-d2f1-424f-80bf-e39dfcbbda4e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:17.994777 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-50ef58eb-d2f1-424f-80bf-e39dfcbbda4e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043270 Aug 10 12:48:17.995398 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 484/974] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:17 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:18.043903 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-50160725-0388-407f-a207-e6c9f218f292 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:18.046140 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-50160725-0388-407f-a207-e6c9f218f292 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:18.052570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50160725-0388-407f-a207-e6c9f218f292 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:18.053053 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50160725-0388-407f-a207-e6c9f218f292 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:18.053499 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50160725-0388-407f-a207-e6c9f218f292 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:18.054186 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50160725-0388-407f-a207-e6c9f218f292 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:18.054640 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50160725-0388-407f-a207-e6c9f218f292 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:18.055804 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50160725-0388-407f-a207-e6c9f218f292 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:18.084205 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-50160725-0388-407f-a207-e6c9f218f292 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044213 Aug 10 12:48:18.084760 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 491/975] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:18 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:18.899617 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-009feee7-44cd-4ed6-8af8-4f4db7f68280 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:18.901779 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-009feee7-44cd-4ed6-8af8-4f4db7f68280 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:18.909975 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-009feee7-44cd-4ed6-8af8-4f4db7f68280 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:18.910476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-009feee7-44cd-4ed6-8af8-4f4db7f68280 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:18.911720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-009feee7-44cd-4ed6-8af8-4f4db7f68280 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:18.911720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-009feee7-44cd-4ed6-8af8-4f4db7f68280 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:18.912104 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-009feee7-44cd-4ed6-8af8-4f4db7f68280 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:18.912529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-009feee7-44cd-4ed6-8af8-4f4db7f68280 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:18.947023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-009feee7-44cd-4ed6-8af8-4f4db7f68280 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054093 Aug 10 12:48:18.951778 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 485/976] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:18 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:19.007127 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5e32afa3-717b-4ee6-ac5f-b48079bc8464 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:19.009884 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5e32afa3-717b-4ee6-ac5f-b48079bc8464 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:19.016018 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e32afa3-717b-4ee6-ac5f-b48079bc8464 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:19.016439 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e32afa3-717b-4ee6-ac5f-b48079bc8464 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:19.016870 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e32afa3-717b-4ee6-ac5f-b48079bc8464 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:19.017562 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e32afa3-717b-4ee6-ac5f-b48079bc8464 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:19.018013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e32afa3-717b-4ee6-ac5f-b48079bc8464 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:19.018430 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e32afa3-717b-4ee6-ac5f-b48079bc8464 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:19.048867 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5e32afa3-717b-4ee6-ac5f-b48079bc8464 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045706 Aug 10 12:48:19.049636 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 492/977] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:19 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:19.096879 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b05602a5-1825-4fe4-b96a-e92f3ed0fed8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:19.099006 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b05602a5-1825-4fe4-b96a-e92f3ed0fed8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:19.105357 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b05602a5-1825-4fe4-b96a-e92f3ed0fed8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:19.105848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b05602a5-1825-4fe4-b96a-e92f3ed0fed8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:19.106282 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b05602a5-1825-4fe4-b96a-e92f3ed0fed8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:19.106979 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b05602a5-1825-4fe4-b96a-e92f3ed0fed8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:19.107457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b05602a5-1825-4fe4-b96a-e92f3ed0fed8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:19.108137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b05602a5-1825-4fe4-b96a-e92f3ed0fed8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:19.138209 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b05602a5-1825-4fe4-b96a-e92f3ed0fed8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045323 Aug 10 12:48:19.138774 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 486/978] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:19 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:19.963374 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-54282b77-686b-42db-86fd-39139c586711 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:19.965577 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-54282b77-686b-42db-86fd-39139c586711 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:19.972212 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54282b77-686b-42db-86fd-39139c586711 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:19.972683 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54282b77-686b-42db-86fd-39139c586711 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:19.973119 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54282b77-686b-42db-86fd-39139c586711 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:19.973801 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54282b77-686b-42db-86fd-39139c586711 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:19.974455 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54282b77-686b-42db-86fd-39139c586711 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:19.974967 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54282b77-686b-42db-86fd-39139c586711 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:20.004947 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-54282b77-686b-42db-86fd-39139c586711 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046360 Aug 10 12:48:20.005508 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 493/979] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:19 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:20.061819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2c1a0f86-6482-4550-bde6-ea2ee0b31158 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:20.063975 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2c1a0f86-6482-4550-bde6-ea2ee0b31158 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:20.070876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c1a0f86-6482-4550-bde6-ea2ee0b31158 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:20.071583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c1a0f86-6482-4550-bde6-ea2ee0b31158 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:20.072030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c1a0f86-6482-4550-bde6-ea2ee0b31158 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:20.072720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c1a0f86-6482-4550-bde6-ea2ee0b31158 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:20.073177 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c1a0f86-6482-4550-bde6-ea2ee0b31158 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:20.073609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c1a0f86-6482-4550-bde6-ea2ee0b31158 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:20.101876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2c1a0f86-6482-4550-bde6-ea2ee0b31158 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044037 Aug 10 12:48:20.102618 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 487/980] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:20 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:20.150376 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2a92fa8d-379d-4481-8392-232376a8af97 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:20.152541 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2a92fa8d-379d-4481-8392-232376a8af97 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:20.158392 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a92fa8d-379d-4481-8392-232376a8af97 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:20.158895 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a92fa8d-379d-4481-8392-232376a8af97 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:20.159369 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a92fa8d-379d-4481-8392-232376a8af97 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:20.160051 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a92fa8d-379d-4481-8392-232376a8af97 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:20.160557 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a92fa8d-379d-4481-8392-232376a8af97 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:20.160975 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a92fa8d-379d-4481-8392-232376a8af97 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:20.189702 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2a92fa8d-379d-4481-8392-232376a8af97 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043460 Aug 10 12:48:20.190246 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 494/981] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:20 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:21.016793 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b616ffda-d890-44aa-8cef-580197a7636d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:21.018953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b616ffda-d890-44aa-8cef-580197a7636d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:21.025611 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b616ffda-d890-44aa-8cef-580197a7636d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:21.026091 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b616ffda-d890-44aa-8cef-580197a7636d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:21.026524 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b616ffda-d890-44aa-8cef-580197a7636d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:21.027236 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b616ffda-d890-44aa-8cef-580197a7636d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:21.027693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b616ffda-d890-44aa-8cef-580197a7636d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:21.028117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b616ffda-d890-44aa-8cef-580197a7636d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:21.063598 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b616ffda-d890-44aa-8cef-580197a7636d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050639 Aug 10 12:48:21.064158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 488/982] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:21 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:21.113802 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-06a65f6b-71a1-4c75-898b-67627b47595d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:21.115954 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-06a65f6b-71a1-4c75-898b-67627b47595d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:21.122344 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06a65f6b-71a1-4c75-898b-67627b47595d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:21.122818 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06a65f6b-71a1-4c75-898b-67627b47595d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:21.123277 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06a65f6b-71a1-4c75-898b-67627b47595d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:21.123957 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06a65f6b-71a1-4c75-898b-67627b47595d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:21.124401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06a65f6b-71a1-4c75-898b-67627b47595d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:21.124818 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06a65f6b-71a1-4c75-898b-67627b47595d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:21.154267 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-06a65f6b-71a1-4c75-898b-67627b47595d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044416 Aug 10 12:48:21.154893 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 495/983] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:21 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:48:21.202255 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c9a72ec5-5eca-40e0-92c0-3f166978b659 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:21.204407 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c9a72ec5-5eca-40e0-92c0-3f166978b659 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:21.210743 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9a72ec5-5eca-40e0-92c0-3f166978b659 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:21.211936 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9a72ec5-5eca-40e0-92c0-3f166978b659 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:21.212379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9a72ec5-5eca-40e0-92c0-3f166978b659 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:21.213071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9a72ec5-5eca-40e0-92c0-3f166978b659 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:21.213527 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9a72ec5-5eca-40e0-92c0-3f166978b659 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:21.213955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9a72ec5-5eca-40e0-92c0-3f166978b659 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:21.242672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c9a72ec5-5eca-40e0-92c0-3f166978b659 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044189 Aug 10 12:48:21.243133 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 489/984] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:21 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:22.075449 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-90c3d0a3-d353-4efd-af23-d9c7df3a477e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:22.077988 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-90c3d0a3-d353-4efd-af23-d9c7df3a477e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:22.083810 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-90c3d0a3-d353-4efd-af23-d9c7df3a477e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:22.084296 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-90c3d0a3-d353-4efd-af23-d9c7df3a477e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:22.084728 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-90c3d0a3-d353-4efd-af23-d9c7df3a477e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:22.085422 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-90c3d0a3-d353-4efd-af23-d9c7df3a477e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:22.085988 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-90c3d0a3-d353-4efd-af23-d9c7df3a477e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:22.086326 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-90c3d0a3-d353-4efd-af23-d9c7df3a477e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:22.089017 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:48:22.117969 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-90c3d0a3-d353-4efd-af23-d9c7df3a477e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045727 Aug 10 12:48:22.118622 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 496/985] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:22 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:22.166574 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3bc34b01-ceaf-48b3-a87c-6ee33341d32b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:22.168741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3bc34b01-ceaf-48b3-a87c-6ee33341d32b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:22.174593 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3bc34b01-ceaf-48b3-a87c-6ee33341d32b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:22.175072 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3bc34b01-ceaf-48b3-a87c-6ee33341d32b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:22.175540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3bc34b01-ceaf-48b3-a87c-6ee33341d32b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:22.176235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3bc34b01-ceaf-48b3-a87c-6ee33341d32b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:22.176688 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3bc34b01-ceaf-48b3-a87c-6ee33341d32b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:22.177109 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3bc34b01-ceaf-48b3-a87c-6ee33341d32b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:22.205568 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3bc34b01-ceaf-48b3-a87c-6ee33341d32b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043574 Aug 10 12:48:22.206149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 490/986] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:22 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:22.254606 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7ae5208f-c858-4966-ac71-7d7fe9a6e81a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:22.256768 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7ae5208f-c858-4966-ac71-7d7fe9a6e81a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:22.263438 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7ae5208f-c858-4966-ac71-7d7fe9a6e81a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:22.264184 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7ae5208f-c858-4966-ac71-7d7fe9a6e81a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:22.264626 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7ae5208f-c858-4966-ac71-7d7fe9a6e81a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:22.265314 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7ae5208f-c858-4966-ac71-7d7fe9a6e81a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:22.265810 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7ae5208f-c858-4966-ac71-7d7fe9a6e81a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:22.266199 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7ae5208f-c858-4966-ac71-7d7fe9a6e81a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:22.296090 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7ae5208f-c858-4966-ac71-7d7fe9a6e81a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046101 Aug 10 12:48:22.296654 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 497/987] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:22 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:23.130123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-cafa6c4c-b2a1-4f2d-ba43-cb12b8aefeaa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:23.132300 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-cafa6c4c-b2a1-4f2d-ba43-cb12b8aefeaa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:23.139978 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cafa6c4c-b2a1-4f2d-ba43-cb12b8aefeaa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:23.140461 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cafa6c4c-b2a1-4f2d-ba43-cb12b8aefeaa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:23.140890 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cafa6c4c-b2a1-4f2d-ba43-cb12b8aefeaa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:23.141579 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cafa6c4c-b2a1-4f2d-ba43-cb12b8aefeaa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:23.142030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cafa6c4c-b2a1-4f2d-ba43-cb12b8aefeaa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:23.142461 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cafa6c4c-b2a1-4f2d-ba43-cb12b8aefeaa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:23.173564 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-cafa6c4c-b2a1-4f2d-ba43-cb12b8aefeaa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047637 Aug 10 12:48:23.174121 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 491/988] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:23 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:23.217718 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c4403a17-9cd7-49b0-809e-70ef8c051cf2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:23.219877 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c4403a17-9cd7-49b0-809e-70ef8c051cf2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:23.225824 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c4403a17-9cd7-49b0-809e-70ef8c051cf2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:23.226298 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c4403a17-9cd7-49b0-809e-70ef8c051cf2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:23.227262 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c4403a17-9cd7-49b0-809e-70ef8c051cf2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:23.227946 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c4403a17-9cd7-49b0-809e-70ef8c051cf2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:23.228397 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c4403a17-9cd7-49b0-809e-70ef8c051cf2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:23.228816 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c4403a17-9cd7-49b0-809e-70ef8c051cf2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:23.257424 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c4403a17-9cd7-49b0-809e-70ef8c051cf2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043674 Aug 10 12:48:23.259046 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 498/989] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:23 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:23.308980 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b9f692f7-1545-4afb-ba4a-93cfaedf3450 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:23.311077 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b9f692f7-1545-4afb-ba4a-93cfaedf3450 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:23.317105 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b9f692f7-1545-4afb-ba4a-93cfaedf3450 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:23.317591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b9f692f7-1545-4afb-ba4a-93cfaedf3450 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:23.318024 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b9f692f7-1545-4afb-ba4a-93cfaedf3450 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:23.318711 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b9f692f7-1545-4afb-ba4a-93cfaedf3450 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:23.319158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b9f692f7-1545-4afb-ba4a-93cfaedf3450 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:23.319671 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b9f692f7-1545-4afb-ba4a-93cfaedf3450 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:23.347929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b9f692f7-1545-4afb-ba4a-93cfaedf3450 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043372 Aug 10 12:48:23.348410 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 492/990] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:23 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:24.186835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d96af2ff-fbe0-4a56-9e6f-337b8622d014 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:24.189015 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d96af2ff-fbe0-4a56-9e6f-337b8622d014 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:24.195744 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d96af2ff-fbe0-4a56-9e6f-337b8622d014 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:24.196238 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d96af2ff-fbe0-4a56-9e6f-337b8622d014 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:24.196673 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d96af2ff-fbe0-4a56-9e6f-337b8622d014 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:24.197368 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d96af2ff-fbe0-4a56-9e6f-337b8622d014 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:24.197820 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d96af2ff-fbe0-4a56-9e6f-337b8622d014 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:24.198242 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d96af2ff-fbe0-4a56-9e6f-337b8622d014 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:24.228097 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d96af2ff-fbe0-4a56-9e6f-337b8622d014 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045820 Aug 10 12:48:24.228653 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 499/991] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:24 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:24.270242 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-af87dd1d-0f5f-4428-b86d-9c96d95a353f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:24.272376 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-af87dd1d-0f5f-4428-b86d-9c96d95a353f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:24.274669 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=88 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:48:24.279507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-af87dd1d-0f5f-4428-b86d-9c96d95a353f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:24.280126 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-af87dd1d-0f5f-4428-b86d-9c96d95a353f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:24.285166 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-af87dd1d-0f5f-4428-b86d-9c96d95a353f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:24.285166 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-af87dd1d-0f5f-4428-b86d-9c96d95a353f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:24.285166 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-af87dd1d-0f5f-4428-b86d-9c96d95a353f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:24.285166 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-af87dd1d-0f5f-4428-b86d-9c96d95a353f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:24.311841 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-af87dd1d-0f5f-4428-b86d-9c96d95a353f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045575 Aug 10 12:48:24.313827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 493/992] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:24 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:24.359573 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-013adbd7-f337-4601-8b64-6375d77856df tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:24.361742 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-013adbd7-f337-4601-8b64-6375d77856df tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:24.368797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-013adbd7-f337-4601-8b64-6375d77856df tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:24.369277 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-013adbd7-f337-4601-8b64-6375d77856df tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:24.369709 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-013adbd7-f337-4601-8b64-6375d77856df tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:24.370392 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-013adbd7-f337-4601-8b64-6375d77856df tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:24.370842 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-013adbd7-f337-4601-8b64-6375d77856df tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:24.371285 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-013adbd7-f337-4601-8b64-6375d77856df tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:24.400518 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-013adbd7-f337-4601-8b64-6375d77856df tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045070 Aug 10 12:48:24.401010 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 500/993] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:24 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:25.239847 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-26ddc1b2-00dd-43e2-b630-8d1aa3e155ad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:25.242747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-26ddc1b2-00dd-43e2-b630-8d1aa3e155ad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:25.249717 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26ddc1b2-00dd-43e2-b630-8d1aa3e155ad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:25.250199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26ddc1b2-00dd-43e2-b630-8d1aa3e155ad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:25.250629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26ddc1b2-00dd-43e2-b630-8d1aa3e155ad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:25.251347 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26ddc1b2-00dd-43e2-b630-8d1aa3e155ad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:25.251792 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26ddc1b2-00dd-43e2-b630-8d1aa3e155ad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:25.252210 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26ddc1b2-00dd-43e2-b630-8d1aa3e155ad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:25.289034 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-26ddc1b2-00dd-43e2-b630-8d1aa3e155ad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053021 Aug 10 12:48:25.289877 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 494/994] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:25 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:25.325627 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ca27e260-75fc-4401-93fd-3e44a501d14d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:25.327780 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ca27e260-75fc-4401-93fd-3e44a501d14d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:25.334116 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca27e260-75fc-4401-93fd-3e44a501d14d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:25.334600 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca27e260-75fc-4401-93fd-3e44a501d14d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:25.335039 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca27e260-75fc-4401-93fd-3e44a501d14d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:25.335851 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca27e260-75fc-4401-93fd-3e44a501d14d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:25.336304 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca27e260-75fc-4401-93fd-3e44a501d14d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:25.336737 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca27e260-75fc-4401-93fd-3e44a501d14d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:25.365331 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ca27e260-75fc-4401-93fd-3e44a501d14d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043667 Aug 10 12:48:25.365990 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 501/995] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:25 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:25.412560 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9ac07fc7-1407-40e1-b28e-5f612f8db633 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:25.414843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9ac07fc7-1407-40e1-b28e-5f612f8db633 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:25.420716 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ac07fc7-1407-40e1-b28e-5f612f8db633 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:25.421189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ac07fc7-1407-40e1-b28e-5f612f8db633 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:25.421616 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ac07fc7-1407-40e1-b28e-5f612f8db633 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:25.422288 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ac07fc7-1407-40e1-b28e-5f612f8db633 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:25.422735 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ac07fc7-1407-40e1-b28e-5f612f8db633 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:25.423152 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ac07fc7-1407-40e1-b28e-5f612f8db633 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:25.452957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9ac07fc7-1407-40e1-b28e-5f612f8db633 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044482 Aug 10 12:48:25.453491 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 495/996] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:25 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:26.307327 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f84245b7-48f9-47f3-8d84-6a9a1abcf787 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:26.309485 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f84245b7-48f9-47f3-8d84-6a9a1abcf787 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:26.315612 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f84245b7-48f9-47f3-8d84-6a9a1abcf787 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:26.316100 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f84245b7-48f9-47f3-8d84-6a9a1abcf787 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:26.316534 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f84245b7-48f9-47f3-8d84-6a9a1abcf787 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:26.317225 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f84245b7-48f9-47f3-8d84-6a9a1abcf787 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:26.317699 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f84245b7-48f9-47f3-8d84-6a9a1abcf787 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:26.318113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f84245b7-48f9-47f3-8d84-6a9a1abcf787 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:26.347269 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f84245b7-48f9-47f3-8d84-6a9a1abcf787 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044904 Aug 10 12:48:26.347827 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 502/997] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:26 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:26.377951 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9f8722e0-2297-457a-b884-fa54a1f72a52 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:26.380237 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9f8722e0-2297-457a-b884-fa54a1f72a52 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:26.387164 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f8722e0-2297-457a-b884-fa54a1f72a52 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:26.387695 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f8722e0-2297-457a-b884-fa54a1f72a52 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:26.388131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f8722e0-2297-457a-b884-fa54a1f72a52 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:26.388818 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f8722e0-2297-457a-b884-fa54a1f72a52 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:26.389271 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f8722e0-2297-457a-b884-fa54a1f72a52 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:26.389698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f8722e0-2297-457a-b884-fa54a1f72a52 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:26.420240 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9f8722e0-2297-457a-b884-fa54a1f72a52 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046273 Aug 10 12:48:26.420817 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 496/998] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:26 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:26.465274 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4be12c3b-b310-40d7-ad60-97a5bce00778 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:26.467507 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4be12c3b-b310-40d7-ad60-97a5bce00778 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:26.473778 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4be12c3b-b310-40d7-ad60-97a5bce00778 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:26.474253 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4be12c3b-b310-40d7-ad60-97a5bce00778 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:26.474682 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4be12c3b-b310-40d7-ad60-97a5bce00778 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:26.475408 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4be12c3b-b310-40d7-ad60-97a5bce00778 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:26.475892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4be12c3b-b310-40d7-ad60-97a5bce00778 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:26.476339 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4be12c3b-b310-40d7-ad60-97a5bce00778 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:26.510503 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4be12c3b-b310-40d7-ad60-97a5bce00778 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049915 Aug 10 12:48:26.511070 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 503/999] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:26 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:27.360544 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4b1135cb-669a-40c9-b6fa-69f49481d812 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:27.362721 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4b1135cb-669a-40c9-b6fa-69f49481d812 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:27.369491 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b1135cb-669a-40c9-b6fa-69f49481d812 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:27.369976 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b1135cb-669a-40c9-b6fa-69f49481d812 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:27.370542 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b1135cb-669a-40c9-b6fa-69f49481d812 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:27.371271 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b1135cb-669a-40c9-b6fa-69f49481d812 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:27.371834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b1135cb-669a-40c9-b6fa-69f49481d812 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:27.372266 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b1135cb-669a-40c9-b6fa-69f49481d812 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:27.374708 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:48:27.402727 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4b1135cb-669a-40c9-b6fa-69f49481d812 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046484 Aug 10 12:48:27.403309 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 497/1000] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:27 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:27.433197 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c755ad50-b50b-494f-b697-0ef1e5f24850 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:27.435347 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c755ad50-b50b-494f-b697-0ef1e5f24850 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:27.441148 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c755ad50-b50b-494f-b697-0ef1e5f24850 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:27.441624 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c755ad50-b50b-494f-b697-0ef1e5f24850 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:27.442055 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c755ad50-b50b-494f-b697-0ef1e5f24850 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:27.442736 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c755ad50-b50b-494f-b697-0ef1e5f24850 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:27.443198 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c755ad50-b50b-494f-b697-0ef1e5f24850 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:27.443625 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c755ad50-b50b-494f-b697-0ef1e5f24850 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:27.472268 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c755ad50-b50b-494f-b697-0ef1e5f24850 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043689 Aug 10 12:48:27.472857 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 504/1001] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:27 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:27.522821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bd9385ee-b072-4e4c-872b-83990e5fa2e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:27.525568 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bd9385ee-b072-4e4c-872b-83990e5fa2e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:27.532016 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd9385ee-b072-4e4c-872b-83990e5fa2e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:27.532448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd9385ee-b072-4e4c-872b-83990e5fa2e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:27.532888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd9385ee-b072-4e4c-872b-83990e5fa2e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:27.533582 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd9385ee-b072-4e4c-872b-83990e5fa2e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:27.534038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd9385ee-b072-4e4c-872b-83990e5fa2e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:27.534467 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd9385ee-b072-4e4c-872b-83990e5fa2e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:27.563291 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bd9385ee-b072-4e4c-872b-83990e5fa2e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044444 Aug 10 12:48:27.563850 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 498/1002] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:27 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:28.414128 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ab4c5309-c37d-4e83-aa76-97fb76827079 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:28.416344 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ab4c5309-c37d-4e83-aa76-97fb76827079 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:28.422261 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab4c5309-c37d-4e83-aa76-97fb76827079 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:28.422743 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab4c5309-c37d-4e83-aa76-97fb76827079 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:28.423207 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab4c5309-c37d-4e83-aa76-97fb76827079 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:28.423898 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab4c5309-c37d-4e83-aa76-97fb76827079 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:28.424345 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab4c5309-c37d-4e83-aa76-97fb76827079 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:28.424765 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab4c5309-c37d-4e83-aa76-97fb76827079 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:28.455932 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ab4c5309-c37d-4e83-aa76-97fb76827079 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045714 Aug 10 12:48:28.456517 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 505/1003] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:28 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:28.485384 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-132f4128-6bb2-46da-ab9a-6dd025430c24 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:28.487565 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-132f4128-6bb2-46da-ab9a-6dd025430c24 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:28.494512 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-132f4128-6bb2-46da-ab9a-6dd025430c24 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:28.494991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-132f4128-6bb2-46da-ab9a-6dd025430c24 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:28.495452 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-132f4128-6bb2-46da-ab9a-6dd025430c24 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:28.496136 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-132f4128-6bb2-46da-ab9a-6dd025430c24 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:28.496587 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-132f4128-6bb2-46da-ab9a-6dd025430c24 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:28.497078 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-132f4128-6bb2-46da-ab9a-6dd025430c24 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:28.526540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-132f4128-6bb2-46da-ab9a-6dd025430c24 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045349 Aug 10 12:48:28.527155 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 499/1004] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:28 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:28.576297 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-439413ee-88d1-4a46-bc49-60da14c3cf56 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:28.578392 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-439413ee-88d1-4a46-bc49-60da14c3cf56 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:28.584730 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-439413ee-88d1-4a46-bc49-60da14c3cf56 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:28.585205 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-439413ee-88d1-4a46-bc49-60da14c3cf56 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:28.585632 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-439413ee-88d1-4a46-bc49-60da14c3cf56 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:28.586309 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-439413ee-88d1-4a46-bc49-60da14c3cf56 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:28.586784 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-439413ee-88d1-4a46-bc49-60da14c3cf56 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:28.587325 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-439413ee-88d1-4a46-bc49-60da14c3cf56 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:28.615484 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-439413ee-88d1-4a46-bc49-60da14c3cf56 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043152 Aug 10 12:48:28.616026 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 506/1005] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:28 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:29.468497 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a1bffe2b-e309-4edb-9826-41833900e1ea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:29.470865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a1bffe2b-e309-4edb-9826-41833900e1ea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:29.476640 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a1bffe2b-e309-4edb-9826-41833900e1ea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:29.477122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a1bffe2b-e309-4edb-9826-41833900e1ea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:29.477555 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a1bffe2b-e309-4edb-9826-41833900e1ea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:29.478273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a1bffe2b-e309-4edb-9826-41833900e1ea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:29.478722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a1bffe2b-e309-4edb-9826-41833900e1ea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:29.479140 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a1bffe2b-e309-4edb-9826-41833900e1ea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:29.509281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a1bffe2b-e309-4edb-9826-41833900e1ea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044202 Aug 10 12:48:29.523450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 500/1006] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:29 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:29.538017 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b890494b-ca0c-42dc-8284-89592c6ab800 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:29.540165 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b890494b-ca0c-42dc-8284-89592c6ab800 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:29.545965 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b890494b-ca0c-42dc-8284-89592c6ab800 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:29.546444 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b890494b-ca0c-42dc-8284-89592c6ab800 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:29.546875 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b890494b-ca0c-42dc-8284-89592c6ab800 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:29.547585 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b890494b-ca0c-42dc-8284-89592c6ab800 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:29.548396 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b890494b-ca0c-42dc-8284-89592c6ab800 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:29.548818 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b890494b-ca0c-42dc-8284-89592c6ab800 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:29.577873 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b890494b-ca0c-42dc-8284-89592c6ab800 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043831 Aug 10 12:48:29.578478 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 507/1007] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:29 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:29.628558 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-cb233c69-e3bb-4a91-8156-5f0a06a29670 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:29.630710 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-cb233c69-e3bb-4a91-8156-5f0a06a29670 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:29.637235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb233c69-e3bb-4a91-8156-5f0a06a29670 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:29.637719 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb233c69-e3bb-4a91-8156-5f0a06a29670 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:29.638157 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb233c69-e3bb-4a91-8156-5f0a06a29670 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:29.638850 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb233c69-e3bb-4a91-8156-5f0a06a29670 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:29.639333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb233c69-e3bb-4a91-8156-5f0a06a29670 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:29.644285 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb233c69-e3bb-4a91-8156-5f0a06a29670 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:29.668826 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-cb233c69-e3bb-4a91-8156-5f0a06a29670 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044257 Aug 10 12:48:29.669380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 501/1008] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:29 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:30.533992 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-82eff037-d8ac-4322-9592-06ce9475324b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:30.536813 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-82eff037-d8ac-4322-9592-06ce9475324b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:30.544041 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82eff037-d8ac-4322-9592-06ce9475324b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:30.544599 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82eff037-d8ac-4322-9592-06ce9475324b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:30.545044 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82eff037-d8ac-4322-9592-06ce9475324b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:30.545754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82eff037-d8ac-4322-9592-06ce9475324b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:30.546209 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82eff037-d8ac-4322-9592-06ce9475324b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:30.546638 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82eff037-d8ac-4322-9592-06ce9475324b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:30.575748 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-82eff037-d8ac-4322-9592-06ce9475324b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045717 Aug 10 12:48:30.576308 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 508/1009] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:30 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:30.590510 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b560c742-0118-40bd-940a-fe1770815660 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:30.592643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b560c742-0118-40bd-940a-fe1770815660 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:30.598935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b560c742-0118-40bd-940a-fe1770815660 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:30.599446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b560c742-0118-40bd-940a-fe1770815660 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:30.599886 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b560c742-0118-40bd-940a-fe1770815660 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:30.600601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b560c742-0118-40bd-940a-fe1770815660 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:30.601052 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b560c742-0118-40bd-940a-fe1770815660 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:30.601476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b560c742-0118-40bd-940a-fe1770815660 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:30.630498 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b560c742-0118-40bd-940a-fe1770815660 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044479 Aug 10 12:48:30.631133 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 502/1010] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:30 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:30.681005 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d57187c4-2a48-4b65-9fe4-a3cdf3629fee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:30.683140 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d57187c4-2a48-4b65-9fe4-a3cdf3629fee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:30.689035 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d57187c4-2a48-4b65-9fe4-a3cdf3629fee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:30.689514 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d57187c4-2a48-4b65-9fe4-a3cdf3629fee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:30.689947 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d57187c4-2a48-4b65-9fe4-a3cdf3629fee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:30.690633 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d57187c4-2a48-4b65-9fe4-a3cdf3629fee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:30.691085 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d57187c4-2a48-4b65-9fe4-a3cdf3629fee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:30.691543 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d57187c4-2a48-4b65-9fe4-a3cdf3629fee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:30.721145 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d57187c4-2a48-4b65-9fe4-a3cdf3629fee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043982 Aug 10 12:48:30.721537 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 509/1011] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:30 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:31.589952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c2987331-f451-4820-a675-327f6b030d08 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:31.591266 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c2987331-f451-4820-a675-327f6b030d08 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:31.597680 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2987331-f451-4820-a675-327f6b030d08 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:31.598164 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2987331-f451-4820-a675-327f6b030d08 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:31.598670 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2987331-f451-4820-a675-327f6b030d08 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:31.599311 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2987331-f451-4820-a675-327f6b030d08 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:31.599783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2987331-f451-4820-a675-327f6b030d08 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:31.600204 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2987331-f451-4820-a675-327f6b030d08 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:31.630044 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c2987331-f451-4820-a675-327f6b030d08 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045710 Aug 10 12:48:31.630593 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 503/1012] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:31 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:31.641870 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e8523e40-8d2a-4d87-af91-bae721c60204 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:31.643984 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e8523e40-8d2a-4d87-af91-bae721c60204 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:31.650758 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e8523e40-8d2a-4d87-af91-bae721c60204 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:31.651262 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e8523e40-8d2a-4d87-af91-bae721c60204 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:31.651722 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e8523e40-8d2a-4d87-af91-bae721c60204 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:31.652405 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e8523e40-8d2a-4d87-af91-bae721c60204 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:31.652849 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e8523e40-8d2a-4d87-af91-bae721c60204 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:31.653262 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e8523e40-8d2a-4d87-af91-bae721c60204 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:31.683301 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e8523e40-8d2a-4d87-af91-bae721c60204 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045335 Aug 10 12:48:31.683917 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 510/1013] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:31 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:31.733182 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f975de86-9fbd-4dd4-9b3f-f075db8d931a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:31.735307 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f975de86-9fbd-4dd4-9b3f-f075db8d931a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:31.741108 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f975de86-9fbd-4dd4-9b3f-f075db8d931a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:31.741582 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f975de86-9fbd-4dd4-9b3f-f075db8d931a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:31.742007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f975de86-9fbd-4dd4-9b3f-f075db8d931a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:31.743363 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f975de86-9fbd-4dd4-9b3f-f075db8d931a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:31.743814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f975de86-9fbd-4dd4-9b3f-f075db8d931a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:31.744232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f975de86-9fbd-4dd4-9b3f-f075db8d931a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:31.772257 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f975de86-9fbd-4dd4-9b3f-f075db8d931a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043197 Aug 10 12:48:31.772808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 504/1014] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:31 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:32.641812 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-06317073-cb2c-486d-8699-6d1615e4a1cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:32.644055 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-06317073-cb2c-486d-8699-6d1615e4a1cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:32.651025 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06317073-cb2c-486d-8699-6d1615e4a1cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:32.651540 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06317073-cb2c-486d-8699-6d1615e4a1cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:32.651975 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06317073-cb2c-486d-8699-6d1615e4a1cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:32.652731 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06317073-cb2c-486d-8699-6d1615e4a1cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:32.653255 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06317073-cb2c-486d-8699-6d1615e4a1cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:32.653725 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06317073-cb2c-486d-8699-6d1615e4a1cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:32.683323 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-06317073-cb2c-486d-8699-6d1615e4a1cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045388 Aug 10 12:48:32.683956 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 511/1015] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:32 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:32.695487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-99c6e574-ce3c-4c6a-9b71-1e39f331173b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:32.698575 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-99c6e574-ce3c-4c6a-9b71-1e39f331173b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:32.704965 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99c6e574-ce3c-4c6a-9b71-1e39f331173b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:32.705447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99c6e574-ce3c-4c6a-9b71-1e39f331173b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:32.705883 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99c6e574-ce3c-4c6a-9b71-1e39f331173b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:32.706569 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99c6e574-ce3c-4c6a-9b71-1e39f331173b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:32.707023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99c6e574-ce3c-4c6a-9b71-1e39f331173b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:32.707503 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99c6e574-ce3c-4c6a-9b71-1e39f331173b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:32.736362 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-99c6e574-ce3c-4c6a-9b71-1e39f331173b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044927 Aug 10 12:48:32.736909 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 505/1016] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:32 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:32.784456 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e8117fe2-3b51-4a3c-85cc-0fa377f458db tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:32.786574 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e8117fe2-3b51-4a3c-85cc-0fa377f458db tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:32.793200 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e8117fe2-3b51-4a3c-85cc-0fa377f458db tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:32.793676 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e8117fe2-3b51-4a3c-85cc-0fa377f458db tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:32.794106 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e8117fe2-3b51-4a3c-85cc-0fa377f458db tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:32.794788 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e8117fe2-3b51-4a3c-85cc-0fa377f458db tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:32.795274 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e8117fe2-3b51-4a3c-85cc-0fa377f458db tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:32.795702 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e8117fe2-3b51-4a3c-85cc-0fa377f458db tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:32.819860 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:48:32.824406 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e8117fe2-3b51-4a3c-85cc-0fa377f458db tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043919 Aug 10 12:48:32.824956 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 512/1017] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:32 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:33.704779 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ec51622b-4663-4c92-966a-ffdb63841e61 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:33.706907 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ec51622b-4663-4c92-966a-ffdb63841e61 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:33.713587 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec51622b-4663-4c92-966a-ffdb63841e61 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:33.714070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec51622b-4663-4c92-966a-ffdb63841e61 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:33.714500 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec51622b-4663-4c92-966a-ffdb63841e61 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:33.715201 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec51622b-4663-4c92-966a-ffdb63841e61 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:33.715652 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec51622b-4663-4c92-966a-ffdb63841e61 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:33.716069 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec51622b-4663-4c92-966a-ffdb63841e61 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:33.745634 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ec51622b-4663-4c92-966a-ffdb63841e61 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044856 Aug 10 12:48:33.746198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 506/1018] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:33 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:33.748002 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4f0852ba-40f4-498e-bcd5-ac44aa2d8e29 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:33.750112 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4f0852ba-40f4-498e-bcd5-ac44aa2d8e29 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:33.757243 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4f0852ba-40f4-498e-bcd5-ac44aa2d8e29 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:33.757726 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4f0852ba-40f4-498e-bcd5-ac44aa2d8e29 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:33.758893 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4f0852ba-40f4-498e-bcd5-ac44aa2d8e29 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:33.759625 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4f0852ba-40f4-498e-bcd5-ac44aa2d8e29 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:33.760080 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4f0852ba-40f4-498e-bcd5-ac44aa2d8e29 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:33.760503 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4f0852ba-40f4-498e-bcd5-ac44aa2d8e29 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:33.788653 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4f0852ba-40f4-498e-bcd5-ac44aa2d8e29 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044520 Aug 10 12:48:33.789206 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 513/1019] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:33 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:48:33.836613 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c92c9f1d-e44a-428d-bdcb-c9911f40eaac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:33.838908 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c92c9f1d-e44a-428d-bdcb-c9911f40eaac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:33.844848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c92c9f1d-e44a-428d-bdcb-c9911f40eaac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:33.845333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c92c9f1d-e44a-428d-bdcb-c9911f40eaac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:33.845772 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c92c9f1d-e44a-428d-bdcb-c9911f40eaac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:33.846462 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c92c9f1d-e44a-428d-bdcb-c9911f40eaac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:33.846915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c92c9f1d-e44a-428d-bdcb-c9911f40eaac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:33.847377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c92c9f1d-e44a-428d-bdcb-c9911f40eaac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:33.877264 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c92c9f1d-e44a-428d-bdcb-c9911f40eaac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044665 Aug 10 12:48:33.877814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 507/1020] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:33 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:34.759473 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-33983c4a-2e82-4f7f-9e9a-f622dbe91d2d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:34.762378 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-33983c4a-2e82-4f7f-9e9a-f622dbe91d2d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:34.773286 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-33983c4a-2e82-4f7f-9e9a-f622dbe91d2d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:34.773286 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-33983c4a-2e82-4f7f-9e9a-f622dbe91d2d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:34.773286 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-33983c4a-2e82-4f7f-9e9a-f622dbe91d2d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:34.773286 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-33983c4a-2e82-4f7f-9e9a-f622dbe91d2d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:34.773590 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-33983c4a-2e82-4f7f-9e9a-f622dbe91d2d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:34.773590 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-33983c4a-2e82-4f7f-9e9a-f622dbe91d2d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:34.800943 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-eeac0e92-766b-4101-9ea8-c96e9e404c42 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:34.802517 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-33983c4a-2e82-4f7f-9e9a-f622dbe91d2d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048162 Aug 10 12:48:34.803262 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-eeac0e92-766b-4101-9ea8-c96e9e404c42 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:34.803387 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 514/1021] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:34 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:34.809569 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eeac0e92-766b-4101-9ea8-c96e9e404c42 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:34.810053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eeac0e92-766b-4101-9ea8-c96e9e404c42 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:34.810488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eeac0e92-766b-4101-9ea8-c96e9e404c42 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:34.811203 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eeac0e92-766b-4101-9ea8-c96e9e404c42 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:34.811671 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eeac0e92-766b-4101-9ea8-c96e9e404c42 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:34.812076 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eeac0e92-766b-4101-9ea8-c96e9e404c42 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:34.842040 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-eeac0e92-766b-4101-9ea8-c96e9e404c42 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045063 Aug 10 12:48:34.842605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 508/1022] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:34 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:48:34.890131 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bebdd836-4c8c-4865-9662-8c2e16d00778 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:34.892348 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bebdd836-4c8c-4865-9662-8c2e16d00778 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:34.898388 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bebdd836-4c8c-4865-9662-8c2e16d00778 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:34.899516 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bebdd836-4c8c-4865-9662-8c2e16d00778 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:34.899956 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bebdd836-4c8c-4865-9662-8c2e16d00778 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:34.900656 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bebdd836-4c8c-4865-9662-8c2e16d00778 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:34.901109 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bebdd836-4c8c-4865-9662-8c2e16d00778 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:34.901532 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bebdd836-4c8c-4865-9662-8c2e16d00778 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:34.930845 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bebdd836-4c8c-4865-9662-8c2e16d00778 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044496 Aug 10 12:48:34.931442 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 515/1023] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:34 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:35.491325 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:48:35.491505 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Wed Aug 10 12:48:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 12:48:35.816259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-807f608d-1220-44bc-85cb-89d83232b724 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:35.818700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-807f608d-1220-44bc-85cb-89d83232b724 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:35.825743 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-807f608d-1220-44bc-85cb-89d83232b724 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:35.826229 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-807f608d-1220-44bc-85cb-89d83232b724 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:35.826665 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-807f608d-1220-44bc-85cb-89d83232b724 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:35.827391 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-807f608d-1220-44bc-85cb-89d83232b724 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:35.827844 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-807f608d-1220-44bc-85cb-89d83232b724 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:35.828385 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-807f608d-1220-44bc-85cb-89d83232b724 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:35.854016 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-59ab4f3e-0663-449e-b921-c31205d3edff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:35.856168 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-59ab4f3e-0663-449e-b921-c31205d3edff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:35.858839 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-807f608d-1220-44bc-85cb-89d83232b724 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047860 Aug 10 12:48:35.859607 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 509/1024] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:35 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:35.862787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-59ab4f3e-0663-449e-b921-c31205d3edff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:35.863311 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-59ab4f3e-0663-449e-b921-c31205d3edff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:35.863745 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-59ab4f3e-0663-449e-b921-c31205d3edff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:35.864754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-59ab4f3e-0663-449e-b921-c31205d3edff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:35.865210 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-59ab4f3e-0663-449e-b921-c31205d3edff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:35.865637 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-59ab4f3e-0663-449e-b921-c31205d3edff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:35.895505 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-59ab4f3e-0663-449e-b921-c31205d3edff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045564 Aug 10 12:48:35.896052 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 516/1025] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:35 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:48:35.941769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-97de810c-9ff3-45b9-9072-a2247a0eb4bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:35.943964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-97de810c-9ff3-45b9-9072-a2247a0eb4bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:35.950724 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97de810c-9ff3-45b9-9072-a2247a0eb4bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:35.951240 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97de810c-9ff3-45b9-9072-a2247a0eb4bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:35.951682 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97de810c-9ff3-45b9-9072-a2247a0eb4bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:35.952376 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97de810c-9ff3-45b9-9072-a2247a0eb4bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:35.952832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97de810c-9ff3-45b9-9072-a2247a0eb4bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:35.953256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97de810c-9ff3-45b9-9072-a2247a0eb4bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:35.982626 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-97de810c-9ff3-45b9-9072-a2247a0eb4bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044458 Aug 10 12:48:35.983181 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 510/1026] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:35 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:36.871209 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1e2d0851-797c-476e-8434-33dbece3ea83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:36.873626 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1e2d0851-797c-476e-8434-33dbece3ea83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:36.879880 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1e2d0851-797c-476e-8434-33dbece3ea83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:36.880442 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1e2d0851-797c-476e-8434-33dbece3ea83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:36.880763 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1e2d0851-797c-476e-8434-33dbece3ea83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:36.881561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1e2d0851-797c-476e-8434-33dbece3ea83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:36.881910 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1e2d0851-797c-476e-8434-33dbece3ea83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:36.882326 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1e2d0851-797c-476e-8434-33dbece3ea83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:36.908132 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2b6216d3-b838-4e3d-802e-4b26643b6a2b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:36.910490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2b6216d3-b838-4e3d-802e-4b26643b6a2b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:36.913136 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1e2d0851-797c-476e-8434-33dbece3ea83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046175 Aug 10 12:48:36.913696 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 517/1027] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:36 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:36.916955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b6216d3-b838-4e3d-802e-4b26643b6a2b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:36.917441 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b6216d3-b838-4e3d-802e-4b26643b6a2b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:36.917874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b6216d3-b838-4e3d-802e-4b26643b6a2b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:36.918573 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b6216d3-b838-4e3d-802e-4b26643b6a2b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:36.919055 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b6216d3-b838-4e3d-802e-4b26643b6a2b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:36.919533 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b6216d3-b838-4e3d-802e-4b26643b6a2b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:36.948848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2b6216d3-b838-4e3d-802e-4b26643b6a2b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044661 Aug 10 12:48:36.949403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 511/1028] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:36 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:48:36.993822 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-40a25bab-4474-44c3-9397-51a757f66bb1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:36.995941 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-40a25bab-4474-44c3-9397-51a757f66bb1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:37.001760 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-40a25bab-4474-44c3-9397-51a757f66bb1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:37.002232 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-40a25bab-4474-44c3-9397-51a757f66bb1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:37.002666 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-40a25bab-4474-44c3-9397-51a757f66bb1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:37.003379 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-40a25bab-4474-44c3-9397-51a757f66bb1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:37.003831 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-40a25bab-4474-44c3-9397-51a757f66bb1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:37.004254 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-40a25bab-4474-44c3-9397-51a757f66bb1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:37.034944 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-40a25bab-4474-44c3-9397-51a757f66bb1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045051 Aug 10 12:48:37.035521 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 518/1029] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:36 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:37.925302 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-335e492a-dce7-44c6-a6b4-e479e74e91db tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:37.927868 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-335e492a-dce7-44c6-a6b4-e479e74e91db tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:37.938856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-335e492a-dce7-44c6-a6b4-e479e74e91db tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:37.938856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-335e492a-dce7-44c6-a6b4-e479e74e91db tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:37.938856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-335e492a-dce7-44c6-a6b4-e479e74e91db tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:37.938856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-335e492a-dce7-44c6-a6b4-e479e74e91db tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:37.939419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-335e492a-dce7-44c6-a6b4-e479e74e91db tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:37.939419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-335e492a-dce7-44c6-a6b4-e479e74e91db tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:37.963871 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-19f503d0-50f2-4fb5-a7f2-04a01b08fb85 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:37.965966 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-19f503d0-50f2-4fb5-a7f2-04a01b08fb85 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:37.966365 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-335e492a-dce7-44c6-a6b4-e479e74e91db tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045000 Aug 10 12:48:37.967009 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 512/1030] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:37 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:37.972333 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19f503d0-50f2-4fb5-a7f2-04a01b08fb85 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:37.972812 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19f503d0-50f2-4fb5-a7f2-04a01b08fb85 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:37.973246 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19f503d0-50f2-4fb5-a7f2-04a01b08fb85 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:37.973939 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19f503d0-50f2-4fb5-a7f2-04a01b08fb85 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:37.974388 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19f503d0-50f2-4fb5-a7f2-04a01b08fb85 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:37.974808 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19f503d0-50f2-4fb5-a7f2-04a01b08fb85 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:38.005360 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-19f503d0-50f2-4fb5-a7f2-04a01b08fb85 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045436 Aug 10 12:48:38.005911 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 519/1031] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:37 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:48:38.047010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7dea9f21-4c48-4ea4-9b96-3e35340d6389 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:38.049126 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7dea9f21-4c48-4ea4-9b96-3e35340d6389 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:38.054947 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7dea9f21-4c48-4ea4-9b96-3e35340d6389 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:38.055882 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7dea9f21-4c48-4ea4-9b96-3e35340d6389 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:38.056319 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7dea9f21-4c48-4ea4-9b96-3e35340d6389 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:38.057000 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7dea9f21-4c48-4ea4-9b96-3e35340d6389 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:38.057453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7dea9f21-4c48-4ea4-9b96-3e35340d6389 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:38.057871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7dea9f21-4c48-4ea4-9b96-3e35340d6389 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:38.081978 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:48:38.087291 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7dea9f21-4c48-4ea4-9b96-3e35340d6389 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043288 Aug 10 12:48:38.087845 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 513/1032] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:38 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:38.978021 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-11f5f7ba-1907-4f0a-82af-947f26cda93c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:38.980418 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-11f5f7ba-1907-4f0a-82af-947f26cda93c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:38.984667 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=86 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:48:38.988116 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11f5f7ba-1907-4f0a-82af-947f26cda93c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:38.988602 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11f5f7ba-1907-4f0a-82af-947f26cda93c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:38.989042 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11f5f7ba-1907-4f0a-82af-947f26cda93c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:38.989737 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11f5f7ba-1907-4f0a-82af-947f26cda93c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:38.990187 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11f5f7ba-1907-4f0a-82af-947f26cda93c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:38.990609 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11f5f7ba-1907-4f0a-82af-947f26cda93c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:39.018546 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-dd185990-b462-48a5-8fe4-e0b5494255ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:39.020912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-dd185990-b462-48a5-8fe4-e0b5494255ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:39.021819 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-11f5f7ba-1907-4f0a-82af-947f26cda93c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047913 Aug 10 12:48:39.022484 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 520/1033] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:38 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:39.029141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd185990-b462-48a5-8fe4-e0b5494255ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:39.029708 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd185990-b462-48a5-8fe4-e0b5494255ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:39.030176 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd185990-b462-48a5-8fe4-e0b5494255ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:39.030874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd185990-b462-48a5-8fe4-e0b5494255ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:39.031374 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd185990-b462-48a5-8fe4-e0b5494255ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:39.031800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd185990-b462-48a5-8fe4-e0b5494255ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:39.060746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-dd185990-b462-48a5-8fe4-e0b5494255ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046653 Aug 10 12:48:39.061304 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 514/1034] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:39 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:48:39.099310 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-155b9702-4e20-453e-b64d-aa64d2e17b7e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:39.101478 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-155b9702-4e20-453e-b64d-aa64d2e17b7e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:39.108564 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-155b9702-4e20-453e-b64d-aa64d2e17b7e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:39.109038 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-155b9702-4e20-453e-b64d-aa64d2e17b7e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:39.109466 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-155b9702-4e20-453e-b64d-aa64d2e17b7e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:39.110139 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-155b9702-4e20-453e-b64d-aa64d2e17b7e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:39.110583 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-155b9702-4e20-453e-b64d-aa64d2e17b7e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:39.110998 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-155b9702-4e20-453e-b64d-aa64d2e17b7e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:39.139732 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-155b9702-4e20-453e-b64d-aa64d2e17b7e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044342 Aug 10 12:48:39.140271 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 521/1035] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:39 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:40.034333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a0914c1b-cde6-47ed-91de-4f3859360555 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:40.037499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a0914c1b-cde6-47ed-91de-4f3859360555 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:40.045259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a0914c1b-cde6-47ed-91de-4f3859360555 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:40.045739 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a0914c1b-cde6-47ed-91de-4f3859360555 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:40.046276 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a0914c1b-cde6-47ed-91de-4f3859360555 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:40.046923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a0914c1b-cde6-47ed-91de-4f3859360555 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:40.047399 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a0914c1b-cde6-47ed-91de-4f3859360555 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:40.047817 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a0914c1b-cde6-47ed-91de-4f3859360555 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:40.073628 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5a84c61c-e138-4846-b5a7-85cb6c2d289a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:40.075334 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5a84c61c-e138-4846-b5a7-85cb6c2d289a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:40.078826 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a0914c1b-cde6-47ed-91de-4f3859360555 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048331 Aug 10 12:48:40.079418 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 515/1036] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:40 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:40.081742 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a84c61c-e138-4846-b5a7-85cb6c2d289a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:40.082229 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a84c61c-e138-4846-b5a7-85cb6c2d289a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:40.082666 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a84c61c-e138-4846-b5a7-85cb6c2d289a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:40.083405 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a84c61c-e138-4846-b5a7-85cb6c2d289a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:40.083854 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a84c61c-e138-4846-b5a7-85cb6c2d289a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:40.084275 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a84c61c-e138-4846-b5a7-85cb6c2d289a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:40.113847 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5a84c61c-e138-4846-b5a7-85cb6c2d289a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045392 Aug 10 12:48:40.114398 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 522/1037] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:40 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:40.152397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0067bef9-76b1-4244-bd71-da1d03a3d0ea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:40.154513 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0067bef9-76b1-4244-bd71-da1d03a3d0ea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:40.160412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0067bef9-76b1-4244-bd71-da1d03a3d0ea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:40.160895 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0067bef9-76b1-4244-bd71-da1d03a3d0ea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:40.161332 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0067bef9-76b1-4244-bd71-da1d03a3d0ea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:40.162013 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0067bef9-76b1-4244-bd71-da1d03a3d0ea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:40.162465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0067bef9-76b1-4244-bd71-da1d03a3d0ea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:40.162893 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0067bef9-76b1-4244-bd71-da1d03a3d0ea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:40.190991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0067bef9-76b1-4244-bd71-da1d03a3d0ea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043190 Aug 10 12:48:40.191565 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 516/1038] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:40 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:48:41.090116 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fc403deb-51ed-4329-8f7b-4cf669e0fe8b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:41.092389 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fc403deb-51ed-4329-8f7b-4cf669e0fe8b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:41.098427 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fc403deb-51ed-4329-8f7b-4cf669e0fe8b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:41.098909 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fc403deb-51ed-4329-8f7b-4cf669e0fe8b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:41.099370 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fc403deb-51ed-4329-8f7b-4cf669e0fe8b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:41.100065 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fc403deb-51ed-4329-8f7b-4cf669e0fe8b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:41.100524 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fc403deb-51ed-4329-8f7b-4cf669e0fe8b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:41.101054 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fc403deb-51ed-4329-8f7b-4cf669e0fe8b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:41.127455 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8747a71b-ff88-4571-aee3-f7ef66913102 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:41.129558 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8747a71b-ff88-4571-aee3-f7ef66913102 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:41.130985 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fc403deb-51ed-4329-8f7b-4cf669e0fe8b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045024 Aug 10 12:48:41.131754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 523/1039] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:41 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:41.137105 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8747a71b-ff88-4571-aee3-f7ef66913102 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:41.137585 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8747a71b-ff88-4571-aee3-f7ef66913102 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:41.138010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8747a71b-ff88-4571-aee3-f7ef66913102 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:41.138700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8747a71b-ff88-4571-aee3-f7ef66913102 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:41.139146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8747a71b-ff88-4571-aee3-f7ef66913102 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:41.139591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8747a71b-ff88-4571-aee3-f7ef66913102 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:41.168383 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8747a71b-ff88-4571-aee3-f7ef66913102 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046023 Aug 10 12:48:41.169118 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 517/1040] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:41 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:41.203620 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b2ed0b50-9409-4062-83a7-da90d43df923 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:41.205718 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b2ed0b50-9409-4062-83a7-da90d43df923 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:41.211565 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2ed0b50-9409-4062-83a7-da90d43df923 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:41.212104 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2ed0b50-9409-4062-83a7-da90d43df923 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:41.212537 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2ed0b50-9409-4062-83a7-da90d43df923 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:41.213218 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2ed0b50-9409-4062-83a7-da90d43df923 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:41.213665 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2ed0b50-9409-4062-83a7-da90d43df923 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:41.214082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2ed0b50-9409-4062-83a7-da90d43df923 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:41.242190 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b2ed0b50-9409-4062-83a7-da90d43df923 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042459 Aug 10 12:48:41.243424 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 524/1041] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:41 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:42.150138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-88e3ae99-1d9c-47a2-a906-92ecd7446289 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:42.152291 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-88e3ae99-1d9c-47a2-a906-92ecd7446289 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:42.158613 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-88e3ae99-1d9c-47a2-a906-92ecd7446289 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:42.159106 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-88e3ae99-1d9c-47a2-a906-92ecd7446289 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:42.159571 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-88e3ae99-1d9c-47a2-a906-92ecd7446289 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:42.160263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-88e3ae99-1d9c-47a2-a906-92ecd7446289 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:42.160716 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-88e3ae99-1d9c-47a2-a906-92ecd7446289 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:42.161141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-88e3ae99-1d9c-47a2-a906-92ecd7446289 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:42.180454 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a8436ebb-67a4-40e6-8343-19a0e2793150 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:42.182573 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a8436ebb-67a4-40e6-8343-19a0e2793150 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:42.188887 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a8436ebb-67a4-40e6-8343-19a0e2793150 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:42.189372 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a8436ebb-67a4-40e6-8343-19a0e2793150 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:42.189804 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a8436ebb-67a4-40e6-8343-19a0e2793150 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:42.190497 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a8436ebb-67a4-40e6-8343-19a0e2793150 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:42.190944 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a8436ebb-67a4-40e6-8343-19a0e2793150 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:42.191389 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a8436ebb-67a4-40e6-8343-19a0e2793150 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:42.196412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-88e3ae99-1d9c-47a2-a906-92ecd7446289 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049858 Aug 10 12:48:42.196990 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 518/1042] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:42 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:42.219559 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a8436ebb-67a4-40e6-8343-19a0e2793150 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043590 Aug 10 12:48:42.220101 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 525/1043] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:42 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:48:42.255030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a70f94ca-e2f3-4e9a-83ee-d26db0f55242 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:42.257200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a70f94ca-e2f3-4e9a-83ee-d26db0f55242 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:42.263472 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a70f94ca-e2f3-4e9a-83ee-d26db0f55242 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:42.263959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a70f94ca-e2f3-4e9a-83ee-d26db0f55242 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:42.264399 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a70f94ca-e2f3-4e9a-83ee-d26db0f55242 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:42.265097 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a70f94ca-e2f3-4e9a-83ee-d26db0f55242 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:42.265551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a70f94ca-e2f3-4e9a-83ee-d26db0f55242 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:42.265979 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a70f94ca-e2f3-4e9a-83ee-d26db0f55242 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:42.295434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a70f94ca-e2f3-4e9a-83ee-d26db0f55242 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044258 Aug 10 12:48:42.295998 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 519/1044] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:42 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:43.207982 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-cf23b1e6-18b5-473f-90e5-95de87722e97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:43.210068 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-cf23b1e6-18b5-473f-90e5-95de87722e97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:43.218028 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf23b1e6-18b5-473f-90e5-95de87722e97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:43.218510 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf23b1e6-18b5-473f-90e5-95de87722e97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:43.219032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf23b1e6-18b5-473f-90e5-95de87722e97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:43.219667 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf23b1e6-18b5-473f-90e5-95de87722e97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:43.220117 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf23b1e6-18b5-473f-90e5-95de87722e97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:43.220536 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf23b1e6-18b5-473f-90e5-95de87722e97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:43.231486 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6516d7f3-d8b1-4699-b1af-7a982e65b723 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:43.233712 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6516d7f3-d8b1-4699-b1af-7a982e65b723 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:43.239735 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6516d7f3-d8b1-4699-b1af-7a982e65b723 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:43.240223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6516d7f3-d8b1-4699-b1af-7a982e65b723 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:43.240661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6516d7f3-d8b1-4699-b1af-7a982e65b723 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:43.241364 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6516d7f3-d8b1-4699-b1af-7a982e65b723 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:43.241813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6516d7f3-d8b1-4699-b1af-7a982e65b723 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:43.242925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6516d7f3-d8b1-4699-b1af-7a982e65b723 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:43.251718 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-cf23b1e6-18b5-473f-90e5-95de87722e97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047436 Aug 10 12:48:43.252448 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 526/1045] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:43 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:43.272848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6516d7f3-d8b1-4699-b1af-7a982e65b723 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045398 Aug 10 12:48:43.273407 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 520/1046] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:43 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:48:43.307380 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a407fd6e-74d9-4dd8-8e4e-9f15254eb85e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:43.309589 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a407fd6e-74d9-4dd8-8e4e-9f15254eb85e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:43.315451 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a407fd6e-74d9-4dd8-8e4e-9f15254eb85e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:43.315935 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a407fd6e-74d9-4dd8-8e4e-9f15254eb85e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:43.316368 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a407fd6e-74d9-4dd8-8e4e-9f15254eb85e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:43.317052 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a407fd6e-74d9-4dd8-8e4e-9f15254eb85e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:43.317499 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a407fd6e-74d9-4dd8-8e4e-9f15254eb85e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:43.317919 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a407fd6e-74d9-4dd8-8e4e-9f15254eb85e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:43.346107 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a407fd6e-74d9-4dd8-8e4e-9f15254eb85e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043403 Aug 10 12:48:43.346653 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 527/1047] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:43 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:44.271911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-45f1fb5f-4499-455a-85db-014d9c99c1dc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:44.271911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-45f1fb5f-4499-455a-85db-014d9c99c1dc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:44.280163 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-45f1fb5f-4499-455a-85db-014d9c99c1dc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:44.280163 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-45f1fb5f-4499-455a-85db-014d9c99c1dc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:44.280163 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-45f1fb5f-4499-455a-85db-014d9c99c1dc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:44.284033 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-45f1fb5f-4499-455a-85db-014d9c99c1dc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:44.284665 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-45f1fb5f-4499-455a-85db-014d9c99c1dc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:44.285108 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-45f1fb5f-4499-455a-85db-014d9c99c1dc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:44.290370 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5c6a0101-2ba4-4307-9bcb-18e321ab778f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:44.290370 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5c6a0101-2ba4-4307-9bcb-18e321ab778f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:44.295815 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c6a0101-2ba4-4307-9bcb-18e321ab778f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:44.296293 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c6a0101-2ba4-4307-9bcb-18e321ab778f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:44.296728 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c6a0101-2ba4-4307-9bcb-18e321ab778f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:44.297435 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c6a0101-2ba4-4307-9bcb-18e321ab778f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:44.297893 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c6a0101-2ba4-4307-9bcb-18e321ab778f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:44.298296 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c6a0101-2ba4-4307-9bcb-18e321ab778f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:44.318101 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-45f1fb5f-4499-455a-85db-014d9c99c1dc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053264 Aug 10 12:48:44.318664 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 521/1048] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:44 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:44.329051 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5c6a0101-2ba4-4307-9bcb-18e321ab778f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047700 Aug 10 12:48:44.329615 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 528/1049] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:44 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:44.358723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9ba7e458-a5ed-4a8a-8bb1-66c78fbaca9c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:44.360858 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9ba7e458-a5ed-4a8a-8bb1-66c78fbaca9c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:44.366707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ba7e458-a5ed-4a8a-8bb1-66c78fbaca9c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:44.367826 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ba7e458-a5ed-4a8a-8bb1-66c78fbaca9c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:44.368401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ba7e458-a5ed-4a8a-8bb1-66c78fbaca9c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:44.369144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ba7e458-a5ed-4a8a-8bb1-66c78fbaca9c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:44.369590 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ba7e458-a5ed-4a8a-8bb1-66c78fbaca9c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:44.370009 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ba7e458-a5ed-4a8a-8bb1-66c78fbaca9c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:44.398502 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9ba7e458-a5ed-4a8a-8bb1-66c78fbaca9c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043906 Aug 10 12:48:44.399049 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 522/1050] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:44 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:45.331198 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-496ceead-2015-42c6-b868-a8554a3cb902 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:45.333328 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-496ceead-2015-42c6-b868-a8554a3cb902 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:45.341091 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-496ceead-2015-42c6-b868-a8554a3cb902 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:45.342000 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-496ceead-2015-42c6-b868-a8554a3cb902 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:45.342440 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-496ceead-2015-42c6-b868-a8554a3cb902 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:45.343145 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-496ceead-2015-42c6-b868-a8554a3cb902 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:45.343625 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-496ceead-2015-42c6-b868-a8554a3cb902 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:45.344049 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-496ceead-2015-42c6-b868-a8554a3cb902 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:45.347133 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6b447ae3-2c84-4c98-8ad9-9f272ac9e686 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:45.349422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6b447ae3-2c84-4c98-8ad9-9f272ac9e686 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:45.356466 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b447ae3-2c84-4c98-8ad9-9f272ac9e686 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:45.356892 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b447ae3-2c84-4c98-8ad9-9f272ac9e686 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:45.357760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b447ae3-2c84-4c98-8ad9-9f272ac9e686 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:45.358519 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:48:45.358986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b447ae3-2c84-4c98-8ad9-9f272ac9e686 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:45.359681 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b447ae3-2c84-4c98-8ad9-9f272ac9e686 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:45.360285 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b447ae3-2c84-4c98-8ad9-9f272ac9e686 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:45.374755 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-496ceead-2015-42c6-b868-a8554a3cb902 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047428 Aug 10 12:48:45.375351 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 529/1051] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:45 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:45.390043 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6b447ae3-2c84-4c98-8ad9-9f272ac9e686 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047072 Aug 10 12:48:45.391429 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 523/1052] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:45 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:48:45.411826 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e26b4a54-df9d-4325-a7aa-91d90b4b2c6c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:45.413933 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e26b4a54-df9d-4325-a7aa-91d90b4b2c6c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:45.420070 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e26b4a54-df9d-4325-a7aa-91d90b4b2c6c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:45.420549 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e26b4a54-df9d-4325-a7aa-91d90b4b2c6c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:45.420988 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e26b4a54-df9d-4325-a7aa-91d90b4b2c6c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:45.421666 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e26b4a54-df9d-4325-a7aa-91d90b4b2c6c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:45.422117 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e26b4a54-df9d-4325-a7aa-91d90b4b2c6c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:45.422539 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e26b4a54-df9d-4325-a7aa-91d90b4b2c6c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:45.451452 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e26b4a54-df9d-4325-a7aa-91d90b4b2c6c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043885 Aug 10 12:48:45.452002 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 530/1053] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:45 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:48:46.386324 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b8dfcefd-968f-4741-8ee2-30f3f78c45ce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:46.389052 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b8dfcefd-968f-4741-8ee2-30f3f78c45ce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:46.395438 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8dfcefd-968f-4741-8ee2-30f3f78c45ce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:46.396148 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8dfcefd-968f-4741-8ee2-30f3f78c45ce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:46.397215 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8dfcefd-968f-4741-8ee2-30f3f78c45ce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:46.397926 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8dfcefd-968f-4741-8ee2-30f3f78c45ce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:46.398390 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8dfcefd-968f-4741-8ee2-30f3f78c45ce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:46.398820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8dfcefd-968f-4741-8ee2-30f3f78c45ce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:46.402889 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3fad78fe-1fb0-40e4-bfd4-3dd22fbee34b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:46.405538 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3fad78fe-1fb0-40e4-bfd4-3dd22fbee34b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:46.412041 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3fad78fe-1fb0-40e4-bfd4-3dd22fbee34b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:46.412594 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3fad78fe-1fb0-40e4-bfd4-3dd22fbee34b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:46.413029 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3fad78fe-1fb0-40e4-bfd4-3dd22fbee34b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:46.413903 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3fad78fe-1fb0-40e4-bfd4-3dd22fbee34b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:46.414356 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3fad78fe-1fb0-40e4-bfd4-3dd22fbee34b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:46.414775 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3fad78fe-1fb0-40e4-bfd4-3dd22fbee34b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:46.429819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b8dfcefd-968f-4741-8ee2-30f3f78c45ce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047265 Aug 10 12:48:46.430422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 524/1054] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:46 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:46.464152 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bcdd9758-d5db-42ee-90b4-da9f43edf471 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:46.466387 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bcdd9758-d5db-42ee-90b4-da9f43edf471 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:46.472735 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bcdd9758-d5db-42ee-90b4-da9f43edf471 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:46.473229 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bcdd9758-d5db-42ee-90b4-da9f43edf471 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:46.473668 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bcdd9758-d5db-42ee-90b4-da9f43edf471 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:46.474382 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bcdd9758-d5db-42ee-90b4-da9f43edf471 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:46.474839 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bcdd9758-d5db-42ee-90b4-da9f43edf471 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:46.475303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bcdd9758-d5db-42ee-90b4-da9f43edf471 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:46.509827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bcdd9758-d5db-42ee-90b4-da9f43edf471 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048979 Aug 10 12:48:46.517617 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 525/1055] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:46 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:48:46.595492 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3fad78fe-1fb0-40e4-bfd4-3dd22fbee34b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.197171 Aug 10 12:48:46.595983 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 531/1056] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:46 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:47.442359 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-decd8b6b-1cc1-4d68-b1dc-a6900a4605a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:47.444524 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-decd8b6b-1cc1-4d68-b1dc-a6900a4605a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:47.452024 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-decd8b6b-1cc1-4d68-b1dc-a6900a4605a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:47.452449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-decd8b6b-1cc1-4d68-b1dc-a6900a4605a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:47.452888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-decd8b6b-1cc1-4d68-b1dc-a6900a4605a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:47.453589 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-decd8b6b-1cc1-4d68-b1dc-a6900a4605a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:47.454044 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-decd8b6b-1cc1-4d68-b1dc-a6900a4605a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:47.454471 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-decd8b6b-1cc1-4d68-b1dc-a6900a4605a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:47.485465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-decd8b6b-1cc1-4d68-b1dc-a6900a4605a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046991 Aug 10 12:48:47.486021 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 526/1057] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:47 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:47.528654 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f07db5de-90cd-41c8-8508-599c89a6a06f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:47.530748 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f07db5de-90cd-41c8-8508-599c89a6a06f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:47.537132 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f07db5de-90cd-41c8-8508-599c89a6a06f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:47.537568 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f07db5de-90cd-41c8-8508-599c89a6a06f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:47.538007 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f07db5de-90cd-41c8-8508-599c89a6a06f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:47.538697 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f07db5de-90cd-41c8-8508-599c89a6a06f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:47.539153 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f07db5de-90cd-41c8-8508-599c89a6a06f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:47.539608 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f07db5de-90cd-41c8-8508-599c89a6a06f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:47.567526 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f07db5de-90cd-41c8-8508-599c89a6a06f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043397 Aug 10 12:48:47.568076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 532/1058] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:47 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:47.608121 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d841f244-d1e5-46f1-b45d-a0991f4a1429 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:47.610276 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d841f244-d1e5-46f1-b45d-a0991f4a1429 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:47.616155 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d841f244-d1e5-46f1-b45d-a0991f4a1429 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:47.616635 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d841f244-d1e5-46f1-b45d-a0991f4a1429 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:47.617068 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d841f244-d1e5-46f1-b45d-a0991f4a1429 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:47.617750 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d841f244-d1e5-46f1-b45d-a0991f4a1429 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:47.618228 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d841f244-d1e5-46f1-b45d-a0991f4a1429 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:47.618890 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d841f244-d1e5-46f1-b45d-a0991f4a1429 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:47.649374 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d841f244-d1e5-46f1-b45d-a0991f4a1429 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045472 Aug 10 12:48:47.650533 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 527/1059] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:47 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:48.497951 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fae25069-b045-4d6c-972d-e1b8e6baaf69 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:48.500130 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fae25069-b045-4d6c-972d-e1b8e6baaf69 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:48.505976 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fae25069-b045-4d6c-972d-e1b8e6baaf69 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:48.506454 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fae25069-b045-4d6c-972d-e1b8e6baaf69 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:48.506885 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fae25069-b045-4d6c-972d-e1b8e6baaf69 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:48.507602 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fae25069-b045-4d6c-972d-e1b8e6baaf69 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:48.508049 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fae25069-b045-4d6c-972d-e1b8e6baaf69 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:48.508569 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fae25069-b045-4d6c-972d-e1b8e6baaf69 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:48.538075 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fae25069-b045-4d6c-972d-e1b8e6baaf69 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043901 Aug 10 12:48:48.538654 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 533/1060] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:48 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:48.580230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d8784fe4-e59e-4338-ab85-80d84268614f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:48.582410 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d8784fe4-e59e-4338-ab85-80d84268614f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:48.588630 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d8784fe4-e59e-4338-ab85-80d84268614f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:48.589109 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d8784fe4-e59e-4338-ab85-80d84268614f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:48.589545 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d8784fe4-e59e-4338-ab85-80d84268614f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:48.590230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d8784fe4-e59e-4338-ab85-80d84268614f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:48.590680 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d8784fe4-e59e-4338-ab85-80d84268614f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:48.591107 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d8784fe4-e59e-4338-ab85-80d84268614f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:48.619915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d8784fe4-e59e-4338-ab85-80d84268614f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043629 Aug 10 12:48:48.620460 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 528/1061] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:48 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:48.662222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-72e4cf90-bde9-4482-80b2-de05a97c7ec8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:48.664332 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-72e4cf90-bde9-4482-80b2-de05a97c7ec8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:48.670390 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72e4cf90-bde9-4482-80b2-de05a97c7ec8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:48.670863 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72e4cf90-bde9-4482-80b2-de05a97c7ec8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:48.671324 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72e4cf90-bde9-4482-80b2-de05a97c7ec8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:48.672011 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72e4cf90-bde9-4482-80b2-de05a97c7ec8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:48.672455 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72e4cf90-bde9-4482-80b2-de05a97c7ec8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:48.672873 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72e4cf90-bde9-4482-80b2-de05a97c7ec8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:48.702176 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-72e4cf90-bde9-4482-80b2-de05a97c7ec8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043869 Aug 10 12:48:48.702725 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 534/1062] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:48 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:49.560342 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-484aa232-786f-4114-978d-7f5cf633dac3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:49.562755 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-484aa232-786f-4114-978d-7f5cf633dac3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:49.568787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-484aa232-786f-4114-978d-7f5cf633dac3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:49.569633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-484aa232-786f-4114-978d-7f5cf633dac3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:49.570075 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-484aa232-786f-4114-978d-7f5cf633dac3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:49.570771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-484aa232-786f-4114-978d-7f5cf633dac3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:49.571287 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-484aa232-786f-4114-978d-7f5cf633dac3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:49.572289 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-484aa232-786f-4114-978d-7f5cf633dac3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:49.602120 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-484aa232-786f-4114-978d-7f5cf633dac3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046294 Aug 10 12:48:49.603856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 529/1063] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:49 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:49.631962 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d24fe2f9-1fbd-4170-bee9-3365c659018f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:49.634752 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d24fe2f9-1fbd-4170-bee9-3365c659018f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:49.641261 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d24fe2f9-1fbd-4170-bee9-3365c659018f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:49.641750 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d24fe2f9-1fbd-4170-bee9-3365c659018f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:49.642189 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d24fe2f9-1fbd-4170-bee9-3365c659018f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:49.642883 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d24fe2f9-1fbd-4170-bee9-3365c659018f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:49.643377 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d24fe2f9-1fbd-4170-bee9-3365c659018f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:49.645805 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d24fe2f9-1fbd-4170-bee9-3365c659018f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:49.673015 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d24fe2f9-1fbd-4170-bee9-3365c659018f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044994 Aug 10 12:48:49.673571 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 535/1064] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:49 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:49.715053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-83493734-8076-44b2-b197-9cd2b81253a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:49.717246 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-83493734-8076-44b2-b197-9cd2b81253a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:49.723157 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83493734-8076-44b2-b197-9cd2b81253a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:49.723689 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83493734-8076-44b2-b197-9cd2b81253a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:49.724131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83493734-8076-44b2-b197-9cd2b81253a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:49.724821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83493734-8076-44b2-b197-9cd2b81253a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:49.725277 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83493734-8076-44b2-b197-9cd2b81253a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:49.725701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83493734-8076-44b2-b197-9cd2b81253a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:49.739587 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:48:49.754929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-83493734-8076-44b2-b197-9cd2b81253a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044901 Aug 10 12:48:49.755519 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 530/1065] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:49 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:50.615521 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a9efd422-fbd3-44a7-8159-9005cc728b23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:50.617646 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a9efd422-fbd3-44a7-8159-9005cc728b23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:50.624241 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a9efd422-fbd3-44a7-8159-9005cc728b23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:50.624715 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a9efd422-fbd3-44a7-8159-9005cc728b23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:50.625689 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a9efd422-fbd3-44a7-8159-9005cc728b23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:50.626395 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a9efd422-fbd3-44a7-8159-9005cc728b23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:50.626902 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a9efd422-fbd3-44a7-8159-9005cc728b23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:50.627361 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a9efd422-fbd3-44a7-8159-9005cc728b23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:50.661387 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a9efd422-fbd3-44a7-8159-9005cc728b23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049849 Aug 10 12:48:50.662029 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 536/1066] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:50 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:50.690085 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f35cc2bd-2591-4907-a3c2-fe7550462b50 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:50.692434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f35cc2bd-2591-4907-a3c2-fe7550462b50 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:50.700910 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f35cc2bd-2591-4907-a3c2-fe7550462b50 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:50.701393 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f35cc2bd-2591-4907-a3c2-fe7550462b50 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:50.701824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f35cc2bd-2591-4907-a3c2-fe7550462b50 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:50.702553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f35cc2bd-2591-4907-a3c2-fe7550462b50 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:50.703005 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f35cc2bd-2591-4907-a3c2-fe7550462b50 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:50.703454 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f35cc2bd-2591-4907-a3c2-fe7550462b50 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:50.735735 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f35cc2bd-2591-4907-a3c2-fe7550462b50 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049583 Aug 10 12:48:50.736303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 531/1067] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:50 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:50.767897 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-81275f8f-075c-4180-97a4-1427b893fccb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:50.770089 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-81275f8f-075c-4180-97a4-1427b893fccb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:50.776429 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-81275f8f-075c-4180-97a4-1427b893fccb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:50.777070 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-81275f8f-075c-4180-97a4-1427b893fccb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:50.777664 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-81275f8f-075c-4180-97a4-1427b893fccb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:50.778598 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-81275f8f-075c-4180-97a4-1427b893fccb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:50.779353 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-81275f8f-075c-4180-97a4-1427b893fccb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:50.779786 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-81275f8f-075c-4180-97a4-1427b893fccb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:50.810916 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-81275f8f-075c-4180-97a4-1427b893fccb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046929 Aug 10 12:48:50.811417 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 537/1068] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:50 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:51.673812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1fedc831-8c46-4d48-b284-2faa015aec48 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:51.676068 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1fedc831-8c46-4d48-b284-2faa015aec48 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:51.683089 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1fedc831-8c46-4d48-b284-2faa015aec48 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:51.683595 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1fedc831-8c46-4d48-b284-2faa015aec48 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:51.684022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1fedc831-8c46-4d48-b284-2faa015aec48 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:51.684706 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1fedc831-8c46-4d48-b284-2faa015aec48 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:51.685146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1fedc831-8c46-4d48-b284-2faa015aec48 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:51.685620 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1fedc831-8c46-4d48-b284-2faa015aec48 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:51.715689 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1fedc831-8c46-4d48-b284-2faa015aec48 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045833 Aug 10 12:48:51.716954 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 532/1069] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:51 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:51.748398 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-cf9e01be-29ed-4b77-8d09-8a3a1b111848 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:51.750528 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-cf9e01be-29ed-4b77-8d09-8a3a1b111848 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:51.756860 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf9e01be-29ed-4b77-8d09-8a3a1b111848 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:51.757341 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf9e01be-29ed-4b77-8d09-8a3a1b111848 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:51.757793 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf9e01be-29ed-4b77-8d09-8a3a1b111848 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:51.758460 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf9e01be-29ed-4b77-8d09-8a3a1b111848 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:51.759557 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf9e01be-29ed-4b77-8d09-8a3a1b111848 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:51.759983 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf9e01be-29ed-4b77-8d09-8a3a1b111848 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:51.787742 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-cf9e01be-29ed-4b77-8d09-8a3a1b111848 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043228 Aug 10 12:48:51.788275 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 538/1070] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:51 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:51.823583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fba95fb4-d1b8-4ed3-bd03-333448af4518 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:51.825701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fba95fb4-d1b8-4ed3-bd03-333448af4518 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:51.831824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fba95fb4-d1b8-4ed3-bd03-333448af4518 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:51.832422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fba95fb4-d1b8-4ed3-bd03-333448af4518 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:51.832861 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fba95fb4-d1b8-4ed3-bd03-333448af4518 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:51.833543 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fba95fb4-d1b8-4ed3-bd03-333448af4518 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:51.834096 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fba95fb4-d1b8-4ed3-bd03-333448af4518 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:51.834397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fba95fb4-d1b8-4ed3-bd03-333448af4518 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:51.864179 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fba95fb4-d1b8-4ed3-bd03-333448af4518 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045066 Aug 10 12:48:51.864728 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 533/1071] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:51 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:52.727966 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e1631a0c-6759-4441-a7e9-6a6726373041 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:52.730113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e1631a0c-6759-4441-a7e9-6a6726373041 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:52.736217 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1631a0c-6759-4441-a7e9-6a6726373041 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:52.736715 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1631a0c-6759-4441-a7e9-6a6726373041 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:52.737414 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1631a0c-6759-4441-a7e9-6a6726373041 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:52.737821 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1631a0c-6759-4441-a7e9-6a6726373041 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:52.738265 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1631a0c-6759-4441-a7e9-6a6726373041 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:52.738683 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1631a0c-6759-4441-a7e9-6a6726373041 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:52.767648 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e1631a0c-6759-4441-a7e9-6a6726373041 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043764 Aug 10 12:48:52.768237 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 539/1072] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:52 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:52.799572 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f258f389-0e69-466a-9d1f-80ecb1296762 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:52.801698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f258f389-0e69-466a-9d1f-80ecb1296762 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:52.808407 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f258f389-0e69-466a-9d1f-80ecb1296762 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:52.808892 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f258f389-0e69-466a-9d1f-80ecb1296762 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:52.809329 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f258f389-0e69-466a-9d1f-80ecb1296762 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:52.810015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f258f389-0e69-466a-9d1f-80ecb1296762 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:52.810484 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f258f389-0e69-466a-9d1f-80ecb1296762 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:52.810897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f258f389-0e69-466a-9d1f-80ecb1296762 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:52.840708 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f258f389-0e69-466a-9d1f-80ecb1296762 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045083 Aug 10 12:48:52.841269 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 534/1073] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:52 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:52.877101 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-84a66a27-bd23-4bf4-9946-5b7f170ac354 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:52.879247 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-84a66a27-bd23-4bf4-9946-5b7f170ac354 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:52.885648 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-84a66a27-bd23-4bf4-9946-5b7f170ac354 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:52.886120 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-84a66a27-bd23-4bf4-9946-5b7f170ac354 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:52.886553 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-84a66a27-bd23-4bf4-9946-5b7f170ac354 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:52.887261 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-84a66a27-bd23-4bf4-9946-5b7f170ac354 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:52.887725 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-84a66a27-bd23-4bf4-9946-5b7f170ac354 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:52.888131 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-84a66a27-bd23-4bf4-9946-5b7f170ac354 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:52.916233 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-84a66a27-bd23-4bf4-9946-5b7f170ac354 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043099 Aug 10 12:48:52.916777 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 540/1074] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:52 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:53.779834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-eb16056c-a197-4269-b70f-ee51e0c8abfe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:53.781991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-eb16056c-a197-4269-b70f-ee51e0c8abfe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:53.788018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb16056c-a197-4269-b70f-ee51e0c8abfe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:53.788507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb16056c-a197-4269-b70f-ee51e0c8abfe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:53.788948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb16056c-a197-4269-b70f-ee51e0c8abfe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:53.789638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb16056c-a197-4269-b70f-ee51e0c8abfe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:53.790244 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb16056c-a197-4269-b70f-ee51e0c8abfe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:53.790685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb16056c-a197-4269-b70f-ee51e0c8abfe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:53.820067 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-eb16056c-a197-4269-b70f-ee51e0c8abfe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044131 Aug 10 12:48:53.820681 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 535/1075] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:53 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:53.853157 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-819c73b9-789a-4c48-8246-6506560aadfb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:53.855339 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-819c73b9-789a-4c48-8246-6506560aadfb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:53.861941 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-819c73b9-789a-4c48-8246-6506560aadfb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:53.862431 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-819c73b9-789a-4c48-8246-6506560aadfb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:53.862904 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-819c73b9-789a-4c48-8246-6506560aadfb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:53.863632 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-819c73b9-789a-4c48-8246-6506560aadfb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:53.864089 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-819c73b9-789a-4c48-8246-6506560aadfb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:53.864517 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-819c73b9-789a-4c48-8246-6506560aadfb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:53.893488 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-819c73b9-789a-4c48-8246-6506560aadfb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044487 Aug 10 12:48:53.894037 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 541/1076] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:53 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:53.928649 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-350c7e45-5e55-4784-b1b2-b2e6b9373cf7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:53.931327 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-350c7e45-5e55-4784-b1b2-b2e6b9373cf7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:53.937260 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-350c7e45-5e55-4784-b1b2-b2e6b9373cf7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:53.937740 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-350c7e45-5e55-4784-b1b2-b2e6b9373cf7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:53.938178 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-350c7e45-5e55-4784-b1b2-b2e6b9373cf7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:53.938866 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-350c7e45-5e55-4784-b1b2-b2e6b9373cf7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:53.939349 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-350c7e45-5e55-4784-b1b2-b2e6b9373cf7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:53.939777 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-350c7e45-5e55-4784-b1b2-b2e6b9373cf7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:53.968600 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-350c7e45-5e55-4784-b1b2-b2e6b9373cf7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043806 Aug 10 12:48:53.969093 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 536/1077] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:53 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:54.832714 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7b53b9e9-95a1-4703-b5f0-1a331382186b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:54.834872 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7b53b9e9-95a1-4703-b5f0-1a331382186b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:54.841736 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7b53b9e9-95a1-4703-b5f0-1a331382186b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:54.842217 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7b53b9e9-95a1-4703-b5f0-1a331382186b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:54.842653 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7b53b9e9-95a1-4703-b5f0-1a331382186b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:54.843387 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7b53b9e9-95a1-4703-b5f0-1a331382186b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:54.843838 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7b53b9e9-95a1-4703-b5f0-1a331382186b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:54.844257 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7b53b9e9-95a1-4703-b5f0-1a331382186b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:54.874587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7b53b9e9-95a1-4703-b5f0-1a331382186b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045777 Aug 10 12:48:54.875264 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 542/1078] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:54 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:54.905742 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f529e96d-9848-4888-8eff-03d829737010 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:54.907962 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f529e96d-9848-4888-8eff-03d829737010 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:54.914235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f529e96d-9848-4888-8eff-03d829737010 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:54.914709 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f529e96d-9848-4888-8eff-03d829737010 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:54.915480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f529e96d-9848-4888-8eff-03d829737010 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:54.916172 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f529e96d-9848-4888-8eff-03d829737010 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:54.916623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f529e96d-9848-4888-8eff-03d829737010 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:54.917043 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f529e96d-9848-4888-8eff-03d829737010 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:54.945974 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f529e96d-9848-4888-8eff-03d829737010 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044265 Aug 10 12:48:54.947314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 537/1079] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:54 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:54.981665 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-871f263a-fff7-46e1-bc86-9f9144c692f8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:54.984082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-871f263a-fff7-46e1-bc86-9f9144c692f8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:54.989995 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-871f263a-fff7-46e1-bc86-9f9144c692f8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:54.990468 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-871f263a-fff7-46e1-bc86-9f9144c692f8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:54.990898 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-871f263a-fff7-46e1-bc86-9f9144c692f8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:54.991617 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-871f263a-fff7-46e1-bc86-9f9144c692f8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:54.992066 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-871f263a-fff7-46e1-bc86-9f9144c692f8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:54.992525 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-871f263a-fff7-46e1-bc86-9f9144c692f8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:55.021150 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-871f263a-fff7-46e1-bc86-9f9144c692f8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044390 Aug 10 12:48:55.021690 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 543/1080] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:54 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:55.886127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-01625991-d63b-4391-96b2-9c11c4a0cf66 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:55.888312 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-01625991-d63b-4391-96b2-9c11c4a0cf66 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:55.890319 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=90 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:48:55.894938 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01625991-d63b-4391-96b2-9c11c4a0cf66 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:55.895454 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01625991-d63b-4391-96b2-9c11c4a0cf66 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:55.895896 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01625991-d63b-4391-96b2-9c11c4a0cf66 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:55.896806 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01625991-d63b-4391-96b2-9c11c4a0cf66 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:55.897133 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01625991-d63b-4391-96b2-9c11c4a0cf66 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:55.897555 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01625991-d63b-4391-96b2-9c11c4a0cf66 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:55.927334 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-01625991-d63b-4391-96b2-9c11c4a0cf66 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045342 Aug 10 12:48:55.927944 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 538/1081] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:55 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:55.958118 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-63d50089-b9be-4ddb-bf34-ce8cc8f01805 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:55.960338 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-63d50089-b9be-4ddb-bf34-ce8cc8f01805 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:55.967421 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63d50089-b9be-4ddb-bf34-ce8cc8f01805 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:55.967903 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63d50089-b9be-4ddb-bf34-ce8cc8f01805 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:55.968337 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63d50089-b9be-4ddb-bf34-ce8cc8f01805 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:55.969069 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63d50089-b9be-4ddb-bf34-ce8cc8f01805 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:55.969518 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63d50089-b9be-4ddb-bf34-ce8cc8f01805 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:55.969941 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63d50089-b9be-4ddb-bf34-ce8cc8f01805 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:55.999886 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-63d50089-b9be-4ddb-bf34-ce8cc8f01805 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045676 Aug 10 12:48:56.000531 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 544/1082] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:55 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:56.033344 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ef00e4ac-82a1-42f6-b4c4-6c00daf59cc3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:56.035485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ef00e4ac-82a1-42f6-b4c4-6c00daf59cc3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:56.042444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef00e4ac-82a1-42f6-b4c4-6c00daf59cc3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:56.042929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef00e4ac-82a1-42f6-b4c4-6c00daf59cc3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:56.043399 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef00e4ac-82a1-42f6-b4c4-6c00daf59cc3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:56.044092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef00e4ac-82a1-42f6-b4c4-6c00daf59cc3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:56.044545 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef00e4ac-82a1-42f6-b4c4-6c00daf59cc3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:56.044971 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef00e4ac-82a1-42f6-b4c4-6c00daf59cc3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:56.073644 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ef00e4ac-82a1-42f6-b4c4-6c00daf59cc3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044223 Aug 10 12:48:56.074206 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 539/1083] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:56 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:56.940643 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9b953d42-d02e-4358-9d55-602c23fb6d10 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:56.942832 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9b953d42-d02e-4358-9d55-602c23fb6d10 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:56.949388 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b953d42-d02e-4358-9d55-602c23fb6d10 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:56.949866 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b953d42-d02e-4358-9d55-602c23fb6d10 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:56.950297 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b953d42-d02e-4358-9d55-602c23fb6d10 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:56.951003 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b953d42-d02e-4358-9d55-602c23fb6d10 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:56.951482 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b953d42-d02e-4358-9d55-602c23fb6d10 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:56.951902 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b953d42-d02e-4358-9d55-602c23fb6d10 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:56.979770 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9b953d42-d02e-4358-9d55-602c23fb6d10 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043296 Aug 10 12:48:56.980386 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 545/1084] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:56 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:57.012472 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ea3a5c5c-9763-464b-91d6-4d3bb7a9bb85 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:57.014597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ea3a5c5c-9763-464b-91d6-4d3bb7a9bb85 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:57.020716 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ea3a5c5c-9763-464b-91d6-4d3bb7a9bb85 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:57.021192 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ea3a5c5c-9763-464b-91d6-4d3bb7a9bb85 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:57.021618 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ea3a5c5c-9763-464b-91d6-4d3bb7a9bb85 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:57.022299 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ea3a5c5c-9763-464b-91d6-4d3bb7a9bb85 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:57.022758 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ea3a5c5c-9763-464b-91d6-4d3bb7a9bb85 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:57.023158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ea3a5c5c-9763-464b-91d6-4d3bb7a9bb85 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:57.051622 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ea3a5c5c-9763-464b-91d6-4d3bb7a9bb85 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043482 Aug 10 12:48:57.052172 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 540/1085] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:57 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:57.085767 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c401f474-2aa4-40f9-8d38-49492e835e1d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:57.087958 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c401f474-2aa4-40f9-8d38-49492e835e1d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:57.093804 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c401f474-2aa4-40f9-8d38-49492e835e1d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:57.094284 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c401f474-2aa4-40f9-8d38-49492e835e1d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:57.094723 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c401f474-2aa4-40f9-8d38-49492e835e1d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:57.095441 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c401f474-2aa4-40f9-8d38-49492e835e1d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:57.095891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c401f474-2aa4-40f9-8d38-49492e835e1d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:57.096314 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c401f474-2aa4-40f9-8d38-49492e835e1d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:57.099808 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:48:57.125709 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c401f474-2aa4-40f9-8d38-49492e835e1d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043836 Aug 10 12:48:57.126257 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 546/1086] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:57 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:57.992188 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-abb44e88-a0df-4f99-a7f5-127842209112 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:57.995753 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-abb44e88-a0df-4f99-a7f5-127842209112 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:58.001479 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abb44e88-a0df-4f99-a7f5-127842209112 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:58.001940 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abb44e88-a0df-4f99-a7f5-127842209112 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:58.002345 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abb44e88-a0df-4f99-a7f5-127842209112 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:58.003034 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abb44e88-a0df-4f99-a7f5-127842209112 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:58.003505 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abb44e88-a0df-4f99-a7f5-127842209112 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:58.003928 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abb44e88-a0df-4f99-a7f5-127842209112 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:58.034631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-abb44e88-a0df-4f99-a7f5-127842209112 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046079 Aug 10 12:48:58.035194 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 541/1087] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:57 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:58.064384 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-cc811b81-40bc-4f5d-bf00-18c164b32f40 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:58.066496 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-cc811b81-40bc-4f5d-bf00-18c164b32f40 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:58.073339 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc811b81-40bc-4f5d-bf00-18c164b32f40 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:58.073817 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc811b81-40bc-4f5d-bf00-18c164b32f40 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:58.074275 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc811b81-40bc-4f5d-bf00-18c164b32f40 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:58.074967 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc811b81-40bc-4f5d-bf00-18c164b32f40 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:58.075442 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc811b81-40bc-4f5d-bf00-18c164b32f40 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:58.075868 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc811b81-40bc-4f5d-bf00-18c164b32f40 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:58.104264 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-cc811b81-40bc-4f5d-bf00-18c164b32f40 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043827 Aug 10 12:48:58.104809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 547/1088] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:58 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:58.137930 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-adfee897-74c6-47b4-b808-4f33b0279265 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:58.140078 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-adfee897-74c6-47b4-b808-4f33b0279265 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:58.145958 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-adfee897-74c6-47b4-b808-4f33b0279265 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:58.146436 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-adfee897-74c6-47b4-b808-4f33b0279265 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:58.146867 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-adfee897-74c6-47b4-b808-4f33b0279265 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:58.147582 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-adfee897-74c6-47b4-b808-4f33b0279265 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:58.148034 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-adfee897-74c6-47b4-b808-4f33b0279265 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:58.148457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-adfee897-74c6-47b4-b808-4f33b0279265 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:58.176829 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-adfee897-74c6-47b4-b808-4f33b0279265 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042949 Aug 10 12:48:58.177372 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 542/1089] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:58 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:48:59.046085 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5e9d75be-b500-4f74-8498-b6ace039bed9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:59.048295 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5e9d75be-b500-4f74-8498-b6ace039bed9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:59.054085 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e9d75be-b500-4f74-8498-b6ace039bed9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:59.054558 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e9d75be-b500-4f74-8498-b6ace039bed9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:59.054986 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e9d75be-b500-4f74-8498-b6ace039bed9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:59.056203 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e9d75be-b500-4f74-8498-b6ace039bed9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:59.056647 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e9d75be-b500-4f74-8498-b6ace039bed9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:59.057064 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e9d75be-b500-4f74-8498-b6ace039bed9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:59.086631 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5e9d75be-b500-4f74-8498-b6ace039bed9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044426 Aug 10 12:48:59.087757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 548/1090] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:59 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:59.116361 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-36b6ae20-8455-41c0-adf5-caee5b01dff2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:59.119457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-36b6ae20-8455-41c0-adf5-caee5b01dff2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:59.125916 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36b6ae20-8455-41c0-adf5-caee5b01dff2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:59.126391 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36b6ae20-8455-41c0-adf5-caee5b01dff2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:59.126822 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36b6ae20-8455-41c0-adf5-caee5b01dff2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:59.127545 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36b6ae20-8455-41c0-adf5-caee5b01dff2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:59.127986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36b6ae20-8455-41c0-adf5-caee5b01dff2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:59.128405 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36b6ae20-8455-41c0-adf5-caee5b01dff2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:59.157974 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-36b6ae20-8455-41c0-adf5-caee5b01dff2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045437 Aug 10 12:48:59.158516 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 543/1091] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:48:59 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:48:59.189826 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-029556a1-e922-450d-aad9-7bac57b1673b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:48:59.191998 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-029556a1-e922-450d-aad9-7bac57b1673b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:48:59.198652 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-029556a1-e922-450d-aad9-7bac57b1673b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:59.199132 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-029556a1-e922-450d-aad9-7bac57b1673b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:59.199598 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-029556a1-e922-450d-aad9-7bac57b1673b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:59.200281 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-029556a1-e922-450d-aad9-7bac57b1673b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:48:59.200732 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-029556a1-e922-450d-aad9-7bac57b1673b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:48:59.201156 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-029556a1-e922-450d-aad9-7bac57b1673b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:48:59.229347 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-029556a1-e922-450d-aad9-7bac57b1673b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043448 Aug 10 12:48:59.229882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 549/1092] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:48:59 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:00.098377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-86de74ab-a2d8-485f-96ea-20d0b3d55d3c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:00.100525 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-86de74ab-a2d8-485f-96ea-20d0b3d55d3c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:00.106476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-86de74ab-a2d8-485f-96ea-20d0b3d55d3c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:00.107225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-86de74ab-a2d8-485f-96ea-20d0b3d55d3c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:00.107661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-86de74ab-a2d8-485f-96ea-20d0b3d55d3c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:00.108344 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-86de74ab-a2d8-485f-96ea-20d0b3d55d3c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:00.108792 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-86de74ab-a2d8-485f-96ea-20d0b3d55d3c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:00.109211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-86de74ab-a2d8-485f-96ea-20d0b3d55d3c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:00.144751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-86de74ab-a2d8-485f-96ea-20d0b3d55d3c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050285 Aug 10 12:49:00.145565 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 544/1093] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:00 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:00.169813 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2f646f93-6148-457f-a711-5e73638a1a8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:00.171933 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2f646f93-6148-457f-a711-5e73638a1a8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:00.178071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2f646f93-6148-457f-a711-5e73638a1a8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:00.178548 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2f646f93-6148-457f-a711-5e73638a1a8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:00.178981 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2f646f93-6148-457f-a711-5e73638a1a8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:00.179688 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2f646f93-6148-457f-a711-5e73638a1a8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:00.180140 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2f646f93-6148-457f-a711-5e73638a1a8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:00.180704 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2f646f93-6148-457f-a711-5e73638a1a8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:00.208727 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2f646f93-6148-457f-a711-5e73638a1a8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042763 Aug 10 12:49:00.209264 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 550/1094] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:00 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:00.241792 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1dc1ac9d-af16-4820-a366-1c449f277cd8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:00.244234 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1dc1ac9d-af16-4820-a366-1c449f277cd8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:00.250235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1dc1ac9d-af16-4820-a366-1c449f277cd8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:00.250713 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1dc1ac9d-af16-4820-a366-1c449f277cd8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:00.251148 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1dc1ac9d-af16-4820-a366-1c449f277cd8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:00.251859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1dc1ac9d-af16-4820-a366-1c449f277cd8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:00.252314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1dc1ac9d-af16-4820-a366-1c449f277cd8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:00.252734 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1dc1ac9d-af16-4820-a366-1c449f277cd8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:00.282477 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1dc1ac9d-af16-4820-a366-1c449f277cd8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044584 Aug 10 12:49:00.283044 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 545/1095] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:00 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:01.156869 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-09f5f9e9-e916-4d6e-af78-3db9f2469217 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:01.159050 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-09f5f9e9-e916-4d6e-af78-3db9f2469217 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:01.165494 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09f5f9e9-e916-4d6e-af78-3db9f2469217 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:01.166091 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09f5f9e9-e916-4d6e-af78-3db9f2469217 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:01.166524 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09f5f9e9-e916-4d6e-af78-3db9f2469217 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:01.167234 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09f5f9e9-e916-4d6e-af78-3db9f2469217 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:01.167688 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09f5f9e9-e916-4d6e-af78-3db9f2469217 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:01.168112 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09f5f9e9-e916-4d6e-af78-3db9f2469217 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:01.198165 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-09f5f9e9-e916-4d6e-af78-3db9f2469217 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045180 Aug 10 12:49:01.202562 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 551/1096] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:01 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:01.221404 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-971368cf-b545-460a-9daa-b3003aad71a8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:01.223565 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-971368cf-b545-460a-9daa-b3003aad71a8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:01.230201 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-971368cf-b545-460a-9daa-b3003aad71a8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:01.230675 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-971368cf-b545-460a-9daa-b3003aad71a8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:01.231103 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-971368cf-b545-460a-9daa-b3003aad71a8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:01.232073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-971368cf-b545-460a-9daa-b3003aad71a8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:01.232517 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-971368cf-b545-460a-9daa-b3003aad71a8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:01.232936 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-971368cf-b545-460a-9daa-b3003aad71a8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:01.263014 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-971368cf-b545-460a-9daa-b3003aad71a8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045459 Aug 10 12:49:01.263599 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 546/1097] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:01 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:01.293954 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-cbd727c5-fe61-43f7-bfb5-5abf87997980 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:01.296108 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-cbd727c5-fe61-43f7-bfb5-5abf87997980 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:01.301976 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cbd727c5-fe61-43f7-bfb5-5abf87997980 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:01.302454 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cbd727c5-fe61-43f7-bfb5-5abf87997980 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:01.302889 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cbd727c5-fe61-43f7-bfb5-5abf87997980 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:01.303602 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cbd727c5-fe61-43f7-bfb5-5abf87997980 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:01.304058 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cbd727c5-fe61-43f7-bfb5-5abf87997980 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:01.304479 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cbd727c5-fe61-43f7-bfb5-5abf87997980 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:01.333050 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-cbd727c5-fe61-43f7-bfb5-5abf87997980 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043104 Aug 10 12:49:01.333587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 552/1098] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:01 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:02.209938 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ccbbd03d-a469-4812-8ade-5c771b96065b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:02.212590 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ccbbd03d-a469-4812-8ade-5c771b96065b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:02.218347 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ccbbd03d-a469-4812-8ade-5c771b96065b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:02.218827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ccbbd03d-a469-4812-8ade-5c771b96065b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:02.219293 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ccbbd03d-a469-4812-8ade-5c771b96065b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:02.219980 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ccbbd03d-a469-4812-8ade-5c771b96065b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:02.220428 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ccbbd03d-a469-4812-8ade-5c771b96065b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:02.220933 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ccbbd03d-a469-4812-8ade-5c771b96065b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:02.224531 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:49:02.276902 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-01afd672-7f16-461a-a87f-b7a06d85ed68 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:02.282095 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-01afd672-7f16-461a-a87f-b7a06d85ed68 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:02.288741 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01afd672-7f16-461a-a87f-b7a06d85ed68 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:02.289256 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01afd672-7f16-461a-a87f-b7a06d85ed68 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:02.289682 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01afd672-7f16-461a-a87f-b7a06d85ed68 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:02.290961 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01afd672-7f16-461a-a87f-b7a06d85ed68 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:02.291447 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01afd672-7f16-461a-a87f-b7a06d85ed68 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:02.291877 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01afd672-7f16-461a-a87f-b7a06d85ed68 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:02.323762 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-01afd672-7f16-461a-a87f-b7a06d85ed68 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052102 Aug 10 12:49:02.324348 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 553/1099] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:02 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:02.345751 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e1b793c4-7c45-4073-b4c5-2525eaf58e35 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:02.347951 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e1b793c4-7c45-4073-b4c5-2525eaf58e35 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:02.354323 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1b793c4-7c45-4073-b4c5-2525eaf58e35 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:02.354805 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1b793c4-7c45-4073-b4c5-2525eaf58e35 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:02.355274 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1b793c4-7c45-4073-b4c5-2525eaf58e35 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:02.355979 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1b793c4-7c45-4073-b4c5-2525eaf58e35 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:02.356430 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1b793c4-7c45-4073-b4c5-2525eaf58e35 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:02.357125 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1b793c4-7c45-4073-b4c5-2525eaf58e35 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:02.387766 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e1b793c4-7c45-4073-b4c5-2525eaf58e35 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046058 Aug 10 12:49:02.388535 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 554/1100] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:02 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:49:02.400998 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ccbbd03d-a469-4812-8ade-5c771b96065b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.194895 Aug 10 12:49:02.401550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 547/1101] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:02 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:03.336050 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-eda12ced-3d43-4abe-b87c-0b1b055a46b5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:03.338906 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-eda12ced-3d43-4abe-b87c-0b1b055a46b5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:03.345837 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eda12ced-3d43-4abe-b87c-0b1b055a46b5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:03.346327 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eda12ced-3d43-4abe-b87c-0b1b055a46b5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:03.346760 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eda12ced-3d43-4abe-b87c-0b1b055a46b5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:03.347501 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eda12ced-3d43-4abe-b87c-0b1b055a46b5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:03.347952 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eda12ced-3d43-4abe-b87c-0b1b055a46b5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:03.348394 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eda12ced-3d43-4abe-b87c-0b1b055a46b5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:03.381113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-eda12ced-3d43-4abe-b87c-0b1b055a46b5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048841 Aug 10 12:49:03.381912 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 555/1102] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:03 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:03.400804 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a87daa68-aeac-4274-9b3d-9ee56761e291 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:03.402992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a87daa68-aeac-4274-9b3d-9ee56761e291 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:03.410364 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a87daa68-aeac-4274-9b3d-9ee56761e291 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:03.410853 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a87daa68-aeac-4274-9b3d-9ee56761e291 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:03.411458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a87daa68-aeac-4274-9b3d-9ee56761e291 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:03.412183 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a87daa68-aeac-4274-9b3d-9ee56761e291 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:03.412638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a87daa68-aeac-4274-9b3d-9ee56761e291 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:03.413023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bc491574-2c8d-4f9a-b9bd-0c9e84fc47a4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:03.413129 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a87daa68-aeac-4274-9b3d-9ee56761e291 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:03.415116 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bc491574-2c8d-4f9a-b9bd-0c9e84fc47a4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:03.421641 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc491574-2c8d-4f9a-b9bd-0c9e84fc47a4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:03.422125 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc491574-2c8d-4f9a-b9bd-0c9e84fc47a4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:03.422560 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc491574-2c8d-4f9a-b9bd-0c9e84fc47a4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:03.423283 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc491574-2c8d-4f9a-b9bd-0c9e84fc47a4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:03.423733 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc491574-2c8d-4f9a-b9bd-0c9e84fc47a4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:03.424154 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc491574-2c8d-4f9a-b9bd-0c9e84fc47a4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:03.443577 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a87daa68-aeac-4274-9b3d-9ee56761e291 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047170 Aug 10 12:49:03.444131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 548/1103] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:03 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:03.454520 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bc491574-2c8d-4f9a-b9bd-0c9e84fc47a4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045294 Aug 10 12:49:03.455074 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 556/1104] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:03 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:49:04.393598 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9879e75f-bf11-449b-b14c-f30c669dcedb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:04.395761 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9879e75f-bf11-449b-b14c-f30c669dcedb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:04.405672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9879e75f-bf11-449b-b14c-f30c669dcedb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:04.405672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9879e75f-bf11-449b-b14c-f30c669dcedb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:04.405672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9879e75f-bf11-449b-b14c-f30c669dcedb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:04.405672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9879e75f-bf11-449b-b14c-f30c669dcedb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:04.406433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9879e75f-bf11-449b-b14c-f30c669dcedb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:04.406433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9879e75f-bf11-449b-b14c-f30c669dcedb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:04.434899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9879e75f-bf11-449b-b14c-f30c669dcedb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045280 Aug 10 12:49:04.435494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 549/1105] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:04 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:04.456048 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e43b5737-e1ab-46a4-bc69-c9c1a2fe52cc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:04.458155 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e43b5737-e1ab-46a4-bc69-c9c1a2fe52cc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:04.465131 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e43b5737-e1ab-46a4-bc69-c9c1a2fe52cc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:04.465601 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e43b5737-e1ab-46a4-bc69-c9c1a2fe52cc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:04.466028 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e43b5737-e1ab-46a4-bc69-c9c1a2fe52cc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:04.466712 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e43b5737-e1ab-46a4-bc69-c9c1a2fe52cc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:04.467160 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e43b5737-e1ab-46a4-bc69-c9c1a2fe52cc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:04.467304 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-aaee10e7-7bbf-4c91-971f-837d994dc41f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:04.467599 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e43b5737-e1ab-46a4-bc69-c9c1a2fe52cc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:04.469408 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-aaee10e7-7bbf-4c91-971f-837d994dc41f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:04.475110 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aaee10e7-7bbf-4c91-971f-837d994dc41f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:04.475616 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aaee10e7-7bbf-4c91-971f-837d994dc41f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:04.476047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aaee10e7-7bbf-4c91-971f-837d994dc41f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:04.476732 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aaee10e7-7bbf-4c91-971f-837d994dc41f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:04.477181 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aaee10e7-7bbf-4c91-971f-837d994dc41f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:04.477601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aaee10e7-7bbf-4c91-971f-837d994dc41f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:04.496344 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e43b5737-e1ab-46a4-bc69-c9c1a2fe52cc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044161 Aug 10 12:49:04.496901 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 557/1106] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:04 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:04.506205 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-aaee10e7-7bbf-4c91-971f-837d994dc41f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043267 Aug 10 12:49:04.506740 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 550/1107] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:04 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:49:05.447266 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8eca67ac-3e8a-4b73-8db6-6066f66d705e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:05.449431 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8eca67ac-3e8a-4b73-8db6-6066f66d705e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:05.455566 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8eca67ac-3e8a-4b73-8db6-6066f66d705e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:05.455984 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8eca67ac-3e8a-4b73-8db6-6066f66d705e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:05.456418 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8eca67ac-3e8a-4b73-8db6-6066f66d705e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:05.457110 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8eca67ac-3e8a-4b73-8db6-6066f66d705e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:05.457560 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8eca67ac-3e8a-4b73-8db6-6066f66d705e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:05.457982 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8eca67ac-3e8a-4b73-8db6-6066f66d705e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:05.487498 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8eca67ac-3e8a-4b73-8db6-6066f66d705e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044302 Aug 10 12:49:05.488049 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 558/1108] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:05 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:05.508712 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-704b7127-fa6a-4235-9a13-9c31941f7974 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:05.510875 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-704b7127-fa6a-4235-9a13-9c31941f7974 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:05.517276 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-704b7127-fa6a-4235-9a13-9c31941f7974 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:05.517746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-704b7127-fa6a-4235-9a13-9c31941f7974 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:05.518170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-704b7127-fa6a-4235-9a13-9c31941f7974 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:05.518690 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bf16e5f5-8d7c-463e-a550-66953987bb90 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:05.518850 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-704b7127-fa6a-4235-9a13-9c31941f7974 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:05.519316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-704b7127-fa6a-4235-9a13-9c31941f7974 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:05.519734 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-704b7127-fa6a-4235-9a13-9c31941f7974 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:05.520865 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bf16e5f5-8d7c-463e-a550-66953987bb90 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:05.527315 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf16e5f5-8d7c-463e-a550-66953987bb90 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:05.527802 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf16e5f5-8d7c-463e-a550-66953987bb90 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:05.528232 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf16e5f5-8d7c-463e-a550-66953987bb90 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:05.528924 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf16e5f5-8d7c-463e-a550-66953987bb90 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:05.529372 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf16e5f5-8d7c-463e-a550-66953987bb90 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:05.529791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf16e5f5-8d7c-463e-a550-66953987bb90 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:05.549824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-704b7127-fa6a-4235-9a13-9c31941f7974 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045026 Aug 10 12:49:05.550377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 551/1109] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:05 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:05.559187 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bf16e5f5-8d7c-463e-a550-66953987bb90 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044223 Aug 10 12:49:05.559769 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 559/1110] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:05 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:49:06.500212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c7f1893a-8ecf-477a-a60e-2983244c6de4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:06.505758 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c7f1893a-8ecf-477a-a60e-2983244c6de4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:06.512266 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7f1893a-8ecf-477a-a60e-2983244c6de4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:06.518844 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7f1893a-8ecf-477a-a60e-2983244c6de4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:06.518844 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7f1893a-8ecf-477a-a60e-2983244c6de4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:06.518844 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7f1893a-8ecf-477a-a60e-2983244c6de4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:06.518844 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7f1893a-8ecf-477a-a60e-2983244c6de4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:06.519346 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7f1893a-8ecf-477a-a60e-2983244c6de4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:06.547473 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c7f1893a-8ecf-477a-a60e-2983244c6de4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047606 Aug 10 12:49:06.547473 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 552/1111] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:06 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:06.562604 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1d6b1825-9976-4cdd-a127-c302186c6485 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:06.564828 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1d6b1825-9976-4cdd-a127-c302186c6485 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:06.571421 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-33863a7b-4bc6-4de4-8322-a4e9b11a04cc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:06.571911 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d6b1825-9976-4cdd-a127-c302186c6485 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:06.572472 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d6b1825-9976-4cdd-a127-c302186c6485 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:06.572932 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d6b1825-9976-4cdd-a127-c302186c6485 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:06.573568 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d6b1825-9976-4cdd-a127-c302186c6485 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:06.573685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-33863a7b-4bc6-4de4-8322-a4e9b11a04cc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:06.574016 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d6b1825-9976-4cdd-a127-c302186c6485 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:06.574437 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d6b1825-9976-4cdd-a127-c302186c6485 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:06.581092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-33863a7b-4bc6-4de4-8322-a4e9b11a04cc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:06.581581 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-33863a7b-4bc6-4de4-8322-a4e9b11a04cc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:06.582078 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-33863a7b-4bc6-4de4-8322-a4e9b11a04cc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:06.582894 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-33863a7b-4bc6-4de4-8322-a4e9b11a04cc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:06.583389 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-33863a7b-4bc6-4de4-8322-a4e9b11a04cc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:06.583814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-33863a7b-4bc6-4de4-8322-a4e9b11a04cc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:06.604321 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1d6b1825-9976-4cdd-a127-c302186c6485 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045634 Aug 10 12:49:06.609249 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 560/1112] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:06 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:06.616146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-33863a7b-4bc6-4de4-8322-a4e9b11a04cc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048642 Aug 10 12:49:06.616812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 553/1113] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:06 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:07.555928 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-50a38ff2-aa96-42e7-927b-bb4af076435d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:07.558528 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-50a38ff2-aa96-42e7-927b-bb4af076435d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:07.564458 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50a38ff2-aa96-42e7-927b-bb4af076435d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:07.565088 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50a38ff2-aa96-42e7-927b-bb4af076435d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:07.565344 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50a38ff2-aa96-42e7-927b-bb4af076435d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:07.566036 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50a38ff2-aa96-42e7-927b-bb4af076435d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:07.566488 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50a38ff2-aa96-42e7-927b-bb4af076435d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:07.566920 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50a38ff2-aa96-42e7-927b-bb4af076435d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:07.597362 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-50a38ff2-aa96-42e7-927b-bb4af076435d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045245 Aug 10 12:49:07.597915 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 561/1114] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:07 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:07.616718 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-97a360e2-4d2c-4ba4-a6c2-56686564fd0c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:07.619355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-97a360e2-4d2c-4ba4-a6c2-56686564fd0c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:07.626047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97a360e2-4d2c-4ba4-a6c2-56686564fd0c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:07.626513 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97a360e2-4d2c-4ba4-a6c2-56686564fd0c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:07.626943 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97a360e2-4d2c-4ba4-a6c2-56686564fd0c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:07.627658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97a360e2-4d2c-4ba4-a6c2-56686564fd0c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:07.628104 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97a360e2-4d2c-4ba4-a6c2-56686564fd0c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:07.628517 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97a360e2-4d2c-4ba4-a6c2-56686564fd0c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:07.629076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7bbfea27-25fc-404d-ab76-300917b9920d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:07.631281 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7bbfea27-25fc-404d-ab76-300917b9920d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:07.638068 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7bbfea27-25fc-404d-ab76-300917b9920d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:07.638611 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7bbfea27-25fc-404d-ab76-300917b9920d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:07.639053 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7bbfea27-25fc-404d-ab76-300917b9920d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:07.639784 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7bbfea27-25fc-404d-ab76-300917b9920d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:07.640239 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7bbfea27-25fc-404d-ab76-300917b9920d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:07.640665 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7bbfea27-25fc-404d-ab76-300917b9920d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:07.658810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-97a360e2-4d2c-4ba4-a6c2-56686564fd0c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046006 Aug 10 12:49:07.659379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 554/1115] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:07 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:07.665668 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:49:07.670382 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7bbfea27-25fc-404d-ab76-300917b9920d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045429 Aug 10 12:49:07.670935 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 562/1116] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:07 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:08.610399 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e4dd60d8-2552-4035-a2d6-1854b7dd676c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:08.612532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e4dd60d8-2552-4035-a2d6-1854b7dd676c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:08.618563 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e4dd60d8-2552-4035-a2d6-1854b7dd676c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:08.619168 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e4dd60d8-2552-4035-a2d6-1854b7dd676c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:08.619529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e4dd60d8-2552-4035-a2d6-1854b7dd676c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:08.620225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e4dd60d8-2552-4035-a2d6-1854b7dd676c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:08.620679 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e4dd60d8-2552-4035-a2d6-1854b7dd676c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:08.621106 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e4dd60d8-2552-4035-a2d6-1854b7dd676c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:08.649337 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e4dd60d8-2552-4035-a2d6-1854b7dd676c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043230 Aug 10 12:49:08.649883 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 555/1117] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:08 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:08.672172 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-406fa216-a0f9-407d-bf23-a4e574d87325 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:08.674278 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-406fa216-a0f9-407d-bf23-a4e574d87325 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:08.681038 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-406fa216-a0f9-407d-bf23-a4e574d87325 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:08.681616 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-406fa216-a0f9-407d-bf23-a4e574d87325 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:08.682049 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-406fa216-a0f9-407d-bf23-a4e574d87325 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:08.682735 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-406fa216-a0f9-407d-bf23-a4e574d87325 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:08.683195 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-406fa216-a0f9-407d-bf23-a4e574d87325 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:08.683620 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-406fa216-a0f9-407d-bf23-a4e574d87325 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:08.685332 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ca4c89ea-8fd9-4ed0-aab0-cb50ac96c668 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:08.687479 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ca4c89ea-8fd9-4ed0-aab0-cb50ac96c668 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:08.693267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ca4c89ea-8fd9-4ed0-aab0-cb50ac96c668 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:08.693748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ca4c89ea-8fd9-4ed0-aab0-cb50ac96c668 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:08.694177 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ca4c89ea-8fd9-4ed0-aab0-cb50ac96c668 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:08.694864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ca4c89ea-8fd9-4ed0-aab0-cb50ac96c668 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:08.695336 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ca4c89ea-8fd9-4ed0-aab0-cb50ac96c668 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:08.695759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ca4c89ea-8fd9-4ed0-aab0-cb50ac96c668 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:08.713790 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-406fa216-a0f9-407d-bf23-a4e574d87325 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044700 Aug 10 12:49:08.714425 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 563/1118] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:08 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:08.725043 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ca4c89ea-8fd9-4ed0-aab0-cb50ac96c668 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043936 Aug 10 12:49:08.725582 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 556/1119] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:08 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:49:09.661712 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-87dd46ce-9f66-427b-9060-033849c4f42d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:09.663862 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-87dd46ce-9f66-427b-9060-033849c4f42d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:09.668132 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=88 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:49:09.671508 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-87dd46ce-9f66-427b-9060-033849c4f42d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:09.671949 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-87dd46ce-9f66-427b-9060-033849c4f42d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:09.672379 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-87dd46ce-9f66-427b-9060-033849c4f42d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:09.673072 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-87dd46ce-9f66-427b-9060-033849c4f42d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:09.673516 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-87dd46ce-9f66-427b-9060-033849c4f42d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:09.673932 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-87dd46ce-9f66-427b-9060-033849c4f42d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:09.704757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-87dd46ce-9f66-427b-9060-033849c4f42d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046948 Aug 10 12:49:09.705310 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 564/1120] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:09 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:09.725907 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d3262958-7908-40f9-9e54-71d5f6d1843e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:09.728031 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d3262958-7908-40f9-9e54-71d5f6d1843e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:09.735665 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d3262958-7908-40f9-9e54-71d5f6d1843e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:09.736145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d3262958-7908-40f9-9e54-71d5f6d1843e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:09.736577 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d3262958-7908-40f9-9e54-71d5f6d1843e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:09.737266 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d3262958-7908-40f9-9e54-71d5f6d1843e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:09.737712 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d3262958-7908-40f9-9e54-71d5f6d1843e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:09.738104 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-45bc5bfd-6778-43a3-91bc-5f6fe704bbe5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:09.738217 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d3262958-7908-40f9-9e54-71d5f6d1843e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:09.740244 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-45bc5bfd-6778-43a3-91bc-5f6fe704bbe5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:09.747599 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-45bc5bfd-6778-43a3-91bc-5f6fe704bbe5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:09.748076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-45bc5bfd-6778-43a3-91bc-5f6fe704bbe5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:09.748506 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-45bc5bfd-6778-43a3-91bc-5f6fe704bbe5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:09.749193 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-45bc5bfd-6778-43a3-91bc-5f6fe704bbe5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:09.749636 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-45bc5bfd-6778-43a3-91bc-5f6fe704bbe5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:09.750053 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-45bc5bfd-6778-43a3-91bc-5f6fe704bbe5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:09.767740 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d3262958-7908-40f9-9e54-71d5f6d1843e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045711 Aug 10 12:49:09.768505 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 557/1121] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:09 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:09.783658 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-45bc5bfd-6778-43a3-91bc-5f6fe704bbe5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048925 Aug 10 12:49:09.784654 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 565/1122] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:09 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:49:10.716851 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8cd9d720-6f9a-4724-aad6-4d9390cdcb11 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:10.719006 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8cd9d720-6f9a-4724-aad6-4d9390cdcb11 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:10.725039 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8cd9d720-6f9a-4724-aad6-4d9390cdcb11 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:10.725528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8cd9d720-6f9a-4724-aad6-4d9390cdcb11 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:10.725989 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8cd9d720-6f9a-4724-aad6-4d9390cdcb11 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:10.726692 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8cd9d720-6f9a-4724-aad6-4d9390cdcb11 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:10.727149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8cd9d720-6f9a-4724-aad6-4d9390cdcb11 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:10.727675 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8cd9d720-6f9a-4724-aad6-4d9390cdcb11 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:10.757899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8cd9d720-6f9a-4724-aad6-4d9390cdcb11 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044943 Aug 10 12:49:10.758444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 558/1123] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:10 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:10.780781 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-441d08a5-9c88-4deb-889b-f002b738fed3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:10.782970 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-441d08a5-9c88-4deb-889b-f002b738fed3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:10.789195 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-441d08a5-9c88-4deb-889b-f002b738fed3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:10.791170 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-441d08a5-9c88-4deb-889b-f002b738fed3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:10.791170 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-441d08a5-9c88-4deb-889b-f002b738fed3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:10.791170 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-441d08a5-9c88-4deb-889b-f002b738fed3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:10.791949 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-441d08a5-9c88-4deb-889b-f002b738fed3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:10.792373 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-441d08a5-9c88-4deb-889b-f002b738fed3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:10.796296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-341a4de1-7cd9-4db8-80b2-43d58c3b3b08 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:10.798390 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-341a4de1-7cd9-4db8-80b2-43d58c3b3b08 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:10.804623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-341a4de1-7cd9-4db8-80b2-43d58c3b3b08 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:10.805101 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-341a4de1-7cd9-4db8-80b2-43d58c3b3b08 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:10.805543 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-341a4de1-7cd9-4db8-80b2-43d58c3b3b08 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:10.807103 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-341a4de1-7cd9-4db8-80b2-43d58c3b3b08 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:10.807681 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-341a4de1-7cd9-4db8-80b2-43d58c3b3b08 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:10.808136 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-341a4de1-7cd9-4db8-80b2-43d58c3b3b08 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:10.822733 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-441d08a5-9c88-4deb-889b-f002b738fed3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045305 Aug 10 12:49:10.823298 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 566/1124] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:10 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:10.837621 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-341a4de1-7cd9-4db8-80b2-43d58c3b3b08 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045032 Aug 10 12:49:10.838457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 559/1125] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:10 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:49:11.770354 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-96649d59-def4-43b6-bb3a-b1d22b61949d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:11.772570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-96649d59-def4-43b6-bb3a-b1d22b61949d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:11.779298 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-96649d59-def4-43b6-bb3a-b1d22b61949d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:11.779781 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-96649d59-def4-43b6-bb3a-b1d22b61949d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:11.780225 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-96649d59-def4-43b6-bb3a-b1d22b61949d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:11.780918 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-96649d59-def4-43b6-bb3a-b1d22b61949d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:11.781476 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-96649d59-def4-43b6-bb3a-b1d22b61949d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:11.781759 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-96649d59-def4-43b6-bb3a-b1d22b61949d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:11.812673 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-96649d59-def4-43b6-bb3a-b1d22b61949d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046626 Aug 10 12:49:11.813298 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 567/1126] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:11 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:49:11.835069 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-27e8db2e-1d86-4f90-9fc9-ed932a2ff8b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:11.837203 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-27e8db2e-1d86-4f90-9fc9-ed932a2ff8b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:11.844184 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27e8db2e-1d86-4f90-9fc9-ed932a2ff8b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:11.844835 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27e8db2e-1d86-4f90-9fc9-ed932a2ff8b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:11.845083 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27e8db2e-1d86-4f90-9fc9-ed932a2ff8b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:11.845760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27e8db2e-1d86-4f90-9fc9-ed932a2ff8b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:11.846202 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27e8db2e-1d86-4f90-9fc9-ed932a2ff8b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:11.846615 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27e8db2e-1d86-4f90-9fc9-ed932a2ff8b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:11.849818 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-953a2d95-83a8-44ea-ac2a-09cc765c99bd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:11.852267 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-953a2d95-83a8-44ea-ac2a-09cc765c99bd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:11.858395 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-953a2d95-83a8-44ea-ac2a-09cc765c99bd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:11.858876 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-953a2d95-83a8-44ea-ac2a-09cc765c99bd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:11.859336 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-953a2d95-83a8-44ea-ac2a-09cc765c99bd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:11.860030 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-953a2d95-83a8-44ea-ac2a-09cc765c99bd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:11.860479 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-953a2d95-83a8-44ea-ac2a-09cc765c99bd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:11.860902 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-953a2d95-83a8-44ea-ac2a-09cc765c99bd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:11.875491 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-27e8db2e-1d86-4f90-9fc9-ed932a2ff8b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044471 Aug 10 12:49:11.876045 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 560/1127] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:11 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:11.889951 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-953a2d95-83a8-44ea-ac2a-09cc765c99bd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043991 Aug 10 12:49:11.890502 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 568/1128] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:11 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:49:12.833495 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fdd85094-e743-44b2-a932-acaeea66351a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:12.835631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fdd85094-e743-44b2-a932-acaeea66351a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:12.842695 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdd85094-e743-44b2-a932-acaeea66351a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:12.843194 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdd85094-e743-44b2-a932-acaeea66351a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:12.843631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdd85094-e743-44b2-a932-acaeea66351a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:12.844313 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdd85094-e743-44b2-a932-acaeea66351a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:12.844755 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdd85094-e743-44b2-a932-acaeea66351a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:12.845173 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdd85094-e743-44b2-a932-acaeea66351a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:12.875052 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fdd85094-e743-44b2-a932-acaeea66351a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045459 Aug 10 12:49:12.875618 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 561/1129] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:12 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:12.886781 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1c82d8c3-83ad-4776-b1eb-55af1cad0eb0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:12.888943 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1c82d8c3-83ad-4776-b1eb-55af1cad0eb0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:12.895129 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c82d8c3-83ad-4776-b1eb-55af1cad0eb0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:12.895632 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c82d8c3-83ad-4776-b1eb-55af1cad0eb0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:12.896062 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c82d8c3-83ad-4776-b1eb-55af1cad0eb0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:12.896753 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c82d8c3-83ad-4776-b1eb-55af1cad0eb0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:12.897196 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c82d8c3-83ad-4776-b1eb-55af1cad0eb0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:12.897612 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c82d8c3-83ad-4776-b1eb-55af1cad0eb0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:12.902639 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6c3ade02-3556-4eee-b359-0626bda79253 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:12.904755 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6c3ade02-3556-4eee-b359-0626bda79253 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:12.910718 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6c3ade02-3556-4eee-b359-0626bda79253 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:12.911207 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6c3ade02-3556-4eee-b359-0626bda79253 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:12.911647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6c3ade02-3556-4eee-b359-0626bda79253 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:12.912330 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6c3ade02-3556-4eee-b359-0626bda79253 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:12.912771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6c3ade02-3556-4eee-b359-0626bda79253 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:12.913186 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6c3ade02-3556-4eee-b359-0626bda79253 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:12.927901 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1c82d8c3-83ad-4776-b1eb-55af1cad0eb0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045089 Aug 10 12:49:12.928470 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 569/1130] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:12 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:12.942556 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6c3ade02-3556-4eee-b359-0626bda79253 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044687 Aug 10 12:49:12.943093 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 562/1131] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:12 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:49:13.886856 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-48643f01-a4e8-44ef-9f97-fc577b50049b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:13.889002 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-48643f01-a4e8-44ef-9f97-fc577b50049b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:13.896871 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-48643f01-a4e8-44ef-9f97-fc577b50049b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:13.896871 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-48643f01-a4e8-44ef-9f97-fc577b50049b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:13.896871 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-48643f01-a4e8-44ef-9f97-fc577b50049b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:13.896871 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-48643f01-a4e8-44ef-9f97-fc577b50049b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:13.897240 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-48643f01-a4e8-44ef-9f97-fc577b50049b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:13.897471 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-48643f01-a4e8-44ef-9f97-fc577b50049b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:13.927914 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-48643f01-a4e8-44ef-9f97-fc577b50049b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044928 Aug 10 12:49:13.928467 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 570/1132] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:13 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:13.940338 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e0763538-2445-451a-a9c8-c922af3f870c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:13.942528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e0763538-2445-451a-a9c8-c922af3f870c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:13.949741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0763538-2445-451a-a9c8-c922af3f870c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:13.950222 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0763538-2445-451a-a9c8-c922af3f870c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:13.950660 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0763538-2445-451a-a9c8-c922af3f870c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:13.951375 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0763538-2445-451a-a9c8-c922af3f870c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:13.951821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0763538-2445-451a-a9c8-c922af3f870c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:13.952236 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0763538-2445-451a-a9c8-c922af3f870c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:13.954559 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bc315bf1-a336-42bf-938a-02ead2e36e09 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:13.956755 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bc315bf1-a336-42bf-938a-02ead2e36e09 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:13.962432 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc315bf1-a336-42bf-938a-02ead2e36e09 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:13.963569 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc315bf1-a336-42bf-938a-02ead2e36e09 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:13.963996 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc315bf1-a336-42bf-938a-02ead2e36e09 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:13.964689 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc315bf1-a336-42bf-938a-02ead2e36e09 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:13.965134 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc315bf1-a336-42bf-938a-02ead2e36e09 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:13.965553 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc315bf1-a336-42bf-938a-02ead2e36e09 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:13.977278 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:49:13.982132 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e0763538-2445-451a-a9c8-c922af3f870c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045499 Aug 10 12:49:13.982697 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 563/1133] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:13 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:13.994679 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bc315bf1-a336-42bf-938a-02ead2e36e09 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043930 Aug 10 12:49:13.995273 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 571/1134] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:13 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:49:14.940814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-de0e29ed-74ad-47c8-9803-80201d23ce3b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:14.942977 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-de0e29ed-74ad-47c8-9803-80201d23ce3b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:14.949190 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-de0e29ed-74ad-47c8-9803-80201d23ce3b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:14.949664 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-de0e29ed-74ad-47c8-9803-80201d23ce3b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:14.950093 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-de0e29ed-74ad-47c8-9803-80201d23ce3b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:14.950774 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-de0e29ed-74ad-47c8-9803-80201d23ce3b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:14.951346 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-de0e29ed-74ad-47c8-9803-80201d23ce3b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:14.951643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-de0e29ed-74ad-47c8-9803-80201d23ce3b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:14.981413 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-de0e29ed-74ad-47c8-9803-80201d23ce3b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045260 Aug 10 12:49:14.982202 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 564/1135] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:14 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:14.998986 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1817a11c-a19d-4b94-b382-fd53df2562da tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:15.001492 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1817a11c-a19d-4b94-b382-fd53df2562da tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:15.005965 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b1639f60-53f2-465b-87c6-a3e9ff15bc4c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:15.007852 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1817a11c-a19d-4b94-b382-fd53df2562da tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:15.008132 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b1639f60-53f2-465b-87c6-a3e9ff15bc4c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:15.008330 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1817a11c-a19d-4b94-b382-fd53df2562da tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:15.008766 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1817a11c-a19d-4b94-b382-fd53df2562da tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:15.009458 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1817a11c-a19d-4b94-b382-fd53df2562da tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:15.009909 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1817a11c-a19d-4b94-b382-fd53df2562da tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:15.010334 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1817a11c-a19d-4b94-b382-fd53df2562da tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:15.015215 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1639f60-53f2-465b-87c6-a3e9ff15bc4c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:15.015215 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1639f60-53f2-465b-87c6-a3e9ff15bc4c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:15.015215 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1639f60-53f2-465b-87c6-a3e9ff15bc4c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:15.015699 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1639f60-53f2-465b-87c6-a3e9ff15bc4c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:15.016139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1639f60-53f2-465b-87c6-a3e9ff15bc4c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:15.016555 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1639f60-53f2-465b-87c6-a3e9ff15bc4c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:15.039436 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1817a11c-a19d-4b94-b382-fd53df2562da tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045442 Aug 10 12:49:15.040006 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 572/1136] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:14 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:15.046633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b1639f60-53f2-465b-87c6-a3e9ff15bc4c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044410 Aug 10 12:49:15.047199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 565/1137] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:15 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:49:16.000916 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5e91a8a7-50f4-4e42-a888-71c97eb66c70 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:16.003097 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5e91a8a7-50f4-4e42-a888-71c97eb66c70 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:16.009818 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e91a8a7-50f4-4e42-a888-71c97eb66c70 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:16.010541 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e91a8a7-50f4-4e42-a888-71c97eb66c70 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:16.011029 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e91a8a7-50f4-4e42-a888-71c97eb66c70 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:16.011754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e91a8a7-50f4-4e42-a888-71c97eb66c70 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:16.012203 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e91a8a7-50f4-4e42-a888-71c97eb66c70 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:16.012627 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5e91a8a7-50f4-4e42-a888-71c97eb66c70 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:16.043074 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5e91a8a7-50f4-4e42-a888-71c97eb66c70 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045433 Aug 10 12:49:16.043650 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 573/1138] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:15 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:49:16.051916 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9725a512-0733-46b3-9997-f65e92379220 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:16.054046 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9725a512-0733-46b3-9997-f65e92379220 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:16.057432 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c2a6a27c-fbfd-49ac-b044-d50f687b1d4b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:16.059573 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c2a6a27c-fbfd-49ac-b044-d50f687b1d4b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:16.060869 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9725a512-0733-46b3-9997-f65e92379220 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:16.061360 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9725a512-0733-46b3-9997-f65e92379220 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:16.061798 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9725a512-0733-46b3-9997-f65e92379220 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:16.062492 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9725a512-0733-46b3-9997-f65e92379220 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:16.062942 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9725a512-0733-46b3-9997-f65e92379220 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:16.063400 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9725a512-0733-46b3-9997-f65e92379220 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:16.065421 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c2a6a27c-fbfd-49ac-b044-d50f687b1d4b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:16.065898 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c2a6a27c-fbfd-49ac-b044-d50f687b1d4b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:16.066322 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c2a6a27c-fbfd-49ac-b044-d50f687b1d4b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:16.067036 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c2a6a27c-fbfd-49ac-b044-d50f687b1d4b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:16.067505 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c2a6a27c-fbfd-49ac-b044-d50f687b1d4b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:16.067935 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c2a6a27c-fbfd-49ac-b044-d50f687b1d4b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:16.092930 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9725a512-0733-46b3-9997-f65e92379220 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044857 Aug 10 12:49:16.093496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 566/1139] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:16 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:16.096305 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c2a6a27c-fbfd-49ac-b044-d50f687b1d4b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042565 Aug 10 12:49:16.096850 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 574/1140] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:16 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:49:17.055706 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9dcae475-1264-4959-9c0c-e3aed7ccc640 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:17.057819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9dcae475-1264-4959-9c0c-e3aed7ccc640 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:17.064705 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9dcae475-1264-4959-9c0c-e3aed7ccc640 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:17.065183 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9dcae475-1264-4959-9c0c-e3aed7ccc640 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:17.065651 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9dcae475-1264-4959-9c0c-e3aed7ccc640 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:17.066335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9dcae475-1264-4959-9c0c-e3aed7ccc640 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:17.066780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9dcae475-1264-4959-9c0c-e3aed7ccc640 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:17.067222 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9dcae475-1264-4959-9c0c-e3aed7ccc640 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:17.097795 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9dcae475-1264-4959-9c0c-e3aed7ccc640 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046791 Aug 10 12:49:17.098351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 567/1141] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:17 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:17.106075 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-41d1d7d5-b3a8-49c0-89fb-a335663778b1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:17.108663 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-41d1d7d5-b3a8-49c0-89fb-a335663778b1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:17.109063 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-79714d47-e0c2-4555-9bb7-ba60238fdc6d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:17.111166 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-79714d47-e0c2-4555-9bb7-ba60238fdc6d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:17.115159 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-41d1d7d5-b3a8-49c0-89fb-a335663778b1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:17.115670 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-41d1d7d5-b3a8-49c0-89fb-a335663778b1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:17.116109 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-41d1d7d5-b3a8-49c0-89fb-a335663778b1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:17.116824 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-41d1d7d5-b3a8-49c0-89fb-a335663778b1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:17.116964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-79714d47-e0c2-4555-9bb7-ba60238fdc6d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:17.117272 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-41d1d7d5-b3a8-49c0-89fb-a335663778b1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:17.117386 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-79714d47-e0c2-4555-9bb7-ba60238fdc6d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:17.117693 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-41d1d7d5-b3a8-49c0-89fb-a335663778b1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:17.117793 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-79714d47-e0c2-4555-9bb7-ba60238fdc6d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:17.118450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-79714d47-e0c2-4555-9bb7-ba60238fdc6d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:17.118897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-79714d47-e0c2-4555-9bb7-ba60238fdc6d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:17.119339 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-79714d47-e0c2-4555-9bb7-ba60238fdc6d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:17.147353 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-41d1d7d5-b3a8-49c0-89fb-a335663778b1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045800 Aug 10 12:49:17.147915 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 575/1142] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:17 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:49:17.148917 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-79714d47-e0c2-4555-9bb7-ba60238fdc6d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044718 Aug 10 12:49:17.149460 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 568/1143] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:17 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:49:18.110285 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-068fd9f5-52f5-4450-a574-1a6da2312992 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:18.112600 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-068fd9f5-52f5-4450-a574-1a6da2312992 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:18.118841 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-068fd9f5-52f5-4450-a574-1a6da2312992 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:18.119480 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-068fd9f5-52f5-4450-a574-1a6da2312992 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:18.119924 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-068fd9f5-52f5-4450-a574-1a6da2312992 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:18.120734 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-068fd9f5-52f5-4450-a574-1a6da2312992 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:18.121758 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-068fd9f5-52f5-4450-a574-1a6da2312992 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:18.122446 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-068fd9f5-52f5-4450-a574-1a6da2312992 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:18.152956 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-068fd9f5-52f5-4450-a574-1a6da2312992 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047132 Aug 10 12:49:18.153758 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 576/1144] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:18 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:18.158979 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-079b2438-ce87-4a83-a383-19b2e41e42ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:18.161152 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-079b2438-ce87-4a83-a383-19b2e41e42ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:18.162768 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bfe4d1f3-19a8-47b4-9cc1-5c9d2e944b75 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:18.164880 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bfe4d1f3-19a8-47b4-9cc1-5c9d2e944b75 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:18.167717 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-079b2438-ce87-4a83-a383-19b2e41e42ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:18.168279 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-079b2438-ce87-4a83-a383-19b2e41e42ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:18.169284 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-079b2438-ce87-4a83-a383-19b2e41e42ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:18.169988 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-079b2438-ce87-4a83-a383-19b2e41e42ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:18.170435 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-079b2438-ce87-4a83-a383-19b2e41e42ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:18.170711 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bfe4d1f3-19a8-47b4-9cc1-5c9d2e944b75 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:18.170899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-079b2438-ce87-4a83-a383-19b2e41e42ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:18.171237 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bfe4d1f3-19a8-47b4-9cc1-5c9d2e944b75 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:18.171649 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bfe4d1f3-19a8-47b4-9cc1-5c9d2e944b75 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:18.172332 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bfe4d1f3-19a8-47b4-9cc1-5c9d2e944b75 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:18.172781 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bfe4d1f3-19a8-47b4-9cc1-5c9d2e944b75 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:18.173200 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bfe4d1f3-19a8-47b4-9cc1-5c9d2e944b75 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:18.201140 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-079b2438-ce87-4a83-a383-19b2e41e42ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046063 Aug 10 12:49:18.201698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 569/1145] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:18 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:18.202541 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bfe4d1f3-19a8-47b4-9cc1-5c9d2e944b75 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043473 Aug 10 12:49:18.203105 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 577/1146] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:18 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:49:19.165788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8b73a19e-a980-4b85-a8f3-e30d8491cc8a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:19.169631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8b73a19e-a980-4b85-a8f3-e30d8491cc8a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:19.176226 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8b73a19e-a980-4b85-a8f3-e30d8491cc8a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:19.177155 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8b73a19e-a980-4b85-a8f3-e30d8491cc8a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:19.177873 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8b73a19e-a980-4b85-a8f3-e30d8491cc8a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:19.178825 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8b73a19e-a980-4b85-a8f3-e30d8491cc8a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:19.179501 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8b73a19e-a980-4b85-a8f3-e30d8491cc8a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:19.180131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8b73a19e-a980-4b85-a8f3-e30d8491cc8a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:19.213953 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9f1679be-1855-4b46-99ce-d720a076a784 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:19.215672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8b73a19e-a980-4b85-a8f3-e30d8491cc8a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053491 Aug 10 12:49:19.219250 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 570/1147] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:19 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:19.219564 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9f1679be-1855-4b46-99ce-d720a076a784 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:19.221063 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-61e552e3-e6d1-4cd6-b049-45beb383ecf2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:19.223211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-61e552e3-e6d1-4cd6-b049-45beb383ecf2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:19.226598 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9f1679be-1855-4b46-99ce-d720a076a784 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:19.227086 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9f1679be-1855-4b46-99ce-d720a076a784 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:19.227548 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9f1679be-1855-4b46-99ce-d720a076a784 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:19.228242 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9f1679be-1855-4b46-99ce-d720a076a784 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:19.228693 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9f1679be-1855-4b46-99ce-d720a076a784 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:19.228965 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61e552e3-e6d1-4cd6-b049-45beb383ecf2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:19.229112 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9f1679be-1855-4b46-99ce-d720a076a784 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:19.229446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61e552e3-e6d1-4cd6-b049-45beb383ecf2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:19.229881 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61e552e3-e6d1-4cd6-b049-45beb383ecf2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:19.230587 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61e552e3-e6d1-4cd6-b049-45beb383ecf2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:19.231981 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61e552e3-e6d1-4cd6-b049-45beb383ecf2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:19.232434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61e552e3-e6d1-4cd6-b049-45beb383ecf2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:19.267203 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-61e552e3-e6d1-4cd6-b049-45beb383ecf2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049662 Aug 10 12:49:19.268247 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 571/1148] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:19 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:19.270991 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9f1679be-1855-4b46-99ce-d720a076a784 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061062 Aug 10 12:49:19.271702 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 578/1149] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:19 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:20.228621 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3349b8dd-72e1-4571-87a9-3d6c639c2b0c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:20.230831 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3349b8dd-72e1-4571-87a9-3d6c639c2b0c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:20.237889 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3349b8dd-72e1-4571-87a9-3d6c639c2b0c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:20.238372 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3349b8dd-72e1-4571-87a9-3d6c639c2b0c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:20.238834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3349b8dd-72e1-4571-87a9-3d6c639c2b0c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:20.239557 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3349b8dd-72e1-4571-87a9-3d6c639c2b0c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:20.240010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3349b8dd-72e1-4571-87a9-3d6c639c2b0c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:20.240439 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3349b8dd-72e1-4571-87a9-3d6c639c2b0c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:20.276778 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3349b8dd-72e1-4571-87a9-3d6c639c2b0c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052726 Aug 10 12:49:20.277486 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 572/1150] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:20 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:20.281342 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-61fc03f2-a01d-4e93-8f35-345ecb3b8708 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:20.283891 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bf2ba201-2b71-463b-9ccd-7818f4dd28c1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:20.284292 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-61fc03f2-a01d-4e93-8f35-345ecb3b8708 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:20.286015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bf2ba201-2b71-463b-9ccd-7818f4dd28c1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:20.290834 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-61fc03f2-a01d-4e93-8f35-345ecb3b8708 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:20.291423 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-61fc03f2-a01d-4e93-8f35-345ecb3b8708 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:20.291781 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf2ba201-2b71-463b-9ccd-7818f4dd28c1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:20.291991 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-61fc03f2-a01d-4e93-8f35-345ecb3b8708 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:20.292249 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf2ba201-2b71-463b-9ccd-7818f4dd28c1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:20.292685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf2ba201-2b71-463b-9ccd-7818f4dd28c1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:20.292880 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-61fc03f2-a01d-4e93-8f35-345ecb3b8708 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:20.293922 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf2ba201-2b71-463b-9ccd-7818f4dd28c1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:20.294037 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-61fc03f2-a01d-4e93-8f35-345ecb3b8708 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:20.294417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf2ba201-2b71-463b-9ccd-7818f4dd28c1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:20.294626 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-61fc03f2-a01d-4e93-8f35-345ecb3b8708 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:20.294794 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf2ba201-2b71-463b-9ccd-7818f4dd28c1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:20.308104 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:49:20.323786 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bf2ba201-2b71-463b-9ccd-7818f4dd28c1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043616 Aug 10 12:49:20.323966 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-61fc03f2-a01d-4e93-8f35-345ecb3b8708 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048071 Aug 10 12:49:20.324343 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 573/1151] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:20 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:49:20.324676 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 579/1152] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:20 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:21.290609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-37851e18-506e-4f49-a817-fb0e63c51f67 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:21.292932 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-37851e18-506e-4f49-a817-fb0e63c51f67 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:21.303919 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-37851e18-506e-4f49-a817-fb0e63c51f67 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:21.303919 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-37851e18-506e-4f49-a817-fb0e63c51f67 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:21.303919 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-37851e18-506e-4f49-a817-fb0e63c51f67 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:21.303919 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-37851e18-506e-4f49-a817-fb0e63c51f67 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:21.304395 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-37851e18-506e-4f49-a817-fb0e63c51f67 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:21.304395 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-37851e18-506e-4f49-a817-fb0e63c51f67 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:21.333406 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-37851e18-506e-4f49-a817-fb0e63c51f67 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047913 Aug 10 12:49:21.333989 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 574/1153] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:21 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:21.336631 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7c06d5a9-21b4-435d-ac16-58d4f1b07f7a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:21.338624 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4b3c8c48-f16a-4ae8-81e3-cea0b6e599e1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:21.338762 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7c06d5a9-21b4-435d-ac16-58d4f1b07f7a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:21.340785 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4b3c8c48-f16a-4ae8-81e3-cea0b6e599e1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:21.345340 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c06d5a9-21b4-435d-ac16-58d4f1b07f7a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:21.345822 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c06d5a9-21b4-435d-ac16-58d4f1b07f7a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:21.346247 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c06d5a9-21b4-435d-ac16-58d4f1b07f7a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:21.346390 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b3c8c48-f16a-4ae8-81e3-cea0b6e599e1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:21.346867 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b3c8c48-f16a-4ae8-81e3-cea0b6e599e1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:21.346981 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c06d5a9-21b4-435d-ac16-58d4f1b07f7a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:21.347355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b3c8c48-f16a-4ae8-81e3-cea0b6e599e1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:21.347471 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c06d5a9-21b4-435d-ac16-58d4f1b07f7a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:21.347797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c06d5a9-21b4-435d-ac16-58d4f1b07f7a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:21.348042 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b3c8c48-f16a-4ae8-81e3-cea0b6e599e1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:21.348489 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b3c8c48-f16a-4ae8-81e3-cea0b6e599e1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:21.348909 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b3c8c48-f16a-4ae8-81e3-cea0b6e599e1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:21.378383 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7c06d5a9-21b4-435d-ac16-58d4f1b07f7a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045862 Aug 10 12:49:21.378626 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4b3c8c48-f16a-4ae8-81e3-cea0b6e599e1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043643 Aug 10 12:49:21.378948 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 580/1154] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:21 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:49:21.379153 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 575/1155] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:21 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:22.345720 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ab57fc11-f2ef-4c8b-a632-354af2296acb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:22.348077 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ab57fc11-f2ef-4c8b-a632-354af2296acb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:22.354474 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab57fc11-f2ef-4c8b-a632-354af2296acb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:22.354961 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab57fc11-f2ef-4c8b-a632-354af2296acb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:22.355424 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab57fc11-f2ef-4c8b-a632-354af2296acb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:22.356312 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab57fc11-f2ef-4c8b-a632-354af2296acb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:22.357022 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab57fc11-f2ef-4c8b-a632-354af2296acb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:22.357443 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab57fc11-f2ef-4c8b-a632-354af2296acb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:22.390361 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ab57fc11-f2ef-4c8b-a632-354af2296acb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048534 Aug 10 12:49:22.390853 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7b3b9051-e258-4dd3-a726-1be1512bf5a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:22.391319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 581/1156] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:22 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:22.393172 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7b3b9051-e258-4dd3-a726-1be1512bf5a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:22.395710 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d7169e7a-a576-40e8-a2ec-7a562b2d0edf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:22.397850 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d7169e7a-a576-40e8-a2ec-7a562b2d0edf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:22.399485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b3b9051-e258-4dd3-a726-1be1512bf5a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:22.399972 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b3b9051-e258-4dd3-a726-1be1512bf5a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:22.400405 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b3b9051-e258-4dd3-a726-1be1512bf5a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:22.401100 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b3b9051-e258-4dd3-a726-1be1512bf5a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:22.401549 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b3b9051-e258-4dd3-a726-1be1512bf5a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:22.401974 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b3b9051-e258-4dd3-a726-1be1512bf5a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:22.404471 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7169e7a-a576-40e8-a2ec-7a562b2d0edf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:22.404952 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7169e7a-a576-40e8-a2ec-7a562b2d0edf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:22.405390 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7169e7a-a576-40e8-a2ec-7a562b2d0edf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:22.406075 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7169e7a-a576-40e8-a2ec-7a562b2d0edf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:22.406525 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7169e7a-a576-40e8-a2ec-7a562b2d0edf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:22.406952 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7169e7a-a576-40e8-a2ec-7a562b2d0edf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:22.432173 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7b3b9051-e258-4dd3-a726-1be1512bf5a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046028 Aug 10 12:49:22.432743 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 576/1157] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:22 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:49:22.436407 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d7169e7a-a576-40e8-a2ec-7a562b2d0edf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044435 Aug 10 12:49:22.436961 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 582/1158] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:22 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:23.402023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a6ecd961-c959-4407-b65e-05e5e6c1c753 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:23.404494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a6ecd961-c959-4407-b65e-05e5e6c1c753 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:23.410893 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a6ecd961-c959-4407-b65e-05e5e6c1c753 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:23.411376 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a6ecd961-c959-4407-b65e-05e5e6c1c753 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:23.411813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a6ecd961-c959-4407-b65e-05e5e6c1c753 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:23.412481 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a6ecd961-c959-4407-b65e-05e5e6c1c753 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:23.412925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a6ecd961-c959-4407-b65e-05e5e6c1c753 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:23.413340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a6ecd961-c959-4407-b65e-05e5e6c1c753 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:23.444719 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bdc8d7b3-ca14-46e4-8fdc-ced0b9788f27 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:23.445233 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a6ecd961-c959-4407-b65e-05e5e6c1c753 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047139 Aug 10 12:49:23.445832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 577/1159] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:23 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:23.446856 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bdc8d7b3-ca14-46e4-8fdc-ced0b9788f27 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:23.450573 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c37803f9-008d-4b57-8c09-1fc33321f609 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:23.452749 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c37803f9-008d-4b57-8c09-1fc33321f609 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:23.453884 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bdc8d7b3-ca14-46e4-8fdc-ced0b9788f27 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:23.454379 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bdc8d7b3-ca14-46e4-8fdc-ced0b9788f27 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:23.454804 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bdc8d7b3-ca14-46e4-8fdc-ced0b9788f27 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:23.455538 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bdc8d7b3-ca14-46e4-8fdc-ced0b9788f27 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:23.455989 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bdc8d7b3-ca14-46e4-8fdc-ced0b9788f27 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:23.456415 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bdc8d7b3-ca14-46e4-8fdc-ced0b9788f27 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:23.458330 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c37803f9-008d-4b57-8c09-1fc33321f609 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:23.458806 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c37803f9-008d-4b57-8c09-1fc33321f609 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:23.459274 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c37803f9-008d-4b57-8c09-1fc33321f609 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:23.459967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c37803f9-008d-4b57-8c09-1fc33321f609 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:23.460413 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c37803f9-008d-4b57-8c09-1fc33321f609 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:23.460834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c37803f9-008d-4b57-8c09-1fc33321f609 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:23.486324 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bdc8d7b3-ca14-46e4-8fdc-ced0b9788f27 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045782 Aug 10 12:49:23.486890 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 583/1160] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:23 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:49:23.489730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c37803f9-008d-4b57-8c09-1fc33321f609 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042914 Aug 10 12:49:23.490280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 578/1161] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:23 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:24.465786 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8c3443e8-468e-40f4-be8b-32bc93c85a15 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:24.468030 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8c3443e8-468e-40f4-be8b-32bc93c85a15 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:24.474316 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8c3443e8-468e-40f4-be8b-32bc93c85a15 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:24.474803 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8c3443e8-468e-40f4-be8b-32bc93c85a15 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:24.475260 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8c3443e8-468e-40f4-be8b-32bc93c85a15 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:24.475958 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8c3443e8-468e-40f4-be8b-32bc93c85a15 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:24.476407 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8c3443e8-468e-40f4-be8b-32bc93c85a15 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:24.476824 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8c3443e8-468e-40f4-be8b-32bc93c85a15 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:24.499204 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8749eb06-cfd0-4a99-9a09-148439cd597b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:24.501333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8749eb06-cfd0-4a99-9a09-148439cd597b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:24.507198 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8c3443e8-468e-40f4-be8b-32bc93c85a15 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045228 Aug 10 12:49:24.507646 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8749eb06-cfd0-4a99-9a09-148439cd597b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:24.508059 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 584/1162] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:24 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:24.508188 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8749eb06-cfd0-4a99-9a09-148439cd597b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:24.508536 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8749eb06-cfd0-4a99-9a09-148439cd597b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:24.509222 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8749eb06-cfd0-4a99-9a09-148439cd597b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:24.509667 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8749eb06-cfd0-4a99-9a09-148439cd597b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:24.510144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8749eb06-cfd0-4a99-9a09-148439cd597b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:24.513513 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-aabe5966-f680-4254-924f-cfd4453f459b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:24.515803 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-aabe5966-f680-4254-924f-cfd4453f459b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:24.521502 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aabe5966-f680-4254-924f-cfd4453f459b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:24.521983 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aabe5966-f680-4254-924f-cfd4453f459b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:24.522416 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aabe5966-f680-4254-924f-cfd4453f459b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:24.523109 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aabe5966-f680-4254-924f-cfd4453f459b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:24.523585 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aabe5966-f680-4254-924f-cfd4453f459b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:24.524008 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aabe5966-f680-4254-924f-cfd4453f459b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:24.540425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8749eb06-cfd0-4a99-9a09-148439cd597b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046280 Aug 10 12:49:24.540969 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 579/1163] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:24 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:49:24.553774 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-aabe5966-f680-4254-924f-cfd4453f459b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044742 Aug 10 12:49:24.554323 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 585/1164] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:24 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:25.519374 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-417964ba-bae3-4302-ba46-c58cf0e05ec7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:25.521506 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-417964ba-bae3-4302-ba46-c58cf0e05ec7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:25.528554 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-417964ba-bae3-4302-ba46-c58cf0e05ec7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:25.529131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-417964ba-bae3-4302-ba46-c58cf0e05ec7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:25.529655 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-417964ba-bae3-4302-ba46-c58cf0e05ec7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:25.530361 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-417964ba-bae3-4302-ba46-c58cf0e05ec7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:25.530857 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-417964ba-bae3-4302-ba46-c58cf0e05ec7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:25.531305 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-417964ba-bae3-4302-ba46-c58cf0e05ec7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:25.546249 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:49:25.554738 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3f2b9a23-8b5a-4c97-85e2-a5b811d8286b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:25.560548 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3f2b9a23-8b5a-4c97-85e2-a5b811d8286b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:25.563048 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-417964ba-bae3-4302-ba46-c58cf0e05ec7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047493 Aug 10 12:49:25.563527 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3f2b9a23-8b5a-4c97-85e2-a5b811d8286b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:25.567480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 580/1165] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:25 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:25.567633 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3f2b9a23-8b5a-4c97-85e2-a5b811d8286b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:25.567633 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3f2b9a23-8b5a-4c97-85e2-a5b811d8286b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:25.567633 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3f2b9a23-8b5a-4c97-85e2-a5b811d8286b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:25.567633 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3f2b9a23-8b5a-4c97-85e2-a5b811d8286b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:25.567981 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3f2b9a23-8b5a-4c97-85e2-a5b811d8286b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:25.568646 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c9c565b5-51be-4510-98f0-84d3255aaad1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:25.570895 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c9c565b5-51be-4510-98f0-84d3255aaad1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:25.578353 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9c565b5-51be-4510-98f0-84d3255aaad1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:25.578859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9c565b5-51be-4510-98f0-84d3255aaad1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:25.579317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9c565b5-51be-4510-98f0-84d3255aaad1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:25.580008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9c565b5-51be-4510-98f0-84d3255aaad1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:25.580453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9c565b5-51be-4510-98f0-84d3255aaad1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:25.580871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9c565b5-51be-4510-98f0-84d3255aaad1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:25.596031 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3f2b9a23-8b5a-4c97-85e2-a5b811d8286b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045555 Aug 10 12:49:25.596598 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 586/1166] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:25 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:25.610622 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c9c565b5-51be-4510-98f0-84d3255aaad1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045710 Aug 10 12:49:25.611161 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 581/1167] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:25 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:26.575824 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-abdac867-4a7e-4eeb-80ac-057de0a59025 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:26.577990 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-abdac867-4a7e-4eeb-80ac-057de0a59025 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:26.586274 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-abdac867-4a7e-4eeb-80ac-057de0a59025 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:26.586756 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-abdac867-4a7e-4eeb-80ac-057de0a59025 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:26.587200 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-abdac867-4a7e-4eeb-80ac-057de0a59025 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:26.587898 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-abdac867-4a7e-4eeb-80ac-057de0a59025 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:26.588346 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-abdac867-4a7e-4eeb-80ac-057de0a59025 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:26.588762 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-abdac867-4a7e-4eeb-80ac-057de0a59025 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:26.608535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0ab47703-7270-43f1-a683-84cf64dd23fa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:26.611136 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0ab47703-7270-43f1-a683-84cf64dd23fa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:26.614450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=88 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:49:26.618105 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ab47703-7270-43f1-a683-84cf64dd23fa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:26.618645 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ab47703-7270-43f1-a683-84cf64dd23fa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:26.619076 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ab47703-7270-43f1-a683-84cf64dd23fa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:26.619825 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ab47703-7270-43f1-a683-84cf64dd23fa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:26.620279 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ab47703-7270-43f1-a683-84cf64dd23fa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:26.620700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ab47703-7270-43f1-a683-84cf64dd23fa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:26.620916 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-abdac867-4a7e-4eeb-80ac-057de0a59025 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049747 Aug 10 12:49:26.621645 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 587/1168] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:26 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:26.626444 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-00668fa0-7592-4e13-a041-bab7536cf7a9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:26.628546 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-00668fa0-7592-4e13-a041-bab7536cf7a9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:26.634199 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-00668fa0-7592-4e13-a041-bab7536cf7a9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:26.634795 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-00668fa0-7592-4e13-a041-bab7536cf7a9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:26.635248 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-00668fa0-7592-4e13-a041-bab7536cf7a9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:26.635930 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-00668fa0-7592-4e13-a041-bab7536cf7a9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:26.636371 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-00668fa0-7592-4e13-a041-bab7536cf7a9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:26.636788 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-00668fa0-7592-4e13-a041-bab7536cf7a9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:26.650728 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0ab47703-7270-43f1-a683-84cf64dd23fa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046513 Aug 10 12:49:26.651309 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 582/1169] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:26 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:49:26.666909 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-00668fa0-7592-4e13-a041-bab7536cf7a9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044253 Aug 10 12:49:26.667489 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 588/1170] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:26 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:27.634836 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a5f43f30-aa84-4ac8-b842-ac94e0dba6da tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:27.637119 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a5f43f30-aa84-4ac8-b842-ac94e0dba6da tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:27.643800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5f43f30-aa84-4ac8-b842-ac94e0dba6da tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:27.644287 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5f43f30-aa84-4ac8-b842-ac94e0dba6da tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:27.644721 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5f43f30-aa84-4ac8-b842-ac94e0dba6da tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:27.645415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5f43f30-aa84-4ac8-b842-ac94e0dba6da tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:27.645862 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5f43f30-aa84-4ac8-b842-ac94e0dba6da tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:27.646286 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5f43f30-aa84-4ac8-b842-ac94e0dba6da tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:27.670491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8fb937ea-ca74-49e0-be9b-167528e814ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:27.672762 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8fb937ea-ca74-49e0-be9b-167528e814ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:27.677766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a5f43f30-aa84-4ac8-b842-ac94e0dba6da tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048578 Aug 10 12:49:27.678332 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 583/1171] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:27 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:27.679032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8fb937ea-ca74-49e0-be9b-167528e814ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:27.679774 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8fb937ea-ca74-49e0-be9b-167528e814ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:27.680201 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8fb937ea-ca74-49e0-be9b-167528e814ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:27.680896 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8fb937ea-ca74-49e0-be9b-167528e814ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:27.681340 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8fb937ea-ca74-49e0-be9b-167528e814ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:27.681754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8fb937ea-ca74-49e0-be9b-167528e814ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:27.686037 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-624204bc-60d1-4f7f-88d2-9ded3978d905 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:27.688173 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-624204bc-60d1-4f7f-88d2-9ded3978d905 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:27.694095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-624204bc-60d1-4f7f-88d2-9ded3978d905 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:27.694580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-624204bc-60d1-4f7f-88d2-9ded3978d905 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:27.695015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-624204bc-60d1-4f7f-88d2-9ded3978d905 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:27.695752 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-624204bc-60d1-4f7f-88d2-9ded3978d905 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:27.696199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-624204bc-60d1-4f7f-88d2-9ded3978d905 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:27.696624 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-624204bc-60d1-4f7f-88d2-9ded3978d905 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:27.710888 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8fb937ea-ca74-49e0-be9b-167528e814ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044890 Aug 10 12:49:27.711468 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 589/1172] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:27 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:49:27.726257 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-624204bc-60d1-4f7f-88d2-9ded3978d905 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046916 Aug 10 12:49:27.726867 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 584/1173] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:27 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:28.690439 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a69d30ba-af3f-4f8c-b389-37bbb52715a0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:28.692600 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a69d30ba-af3f-4f8c-b389-37bbb52715a0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:28.698882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a69d30ba-af3f-4f8c-b389-37bbb52715a0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:28.699399 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a69d30ba-af3f-4f8c-b389-37bbb52715a0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:28.699838 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a69d30ba-af3f-4f8c-b389-37bbb52715a0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:28.700602 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a69d30ba-af3f-4f8c-b389-37bbb52715a0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:28.701203 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a69d30ba-af3f-4f8c-b389-37bbb52715a0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:28.701629 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a69d30ba-af3f-4f8c-b389-37bbb52715a0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:28.724103 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-356baf94-ee37-4c11-a551-907157df1844 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:28.726296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-356baf94-ee37-4c11-a551-907157df1844 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:28.731150 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a69d30ba-af3f-4f8c-b389-37bbb52715a0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044546 Aug 10 12:49:28.732527 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 590/1174] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:28 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:28.733612 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-356baf94-ee37-4c11-a551-907157df1844 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:28.734096 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-356baf94-ee37-4c11-a551-907157df1844 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:28.734770 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-356baf94-ee37-4c11-a551-907157df1844 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:28.735678 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-356baf94-ee37-4c11-a551-907157df1844 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:28.736131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-356baf94-ee37-4c11-a551-907157df1844 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:28.736586 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-356baf94-ee37-4c11-a551-907157df1844 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:28.741359 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0f6e87ae-1c86-43e1-949c-6dd6f0298b20 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:28.743517 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0f6e87ae-1c86-43e1-949c-6dd6f0298b20 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:28.750035 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f6e87ae-1c86-43e1-949c-6dd6f0298b20 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:28.750514 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f6e87ae-1c86-43e1-949c-6dd6f0298b20 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:28.750943 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f6e87ae-1c86-43e1-949c-6dd6f0298b20 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:28.751663 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f6e87ae-1c86-43e1-949c-6dd6f0298b20 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:28.752114 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f6e87ae-1c86-43e1-949c-6dd6f0298b20 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:28.752535 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f6e87ae-1c86-43e1-949c-6dd6f0298b20 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:28.766018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-356baf94-ee37-4c11-a551-907157df1844 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046123 Aug 10 12:49:28.766571 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 585/1175] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:28 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:28.780772 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0f6e87ae-1c86-43e1-949c-6dd6f0298b20 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043136 Aug 10 12:49:28.781318 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 591/1176] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:28 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:49:29.745700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bc05267c-a170-47e3-ac8e-0ec488211436 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:29.748547 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bc05267c-a170-47e3-ac8e-0ec488211436 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:29.755026 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc05267c-a170-47e3-ac8e-0ec488211436 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:29.755574 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc05267c-a170-47e3-ac8e-0ec488211436 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:29.756181 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc05267c-a170-47e3-ac8e-0ec488211436 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:29.756891 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc05267c-a170-47e3-ac8e-0ec488211436 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:29.757341 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc05267c-a170-47e3-ac8e-0ec488211436 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:29.757951 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc05267c-a170-47e3-ac8e-0ec488211436 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:29.779279 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0b465001-b88d-4d5b-b2f1-8f723f2ab48b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:29.781427 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0b465001-b88d-4d5b-b2f1-8f723f2ab48b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:29.788066 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0b465001-b88d-4d5b-b2f1-8f723f2ab48b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:29.788575 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0b465001-b88d-4d5b-b2f1-8f723f2ab48b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:29.788862 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bc05267c-a170-47e3-ac8e-0ec488211436 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048786 Aug 10 12:49:29.789009 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0b465001-b88d-4d5b-b2f1-8f723f2ab48b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:29.789427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 586/1177] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:29 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:29.789707 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0b465001-b88d-4d5b-b2f1-8f723f2ab48b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:29.790156 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0b465001-b88d-4d5b-b2f1-8f723f2ab48b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:29.790579 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0b465001-b88d-4d5b-b2f1-8f723f2ab48b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:29.794147 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-25f2002b-d40c-46e1-9c13-ef8f75e08331 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:29.796450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-25f2002b-d40c-46e1-9c13-ef8f75e08331 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:29.802090 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25f2002b-d40c-46e1-9c13-ef8f75e08331 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:29.802573 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25f2002b-d40c-46e1-9c13-ef8f75e08331 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:29.803007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25f2002b-d40c-46e1-9c13-ef8f75e08331 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:29.803756 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25f2002b-d40c-46e1-9c13-ef8f75e08331 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:29.804207 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25f2002b-d40c-46e1-9c13-ef8f75e08331 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:29.804633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25f2002b-d40c-46e1-9c13-ef8f75e08331 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:29.820929 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0b465001-b88d-4d5b-b2f1-8f723f2ab48b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046711 Aug 10 12:49:29.821496 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 592/1178] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:29 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:29.834811 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-25f2002b-d40c-46e1-9c13-ef8f75e08331 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044373 Aug 10 12:49:29.835380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 587/1179] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:29 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:30.801728 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8104fe72-5bc0-4426-b279-666b35d3dc98 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:30.804000 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8104fe72-5bc0-4426-b279-666b35d3dc98 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:30.810522 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8104fe72-5bc0-4426-b279-666b35d3dc98 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:30.811008 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8104fe72-5bc0-4426-b279-666b35d3dc98 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:30.811474 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8104fe72-5bc0-4426-b279-666b35d3dc98 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:30.812177 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8104fe72-5bc0-4426-b279-666b35d3dc98 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:30.812630 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8104fe72-5bc0-4426-b279-666b35d3dc98 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:30.813055 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8104fe72-5bc0-4426-b279-666b35d3dc98 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:30.833915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e159bbf9-e470-4ff1-a545-3925c2379475 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:30.837144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e159bbf9-e470-4ff1-a545-3925c2379475 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:30.844861 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e159bbf9-e470-4ff1-a545-3925c2379475 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:30.848018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e159bbf9-e470-4ff1-a545-3925c2379475 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:30.848018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e159bbf9-e470-4ff1-a545-3925c2379475 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:30.848018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e159bbf9-e470-4ff1-a545-3925c2379475 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:30.848018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e159bbf9-e470-4ff1-a545-3925c2379475 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:30.848490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e159bbf9-e470-4ff1-a545-3925c2379475 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:30.848601 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8104fe72-5bc0-4426-b279-666b35d3dc98 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050457 Aug 10 12:49:30.852873 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 593/1180] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:30 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:30.854311 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3149f5f8-d088-4e81-8b12-fbded0aaefdf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:30.856988 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3149f5f8-d088-4e81-8b12-fbded0aaefdf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:30.863392 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3149f5f8-d088-4e81-8b12-fbded0aaefdf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:30.863876 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3149f5f8-d088-4e81-8b12-fbded0aaefdf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:30.864312 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3149f5f8-d088-4e81-8b12-fbded0aaefdf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:30.865012 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3149f5f8-d088-4e81-8b12-fbded0aaefdf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:30.865461 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3149f5f8-d088-4e81-8b12-fbded0aaefdf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:30.865886 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3149f5f8-d088-4e81-8b12-fbded0aaefdf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:30.877134 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e159bbf9-e470-4ff1-a545-3925c2379475 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047020 Aug 10 12:49:30.878495 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 588/1181] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:30 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:49:30.895972 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3149f5f8-d088-4e81-8b12-fbded0aaefdf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045313 Aug 10 12:49:30.896525 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 594/1182] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:30 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:31.862069 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2b0c47c0-6e5d-4a9e-aad8-dd1e3f9afcad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:31.864302 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2b0c47c0-6e5d-4a9e-aad8-dd1e3f9afcad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:31.870656 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b0c47c0-6e5d-4a9e-aad8-dd1e3f9afcad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:31.871143 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b0c47c0-6e5d-4a9e-aad8-dd1e3f9afcad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:31.871619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b0c47c0-6e5d-4a9e-aad8-dd1e3f9afcad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:31.873739 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b0c47c0-6e5d-4a9e-aad8-dd1e3f9afcad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:31.874232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b0c47c0-6e5d-4a9e-aad8-dd1e3f9afcad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:31.874721 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b0c47c0-6e5d-4a9e-aad8-dd1e3f9afcad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:31.889166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2b5d5134-1551-450f-b4e3-bb1b9e6c0dec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:31.891768 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2b5d5134-1551-450f-b4e3-bb1b9e6c0dec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:31.904383 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b5d5134-1551-450f-b4e3-bb1b9e6c0dec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:31.909396 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b5d5134-1551-450f-b4e3-bb1b9e6c0dec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:31.909396 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b5d5134-1551-450f-b4e3-bb1b9e6c0dec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:31.909396 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b5d5134-1551-450f-b4e3-bb1b9e6c0dec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:31.909396 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b5d5134-1551-450f-b4e3-bb1b9e6c0dec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:31.909786 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b5d5134-1551-450f-b4e3-bb1b9e6c0dec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:31.909865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2b0c47c0-6e5d-4a9e-aad8-dd1e3f9afcad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052737 Aug 10 12:49:31.910027 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 589/1183] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:31 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:31.914777 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3e9c673f-a944-490f-b6b1-a6e087a68f99 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:31.916943 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3e9c673f-a944-490f-b6b1-a6e087a68f99 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:31.922831 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3e9c673f-a944-490f-b6b1-a6e087a68f99 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:31.923350 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3e9c673f-a944-490f-b6b1-a6e087a68f99 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:31.923782 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3e9c673f-a944-490f-b6b1-a6e087a68f99 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:31.924975 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3e9c673f-a944-490f-b6b1-a6e087a68f99 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:31.924975 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3e9c673f-a944-490f-b6b1-a6e087a68f99 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:31.925429 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3e9c673f-a944-490f-b6b1-a6e087a68f99 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:31.940589 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2b5d5134-1551-450f-b4e3-bb1b9e6c0dec tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055320 Aug 10 12:49:31.942359 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 595/1184] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:31 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:49:31.956058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3e9c673f-a944-490f-b6b1-a6e087a68f99 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044830 Aug 10 12:49:31.959414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 590/1185] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:31 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:32.921511 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4a26f6dc-60d8-4c4f-91ff-949ddff951e9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:32.924007 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4a26f6dc-60d8-4c4f-91ff-949ddff951e9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:32.930627 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4a26f6dc-60d8-4c4f-91ff-949ddff951e9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:32.931156 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4a26f6dc-60d8-4c4f-91ff-949ddff951e9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:32.931593 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4a26f6dc-60d8-4c4f-91ff-949ddff951e9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:32.932359 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4a26f6dc-60d8-4c4f-91ff-949ddff951e9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:32.932816 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4a26f6dc-60d8-4c4f-91ff-949ddff951e9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:32.933243 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4a26f6dc-60d8-4c4f-91ff-949ddff951e9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:32.936760 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:49:32.953667 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6f007a53-3774-4647-9d4b-759a87a5764c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:32.960249 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6f007a53-3774-4647-9d4b-759a87a5764c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:32.962433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f007a53-3774-4647-9d4b-759a87a5764c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:32.962925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f007a53-3774-4647-9d4b-759a87a5764c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:32.963392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f007a53-3774-4647-9d4b-759a87a5764c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:32.964097 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f007a53-3774-4647-9d4b-759a87a5764c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:32.966265 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f007a53-3774-4647-9d4b-759a87a5764c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:32.966709 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f007a53-3774-4647-9d4b-759a87a5764c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:32.968585 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4a26f6dc-60d8-4c4f-91ff-949ddff951e9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051014 Aug 10 12:49:32.972931 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 596/1186] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:32 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:32.974013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a90821db-8afa-487b-b8f7-0f8f3b78ae69 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:32.976167 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a90821db-8afa-487b-b8f7-0f8f3b78ae69 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:32.982653 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a90821db-8afa-487b-b8f7-0f8f3b78ae69 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:32.983131 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a90821db-8afa-487b-b8f7-0f8f3b78ae69 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:32.983583 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a90821db-8afa-487b-b8f7-0f8f3b78ae69 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:32.984270 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a90821db-8afa-487b-b8f7-0f8f3b78ae69 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:32.984713 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a90821db-8afa-487b-b8f7-0f8f3b78ae69 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:32.985129 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a90821db-8afa-487b-b8f7-0f8f3b78ae69 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:32.996631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6f007a53-3774-4647-9d4b-759a87a5764c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047708 Aug 10 12:49:32.997726 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 591/1187] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:32 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:49:33.013532 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a90821db-8afa-487b-b8f7-0f8f3b78ae69 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043185 Aug 10 12:49:33.014072 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 597/1188] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:32 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:33.979989 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-33178cec-16bd-4484-a63f-c23e0fd14582 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:33.982791 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-33178cec-16bd-4484-a63f-c23e0fd14582 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:33.989270 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-33178cec-16bd-4484-a63f-c23e0fd14582 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:33.989751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-33178cec-16bd-4484-a63f-c23e0fd14582 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:33.990562 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-33178cec-16bd-4484-a63f-c23e0fd14582 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:33.991293 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-33178cec-16bd-4484-a63f-c23e0fd14582 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:33.991741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-33178cec-16bd-4484-a63f-c23e0fd14582 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:33.992158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-33178cec-16bd-4484-a63f-c23e0fd14582 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:34.008539 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2c9d8653-cb35-4641-a9cf-4bc3d511c434 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:34.010742 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2c9d8653-cb35-4641-a9cf-4bc3d511c434 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:34.017574 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c9d8653-cb35-4641-a9cf-4bc3d511c434 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:34.018057 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c9d8653-cb35-4641-a9cf-4bc3d511c434 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:34.018492 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c9d8653-cb35-4641-a9cf-4bc3d511c434 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:34.019199 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c9d8653-cb35-4641-a9cf-4bc3d511c434 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:34.019913 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c9d8653-cb35-4641-a9cf-4bc3d511c434 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:34.020495 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c9d8653-cb35-4641-a9cf-4bc3d511c434 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:34.023392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-33178cec-16bd-4484-a63f-c23e0fd14582 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047323 Aug 10 12:49:34.023958 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 592/1189] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:33 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:34.029375 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-416b1674-6acc-403e-9f27-c4899a7519ea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:34.031623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-416b1674-6acc-403e-9f27-c4899a7519ea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:34.037358 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-416b1674-6acc-403e-9f27-c4899a7519ea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:34.038245 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-416b1674-6acc-403e-9f27-c4899a7519ea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:34.038245 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-416b1674-6acc-403e-9f27-c4899a7519ea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:34.038949 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-416b1674-6acc-403e-9f27-c4899a7519ea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:34.039429 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-416b1674-6acc-403e-9f27-c4899a7519ea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:34.039855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-416b1674-6acc-403e-9f27-c4899a7519ea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:34.050681 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2c9d8653-cb35-4641-a9cf-4bc3d511c434 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046047 Aug 10 12:49:34.051275 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 598/1190] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:34 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:49:34.068347 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-416b1674-6acc-403e-9f27-c4899a7519ea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043198 Aug 10 12:49:34.068901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 593/1191] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:34 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:35.035582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-406a40bb-5f48-4fe0-8962-915c42d2efad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:35.037738 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-406a40bb-5f48-4fe0-8962-915c42d2efad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:35.044366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-406a40bb-5f48-4fe0-8962-915c42d2efad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:35.044857 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-406a40bb-5f48-4fe0-8962-915c42d2efad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:35.045295 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-406a40bb-5f48-4fe0-8962-915c42d2efad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:35.045998 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-406a40bb-5f48-4fe0-8962-915c42d2efad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:35.046466 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-406a40bb-5f48-4fe0-8962-915c42d2efad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:35.046885 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-406a40bb-5f48-4fe0-8962-915c42d2efad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:35.063845 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-53c1106f-9dcb-4e53-babb-cea8b7accd0a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:35.066046 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-53c1106f-9dcb-4e53-babb-cea8b7accd0a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:35.073049 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53c1106f-9dcb-4e53-babb-cea8b7accd0a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:35.073212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53c1106f-9dcb-4e53-babb-cea8b7accd0a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:35.073577 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53c1106f-9dcb-4e53-babb-cea8b7accd0a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:35.074264 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53c1106f-9dcb-4e53-babb-cea8b7accd0a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:35.074706 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53c1106f-9dcb-4e53-babb-cea8b7accd0a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:35.076571 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53c1106f-9dcb-4e53-babb-cea8b7accd0a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:35.077949 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-406a40bb-5f48-4fe0-8962-915c42d2efad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046262 Aug 10 12:49:35.078516 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 599/1192] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:35 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:35.083037 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c1ab4737-5454-42d8-9c43-79176e0eaafa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:35.085202 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c1ab4737-5454-42d8-9c43-79176e0eaafa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:35.090899 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c1ab4737-5454-42d8-9c43-79176e0eaafa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:35.091535 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c1ab4737-5454-42d8-9c43-79176e0eaafa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:35.091982 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c1ab4737-5454-42d8-9c43-79176e0eaafa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:35.092674 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c1ab4737-5454-42d8-9c43-79176e0eaafa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:35.093128 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c1ab4737-5454-42d8-9c43-79176e0eaafa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:35.093551 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c1ab4737-5454-42d8-9c43-79176e0eaafa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:35.106442 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-53c1106f-9dcb-4e53-babb-cea8b7accd0a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047794 Aug 10 12:49:35.107392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 594/1193] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:35 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:49:35.123520 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c1ab4737-5454-42d8-9c43-79176e0eaafa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043977 Aug 10 12:49:35.124069 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 600/1194] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:35 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:36.092031 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-35a685b2-e08f-42a8-8ab6-b0136ddb7ec4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:36.094374 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-35a685b2-e08f-42a8-8ab6-b0136ddb7ec4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:36.100956 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35a685b2-e08f-42a8-8ab6-b0136ddb7ec4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:36.101445 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35a685b2-e08f-42a8-8ab6-b0136ddb7ec4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:36.102106 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35a685b2-e08f-42a8-8ab6-b0136ddb7ec4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:36.102806 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35a685b2-e08f-42a8-8ab6-b0136ddb7ec4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:36.103285 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35a685b2-e08f-42a8-8ab6-b0136ddb7ec4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:36.103712 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35a685b2-e08f-42a8-8ab6-b0136ddb7ec4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:36.121523 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5f388855-e67f-4a3c-9acf-1c12ed227ee5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:36.121986 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5f388855-e67f-4a3c-9acf-1c12ed227ee5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:36.127768 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5f388855-e67f-4a3c-9acf-1c12ed227ee5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:36.128253 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5f388855-e67f-4a3c-9acf-1c12ed227ee5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:36.128685 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5f388855-e67f-4a3c-9acf-1c12ed227ee5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:36.129435 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5f388855-e67f-4a3c-9acf-1c12ed227ee5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:36.130079 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5f388855-e67f-4a3c-9acf-1c12ed227ee5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:36.130576 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5f388855-e67f-4a3c-9acf-1c12ed227ee5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:36.133350 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-35a685b2-e08f-42a8-8ab6-b0136ddb7ec4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046020 Aug 10 12:49:36.133918 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 595/1195] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:36 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:36.138971 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-059782f5-74cc-4a6f-a0df-9b00c84dfb91 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:36.141098 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-059782f5-74cc-4a6f-a0df-9b00c84dfb91 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:36.146785 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-059782f5-74cc-4a6f-a0df-9b00c84dfb91 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:36.147311 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-059782f5-74cc-4a6f-a0df-9b00c84dfb91 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:36.147750 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-059782f5-74cc-4a6f-a0df-9b00c84dfb91 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:36.148449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-059782f5-74cc-4a6f-a0df-9b00c84dfb91 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:36.148891 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-059782f5-74cc-4a6f-a0df-9b00c84dfb91 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:36.149311 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-059782f5-74cc-4a6f-a0df-9b00c84dfb91 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:36.160814 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5f388855-e67f-4a3c-9acf-1c12ed227ee5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045662 Aug 10 12:49:36.161375 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 601/1196] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:36 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:49:36.178687 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-059782f5-74cc-4a6f-a0df-9b00c84dfb91 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043763 Aug 10 12:49:36.179251 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 596/1197] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:36 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:37.146516 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9b1963e6-3a77-4374-acda-2130addb5904 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:37.148752 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9b1963e6-3a77-4374-acda-2130addb5904 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:37.155880 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b1963e6-3a77-4374-acda-2130addb5904 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:37.156390 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b1963e6-3a77-4374-acda-2130addb5904 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:37.156947 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b1963e6-3a77-4374-acda-2130addb5904 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:37.157639 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b1963e6-3a77-4374-acda-2130addb5904 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:37.158077 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b1963e6-3a77-4374-acda-2130addb5904 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:37.158740 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b1963e6-3a77-4374-acda-2130addb5904 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:37.174295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-13440f3f-5baa-49a1-883c-0a97c853da30 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:37.181796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-13440f3f-5baa-49a1-883c-0a97c853da30 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:37.189133 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9b1963e6-3a77-4374-acda-2130addb5904 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047845 Aug 10 12:49:37.189726 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 602/1198] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:37 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:37.195781 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-13440f3f-5baa-49a1-883c-0a97c853da30 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:37.195781 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-13440f3f-5baa-49a1-883c-0a97c853da30 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:37.195781 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-13440f3f-5baa-49a1-883c-0a97c853da30 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:37.195781 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-13440f3f-5baa-49a1-883c-0a97c853da30 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:37.196169 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-13440f3f-5baa-49a1-883c-0a97c853da30 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:37.196169 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-13440f3f-5baa-49a1-883c-0a97c853da30 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:37.196330 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-097df725-595f-4d72-98f8-b12d286b3697 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:37.196409 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:49:37.196491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-097df725-595f-4d72-98f8-b12d286b3697 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:37.202231 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-097df725-595f-4d72-98f8-b12d286b3697 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:37.202721 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-097df725-595f-4d72-98f8-b12d286b3697 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:37.203161 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-097df725-595f-4d72-98f8-b12d286b3697 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:37.203889 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-097df725-595f-4d72-98f8-b12d286b3697 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:37.204354 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-097df725-595f-4d72-98f8-b12d286b3697 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:37.204763 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-097df725-595f-4d72-98f8-b12d286b3697 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:37.224449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-13440f3f-5baa-49a1-883c-0a97c853da30 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055086 Aug 10 12:49:37.225269 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 597/1199] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:37 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:49:37.234614 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-097df725-595f-4d72-98f8-b12d286b3697 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043880 Aug 10 12:49:37.235189 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 603/1200] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:37 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:38.206176 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-168e73fa-f17d-4181-80b0-4d91c26ec1c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:38.208394 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-168e73fa-f17d-4181-80b0-4d91c26ec1c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:38.215441 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-168e73fa-f17d-4181-80b0-4d91c26ec1c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:38.216433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-168e73fa-f17d-4181-80b0-4d91c26ec1c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:38.216874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-168e73fa-f17d-4181-80b0-4d91c26ec1c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:38.217566 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-168e73fa-f17d-4181-80b0-4d91c26ec1c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:38.218015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-168e73fa-f17d-4181-80b0-4d91c26ec1c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:38.218434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-168e73fa-f17d-4181-80b0-4d91c26ec1c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:38.237872 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f7110abd-0291-4584-8988-1a6af09c9aab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:38.240061 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f7110abd-0291-4584-8988-1a6af09c9aab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:38.246087 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f7110abd-0291-4584-8988-1a6af09c9aab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:38.246563 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f7110abd-0291-4584-8988-1a6af09c9aab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:38.247024 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f7110abd-0291-4584-8988-1a6af09c9aab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:38.247880 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f7110abd-0291-4584-8988-1a6af09c9aab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:38.248327 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f7110abd-0291-4584-8988-1a6af09c9aab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:38.248531 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-168e73fa-f17d-4181-80b0-4d91c26ec1c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046587 Aug 10 12:49:38.248751 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f7110abd-0291-4584-8988-1a6af09c9aab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:38.249090 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 598/1201] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:38 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:38.253709 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d6029c46-547f-4e2c-a9c2-145f397e6b35 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:38.255834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d6029c46-547f-4e2c-a9c2-145f397e6b35 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:38.261584 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6029c46-547f-4e2c-a9c2-145f397e6b35 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:38.262068 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6029c46-547f-4e2c-a9c2-145f397e6b35 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:38.263152 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6029c46-547f-4e2c-a9c2-145f397e6b35 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:38.263907 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6029c46-547f-4e2c-a9c2-145f397e6b35 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:38.264473 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6029c46-547f-4e2c-a9c2-145f397e6b35 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:38.264898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6029c46-547f-4e2c-a9c2-145f397e6b35 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:38.279492 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f7110abd-0291-4584-8988-1a6af09c9aab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044665 Aug 10 12:49:38.280730 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 604/1202] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:38 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:38.294475 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d6029c46-547f-4e2c-a9c2-145f397e6b35 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044250 Aug 10 12:49:38.295030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 599/1203] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:38 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:39.262519 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7699c27e-5910-47ae-8ef5-91eed3853e12 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:39.266244 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7699c27e-5910-47ae-8ef5-91eed3853e12 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:39.272860 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7699c27e-5910-47ae-8ef5-91eed3853e12 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:39.273344 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7699c27e-5910-47ae-8ef5-91eed3853e12 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:39.273784 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7699c27e-5910-47ae-8ef5-91eed3853e12 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:39.274475 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7699c27e-5910-47ae-8ef5-91eed3853e12 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:39.274926 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7699c27e-5910-47ae-8ef5-91eed3853e12 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:39.275383 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7699c27e-5910-47ae-8ef5-91eed3853e12 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:39.291598 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-439679a9-b05f-4cf4-b61b-296649d85735 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:39.293712 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-439679a9-b05f-4cf4-b61b-296649d85735 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:39.300831 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-439679a9-b05f-4cf4-b61b-296649d85735 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:39.301307 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-439679a9-b05f-4cf4-b61b-296649d85735 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:39.301736 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-439679a9-b05f-4cf4-b61b-296649d85735 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:39.302422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-439679a9-b05f-4cf4-b61b-296649d85735 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:39.302866 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-439679a9-b05f-4cf4-b61b-296649d85735 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:39.303311 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-439679a9-b05f-4cf4-b61b-296649d85735 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:39.307144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7699c27e-5910-47ae-8ef5-91eed3853e12 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048451 Aug 10 12:49:39.307882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 605/1204] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:39 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:39.313368 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1ebb9d1c-ea38-45ba-ba12-736e1527db59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:39.315510 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1ebb9d1c-ea38-45ba-ba12-736e1527db59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:39.321178 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1ebb9d1c-ea38-45ba-ba12-736e1527db59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:39.321659 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1ebb9d1c-ea38-45ba-ba12-736e1527db59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:39.322089 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1ebb9d1c-ea38-45ba-ba12-736e1527db59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:39.322784 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1ebb9d1c-ea38-45ba-ba12-736e1527db59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:39.323257 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1ebb9d1c-ea38-45ba-ba12-736e1527db59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:39.323686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1ebb9d1c-ea38-45ba-ba12-736e1527db59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:39.334143 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-439679a9-b05f-4cf4-b61b-296649d85735 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046550 Aug 10 12:49:39.334698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 600/1205] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:39 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:49:39.352224 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1ebb9d1c-ea38-45ba-ba12-736e1527db59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043427 Aug 10 12:49:39.352785 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 606/1206] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:39 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:40.319555 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b1a69044-5617-4003-8275-567c0c7c7197 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:40.321741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b1a69044-5617-4003-8275-567c0c7c7197 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:40.328251 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1a69044-5617-4003-8275-567c0c7c7197 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:40.328740 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1a69044-5617-4003-8275-567c0c7c7197 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:40.329178 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1a69044-5617-4003-8275-567c0c7c7197 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:40.329870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1a69044-5617-4003-8275-567c0c7c7197 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:40.330323 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1a69044-5617-4003-8275-567c0c7c7197 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:40.330770 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1a69044-5617-4003-8275-567c0c7c7197 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:40.346801 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4d293a03-7279-42e2-ba3e-4519f4ca168f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:40.348960 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4d293a03-7279-42e2-ba3e-4519f4ca168f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:40.351258 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=86 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:49:40.356027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d293a03-7279-42e2-ba3e-4519f4ca168f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:40.357411 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d293a03-7279-42e2-ba3e-4519f4ca168f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:40.357839 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d293a03-7279-42e2-ba3e-4519f4ca168f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:40.358531 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d293a03-7279-42e2-ba3e-4519f4ca168f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:40.359006 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d293a03-7279-42e2-ba3e-4519f4ca168f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:40.359446 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d293a03-7279-42e2-ba3e-4519f4ca168f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:40.361924 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b1a69044-5617-4003-8275-567c0c7c7197 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046236 Aug 10 12:49:40.372328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 601/1207] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:40 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:40.372328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7103f203-fd4c-4a19-9265-4dbe6f77d97b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:40.372328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7103f203-fd4c-4a19-9265-4dbe6f77d97b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:40.375638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7103f203-fd4c-4a19-9265-4dbe6f77d97b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:40.376129 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7103f203-fd4c-4a19-9265-4dbe6f77d97b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:40.376564 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7103f203-fd4c-4a19-9265-4dbe6f77d97b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:40.377255 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7103f203-fd4c-4a19-9265-4dbe6f77d97b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:40.377705 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7103f203-fd4c-4a19-9265-4dbe6f77d97b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:40.378128 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7103f203-fd4c-4a19-9265-4dbe6f77d97b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:40.389894 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4d293a03-7279-42e2-ba3e-4519f4ca168f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047256 Aug 10 12:49:40.390440 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 607/1208] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:40 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:40.407413 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7103f203-fd4c-4a19-9265-4dbe6f77d97b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043894 Aug 10 12:49:40.407958 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 602/1209] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:40 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:41.382666 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-191b8383-034d-4efc-9f93-a8bee25e8f93 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:41.385124 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-191b8383-034d-4efc-9f93-a8bee25e8f93 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:41.391356 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-191b8383-034d-4efc-9f93-a8bee25e8f93 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:41.391834 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-191b8383-034d-4efc-9f93-a8bee25e8f93 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:41.392270 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-191b8383-034d-4efc-9f93-a8bee25e8f93 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:41.392984 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-191b8383-034d-4efc-9f93-a8bee25e8f93 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:41.393483 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-191b8383-034d-4efc-9f93-a8bee25e8f93 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:41.393830 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-191b8383-034d-4efc-9f93-a8bee25e8f93 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:41.401865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7141b5a0-ca68-4241-bb4b-16e3b95cc2a3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:41.404193 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7141b5a0-ca68-4241-bb4b-16e3b95cc2a3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:41.410934 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7141b5a0-ca68-4241-bb4b-16e3b95cc2a3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:41.411454 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7141b5a0-ca68-4241-bb4b-16e3b95cc2a3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:41.411883 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7141b5a0-ca68-4241-bb4b-16e3b95cc2a3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:41.412572 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7141b5a0-ca68-4241-bb4b-16e3b95cc2a3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:41.413017 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7141b5a0-ca68-4241-bb4b-16e3b95cc2a3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:41.413444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7141b5a0-ca68-4241-bb4b-16e3b95cc2a3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:41.426276 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-191b8383-034d-4efc-9f93-a8bee25e8f93 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047669 Aug 10 12:49:41.426850 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 608/1210] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:41 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:41.431454 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-dfd2ab64-e4f6-4837-bb85-5de5c3e4fa58 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:41.433599 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-dfd2ab64-e4f6-4837-bb85-5de5c3e4fa58 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:41.440063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dfd2ab64-e4f6-4837-bb85-5de5c3e4fa58 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:41.440551 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dfd2ab64-e4f6-4837-bb85-5de5c3e4fa58 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:41.440990 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dfd2ab64-e4f6-4837-bb85-5de5c3e4fa58 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:41.441690 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dfd2ab64-e4f6-4837-bb85-5de5c3e4fa58 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:41.442147 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dfd2ab64-e4f6-4837-bb85-5de5c3e4fa58 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:41.442572 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dfd2ab64-e4f6-4837-bb85-5de5c3e4fa58 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:41.444162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7141b5a0-ca68-4241-bb4b-16e3b95cc2a3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046176 Aug 10 12:49:41.444726 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 603/1211] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:41 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:49:41.470700 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-dfd2ab64-e4f6-4837-bb85-5de5c3e4fa58 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042760 Aug 10 12:49:41.471281 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 609/1212] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:41 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:42.438681 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c69332ab-f596-44da-9f09-054d064ee8ff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:42.440842 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c69332ab-f596-44da-9f09-054d064ee8ff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:42.447235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c69332ab-f596-44da-9f09-054d064ee8ff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:42.447720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c69332ab-f596-44da-9f09-054d064ee8ff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:42.448194 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c69332ab-f596-44da-9f09-054d064ee8ff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:42.448831 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c69332ab-f596-44da-9f09-054d064ee8ff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:42.449281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c69332ab-f596-44da-9f09-054d064ee8ff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:42.449703 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c69332ab-f596-44da-9f09-054d064ee8ff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:42.457457 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c6e4fcd2-10c4-4f44-af1d-6e0bef517384 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:42.459691 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c6e4fcd2-10c4-4f44-af1d-6e0bef517384 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:42.466623 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c6e4fcd2-10c4-4f44-af1d-6e0bef517384 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:42.467162 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c6e4fcd2-10c4-4f44-af1d-6e0bef517384 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:42.467695 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c6e4fcd2-10c4-4f44-af1d-6e0bef517384 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:42.468402 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c6e4fcd2-10c4-4f44-af1d-6e0bef517384 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:42.468918 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c6e4fcd2-10c4-4f44-af1d-6e0bef517384 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:42.469346 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c6e4fcd2-10c4-4f44-af1d-6e0bef517384 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:42.487869 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c69332ab-f596-44da-9f09-054d064ee8ff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053734 Aug 10 12:49:42.488435 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 604/1213] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:42 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:42.492943 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-104f3a5d-11fa-4bb2-9d7c-f6ed4fd608bb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:42.495030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-104f3a5d-11fa-4bb2-9d7c-f6ed4fd608bb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:42.500753 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-104f3a5d-11fa-4bb2-9d7c-f6ed4fd608bb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:42.501230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-104f3a5d-11fa-4bb2-9d7c-f6ed4fd608bb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:42.501662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-104f3a5d-11fa-4bb2-9d7c-f6ed4fd608bb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:42.502065 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c6e4fcd2-10c4-4f44-af1d-6e0bef517384 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048788 Aug 10 12:49:42.502347 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-104f3a5d-11fa-4bb2-9d7c-f6ed4fd608bb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:42.502636 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 610/1214] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:42 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:49:42.502812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-104f3a5d-11fa-4bb2-9d7c-f6ed4fd608bb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:42.503232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-104f3a5d-11fa-4bb2-9d7c-f6ed4fd608bb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:42.532008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-104f3a5d-11fa-4bb2-9d7c-f6ed4fd608bb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042484 Aug 10 12:49:42.532468 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 605/1215] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:42 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:43.499950 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-de43cfe3-f870-4bd1-ba90-2dfa191ff591 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:43.502092 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-de43cfe3-f870-4bd1-ba90-2dfa191ff591 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:43.510153 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-de43cfe3-f870-4bd1-ba90-2dfa191ff591 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:43.510649 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-de43cfe3-f870-4bd1-ba90-2dfa191ff591 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:43.511089 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-de43cfe3-f870-4bd1-ba90-2dfa191ff591 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:43.511825 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-de43cfe3-f870-4bd1-ba90-2dfa191ff591 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:43.512279 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-de43cfe3-f870-4bd1-ba90-2dfa191ff591 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:43.513315 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-de43cfe3-f870-4bd1-ba90-2dfa191ff591 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:43.514833 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-524fbde7-fdbc-4c83-ad83-3ae4180da49d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:43.516976 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-524fbde7-fdbc-4c83-ad83-3ae4180da49d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:43.523444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-524fbde7-fdbc-4c83-ad83-3ae4180da49d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:43.523931 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-524fbde7-fdbc-4c83-ad83-3ae4180da49d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:43.524365 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-524fbde7-fdbc-4c83-ad83-3ae4180da49d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:43.525055 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-524fbde7-fdbc-4c83-ad83-3ae4180da49d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:43.525503 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-524fbde7-fdbc-4c83-ad83-3ae4180da49d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:43.525923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-524fbde7-fdbc-4c83-ad83-3ae4180da49d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:43.544917 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-de43cfe3-f870-4bd1-ba90-2dfa191ff591 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048852 Aug 10 12:49:43.545444 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 611/1216] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:43 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:43.550645 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-31797830-2a01-4033-a858-b70188f2d7d8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:43.552764 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-31797830-2a01-4033-a858-b70188f2d7d8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:43.555542 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-524fbde7-fdbc-4c83-ad83-3ae4180da49d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045089 Aug 10 12:49:43.556105 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 606/1217] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:43 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:49:43.558337 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-31797830-2a01-4033-a858-b70188f2d7d8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:43.558804 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-31797830-2a01-4033-a858-b70188f2d7d8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:43.559261 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-31797830-2a01-4033-a858-b70188f2d7d8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:43.559951 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-31797830-2a01-4033-a858-b70188f2d7d8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:43.560408 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-31797830-2a01-4033-a858-b70188f2d7d8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:43.560805 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-31797830-2a01-4033-a858-b70188f2d7d8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:43.585076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:49:43.589480 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-31797830-2a01-4033-a858-b70188f2d7d8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043103 Aug 10 12:49:43.599856 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 612/1218] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:43 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:44.556934 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c7246d39-1382-467e-bdd6-dd2d49d6b198 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:44.559122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c7246d39-1382-467e-bdd6-dd2d49d6b198 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:44.568562 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7246d39-1382-467e-bdd6-dd2d49d6b198 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:44.568562 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7246d39-1382-467e-bdd6-dd2d49d6b198 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:44.568562 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7246d39-1382-467e-bdd6-dd2d49d6b198 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:44.568562 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7246d39-1382-467e-bdd6-dd2d49d6b198 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:44.568928 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6efe7065-78d7-4bfa-b5bd-a3d977ad0a7e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:44.569386 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7246d39-1382-467e-bdd6-dd2d49d6b198 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:44.569386 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7246d39-1382-467e-bdd6-dd2d49d6b198 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:44.571074 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6efe7065-78d7-4bfa-b5bd-a3d977ad0a7e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:44.577598 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6efe7065-78d7-4bfa-b5bd-a3d977ad0a7e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:44.578080 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6efe7065-78d7-4bfa-b5bd-a3d977ad0a7e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:44.578515 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6efe7065-78d7-4bfa-b5bd-a3d977ad0a7e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:44.579261 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6efe7065-78d7-4bfa-b5bd-a3d977ad0a7e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:44.579714 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6efe7065-78d7-4bfa-b5bd-a3d977ad0a7e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:44.580164 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6efe7065-78d7-4bfa-b5bd-a3d977ad0a7e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:44.598286 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c7246d39-1382-467e-bdd6-dd2d49d6b198 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045281 Aug 10 12:49:44.598848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 607/1219] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:44 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:44.609661 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6efe7065-78d7-4bfa-b5bd-a3d977ad0a7e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045434 Aug 10 12:49:44.610227 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 613/1220] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:44 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:44.610437 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-834e3006-5988-4860-b770-871c88386ffe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:44.612756 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-834e3006-5988-4860-b770-871c88386ffe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:44.618561 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-834e3006-5988-4860-b770-871c88386ffe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:44.619041 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-834e3006-5988-4860-b770-871c88386ffe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:44.619509 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-834e3006-5988-4860-b770-871c88386ffe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:44.620247 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-834e3006-5988-4860-b770-871c88386ffe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:44.620694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-834e3006-5988-4860-b770-871c88386ffe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:44.621146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-834e3006-5988-4860-b770-871c88386ffe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:44.649987 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-834e3006-5988-4860-b770-871c88386ffe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044094 Aug 10 12:49:44.650536 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 608/1221] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:44 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:49:45.610973 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-548cc2eb-06e4-44f2-9bfe-a6b07ff52153 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:45.613216 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-548cc2eb-06e4-44f2-9bfe-a6b07ff52153 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:45.620388 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-548cc2eb-06e4-44f2-9bfe-a6b07ff52153 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:45.620888 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-548cc2eb-06e4-44f2-9bfe-a6b07ff52153 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:45.621327 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-548cc2eb-06e4-44f2-9bfe-a6b07ff52153 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:45.622106 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-dcb0b3e2-c211-4252-b99b-8b64bd954946 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:45.622597 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-548cc2eb-06e4-44f2-9bfe-a6b07ff52153 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:45.622597 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-548cc2eb-06e4-44f2-9bfe-a6b07ff52153 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:45.623033 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-548cc2eb-06e4-44f2-9bfe-a6b07ff52153 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:45.625169 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-dcb0b3e2-c211-4252-b99b-8b64bd954946 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:45.631377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dcb0b3e2-c211-4252-b99b-8b64bd954946 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:45.631873 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dcb0b3e2-c211-4252-b99b-8b64bd954946 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:45.632296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dcb0b3e2-c211-4252-b99b-8b64bd954946 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:45.632991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dcb0b3e2-c211-4252-b99b-8b64bd954946 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:45.633434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dcb0b3e2-c211-4252-b99b-8b64bd954946 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:45.633854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dcb0b3e2-c211-4252-b99b-8b64bd954946 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:45.652014 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-548cc2eb-06e4-44f2-9bfe-a6b07ff52153 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046082 Aug 10 12:49:45.652765 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 614/1222] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:45 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:45.663457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-dcb0b3e2-c211-4252-b99b-8b64bd954946 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045448 Aug 10 12:49:45.664175 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ef9be468-2162-4e41-8b32-92ff6522e809 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:45.664303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 609/1223] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:45 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:49:45.666144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ef9be468-2162-4e41-8b32-92ff6522e809 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:45.672749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef9be468-2162-4e41-8b32-92ff6522e809 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:45.673232 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef9be468-2162-4e41-8b32-92ff6522e809 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:45.673675 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef9be468-2162-4e41-8b32-92ff6522e809 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:45.674373 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef9be468-2162-4e41-8b32-92ff6522e809 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:45.674825 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef9be468-2162-4e41-8b32-92ff6522e809 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:45.675270 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef9be468-2162-4e41-8b32-92ff6522e809 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:45.703577 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ef9be468-2162-4e41-8b32-92ff6522e809 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043376 Aug 10 12:49:45.704126 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 615/1224] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:45 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:49:46.665494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-14a37608-0269-479a-9382-ec8d13014cfa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:46.668276 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-14a37608-0269-479a-9382-ec8d13014cfa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:46.675398 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-14a37608-0269-479a-9382-ec8d13014cfa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:46.675875 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-14a37608-0269-479a-9382-ec8d13014cfa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:46.676336 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-14a37608-0269-479a-9382-ec8d13014cfa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:46.676554 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fee006e6-4d85-475b-839d-a95f24f9e78b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:46.677019 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-14a37608-0269-479a-9382-ec8d13014cfa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:46.677805 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-14a37608-0269-479a-9382-ec8d13014cfa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:46.678832 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fee006e6-4d85-475b-839d-a95f24f9e78b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:46.679470 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-14a37608-0269-479a-9382-ec8d13014cfa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:46.685601 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fee006e6-4d85-475b-839d-a95f24f9e78b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:46.686083 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fee006e6-4d85-475b-839d-a95f24f9e78b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:46.686512 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fee006e6-4d85-475b-839d-a95f24f9e78b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:46.687229 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fee006e6-4d85-475b-839d-a95f24f9e78b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:46.687680 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fee006e6-4d85-475b-839d-a95f24f9e78b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:46.688102 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fee006e6-4d85-475b-839d-a95f24f9e78b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:46.713567 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-14a37608-0269-479a-9382-ec8d13014cfa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052639 Aug 10 12:49:46.714123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 610/1225] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:46 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:46.717318 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fee006e6-4d85-475b-839d-a95f24f9e78b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045105 Aug 10 12:49:46.717880 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 616/1226] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:46 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:49:46.718741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2070d59e-2c3d-4255-bd90-485c115bdd16 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:46.720898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2070d59e-2c3d-4255-bd90-485c115bdd16 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:46.726519 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2070d59e-2c3d-4255-bd90-485c115bdd16 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:46.726990 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2070d59e-2c3d-4255-bd90-485c115bdd16 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:46.727446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2070d59e-2c3d-4255-bd90-485c115bdd16 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:46.728125 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2070d59e-2c3d-4255-bd90-485c115bdd16 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:46.728564 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2070d59e-2c3d-4255-bd90-485c115bdd16 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:46.728978 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2070d59e-2c3d-4255-bd90-485c115bdd16 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:46.758799 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2070d59e-2c3d-4255-bd90-485c115bdd16 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043679 Aug 10 12:49:46.759491 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 611/1227] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:46 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:47.726196 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-30aba620-a660-4fa1-88c9-7a5dfe604694 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:47.728407 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-30aba620-a660-4fa1-88c9-7a5dfe604694 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:47.728821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-169ba88d-2e78-49cf-800b-c27d8a10d5f7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:47.730915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-169ba88d-2e78-49cf-800b-c27d8a10d5f7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:47.736024 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-30aba620-a660-4fa1-88c9-7a5dfe604694 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:47.736925 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-30aba620-a660-4fa1-88c9-7a5dfe604694 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:47.737372 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-30aba620-a660-4fa1-88c9-7a5dfe604694 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:47.738079 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-30aba620-a660-4fa1-88c9-7a5dfe604694 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:47.738545 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-30aba620-a660-4fa1-88c9-7a5dfe604694 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:47.738950 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-30aba620-a660-4fa1-88c9-7a5dfe604694 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:47.744520 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-169ba88d-2e78-49cf-800b-c27d8a10d5f7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:47.745006 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-169ba88d-2e78-49cf-800b-c27d8a10d5f7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:47.745440 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-169ba88d-2e78-49cf-800b-c27d8a10d5f7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:47.746275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-169ba88d-2e78-49cf-800b-c27d8a10d5f7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:47.746722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-169ba88d-2e78-49cf-800b-c27d8a10d5f7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:47.747696 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-169ba88d-2e78-49cf-800b-c27d8a10d5f7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:47.769506 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-30aba620-a660-4fa1-88c9-7a5dfe604694 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047750 Aug 10 12:49:47.770073 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 617/1228] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:47 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:47.774690 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-aecd8d6a-0028-4386-92b7-fc647c284786 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:47.776812 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-aecd8d6a-0028-4386-92b7-fc647c284786 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:47.778557 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-169ba88d-2e78-49cf-800b-c27d8a10d5f7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053695 Aug 10 12:49:47.779122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 612/1229] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:47 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:49:47.782714 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aecd8d6a-0028-4386-92b7-fc647c284786 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:47.783216 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aecd8d6a-0028-4386-92b7-fc647c284786 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:47.783647 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aecd8d6a-0028-4386-92b7-fc647c284786 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:47.784328 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aecd8d6a-0028-4386-92b7-fc647c284786 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:47.784770 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aecd8d6a-0028-4386-92b7-fc647c284786 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:47.785185 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aecd8d6a-0028-4386-92b7-fc647c284786 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:47.813713 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-aecd8d6a-0028-4386-92b7-fc647c284786 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042666 Aug 10 12:49:47.814258 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 618/1230] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:47 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:48.781596 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-377e1d24-bc0a-4eac-9857-30facf46da83 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:48.783998 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-377e1d24-bc0a-4eac-9857-30facf46da83 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:48.789957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-377e1d24-bc0a-4eac-9857-30facf46da83 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:48.791042 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f194eb35-f284-4dbf-b48b-8d71747ff239 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:48.791624 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-377e1d24-bc0a-4eac-9857-30facf46da83 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:48.791624 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-377e1d24-bc0a-4eac-9857-30facf46da83 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:48.791624 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-377e1d24-bc0a-4eac-9857-30facf46da83 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:48.792018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-377e1d24-bc0a-4eac-9857-30facf46da83 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:48.792475 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f194eb35-f284-4dbf-b48b-8d71747ff239 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:48.792558 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-377e1d24-bc0a-4eac-9857-30facf46da83 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:48.799348 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f194eb35-f284-4dbf-b48b-8d71747ff239 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:48.799835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f194eb35-f284-4dbf-b48b-8d71747ff239 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:48.800276 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f194eb35-f284-4dbf-b48b-8d71747ff239 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:48.800981 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f194eb35-f284-4dbf-b48b-8d71747ff239 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:48.801439 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f194eb35-f284-4dbf-b48b-8d71747ff239 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:48.801864 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f194eb35-f284-4dbf-b48b-8d71747ff239 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:48.817856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:49:48.822693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-377e1d24-bc0a-4eac-9857-30facf46da83 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045833 Aug 10 12:49:48.823429 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 613/1231] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:48 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:48.828846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-58db1a5b-1edc-4d4f-bc0b-3dac5c234dcf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:48.830949 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-58db1a5b-1edc-4d4f-bc0b-3dac5c234dcf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:48.832972 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f194eb35-f284-4dbf-b48b-8d71747ff239 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046615 Aug 10 12:49:48.836846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-58db1a5b-1edc-4d4f-bc0b-3dac5c234dcf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:48.837320 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-58db1a5b-1edc-4d4f-bc0b-3dac5c234dcf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:48.837596 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 619/1232] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:48 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:48.837820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-58db1a5b-1edc-4d4f-bc0b-3dac5c234dcf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:48.838510 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-58db1a5b-1edc-4d4f-bc0b-3dac5c234dcf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:48.838961 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-58db1a5b-1edc-4d4f-bc0b-3dac5c234dcf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:48.839407 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-58db1a5b-1edc-4d4f-bc0b-3dac5c234dcf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:48.868925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-58db1a5b-1edc-4d4f-bc0b-3dac5c234dcf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044517 Aug 10 12:49:48.869466 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 614/1233] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:48 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:49.835790 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-82f4b599-357c-4183-8e34-dd18737701d5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:49.838314 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-82f4b599-357c-4183-8e34-dd18737701d5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:49.844934 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82f4b599-357c-4183-8e34-dd18737701d5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:49.845117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-468c6420-6ba0-4703-9101-f0850a4efe63 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:49.845531 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82f4b599-357c-4183-8e34-dd18737701d5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:49.845845 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82f4b599-357c-4183-8e34-dd18737701d5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:49.846762 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82f4b599-357c-4183-8e34-dd18737701d5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:49.847244 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82f4b599-357c-4183-8e34-dd18737701d5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:49.847358 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-468c6420-6ba0-4703-9101-f0850a4efe63 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:49.847675 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82f4b599-357c-4183-8e34-dd18737701d5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:49.853871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-468c6420-6ba0-4703-9101-f0850a4efe63 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:49.854359 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-468c6420-6ba0-4703-9101-f0850a4efe63 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:49.854793 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-468c6420-6ba0-4703-9101-f0850a4efe63 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:49.855518 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-468c6420-6ba0-4703-9101-f0850a4efe63 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:49.856231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-468c6420-6ba0-4703-9101-f0850a4efe63 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:49.857183 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-468c6420-6ba0-4703-9101-f0850a4efe63 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:49.879299 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-82f4b599-357c-4183-8e34-dd18737701d5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047762 Aug 10 12:49:49.879869 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 620/1234] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:49 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:49.884519 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5b8a208b-6991-4f40-8927-63d68fbc610e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:49.886628 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5b8a208b-6991-4f40-8927-63d68fbc610e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:49.888085 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-468c6420-6ba0-4703-9101-f0850a4efe63 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046789 Aug 10 12:49:49.888703 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 615/1235] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:49 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:49:49.892477 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b8a208b-6991-4f40-8927-63d68fbc610e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:49.892964 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b8a208b-6991-4f40-8927-63d68fbc610e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:49.893396 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b8a208b-6991-4f40-8927-63d68fbc610e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:49.894094 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b8a208b-6991-4f40-8927-63d68fbc610e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:49.894547 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b8a208b-6991-4f40-8927-63d68fbc610e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:49.894971 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b8a208b-6991-4f40-8927-63d68fbc610e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:49.924520 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5b8a208b-6991-4f40-8927-63d68fbc610e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043664 Aug 10 12:49:49.925074 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 621/1236] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:49 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:50.892162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d5f82be0-d79b-436d-9f97-ee1476eb8dd5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:50.894582 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d5f82be0-d79b-436d-9f97-ee1476eb8dd5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:50.901196 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d5f82be0-d79b-436d-9f97-ee1476eb8dd5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:50.901685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d5f82be0-d79b-436d-9f97-ee1476eb8dd5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:50.902120 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d5f82be0-d79b-436d-9f97-ee1476eb8dd5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:50.902609 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5d83a16d-c634-404f-9cb6-ab2413c72cbc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:50.903748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d5f82be0-d79b-436d-9f97-ee1476eb8dd5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:50.903748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d5f82be0-d79b-436d-9f97-ee1476eb8dd5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:50.904334 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d5f82be0-d79b-436d-9f97-ee1476eb8dd5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:50.906168 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5d83a16d-c634-404f-9cb6-ab2413c72cbc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:50.912760 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d83a16d-c634-404f-9cb6-ab2413c72cbc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:50.913379 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d83a16d-c634-404f-9cb6-ab2413c72cbc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:50.913810 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d83a16d-c634-404f-9cb6-ab2413c72cbc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:50.914517 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d83a16d-c634-404f-9cb6-ab2413c72cbc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:50.914941 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d83a16d-c634-404f-9cb6-ab2413c72cbc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:50.915403 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d83a16d-c634-404f-9cb6-ab2413c72cbc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:50.937843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d5f82be0-d79b-436d-9f97-ee1476eb8dd5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049705 Aug 10 12:49:50.938411 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 616/1237] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:50 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:50.942999 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-44413d25-281f-4dfb-84cb-dc12a7e3022c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:50.945124 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-44413d25-281f-4dfb-84cb-dc12a7e3022c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:50.949431 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5d83a16d-c634-404f-9cb6-ab2413c72cbc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052747 Aug 10 12:49:50.950004 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 622/1238] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:50 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:50.951058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-44413d25-281f-4dfb-84cb-dc12a7e3022c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:50.951588 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-44413d25-281f-4dfb-84cb-dc12a7e3022c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:50.952026 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-44413d25-281f-4dfb-84cb-dc12a7e3022c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:50.952715 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-44413d25-281f-4dfb-84cb-dc12a7e3022c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:50.953165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-44413d25-281f-4dfb-84cb-dc12a7e3022c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:50.953589 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-44413d25-281f-4dfb-84cb-dc12a7e3022c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:50.983680 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-44413d25-281f-4dfb-84cb-dc12a7e3022c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044250 Aug 10 12:49:50.984222 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 617/1239] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:50 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:51.952319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6fecc984-c0ac-4b52-ad46-a3072dba70dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:51.954584 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6fecc984-c0ac-4b52-ad46-a3072dba70dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:51.962259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8d3b12ef-8c97-498c-811b-67d2f0e465cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:51.963438 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6fecc984-c0ac-4b52-ad46-a3072dba70dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:51.964098 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6fecc984-c0ac-4b52-ad46-a3072dba70dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:51.964431 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8d3b12ef-8c97-498c-811b-67d2f0e465cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:51.964542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6fecc984-c0ac-4b52-ad46-a3072dba70dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:51.965220 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6fecc984-c0ac-4b52-ad46-a3072dba70dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:51.966400 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6fecc984-c0ac-4b52-ad46-a3072dba70dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:51.966934 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6fecc984-c0ac-4b52-ad46-a3072dba70dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:51.971959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d3b12ef-8c97-498c-811b-67d2f0e465cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:51.972634 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d3b12ef-8c97-498c-811b-67d2f0e465cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:51.973073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d3b12ef-8c97-498c-811b-67d2f0e465cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:51.973775 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d3b12ef-8c97-498c-811b-67d2f0e465cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:51.974228 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d3b12ef-8c97-498c-811b-67d2f0e465cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:51.974654 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d3b12ef-8c97-498c-811b-67d2f0e465cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:51.997503 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6fecc984-c0ac-4b52-ad46-a3072dba70dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049443 Aug 10 12:49:51.999298 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 623/1240] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:51 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:52.003026 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0078a72a-75cb-4065-aa6c-31f94404d40b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:52.004881 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8d3b12ef-8c97-498c-811b-67d2f0e465cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046799 Aug 10 12:49:52.005181 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0078a72a-75cb-4065-aa6c-31f94404d40b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:52.005442 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 618/1241] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:51 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:52.011075 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0078a72a-75cb-4065-aa6c-31f94404d40b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:52.011587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0078a72a-75cb-4065-aa6c-31f94404d40b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:52.012024 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0078a72a-75cb-4065-aa6c-31f94404d40b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:52.013447 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0078a72a-75cb-4065-aa6c-31f94404d40b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:52.014060 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0078a72a-75cb-4065-aa6c-31f94404d40b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:52.014267 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0078a72a-75cb-4065-aa6c-31f94404d40b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:52.049180 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0078a72a-75cb-4065-aa6c-31f94404d40b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049855 Aug 10 12:49:52.049738 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 624/1242] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:51 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:53.009974 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-43d89e6a-c0d2-49a3-9c45-18398381a41a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:53.013253 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-43d89e6a-c0d2-49a3-9c45-18398381a41a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:53.019208 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f743f68e-4329-44f1-baa2-1ef0eb5a5517 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:53.020221 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-43d89e6a-c0d2-49a3-9c45-18398381a41a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:53.020825 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-43d89e6a-c0d2-49a3-9c45-18398381a41a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:53.021134 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-43d89e6a-c0d2-49a3-9c45-18398381a41a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:53.021404 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f743f68e-4329-44f1-baa2-1ef0eb5a5517 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:53.021833 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-43d89e6a-c0d2-49a3-9c45-18398381a41a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:53.022285 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-43d89e6a-c0d2-49a3-9c45-18398381a41a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:53.022698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-43d89e6a-c0d2-49a3-9c45-18398381a41a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:53.027787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f743f68e-4329-44f1-baa2-1ef0eb5a5517 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:53.028782 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f743f68e-4329-44f1-baa2-1ef0eb5a5517 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:53.029217 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f743f68e-4329-44f1-baa2-1ef0eb5a5517 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:53.029916 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f743f68e-4329-44f1-baa2-1ef0eb5a5517 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:53.030367 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f743f68e-4329-44f1-baa2-1ef0eb5a5517 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:53.030791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f743f68e-4329-44f1-baa2-1ef0eb5a5517 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:53.063648 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-43d89e6a-c0d2-49a3-9c45-18398381a41a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057535 Aug 10 12:49:53.064051 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f743f68e-4329-44f1-baa2-1ef0eb5a5517 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049002 Aug 10 12:49:53.064378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 619/1243] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:53 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:53.064625 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 625/1244] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:53 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:53.069427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c5473805-68ec-4c53-b6a2-44577c940d9a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:53.071574 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c5473805-68ec-4c53-b6a2-44577c940d9a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:53.077450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c5473805-68ec-4c53-b6a2-44577c940d9a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:53.077919 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c5473805-68ec-4c53-b6a2-44577c940d9a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:53.078346 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c5473805-68ec-4c53-b6a2-44577c940d9a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:53.079020 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c5473805-68ec-4c53-b6a2-44577c940d9a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:53.079486 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c5473805-68ec-4c53-b6a2-44577c940d9a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:53.079901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c5473805-68ec-4c53-b6a2-44577c940d9a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:53.110759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c5473805-68ec-4c53-b6a2-44577c940d9a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044960 Aug 10 12:49:53.111349 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 620/1245] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:53 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:54.076086 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7e3d5f15-8deb-4c35-829c-3db195feab30 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:54.077900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ac71abbb-6b39-49e0-94a4-9bfa4e9a3b91 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:54.078934 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7e3d5f15-8deb-4c35-829c-3db195feab30 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:54.080037 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ac71abbb-6b39-49e0-94a4-9bfa4e9a3b91 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:54.085278 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7e3d5f15-8deb-4c35-829c-3db195feab30 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:54.085766 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7e3d5f15-8deb-4c35-829c-3db195feab30 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:54.086204 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7e3d5f15-8deb-4c35-829c-3db195feab30 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:54.086448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac71abbb-6b39-49e0-94a4-9bfa4e9a3b91 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:54.086939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac71abbb-6b39-49e0-94a4-9bfa4e9a3b91 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:54.087086 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7e3d5f15-8deb-4c35-829c-3db195feab30 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:54.087413 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac71abbb-6b39-49e0-94a4-9bfa4e9a3b91 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:54.087991 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7e3d5f15-8deb-4c35-829c-3db195feab30 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:54.088428 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7e3d5f15-8deb-4c35-829c-3db195feab30 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:54.094473 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac71abbb-6b39-49e0-94a4-9bfa4e9a3b91 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:54.095024 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac71abbb-6b39-49e0-94a4-9bfa4e9a3b91 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:54.095513 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac71abbb-6b39-49e0-94a4-9bfa4e9a3b91 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:54.122528 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7e3d5f15-8deb-4c35-829c-3db195feab30 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050374 Aug 10 12:49:54.123108 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 626/1246] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:54 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:54.125546 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ac71abbb-6b39-49e0-94a4-9bfa4e9a3b91 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053080 Aug 10 12:49:54.129848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 621/1247] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:54 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:54.129984 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8d1b1ee7-9bba-4947-83f1-c1b576c6be83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:54.129984 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8d1b1ee7-9bba-4947-83f1-c1b576c6be83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:54.135808 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8d1b1ee7-9bba-4947-83f1-c1b576c6be83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:54.136290 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8d1b1ee7-9bba-4947-83f1-c1b576c6be83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:54.136736 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8d1b1ee7-9bba-4947-83f1-c1b576c6be83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:54.137490 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8d1b1ee7-9bba-4947-83f1-c1b576c6be83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:54.137944 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8d1b1ee7-9bba-4947-83f1-c1b576c6be83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:54.138556 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8d1b1ee7-9bba-4947-83f1-c1b576c6be83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:54.166749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8d1b1ee7-9bba-4947-83f1-c1b576c6be83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042635 Aug 10 12:49:54.167354 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 627/1248] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:54 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:54.829849 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:49:54.830076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Wed Aug 10 12:49:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 12:49:55.135209 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a411acde-698f-40d5-88db-692a2a95a00b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:55.137427 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3d8e2524-524e-4336-afeb-ed5d7267c526 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:55.138834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a411acde-698f-40d5-88db-692a2a95a00b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:55.142469 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3d8e2524-524e-4336-afeb-ed5d7267c526 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:55.144644 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a411acde-698f-40d5-88db-692a2a95a00b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:55.145314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a411acde-698f-40d5-88db-692a2a95a00b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:55.145814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a411acde-698f-40d5-88db-692a2a95a00b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:55.146627 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a411acde-698f-40d5-88db-692a2a95a00b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:55.147139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a411acde-698f-40d5-88db-692a2a95a00b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:55.147457 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d8e2524-524e-4336-afeb-ed5d7267c526 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:55.147665 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a411acde-698f-40d5-88db-692a2a95a00b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:55.147939 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d8e2524-524e-4336-afeb-ed5d7267c526 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:55.148357 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d8e2524-524e-4336-afeb-ed5d7267c526 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:55.149259 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d8e2524-524e-4336-afeb-ed5d7267c526 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:55.149710 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d8e2524-524e-4336-afeb-ed5d7267c526 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:55.150140 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d8e2524-524e-4336-afeb-ed5d7267c526 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:55.178103 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a411acde-698f-40d5-88db-692a2a95a00b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047323 Aug 10 12:49:55.179899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 622/1249] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:55 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:55.181894 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3d8e2524-524e-4336-afeb-ed5d7267c526 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048313 Aug 10 12:49:55.182453 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 628/1250] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:55 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:49:55.183128 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b8830350-dfb7-4eb7-aaef-e4a12aee9772 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:55.185965 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b8830350-dfb7-4eb7-aaef-e4a12aee9772 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:55.191709 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8830350-dfb7-4eb7-aaef-e4a12aee9772 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:55.192179 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8830350-dfb7-4eb7-aaef-e4a12aee9772 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:55.192614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8830350-dfb7-4eb7-aaef-e4a12aee9772 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:55.193295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8830350-dfb7-4eb7-aaef-e4a12aee9772 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:55.193739 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8830350-dfb7-4eb7-aaef-e4a12aee9772 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:55.194153 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8830350-dfb7-4eb7-aaef-e4a12aee9772 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:55.223121 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b8830350-dfb7-4eb7-aaef-e4a12aee9772 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043463 Aug 10 12:49:55.223751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 623/1251] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:55 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:56.190173 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-66a42118-e2d8-4bd1-8c6b-0c5a27202cb9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:56.192377 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-66a42118-e2d8-4bd1-8c6b-0c5a27202cb9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:56.193872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-35c87411-55fe-4f7e-8d7d-482bfb6bb271 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:56.196731 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-35c87411-55fe-4f7e-8d7d-482bfb6bb271 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:56.198888 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-66a42118-e2d8-4bd1-8c6b-0c5a27202cb9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:56.199617 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-66a42118-e2d8-4bd1-8c6b-0c5a27202cb9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:56.200193 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-66a42118-e2d8-4bd1-8c6b-0c5a27202cb9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:56.201015 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-66a42118-e2d8-4bd1-8c6b-0c5a27202cb9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:56.201470 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-66a42118-e2d8-4bd1-8c6b-0c5a27202cb9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:56.201893 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-66a42118-e2d8-4bd1-8c6b-0c5a27202cb9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:56.206712 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35c87411-55fe-4f7e-8d7d-482bfb6bb271 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:56.207236 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35c87411-55fe-4f7e-8d7d-482bfb6bb271 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:56.207683 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35c87411-55fe-4f7e-8d7d-482bfb6bb271 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:56.208382 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35c87411-55fe-4f7e-8d7d-482bfb6bb271 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:56.208838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35c87411-55fe-4f7e-8d7d-482bfb6bb271 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:56.209265 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35c87411-55fe-4f7e-8d7d-482bfb6bb271 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:56.215342 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:49:56.233811 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-66a42118-e2d8-4bd1-8c6b-0c5a27202cb9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047750 Aug 10 12:49:56.234366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 629/1252] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:56 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:56.239206 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-14eaaead-d5ad-42b0-a7e2-fcc17ecec424 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:56.240521 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-35c87411-55fe-4f7e-8d7d-482bfb6bb271 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050150 Aug 10 12:49:56.241087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 624/1253] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:56 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:56.241412 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-14eaaead-d5ad-42b0-a7e2-fcc17ecec424 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:56.247708 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-14eaaead-d5ad-42b0-a7e2-fcc17ecec424 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:56.248233 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-14eaaead-d5ad-42b0-a7e2-fcc17ecec424 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:56.248665 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-14eaaead-d5ad-42b0-a7e2-fcc17ecec424 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:56.249349 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-14eaaead-d5ad-42b0-a7e2-fcc17ecec424 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:56.249792 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-14eaaead-d5ad-42b0-a7e2-fcc17ecec424 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:56.250208 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-14eaaead-d5ad-42b0-a7e2-fcc17ecec424 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:56.279530 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-14eaaead-d5ad-42b0-a7e2-fcc17ecec424 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044093 Aug 10 12:49:56.280096 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 630/1254] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:56 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:57.248543 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f304005b-aa23-4c56-bda3-038d5c09795b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:57.251055 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f304005b-aa23-4c56-bda3-038d5c09795b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:57.253847 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4ca8615d-a69c-4843-99c2-d93994331fa3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:57.256117 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4ca8615d-a69c-4843-99c2-d93994331fa3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:57.258198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f304005b-aa23-4c56-bda3-038d5c09795b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:57.258685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f304005b-aa23-4c56-bda3-038d5c09795b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:57.259122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f304005b-aa23-4c56-bda3-038d5c09795b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:57.259859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f304005b-aa23-4c56-bda3-038d5c09795b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:57.265804 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f304005b-aa23-4c56-bda3-038d5c09795b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:57.271358 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f304005b-aa23-4c56-bda3-038d5c09795b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:57.271637 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4ca8615d-a69c-4843-99c2-d93994331fa3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:57.271637 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4ca8615d-a69c-4843-99c2-d93994331fa3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:57.271637 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4ca8615d-a69c-4843-99c2-d93994331fa3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:57.271637 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4ca8615d-a69c-4843-99c2-d93994331fa3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:57.271929 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4ca8615d-a69c-4843-99c2-d93994331fa3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:57.271929 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4ca8615d-a69c-4843-99c2-d93994331fa3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:57.298576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f304005b-aa23-4c56-bda3-038d5c09795b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056443 Aug 10 12:49:57.299191 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 625/1255] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:57 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:57.303943 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-745b16d5-44b8-4b28-8e95-0c952083f89f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:57.306056 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-745b16d5-44b8-4b28-8e95-0c952083f89f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:57.311792 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-745b16d5-44b8-4b28-8e95-0c952083f89f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:57.311933 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4ca8615d-a69c-4843-99c2-d93994331fa3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062016 Aug 10 12:49:57.312276 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-745b16d5-44b8-4b28-8e95-0c952083f89f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:57.312713 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 631/1256] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:57 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:49:57.312861 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-745b16d5-44b8-4b28-8e95-0c952083f89f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:57.313403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-745b16d5-44b8-4b28-8e95-0c952083f89f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:57.313856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-745b16d5-44b8-4b28-8e95-0c952083f89f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:57.314284 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-745b16d5-44b8-4b28-8e95-0c952083f89f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:57.343489 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-745b16d5-44b8-4b28-8e95-0c952083f89f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043260 Aug 10 12:49:57.344040 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 626/1257] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:57 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:58.310249 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-11096fe2-7586-42e2-81f6-49e7a36777ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:58.312422 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-11096fe2-7586-42e2-81f6-49e7a36777ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:58.318941 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11096fe2-7586-42e2-81f6-49e7a36777ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:58.319297 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11096fe2-7586-42e2-81f6-49e7a36777ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:58.319737 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11096fe2-7586-42e2-81f6-49e7a36777ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:58.320431 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11096fe2-7586-42e2-81f6-49e7a36777ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:58.320879 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11096fe2-7586-42e2-81f6-49e7a36777ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:58.321306 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11096fe2-7586-42e2-81f6-49e7a36777ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:58.324182 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1fe6dc94-cb51-46e5-bbfd-924256457df9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:58.327135 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1fe6dc94-cb51-46e5-bbfd-924256457df9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:58.330481 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=90 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:49:58.334206 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1fe6dc94-cb51-46e5-bbfd-924256457df9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:58.334888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1fe6dc94-cb51-46e5-bbfd-924256457df9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:58.335527 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1fe6dc94-cb51-46e5-bbfd-924256457df9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:58.336218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1fe6dc94-cb51-46e5-bbfd-924256457df9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:58.336783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1fe6dc94-cb51-46e5-bbfd-924256457df9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:58.337205 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1fe6dc94-cb51-46e5-bbfd-924256457df9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:58.351698 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-11096fe2-7586-42e2-81f6-49e7a36777ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045740 Aug 10 12:49:58.352424 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 632/1258] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:58 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:58.357642 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7ed9d5a6-335b-4dd9-8eb7-c5f1a65b2fbf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:58.359844 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7ed9d5a6-335b-4dd9-8eb7-c5f1a65b2fbf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:58.365855 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7ed9d5a6-335b-4dd9-8eb7-c5f1a65b2fbf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:58.366335 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7ed9d5a6-335b-4dd9-8eb7-c5f1a65b2fbf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:58.366768 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7ed9d5a6-335b-4dd9-8eb7-c5f1a65b2fbf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:58.367493 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7ed9d5a6-335b-4dd9-8eb7-c5f1a65b2fbf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:58.367608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1fe6dc94-cb51-46e5-bbfd-924256457df9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047306 Aug 10 12:49:58.367945 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7ed9d5a6-335b-4dd9-8eb7-c5f1a65b2fbf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:58.368371 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7ed9d5a6-335b-4dd9-8eb7-c5f1a65b2fbf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:58.372607 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 627/1259] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:58 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:49:58.398544 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7ed9d5a6-335b-4dd9-8eb7-c5f1a65b2fbf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044929 Aug 10 12:49:58.399302 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 633/1260] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:58 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:49:58.489807 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:49:58.489970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Wed Aug 10 12:49:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 12:49:59.364252 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-76fc60cb-c035-4526-a352-cc1346d4ec9a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:59.366424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-76fc60cb-c035-4526-a352-cc1346d4ec9a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:59.373165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76fc60cb-c035-4526-a352-cc1346d4ec9a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:59.373645 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76fc60cb-c035-4526-a352-cc1346d4ec9a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:59.374080 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76fc60cb-c035-4526-a352-cc1346d4ec9a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:59.374772 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76fc60cb-c035-4526-a352-cc1346d4ec9a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:59.375239 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76fc60cb-c035-4526-a352-cc1346d4ec9a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:59.375675 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76fc60cb-c035-4526-a352-cc1346d4ec9a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:59.379473 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9e59719e-6020-402d-9d5a-5b36b9166617 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:59.381647 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9e59719e-6020-402d-9d5a-5b36b9166617 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:59.388663 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e59719e-6020-402d-9d5a-5b36b9166617 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:59.389149 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e59719e-6020-402d-9d5a-5b36b9166617 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:59.389577 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e59719e-6020-402d-9d5a-5b36b9166617 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:59.390266 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e59719e-6020-402d-9d5a-5b36b9166617 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:59.390713 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e59719e-6020-402d-9d5a-5b36b9166617 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:59.391132 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e59719e-6020-402d-9d5a-5b36b9166617 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:59.407885 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-76fc60cb-c035-4526-a352-cc1346d4ec9a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047569 Aug 10 12:49:59.408445 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 628/1261] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:49:59 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:49:59.413027 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-44195058-6111-4570-a63e-c353f8567432 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:49:59.415146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-44195058-6111-4570-a63e-c353f8567432 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:49:59.421179 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9e59719e-6020-402d-9d5a-5b36b9166617 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045550 Aug 10 12:49:59.424452 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-44195058-6111-4570-a63e-c353f8567432 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:59.424784 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 634/1262] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:59 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:49:59.424874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-44195058-6111-4570-a63e-c353f8567432 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:59.424874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-44195058-6111-4570-a63e-c353f8567432 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:59.424874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-44195058-6111-4570-a63e-c353f8567432 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:49:59.424874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-44195058-6111-4570-a63e-c353f8567432 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:49:59.425168 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-44195058-6111-4570-a63e-c353f8567432 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:49:59.453816 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-44195058-6111-4570-a63e-c353f8567432 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044372 Aug 10 12:49:59.454354 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 629/1263] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:49:59 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:00.421384 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-64b9dc39-b58f-4c65-baf5-2b13b09b8861 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:00.423549 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-64b9dc39-b58f-4c65-baf5-2b13b09b8861 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:00.429839 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-64b9dc39-b58f-4c65-baf5-2b13b09b8861 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:00.430314 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-64b9dc39-b58f-4c65-baf5-2b13b09b8861 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:00.430743 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-64b9dc39-b58f-4c65-baf5-2b13b09b8861 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:00.431486 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-64b9dc39-b58f-4c65-baf5-2b13b09b8861 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:00.431933 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-64b9dc39-b58f-4c65-baf5-2b13b09b8861 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:00.432354 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-64b9dc39-b58f-4c65-baf5-2b13b09b8861 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:00.433218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-77144ff1-8145-4cea-9119-e49bf499a3e8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:00.435415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-77144ff1-8145-4cea-9119-e49bf499a3e8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:00.441781 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-77144ff1-8145-4cea-9119-e49bf499a3e8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:00.442263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-77144ff1-8145-4cea-9119-e49bf499a3e8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:00.442709 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-77144ff1-8145-4cea-9119-e49bf499a3e8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:00.443450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-77144ff1-8145-4cea-9119-e49bf499a3e8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:00.443896 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-77144ff1-8145-4cea-9119-e49bf499a3e8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:00.444325 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-77144ff1-8145-4cea-9119-e49bf499a3e8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:00.458850 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:50:00.463536 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-64b9dc39-b58f-4c65-baf5-2b13b09b8861 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047392 Aug 10 12:50:00.473342 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 635/1264] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:00 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:00.473342 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-17b5ed32-ea2b-4a18-9f71-e227fb13df2e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:00.473342 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-17b5ed32-ea2b-4a18-9f71-e227fb13df2e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:00.476568 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-77144ff1-8145-4cea-9119-e49bf499a3e8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047177 Aug 10 12:50:00.477139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 630/1265] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:00 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:50:00.479362 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17b5ed32-ea2b-4a18-9f71-e227fb13df2e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:00.479835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17b5ed32-ea2b-4a18-9f71-e227fb13df2e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:00.480261 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17b5ed32-ea2b-4a18-9f71-e227fb13df2e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:00.481216 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17b5ed32-ea2b-4a18-9f71-e227fb13df2e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:00.482546 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17b5ed32-ea2b-4a18-9f71-e227fb13df2e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:00.482968 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17b5ed32-ea2b-4a18-9f71-e227fb13df2e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:00.515145 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-17b5ed32-ea2b-4a18-9f71-e227fb13df2e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049807 Aug 10 12:50:00.520412 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 636/1266] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:00 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:01.440002 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:50:01.440466 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Wed Aug 10 12:50:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 12:50:01.481118 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a6c91817-4cfc-4c39-b43b-ff14a8c99799 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:01.483668 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a6c91817-4cfc-4c39-b43b-ff14a8c99799 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:01.488735 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f2eba5b4-5678-4aed-9537-d0d3c3ad11c4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:01.491057 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f2eba5b4-5678-4aed-9537-d0d3c3ad11c4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:01.491841 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a6c91817-4cfc-4c39-b43b-ff14a8c99799 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:01.492440 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a6c91817-4cfc-4c39-b43b-ff14a8c99799 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:01.492750 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a6c91817-4cfc-4c39-b43b-ff14a8c99799 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:01.493446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a6c91817-4cfc-4c39-b43b-ff14a8c99799 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:01.494104 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a6c91817-4cfc-4c39-b43b-ff14a8c99799 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:01.494316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a6c91817-4cfc-4c39-b43b-ff14a8c99799 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:01.497978 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f2eba5b4-5678-4aed-9537-d0d3c3ad11c4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:01.498705 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f2eba5b4-5678-4aed-9537-d0d3c3ad11c4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:01.498896 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f2eba5b4-5678-4aed-9537-d0d3c3ad11c4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:01.499915 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f2eba5b4-5678-4aed-9537-d0d3c3ad11c4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:01.500374 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f2eba5b4-5678-4aed-9537-d0d3c3ad11c4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:01.500847 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f2eba5b4-5678-4aed-9537-d0d3c3ad11c4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:01.530886 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f2eba5b4-5678-4aed-9537-d0d3c3ad11c4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046002 Aug 10 12:50:01.531484 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a6c91817-4cfc-4c39-b43b-ff14a8c99799 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054467 Aug 10 12:50:01.531649 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 637/1267] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:01 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:01.532197 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 631/1268] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:01 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:01.536043 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-10d5310b-d275-4316-91e7-76d6fbf1080a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:01.538151 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-10d5310b-d275-4316-91e7-76d6fbf1080a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:01.544447 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-10d5310b-d275-4316-91e7-76d6fbf1080a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:01.545035 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-10d5310b-d275-4316-91e7-76d6fbf1080a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:01.545470 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-10d5310b-d275-4316-91e7-76d6fbf1080a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:01.546155 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-10d5310b-d275-4316-91e7-76d6fbf1080a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:01.546603 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-10d5310b-d275-4316-91e7-76d6fbf1080a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:01.547022 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-10d5310b-d275-4316-91e7-76d6fbf1080a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:01.575911 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-10d5310b-d275-4316-91e7-76d6fbf1080a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043428 Aug 10 12:50:01.576461 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 638/1269] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:01 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:02.542779 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1bd0619b-fe05-4adf-b335-6f25fe4076f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:02.544294 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-20574b71-3ebe-4a46-96d1-bc9001b4cb1c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:02.545574 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1bd0619b-fe05-4adf-b335-6f25fe4076f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:02.546516 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-20574b71-3ebe-4a46-96d1-bc9001b4cb1c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:02.551993 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1bd0619b-fe05-4adf-b335-6f25fe4076f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:02.552480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1bd0619b-fe05-4adf-b335-6f25fe4076f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:02.552802 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20574b71-3ebe-4a46-96d1-bc9001b4cb1c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:02.552921 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1bd0619b-fe05-4adf-b335-6f25fe4076f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:02.553273 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20574b71-3ebe-4a46-96d1-bc9001b4cb1c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:02.553598 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1bd0619b-fe05-4adf-b335-6f25fe4076f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:02.553741 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20574b71-3ebe-4a46-96d1-bc9001b4cb1c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:02.554046 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1bd0619b-fe05-4adf-b335-6f25fe4076f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:02.554369 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20574b71-3ebe-4a46-96d1-bc9001b4cb1c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:02.554474 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1bd0619b-fe05-4adf-b335-6f25fe4076f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:02.554813 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20574b71-3ebe-4a46-96d1-bc9001b4cb1c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:02.555283 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20574b71-3ebe-4a46-96d1-bc9001b4cb1c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:02.584275 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-20574b71-3ebe-4a46-96d1-bc9001b4cb1c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044435 Aug 10 12:50:02.584763 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1bd0619b-fe05-4adf-b335-6f25fe4076f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046129 Aug 10 12:50:02.584926 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 639/1270] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:02 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:02.589068 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 632/1271] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:02 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:02.589944 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-271fbfd3-fb91-4acb-bba9-0db81e182f81 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:02.592114 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-271fbfd3-fb91-4acb-bba9-0db81e182f81 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:02.597752 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-271fbfd3-fb91-4acb-bba9-0db81e182f81 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:02.598227 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-271fbfd3-fb91-4acb-bba9-0db81e182f81 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:02.598651 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-271fbfd3-fb91-4acb-bba9-0db81e182f81 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:02.599359 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-271fbfd3-fb91-4acb-bba9-0db81e182f81 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:02.599808 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-271fbfd3-fb91-4acb-bba9-0db81e182f81 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:02.600224 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-271fbfd3-fb91-4acb-bba9-0db81e182f81 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:02.630688 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-271fbfd3-fb91-4acb-bba9-0db81e182f81 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044886 Aug 10 12:50:02.631251 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 640/1272] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:02 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:03.598013 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-10b0fdc2-a990-4580-b3c3-6e5fea8038a0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:03.598499 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-50b52ca9-eeb5-4525-8f2d-8e695c9a8615 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:03.600164 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-50b52ca9-eeb5-4525-8f2d-8e695c9a8615 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:03.600306 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-10b0fdc2-a990-4580-b3c3-6e5fea8038a0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:03.606882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50b52ca9-eeb5-4525-8f2d-8e695c9a8615 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:03.607335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-10b0fdc2-a990-4580-b3c3-6e5fea8038a0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:03.607473 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50b52ca9-eeb5-4525-8f2d-8e695c9a8615 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:03.607816 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50b52ca9-eeb5-4525-8f2d-8e695c9a8615 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:03.607922 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-10b0fdc2-a990-4580-b3c3-6e5fea8038a0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:03.608254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-10b0fdc2-a990-4580-b3c3-6e5fea8038a0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:03.608517 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50b52ca9-eeb5-4525-8f2d-8e695c9a8615 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:03.608951 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-10b0fdc2-a990-4580-b3c3-6e5fea8038a0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:03.609049 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50b52ca9-eeb5-4525-8f2d-8e695c9a8615 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:03.609378 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50b52ca9-eeb5-4525-8f2d-8e695c9a8615 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:03.609486 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-10b0fdc2-a990-4580-b3c3-6e5fea8038a0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:03.609819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-10b0fdc2-a990-4580-b3c3-6e5fea8038a0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:03.639776 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-50b52ca9-eeb5-4525-8f2d-8e695c9a8615 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045837 Aug 10 12:50:03.640348 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 641/1273] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:03 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:03.641456 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-10b0fdc2-a990-4580-b3c3-6e5fea8038a0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047569 Aug 10 12:50:03.642304 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 633/1274] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:03 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:03.644871 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9260ffd4-fdd4-4cd6-9ff0-ccf20225c311 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:03.646966 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9260ffd4-fdd4-4cd6-9ff0-ccf20225c311 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:03.652706 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9260ffd4-fdd4-4cd6-9ff0-ccf20225c311 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:03.653327 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9260ffd4-fdd4-4cd6-9ff0-ccf20225c311 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:03.653810 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9260ffd4-fdd4-4cd6-9ff0-ccf20225c311 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:03.654672 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9260ffd4-fdd4-4cd6-9ff0-ccf20225c311 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:03.655126 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9260ffd4-fdd4-4cd6-9ff0-ccf20225c311 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:03.655586 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9260ffd4-fdd4-4cd6-9ff0-ccf20225c311 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:03.683307 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9260ffd4-fdd4-4cd6-9ff0-ccf20225c311 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041960 Aug 10 12:50:03.683855 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 642/1275] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:03 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:04.651548 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-eb9b8ddd-0ab7-4c72-a89b-f877aac7b4d3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:04.654428 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9682423c-85b8-4240-9e5b-2f42821c99df tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:04.654850 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-eb9b8ddd-0ab7-4c72-a89b-f877aac7b4d3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:04.656726 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9682423c-85b8-4240-9e5b-2f42821c99df tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:04.661177 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb9b8ddd-0ab7-4c72-a89b-f877aac7b4d3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:04.661656 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb9b8ddd-0ab7-4c72-a89b-f877aac7b4d3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:04.662142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb9b8ddd-0ab7-4c72-a89b-f877aac7b4d3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:04.662837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb9b8ddd-0ab7-4c72-a89b-f877aac7b4d3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:04.663070 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9682423c-85b8-4240-9e5b-2f42821c99df tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:04.663379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb9b8ddd-0ab7-4c72-a89b-f877aac7b4d3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:04.663586 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9682423c-85b8-4240-9e5b-2f42821c99df tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:04.663799 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb9b8ddd-0ab7-4c72-a89b-f877aac7b4d3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:04.664022 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9682423c-85b8-4240-9e5b-2f42821c99df tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:04.664727 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9682423c-85b8-4240-9e5b-2f42821c99df tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:04.665176 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9682423c-85b8-4240-9e5b-2f42821c99df tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:04.665602 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9682423c-85b8-4240-9e5b-2f42821c99df tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:04.694112 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9682423c-85b8-4240-9e5b-2f42821c99df tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044175 Aug 10 12:50:04.694561 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-eb9b8ddd-0ab7-4c72-a89b-f877aac7b4d3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047191 Aug 10 12:50:04.694703 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 643/1276] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:04 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:04.698507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 634/1277] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:04 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:04.699261 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6c931819-7223-4505-8fba-609096985f83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:04.701967 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6c931819-7223-4505-8fba-609096985f83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:04.707636 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6c931819-7223-4505-8fba-609096985f83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:04.708116 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6c931819-7223-4505-8fba-609096985f83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:04.708552 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6c931819-7223-4505-8fba-609096985f83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:04.709248 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6c931819-7223-4505-8fba-609096985f83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:04.709702 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6c931819-7223-4505-8fba-609096985f83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:04.710128 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6c931819-7223-4505-8fba-609096985f83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:04.739035 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6c931819-7223-4505-8fba-609096985f83 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043380 Aug 10 12:50:04.739610 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 644/1278] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:04 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:05.707199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-579a96e3-b23f-48c8-b2ec-6ee306dbbd7c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:05.707689 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8f8cb2a9-0da8-473e-b1f5-f9773c4c24e1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:05.709399 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-579a96e3-b23f-48c8-b2ec-6ee306dbbd7c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:05.709631 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8f8cb2a9-0da8-473e-b1f5-f9773c4c24e1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:05.716367 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8f8cb2a9-0da8-473e-b1f5-f9773c4c24e1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:05.716526 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-579a96e3-b23f-48c8-b2ec-6ee306dbbd7c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:05.716767 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8f8cb2a9-0da8-473e-b1f5-f9773c4c24e1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:05.716921 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-579a96e3-b23f-48c8-b2ec-6ee306dbbd7c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:05.717209 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8f8cb2a9-0da8-473e-b1f5-f9773c4c24e1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:05.717361 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-579a96e3-b23f-48c8-b2ec-6ee306dbbd7c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:05.717940 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8f8cb2a9-0da8-473e-b1f5-f9773c4c24e1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:05.718049 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-579a96e3-b23f-48c8-b2ec-6ee306dbbd7c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:05.718397 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8f8cb2a9-0da8-473e-b1f5-f9773c4c24e1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:05.718529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-579a96e3-b23f-48c8-b2ec-6ee306dbbd7c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:05.718823 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8f8cb2a9-0da8-473e-b1f5-f9773c4c24e1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:05.718929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-579a96e3-b23f-48c8-b2ec-6ee306dbbd7c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:05.748912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-579a96e3-b23f-48c8-b2ec-6ee306dbbd7c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045838 Aug 10 12:50:05.749329 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8f8cb2a9-0da8-473e-b1f5-f9773c4c24e1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046051 Aug 10 12:50:05.749756 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 635/1279] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:05 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:05.753871 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 645/1280] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:05 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:05.754230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-91328f56-53ec-4914-8c36-f6c6747ead21 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:05.756323 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-91328f56-53ec-4914-8c36-f6c6747ead21 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:05.762027 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91328f56-53ec-4914-8c36-f6c6747ead21 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:05.763150 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91328f56-53ec-4914-8c36-f6c6747ead21 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:05.763840 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91328f56-53ec-4914-8c36-f6c6747ead21 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:05.764530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91328f56-53ec-4914-8c36-f6c6747ead21 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:05.764976 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91328f56-53ec-4914-8c36-f6c6747ead21 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:05.765398 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91328f56-53ec-4914-8c36-f6c6747ead21 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:05.793070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-91328f56-53ec-4914-8c36-f6c6747ead21 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042467 Aug 10 12:50:05.793604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 636/1281] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:05 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:06.761483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8c7006ca-053e-4659-98c5-0ed44dd96b5e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:06.762213 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1e275e29-8de7-4945-8b10-7ff1038fda33 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:06.764879 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8c7006ca-053e-4659-98c5-0ed44dd96b5e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:06.765163 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1e275e29-8de7-4945-8b10-7ff1038fda33 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:06.771529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c7006ca-053e-4659-98c5-0ed44dd96b5e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:06.771668 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1e275e29-8de7-4945-8b10-7ff1038fda33 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:06.771991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c7006ca-053e-4659-98c5-0ed44dd96b5e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:06.772110 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1e275e29-8de7-4945-8b10-7ff1038fda33 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:06.772416 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c7006ca-053e-4659-98c5-0ed44dd96b5e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:06.772534 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1e275e29-8de7-4945-8b10-7ff1038fda33 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:06.773138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c7006ca-053e-4659-98c5-0ed44dd96b5e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:06.773498 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1e275e29-8de7-4945-8b10-7ff1038fda33 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:06.773634 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c7006ca-053e-4659-98c5-0ed44dd96b5e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:06.773962 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1e275e29-8de7-4945-8b10-7ff1038fda33 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:06.774092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c7006ca-053e-4659-98c5-0ed44dd96b5e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:06.774388 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1e275e29-8de7-4945-8b10-7ff1038fda33 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:06.777985 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:50:06.803636 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8c7006ca-053e-4659-98c5-0ed44dd96b5e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046022 Aug 10 12:50:06.804468 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 637/1282] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:06 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:06.805062 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1e275e29-8de7-4945-8b10-7ff1038fda33 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047917 Aug 10 12:50:06.805778 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 646/1283] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:06 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:06.810189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5bb71142-a20e-4556-887b-4122418b3356 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:06.812495 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5bb71142-a20e-4556-887b-4122418b3356 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:06.818240 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5bb71142-a20e-4556-887b-4122418b3356 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:06.818717 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5bb71142-a20e-4556-887b-4122418b3356 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:06.819152 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5bb71142-a20e-4556-887b-4122418b3356 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:06.819856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5bb71142-a20e-4556-887b-4122418b3356 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:06.820308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5bb71142-a20e-4556-887b-4122418b3356 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:06.820726 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5bb71142-a20e-4556-887b-4122418b3356 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:06.848616 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5bb71142-a20e-4556-887b-4122418b3356 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043028 Aug 10 12:50:06.849155 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 638/1284] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:06 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:07.816615 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fc09c642-e568-4f4a-be8c-a2fb6e7dd98a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:07.817203 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-11f646f5-3c81-4fb2-869a-8d48573afa45 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:07.819487 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-11f646f5-3c81-4fb2-869a-8d48573afa45 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:07.820526 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fc09c642-e568-4f4a-be8c-a2fb6e7dd98a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:07.826663 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11f646f5-3c81-4fb2-869a-8d48573afa45 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:07.827268 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11f646f5-3c81-4fb2-869a-8d48573afa45 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:07.827678 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fc09c642-e568-4f4a-be8c-a2fb6e7dd98a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:07.827836 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11f646f5-3c81-4fb2-869a-8d48573afa45 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:07.828196 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fc09c642-e568-4f4a-be8c-a2fb6e7dd98a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:07.828545 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11f646f5-3c81-4fb2-869a-8d48573afa45 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:07.828662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fc09c642-e568-4f4a-be8c-a2fb6e7dd98a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:07.828995 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11f646f5-3c81-4fb2-869a-8d48573afa45 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:07.829313 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fc09c642-e568-4f4a-be8c-a2fb6e7dd98a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:07.829412 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11f646f5-3c81-4fb2-869a-8d48573afa45 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:07.829793 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fc09c642-e568-4f4a-be8c-a2fb6e7dd98a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:07.830215 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fc09c642-e568-4f4a-be8c-a2fb6e7dd98a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:07.860873 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-11f646f5-3c81-4fb2-869a-8d48573afa45 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048594 Aug 10 12:50:07.861085 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fc09c642-e568-4f4a-be8c-a2fb6e7dd98a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048494 Aug 10 12:50:07.865395 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 647/1286] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:07 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:07.865562 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 639/1286] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:07 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:50:07.866191 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-53b30ec7-07b8-4fa2-a30f-ffaa7e10dde1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:07.868291 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-53b30ec7-07b8-4fa2-a30f-ffaa7e10dde1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:07.874769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53b30ec7-07b8-4fa2-a30f-ffaa7e10dde1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:07.875271 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53b30ec7-07b8-4fa2-a30f-ffaa7e10dde1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:07.875703 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53b30ec7-07b8-4fa2-a30f-ffaa7e10dde1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:07.876376 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53b30ec7-07b8-4fa2-a30f-ffaa7e10dde1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:07.876825 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53b30ec7-07b8-4fa2-a30f-ffaa7e10dde1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:07.877242 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53b30ec7-07b8-4fa2-a30f-ffaa7e10dde1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:07.905054 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-53b30ec7-07b8-4fa2-a30f-ffaa7e10dde1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042607 Aug 10 12:50:07.905586 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 640/1287] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:07 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:08.873756 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d6b1b55c-e990-43da-9cf4-f8c71a2745a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:08.874277 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-60a7f96c-0bd2-4e57-937b-7ab49dcdce0d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:08.876533 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-60a7f96c-0bd2-4e57-937b-7ab49dcdce0d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:08.877054 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d6b1b55c-e990-43da-9cf4-f8c71a2745a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:08.883133 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60a7f96c-0bd2-4e57-937b-7ab49dcdce0d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:08.883708 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60a7f96c-0bd2-4e57-937b-7ab49dcdce0d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:08.883846 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d6b1b55c-e990-43da-9cf4-f8c71a2745a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:08.884209 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d6b1b55c-e990-43da-9cf4-f8c71a2745a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:08.884339 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60a7f96c-0bd2-4e57-937b-7ab49dcdce0d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:08.884644 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d6b1b55c-e990-43da-9cf4-f8c71a2745a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:08.885126 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60a7f96c-0bd2-4e57-937b-7ab49dcdce0d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:08.885393 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d6b1b55c-e990-43da-9cf4-f8c71a2745a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:08.885699 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60a7f96c-0bd2-4e57-937b-7ab49dcdce0d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:08.885845 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d6b1b55c-e990-43da-9cf4-f8c71a2745a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:08.886244 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60a7f96c-0bd2-4e57-937b-7ab49dcdce0d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:08.886356 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d6b1b55c-e990-43da-9cf4-f8c71a2745a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:08.916392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-60a7f96c-0bd2-4e57-937b-7ab49dcdce0d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046918 Aug 10 12:50:08.916623 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d6b1b55c-e990-43da-9cf4-f8c71a2745a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047261 Aug 10 12:50:08.917238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 641/1288] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:08 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:50:08.917383 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 648/1289] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:08 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:08.922354 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-09df4aa4-8bcd-4207-8d10-fe9bd924489f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:08.924479 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-09df4aa4-8bcd-4207-8d10-fe9bd924489f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:08.930071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-09df4aa4-8bcd-4207-8d10-fe9bd924489f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:08.930543 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-09df4aa4-8bcd-4207-8d10-fe9bd924489f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:08.930970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-09df4aa4-8bcd-4207-8d10-fe9bd924489f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:08.931674 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-09df4aa4-8bcd-4207-8d10-fe9bd924489f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:08.932117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-09df4aa4-8bcd-4207-8d10-fe9bd924489f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:08.932531 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-09df4aa4-8bcd-4207-8d10-fe9bd924489f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:08.960733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-09df4aa4-8bcd-4207-8d10-fe9bd924489f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042704 Aug 10 12:50:08.961286 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 642/1290] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:08 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:09.929139 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-15285a32-b9f5-4b3e-99e6-9901bc883faf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:09.930274 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bcf9d384-25f9-4558-b4ef-9f9990d06634 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:09.931314 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-15285a32-b9f5-4b3e-99e6-9901bc883faf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:09.932510 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bcf9d384-25f9-4558-b4ef-9f9990d06634 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:09.937759 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15285a32-b9f5-4b3e-99e6-9901bc883faf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:09.938247 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15285a32-b9f5-4b3e-99e6-9901bc883faf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:09.938682 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15285a32-b9f5-4b3e-99e6-9901bc883faf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:09.938795 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bcf9d384-25f9-4558-b4ef-9f9990d06634 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:09.939253 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bcf9d384-25f9-4558-b4ef-9f9990d06634 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:09.939416 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15285a32-b9f5-4b3e-99e6-9901bc883faf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:09.939854 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15285a32-b9f5-4b3e-99e6-9901bc883faf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:09.940282 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15285a32-b9f5-4b3e-99e6-9901bc883faf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:09.940530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bcf9d384-25f9-4558-b4ef-9f9990d06634 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:09.941524 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bcf9d384-25f9-4558-b4ef-9f9990d06634 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:09.941977 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bcf9d384-25f9-4558-b4ef-9f9990d06634 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:09.942396 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bcf9d384-25f9-4558-b4ef-9f9990d06634 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:09.971006 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-15285a32-b9f5-4b3e-99e6-9901bc883faf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045721 Aug 10 12:50:09.971603 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 649/1291] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:09 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:09.973081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bcf9d384-25f9-4558-b4ef-9f9990d06634 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047464 Aug 10 12:50:09.974815 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 643/1292] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:09 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:50:09.976138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-cff0c9ad-2470-4aae-bb37-41f7aa68cbb1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:09.978241 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-cff0c9ad-2470-4aae-bb37-41f7aa68cbb1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:09.984226 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cff0c9ad-2470-4aae-bb37-41f7aa68cbb1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:09.984710 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cff0c9ad-2470-4aae-bb37-41f7aa68cbb1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:09.985137 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cff0c9ad-2470-4aae-bb37-41f7aa68cbb1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:09.985823 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cff0c9ad-2470-4aae-bb37-41f7aa68cbb1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:09.986271 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cff0c9ad-2470-4aae-bb37-41f7aa68cbb1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:09.986690 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cff0c9ad-2470-4aae-bb37-41f7aa68cbb1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:10.014913 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-cff0c9ad-2470-4aae-bb37-41f7aa68cbb1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042324 Aug 10 12:50:10.015480 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 650/1293] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:09 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:10.984873 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7df7348f-e976-4093-a46f-6fed2788661a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:10.985457 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7bdd9e5f-83ab-4aee-ba61-962372c31253 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:10.987462 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7df7348f-e976-4093-a46f-6fed2788661a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:10.987609 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7bdd9e5f-83ab-4aee-ba61-962372c31253 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:10.994019 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7df7348f-e976-4093-a46f-6fed2788661a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:10.994504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7df7348f-e976-4093-a46f-6fed2788661a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:10.994781 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7bdd9e5f-83ab-4aee-ba61-962372c31253 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:10.994930 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7df7348f-e976-4093-a46f-6fed2788661a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:10.995284 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7bdd9e5f-83ab-4aee-ba61-962372c31253 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:10.996021 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7bdd9e5f-83ab-4aee-ba61-962372c31253 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:10.996153 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7df7348f-e976-4093-a46f-6fed2788661a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:10.996501 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7df7348f-e976-4093-a46f-6fed2788661a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:10.996746 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7bdd9e5f-83ab-4aee-ba61-962372c31253 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:10.996924 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7df7348f-e976-4093-a46f-6fed2788661a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:10.997377 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7bdd9e5f-83ab-4aee-ba61-962372c31253 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:10.997786 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7bdd9e5f-83ab-4aee-ba61-962372c31253 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:11.027940 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7df7348f-e976-4093-a46f-6fed2788661a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048165 Aug 10 12:50:11.028283 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7bdd9e5f-83ab-4aee-ba61-962372c31253 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047307 Aug 10 12:50:11.032787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 644/1294] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:10 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:11.032949 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 651/1295] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:10 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:50:11.033514 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e5d7a6a1-fc5a-46f5-a2f6-6f1990054a7b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:11.035645 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e5d7a6a1-fc5a-46f5-a2f6-6f1990054a7b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:11.041250 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e5d7a6a1-fc5a-46f5-a2f6-6f1990054a7b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:11.041723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e5d7a6a1-fc5a-46f5-a2f6-6f1990054a7b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:11.042147 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e5d7a6a1-fc5a-46f5-a2f6-6f1990054a7b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:11.042822 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e5d7a6a1-fc5a-46f5-a2f6-6f1990054a7b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:11.043295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e5d7a6a1-fc5a-46f5-a2f6-6f1990054a7b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:11.043714 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e5d7a6a1-fc5a-46f5-a2f6-6f1990054a7b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:11.072030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e5d7a6a1-fc5a-46f5-a2f6-6f1990054a7b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042213 Aug 10 12:50:11.072565 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 645/1296] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:11 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:12.040558 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-76cc9f32-1cb7-4411-85e5-f87ab94f80ad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:12.042307 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6a1db19d-66e6-4381-9600-4fd09511a6a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:12.042737 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-76cc9f32-1cb7-4411-85e5-f87ab94f80ad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:12.044619 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6a1db19d-66e6-4381-9600-4fd09511a6a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:12.048939 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=90 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:50:12.049847 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76cc9f32-1cb7-4411-85e5-f87ab94f80ad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:12.050346 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76cc9f32-1cb7-4411-85e5-f87ab94f80ad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:12.050885 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76cc9f32-1cb7-4411-85e5-f87ab94f80ad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:12.051624 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76cc9f32-1cb7-4411-85e5-f87ab94f80ad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:12.052080 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76cc9f32-1cb7-4411-85e5-f87ab94f80ad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:12.052472 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a1db19d-66e6-4381-9600-4fd09511a6a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:12.052576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76cc9f32-1cb7-4411-85e5-f87ab94f80ad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:12.052952 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a1db19d-66e6-4381-9600-4fd09511a6a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:12.053384 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a1db19d-66e6-4381-9600-4fd09511a6a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:12.054082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a1db19d-66e6-4381-9600-4fd09511a6a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:12.054566 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a1db19d-66e6-4381-9600-4fd09511a6a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:12.054987 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a1db19d-66e6-4381-9600-4fd09511a6a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:12.083201 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-76cc9f32-1cb7-4411-85e5-f87ab94f80ad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046559 Aug 10 12:50:12.083938 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 646/1297] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:12 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:50:12.086857 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6a1db19d-66e6-4381-9600-4fd09511a6a8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049353 Aug 10 12:50:12.087835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 652/1298] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:12 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:12.088255 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9d7d3202-fa06-4b8c-ab89-2c0fe9c170f5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:12.090451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9d7d3202-fa06-4b8c-ab89-2c0fe9c170f5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:12.096198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d7d3202-fa06-4b8c-ab89-2c0fe9c170f5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:12.096682 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d7d3202-fa06-4b8c-ab89-2c0fe9c170f5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:12.097120 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d7d3202-fa06-4b8c-ab89-2c0fe9c170f5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:12.097812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d7d3202-fa06-4b8c-ab89-2c0fe9c170f5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:12.098265 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d7d3202-fa06-4b8c-ab89-2c0fe9c170f5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:12.098690 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d7d3202-fa06-4b8c-ab89-2c0fe9c170f5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:12.102230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:50:12.128002 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9d7d3202-fa06-4b8c-ab89-2c0fe9c170f5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043243 Aug 10 12:50:12.128547 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 647/1299] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:12 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:13.096255 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-396cfab5-cf21-47ef-b5c0-f2661c92eae3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:13.098543 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-396cfab5-cf21-47ef-b5c0-f2661c92eae3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:13.099137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-35ffef04-9abc-473e-9290-4261905ed7b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:13.101265 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-35ffef04-9abc-473e-9290-4261905ed7b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:13.105489 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-396cfab5-cf21-47ef-b5c0-f2661c92eae3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:13.106243 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-396cfab5-cf21-47ef-b5c0-f2661c92eae3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:13.106886 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-396cfab5-cf21-47ef-b5c0-f2661c92eae3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:13.107967 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-396cfab5-cf21-47ef-b5c0-f2661c92eae3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:13.108404 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-396cfab5-cf21-47ef-b5c0-f2661c92eae3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:13.108802 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35ffef04-9abc-473e-9290-4261905ed7b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:13.108916 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-396cfab5-cf21-47ef-b5c0-f2661c92eae3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:13.109281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35ffef04-9abc-473e-9290-4261905ed7b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:13.109711 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35ffef04-9abc-473e-9290-4261905ed7b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:13.110397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35ffef04-9abc-473e-9290-4261905ed7b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:13.110842 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35ffef04-9abc-473e-9290-4261905ed7b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:13.111305 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35ffef04-9abc-473e-9290-4261905ed7b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:13.140309 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-396cfab5-cf21-47ef-b5c0-f2661c92eae3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048840 Aug 10 12:50:13.144953 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 653/1300] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:13 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:13.145110 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-35ffef04-9abc-473e-9290-4261905ed7b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046248 Aug 10 12:50:13.145110 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 648/1301] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:13 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:50:13.149890 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ba5906b2-3879-44b3-8ec7-4a164fa3f1af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:13.159273 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ba5906b2-3879-44b3-8ec7-4a164fa3f1af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:13.159273 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ba5906b2-3879-44b3-8ec7-4a164fa3f1af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:13.159273 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ba5906b2-3879-44b3-8ec7-4a164fa3f1af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:13.159621 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ba5906b2-3879-44b3-8ec7-4a164fa3f1af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:13.160129 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ba5906b2-3879-44b3-8ec7-4a164fa3f1af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:13.160583 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ba5906b2-3879-44b3-8ec7-4a164fa3f1af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:13.161007 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ba5906b2-3879-44b3-8ec7-4a164fa3f1af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:13.191055 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ba5906b2-3879-44b3-8ec7-4a164fa3f1af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049144 Aug 10 12:50:13.191656 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 654/1302] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:13 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:14.153566 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-388a2c82-aaba-432a-a552-26e94dbf59dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:14.154099 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4b21e3ba-cb94-401f-9ddb-2f3c47268ced tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:14.156020 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-388a2c82-aaba-432a-a552-26e94dbf59dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:14.156293 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4b21e3ba-cb94-401f-9ddb-2f3c47268ced tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:14.162221 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-388a2c82-aaba-432a-a552-26e94dbf59dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:14.162696 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b21e3ba-cb94-401f-9ddb-2f3c47268ced tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:14.162827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-388a2c82-aaba-432a-a552-26e94dbf59dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:14.163140 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-388a2c82-aaba-432a-a552-26e94dbf59dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:14.163304 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b21e3ba-cb94-401f-9ddb-2f3c47268ced tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:14.163624 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b21e3ba-cb94-401f-9ddb-2f3c47268ced tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:14.163856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-388a2c82-aaba-432a-a552-26e94dbf59dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:14.164305 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-388a2c82-aaba-432a-a552-26e94dbf59dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:14.164434 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b21e3ba-cb94-401f-9ddb-2f3c47268ced tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:14.164725 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-388a2c82-aaba-432a-a552-26e94dbf59dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:14.164834 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b21e3ba-cb94-401f-9ddb-2f3c47268ced tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:14.165148 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b21e3ba-cb94-401f-9ddb-2f3c47268ced tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:14.194346 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-388a2c82-aaba-432a-a552-26e94dbf59dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045645 Aug 10 12:50:14.194901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 649/1303] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:14 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:14.195914 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4b21e3ba-cb94-401f-9ddb-2f3c47268ced tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045924 Aug 10 12:50:14.196469 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 655/1304] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:14 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:50:14.204402 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-23980b1c-72a3-487f-986e-1323e7df907b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:14.206529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-23980b1c-72a3-487f-986e-1323e7df907b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:14.212229 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23980b1c-72a3-487f-986e-1323e7df907b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:14.212709 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23980b1c-72a3-487f-986e-1323e7df907b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:14.213143 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23980b1c-72a3-487f-986e-1323e7df907b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:14.213825 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23980b1c-72a3-487f-986e-1323e7df907b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:14.214271 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23980b1c-72a3-487f-986e-1323e7df907b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:14.214691 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23980b1c-72a3-487f-986e-1323e7df907b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:14.243080 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-23980b1c-72a3-487f-986e-1323e7df907b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042958 Aug 10 12:50:14.243646 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 650/1305] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:14 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:50:15.208491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ac80710a-d2e3-4fb8-8e38-23d5e2a85b66 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:15.209062 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e2607b02-bee7-4089-ad2c-a7c6b1fefd82 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:15.211504 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ac80710a-d2e3-4fb8-8e38-23d5e2a85b66 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:15.217903 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e2607b02-bee7-4089-ad2c-a7c6b1fefd82 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:15.219075 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2607b02-bee7-4089-ad2c-a7c6b1fefd82 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:15.219607 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2607b02-bee7-4089-ad2c-a7c6b1fefd82 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:15.220207 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2607b02-bee7-4089-ad2c-a7c6b1fefd82 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:15.221094 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2607b02-bee7-4089-ad2c-a7c6b1fefd82 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:15.221541 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2607b02-bee7-4089-ad2c-a7c6b1fefd82 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:15.221997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2607b02-bee7-4089-ad2c-a7c6b1fefd82 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:15.225764 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ac80710a-d2e3-4fb8-8e38-23d5e2a85b66 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:15.226336 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ac80710a-d2e3-4fb8-8e38-23d5e2a85b66 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:15.226839 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ac80710a-d2e3-4fb8-8e38-23d5e2a85b66 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:15.227644 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ac80710a-d2e3-4fb8-8e38-23d5e2a85b66 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:15.228182 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ac80710a-d2e3-4fb8-8e38-23d5e2a85b66 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:15.228637 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ac80710a-d2e3-4fb8-8e38-23d5e2a85b66 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:15.257921 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e2607b02-bee7-4089-ad2c-a7c6b1fefd82 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047440 Aug 10 12:50:15.257921 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 651/1306] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:15 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:15.260797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ac80710a-d2e3-4fb8-8e38-23d5e2a85b66 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058212 Aug 10 12:50:15.261553 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 656/1307] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:15 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:15.264867 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-003d7311-c2b1-4708-8cea-ab9ac99e8e98 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:15.267043 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-003d7311-c2b1-4708-8cea-ab9ac99e8e98 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:15.274328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-003d7311-c2b1-4708-8cea-ab9ac99e8e98 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:15.274808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-003d7311-c2b1-4708-8cea-ab9ac99e8e98 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:15.275296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-003d7311-c2b1-4708-8cea-ab9ac99e8e98 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:15.276018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-003d7311-c2b1-4708-8cea-ab9ac99e8e98 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:15.276465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-003d7311-c2b1-4708-8cea-ab9ac99e8e98 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:15.276881 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-003d7311-c2b1-4708-8cea-ab9ac99e8e98 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:15.308924 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-003d7311-c2b1-4708-8cea-ab9ac99e8e98 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054701 Aug 10 12:50:15.313692 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 652/1308] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:15 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:16.268808 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-206bc542-2af9-4ab5-9eb9-c4ab7eef09a3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:16.270314 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-206bc542-2af9-4ab5-9eb9-c4ab7eef09a3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:16.274645 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5898ede2-cef5-4718-8bd6-68842ec3ad08 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:16.277317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5898ede2-cef5-4718-8bd6-68842ec3ad08 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:16.282125 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-206bc542-2af9-4ab5-9eb9-c4ab7eef09a3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:16.282612 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-206bc542-2af9-4ab5-9eb9-c4ab7eef09a3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:16.283041 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-206bc542-2af9-4ab5-9eb9-c4ab7eef09a3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:16.283761 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-206bc542-2af9-4ab5-9eb9-c4ab7eef09a3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:16.284233 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-206bc542-2af9-4ab5-9eb9-c4ab7eef09a3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:16.284651 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-206bc542-2af9-4ab5-9eb9-c4ab7eef09a3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:16.285150 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5898ede2-cef5-4718-8bd6-68842ec3ad08 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:16.285629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5898ede2-cef5-4718-8bd6-68842ec3ad08 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:16.286056 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5898ede2-cef5-4718-8bd6-68842ec3ad08 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:16.286741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5898ede2-cef5-4718-8bd6-68842ec3ad08 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:16.287195 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5898ede2-cef5-4718-8bd6-68842ec3ad08 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:16.287618 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5898ede2-cef5-4718-8bd6-68842ec3ad08 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:16.313717 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-206bc542-2af9-4ab5-9eb9-c4ab7eef09a3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049859 Aug 10 12:50:16.314273 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 657/1309] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:16 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:16.317688 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5898ede2-cef5-4718-8bd6-68842ec3ad08 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047187 Aug 10 12:50:16.318398 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 653/1310] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:16 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:16.321436 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7f8a9ef2-dbf9-4313-842e-2a77873163a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:16.323931 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7f8a9ef2-dbf9-4313-842e-2a77873163a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:16.330321 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7f8a9ef2-dbf9-4313-842e-2a77873163a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:16.330804 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7f8a9ef2-dbf9-4313-842e-2a77873163a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:16.331274 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7f8a9ef2-dbf9-4313-842e-2a77873163a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:16.331968 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7f8a9ef2-dbf9-4313-842e-2a77873163a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:16.332420 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7f8a9ef2-dbf9-4313-842e-2a77873163a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:16.332846 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7f8a9ef2-dbf9-4313-842e-2a77873163a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:16.362308 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7f8a9ef2-dbf9-4313-842e-2a77873163a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044992 Aug 10 12:50:16.362855 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 658/1311] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:16 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:50:17.325826 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-36606d27-ce98-435d-8703-883ec50a7605 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:17.328165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-36606d27-ce98-435d-8703-883ec50a7605 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:17.330603 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6c227fac-bfb8-4329-bdb2-3e15ff3f24de tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:17.333480 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6c227fac-bfb8-4329-bdb2-3e15ff3f24de tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:17.334952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36606d27-ce98-435d-8703-883ec50a7605 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:17.335367 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36606d27-ce98-435d-8703-883ec50a7605 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:17.340801 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36606d27-ce98-435d-8703-883ec50a7605 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:17.340801 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36606d27-ce98-435d-8703-883ec50a7605 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:17.340801 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36606d27-ce98-435d-8703-883ec50a7605 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:17.340801 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36606d27-ce98-435d-8703-883ec50a7605 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:17.341101 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6c227fac-bfb8-4329-bdb2-3e15ff3f24de tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:17.341101 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6c227fac-bfb8-4329-bdb2-3e15ff3f24de tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:17.341101 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6c227fac-bfb8-4329-bdb2-3e15ff3f24de tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:17.341402 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6c227fac-bfb8-4329-bdb2-3e15ff3f24de tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:17.341934 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6c227fac-bfb8-4329-bdb2-3e15ff3f24de tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:17.342519 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6c227fac-bfb8-4329-bdb2-3e15ff3f24de tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:17.368115 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-36606d27-ce98-435d-8703-883ec50a7605 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046123 Aug 10 12:50:17.368915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 654/1312] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:17 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:17.374476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d16e3dad-c7e4-4710-87c0-a101e2698110 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:17.375285 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6c227fac-bfb8-4329-bdb2-3e15ff3f24de tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049417 Aug 10 12:50:17.375845 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 659/1313] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:17 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:17.376686 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d16e3dad-c7e4-4710-87c0-a101e2698110 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:17.382419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d16e3dad-c7e4-4710-87c0-a101e2698110 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:17.382899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d16e3dad-c7e4-4710-87c0-a101e2698110 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:17.383377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d16e3dad-c7e4-4710-87c0-a101e2698110 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:17.384315 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d16e3dad-c7e4-4710-87c0-a101e2698110 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:17.384536 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d16e3dad-c7e4-4710-87c0-a101e2698110 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:17.385010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d16e3dad-c7e4-4710-87c0-a101e2698110 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:17.415528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d16e3dad-c7e4-4710-87c0-a101e2698110 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045382 Aug 10 12:50:17.416076 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 655/1314] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:17 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:50:18.380839 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-cacb3cee-83b7-40bc-a318-e3ebbebb806b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:18.383211 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-cacb3cee-83b7-40bc-a318-e3ebbebb806b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:18.389806 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cacb3cee-83b7-40bc-a318-e3ebbebb806b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:18.390294 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cacb3cee-83b7-40bc-a318-e3ebbebb806b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:18.390727 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cacb3cee-83b7-40bc-a318-e3ebbebb806b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:18.391457 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cacb3cee-83b7-40bc-a318-e3ebbebb806b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:18.391909 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cacb3cee-83b7-40bc-a318-e3ebbebb806b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:18.392330 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cacb3cee-83b7-40bc-a318-e3ebbebb806b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:18.394566 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9517af1b-c734-4fcf-a9bf-d5f7b081e1e5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:18.396804 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9517af1b-c734-4fcf-a9bf-d5f7b081e1e5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:18.402629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9517af1b-c734-4fcf-a9bf-d5f7b081e1e5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:18.403109 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9517af1b-c734-4fcf-a9bf-d5f7b081e1e5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:18.403589 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9517af1b-c734-4fcf-a9bf-d5f7b081e1e5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:18.404829 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9517af1b-c734-4fcf-a9bf-d5f7b081e1e5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:18.405388 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9517af1b-c734-4fcf-a9bf-d5f7b081e1e5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:18.405953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9517af1b-c734-4fcf-a9bf-d5f7b081e1e5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:18.422564 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-cacb3cee-83b7-40bc-a318-e3ebbebb806b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045592 Aug 10 12:50:18.424638 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 660/1315] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:18 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:18.429348 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fe71a7fe-94f5-4f9f-a1dc-2108e12974f6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:18.431496 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fe71a7fe-94f5-4f9f-a1dc-2108e12974f6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:18.435416 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9517af1b-c734-4fcf-a9bf-d5f7b081e1e5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044543 Aug 10 12:50:18.436049 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 656/1316] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:18 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:18.437295 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe71a7fe-94f5-4f9f-a1dc-2108e12974f6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:18.437780 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe71a7fe-94f5-4f9f-a1dc-2108e12974f6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:18.438216 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe71a7fe-94f5-4f9f-a1dc-2108e12974f6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:18.438914 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe71a7fe-94f5-4f9f-a1dc-2108e12974f6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:18.439393 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe71a7fe-94f5-4f9f-a1dc-2108e12974f6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:18.439819 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe71a7fe-94f5-4f9f-a1dc-2108e12974f6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:18.468460 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fe71a7fe-94f5-4f9f-a1dc-2108e12974f6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042706 Aug 10 12:50:18.469007 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 661/1317] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:18 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:19.435060 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ba7f4b64-7d14-4803-8058-82c02d26e7d2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:19.439912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ba7f4b64-7d14-4803-8058-82c02d26e7d2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:19.448443 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ba7f4b64-7d14-4803-8058-82c02d26e7d2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:19.448733 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3d1f9d0d-00e5-425e-b2e5-1967cc849dfe tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:19.449665 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ba7f4b64-7d14-4803-8058-82c02d26e7d2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:19.450109 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ba7f4b64-7d14-4803-8058-82c02d26e7d2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:19.450820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ba7f4b64-7d14-4803-8058-82c02d26e7d2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:19.451686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3d1f9d0d-00e5-425e-b2e5-1967cc849dfe tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:19.452122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ba7f4b64-7d14-4803-8058-82c02d26e7d2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:19.452731 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ba7f4b64-7d14-4803-8058-82c02d26e7d2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:19.458914 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d1f9d0d-00e5-425e-b2e5-1967cc849dfe tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:19.459460 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d1f9d0d-00e5-425e-b2e5-1967cc849dfe tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:19.460076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d1f9d0d-00e5-425e-b2e5-1967cc849dfe tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:19.460969 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d1f9d0d-00e5-425e-b2e5-1967cc849dfe tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:19.461578 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d1f9d0d-00e5-425e-b2e5-1967cc849dfe tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:19.462160 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d1f9d0d-00e5-425e-b2e5-1967cc849dfe tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:19.486590 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ba7f4b64-7d14-4803-8058-82c02d26e7d2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055464 Aug 10 12:50:19.487358 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 657/1318] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:19 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:50:19.491134 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:50:19.496015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0da1e22d-4d37-42bf-aa9e-6b010e215e32 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:19.496632 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3d1f9d0d-00e5-425e-b2e5-1967cc849dfe tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052808 Aug 10 12:50:19.501705 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 662/1319] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:19 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:19.502464 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0da1e22d-4d37-42bf-aa9e-6b010e215e32 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:19.504915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0da1e22d-4d37-42bf-aa9e-6b010e215e32 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:19.505411 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0da1e22d-4d37-42bf-aa9e-6b010e215e32 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:19.505849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0da1e22d-4d37-42bf-aa9e-6b010e215e32 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:19.506553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0da1e22d-4d37-42bf-aa9e-6b010e215e32 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:19.507004 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0da1e22d-4d37-42bf-aa9e-6b010e215e32 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:19.512358 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0da1e22d-4d37-42bf-aa9e-6b010e215e32 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:19.538829 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0da1e22d-4d37-42bf-aa9e-6b010e215e32 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046360 Aug 10 12:50:19.539655 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 658/1320] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:19 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:20.498463 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-231883af-9652-4d0a-9b19-49ec986ba5e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:20.500813 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-231883af-9652-4d0a-9b19-49ec986ba5e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:20.508034 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-231883af-9652-4d0a-9b19-49ec986ba5e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:20.508510 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-231883af-9652-4d0a-9b19-49ec986ba5e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:20.508936 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-231883af-9652-4d0a-9b19-49ec986ba5e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:20.509540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6631c73e-5217-4878-8ca7-f0af9b4f8acd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:20.509973 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-231883af-9652-4d0a-9b19-49ec986ba5e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:20.510068 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-231883af-9652-4d0a-9b19-49ec986ba5e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:20.510461 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-231883af-9652-4d0a-9b19-49ec986ba5e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:20.511774 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6631c73e-5217-4878-8ca7-f0af9b4f8acd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:20.518331 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6631c73e-5217-4878-8ca7-f0af9b4f8acd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:20.518813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6631c73e-5217-4878-8ca7-f0af9b4f8acd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:20.519284 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6631c73e-5217-4878-8ca7-f0af9b4f8acd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:20.519984 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6631c73e-5217-4878-8ca7-f0af9b4f8acd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:20.520437 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6631c73e-5217-4878-8ca7-f0af9b4f8acd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:20.520865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6631c73e-5217-4878-8ca7-f0af9b4f8acd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:20.539936 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-231883af-9652-4d0a-9b19-49ec986ba5e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045863 Aug 10 12:50:20.541177 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 663/1321] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:20 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:20.551273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6631c73e-5217-4878-8ca7-f0af9b4f8acd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045721 Aug 10 12:50:20.551485 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0a118589-fcc5-4991-ae5b-7b9bc942834f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:20.552052 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 659/1322] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:20 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:20.553591 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0a118589-fcc5-4991-ae5b-7b9bc942834f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:20.559525 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0a118589-fcc5-4991-ae5b-7b9bc942834f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:20.560011 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0a118589-fcc5-4991-ae5b-7b9bc942834f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:20.561141 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0a118589-fcc5-4991-ae5b-7b9bc942834f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:20.561867 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0a118589-fcc5-4991-ae5b-7b9bc942834f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:20.562324 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0a118589-fcc5-4991-ae5b-7b9bc942834f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:20.562754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0a118589-fcc5-4991-ae5b-7b9bc942834f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:20.592205 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0a118589-fcc5-4991-ae5b-7b9bc942834f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044173 Aug 10 12:50:20.592756 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 664/1323] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:20 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:21.553894 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7a15ca61-7875-453e-892f-42ebada0c56f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:21.556030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7a15ca61-7875-453e-892f-42ebada0c56f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:21.563526 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a15ca61-7875-453e-892f-42ebada0c56f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:21.564119 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a15ca61-7875-453e-892f-42ebada0c56f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:21.564561 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a15ca61-7875-453e-892f-42ebada0c56f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:21.564875 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6932b8a7-ed48-40c2-bf6a-9bf248e43e65 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:21.565314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a15ca61-7875-453e-892f-42ebada0c56f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:21.565710 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a15ca61-7875-453e-892f-42ebada0c56f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:21.566136 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a15ca61-7875-453e-892f-42ebada0c56f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:21.567004 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6932b8a7-ed48-40c2-bf6a-9bf248e43e65 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:21.573491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6932b8a7-ed48-40c2-bf6a-9bf248e43e65 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:21.573976 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6932b8a7-ed48-40c2-bf6a-9bf248e43e65 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:21.574419 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6932b8a7-ed48-40c2-bf6a-9bf248e43e65 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:21.575117 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6932b8a7-ed48-40c2-bf6a-9bf248e43e65 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:21.575613 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6932b8a7-ed48-40c2-bf6a-9bf248e43e65 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:21.576657 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6932b8a7-ed48-40c2-bf6a-9bf248e43e65 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:21.596471 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7a15ca61-7875-453e-892f-42ebada0c56f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046478 Aug 10 12:50:21.597044 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 660/1324] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:21 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:21.603870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-93de1696-4652-46a1-abab-4e26da6fe6fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:21.606258 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-93de1696-4652-46a1-abab-4e26da6fe6fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:21.606497 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6932b8a7-ed48-40c2-bf6a-9bf248e43e65 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046380 Aug 10 12:50:21.607042 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 665/1325] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:21 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:50:21.612484 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93de1696-4652-46a1-abab-4e26da6fe6fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:21.612965 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93de1696-4652-46a1-abab-4e26da6fe6fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:21.613396 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93de1696-4652-46a1-abab-4e26da6fe6fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:21.614088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93de1696-4652-46a1-abab-4e26da6fe6fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:21.614536 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93de1696-4652-46a1-abab-4e26da6fe6fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:21.614955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93de1696-4652-46a1-abab-4e26da6fe6fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:21.644150 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-93de1696-4652-46a1-abab-4e26da6fe6fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043937 Aug 10 12:50:21.644692 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 661/1326] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:21 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:22.610966 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e307c32c-12cc-4c8d-8706-0625cbd858cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:22.613394 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e307c32c-12cc-4c8d-8706-0625cbd858cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:22.618488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-95647265-1eb9-4bb9-99ee-5b62466021bd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:22.619540 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e307c32c-12cc-4c8d-8706-0625cbd858cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:22.620023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e307c32c-12cc-4c8d-8706-0625cbd858cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:22.620453 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e307c32c-12cc-4c8d-8706-0625cbd858cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:22.620647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-95647265-1eb9-4bb9-99ee-5b62466021bd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:22.621146 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e307c32c-12cc-4c8d-8706-0625cbd858cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:22.621597 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e307c32c-12cc-4c8d-8706-0625cbd858cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:22.622016 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e307c32c-12cc-4c8d-8706-0625cbd858cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:22.626806 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-95647265-1eb9-4bb9-99ee-5b62466021bd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:22.627318 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-95647265-1eb9-4bb9-99ee-5b62466021bd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:22.627760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-95647265-1eb9-4bb9-99ee-5b62466021bd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:22.628454 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-95647265-1eb9-4bb9-99ee-5b62466021bd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:22.628907 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-95647265-1eb9-4bb9-99ee-5b62466021bd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:22.629331 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-95647265-1eb9-4bb9-99ee-5b62466021bd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:22.651033 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e307c32c-12cc-4c8d-8706-0625cbd858cb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043999 Aug 10 12:50:22.656566 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 666/1327] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:22 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:22.659315 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-95647265-1eb9-4bb9-99ee-5b62466021bd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045048 Aug 10 12:50:22.659874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 662/1328] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:22 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:50:22.661296 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9613647c-0d9c-482d-bd09-79cac2e548ca tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:22.663451 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9613647c-0d9c-482d-bd09-79cac2e548ca tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:22.669217 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9613647c-0d9c-482d-bd09-79cac2e548ca tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:22.669748 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9613647c-0d9c-482d-bd09-79cac2e548ca tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:22.670188 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9613647c-0d9c-482d-bd09-79cac2e548ca tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:22.670876 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9613647c-0d9c-482d-bd09-79cac2e548ca tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:22.671356 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9613647c-0d9c-482d-bd09-79cac2e548ca tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:22.671778 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9613647c-0d9c-482d-bd09-79cac2e548ca tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:22.699448 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9613647c-0d9c-482d-bd09-79cac2e548ca tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041839 Aug 10 12:50:22.699995 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 667/1329] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:22 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:23.664356 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5fadfa1d-4425-4bc2-ad99-26c42f6d3398 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:23.666722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5fadfa1d-4425-4bc2-ad99-26c42f6d3398 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:23.671758 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f5b7d687-8799-4b05-9405-f1effdf315d6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:23.673521 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5fadfa1d-4425-4bc2-ad99-26c42f6d3398 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:23.674020 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5fadfa1d-4425-4bc2-ad99-26c42f6d3398 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:23.674461 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5fadfa1d-4425-4bc2-ad99-26c42f6d3398 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:23.674694 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f5b7d687-8799-4b05-9405-f1effdf315d6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:23.675130 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5fadfa1d-4425-4bc2-ad99-26c42f6d3398 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:23.675605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5fadfa1d-4425-4bc2-ad99-26c42f6d3398 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:23.676077 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5fadfa1d-4425-4bc2-ad99-26c42f6d3398 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:23.680984 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5b7d687-8799-4b05-9405-f1effdf315d6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:23.681466 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5b7d687-8799-4b05-9405-f1effdf315d6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:23.681899 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5b7d687-8799-4b05-9405-f1effdf315d6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:23.682598 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5b7d687-8799-4b05-9405-f1effdf315d6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:23.683047 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5b7d687-8799-4b05-9405-f1effdf315d6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:23.683509 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5b7d687-8799-4b05-9405-f1effdf315d6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:23.700970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:50:23.706285 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5fadfa1d-4425-4bc2-ad99-26c42f6d3398 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045881 Aug 10 12:50:23.708309 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 663/1330] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:23 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:23.711849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a114c746-b0a7-4739-b5b4-40aba948f103 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:23.713206 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f5b7d687-8799-4b05-9405-f1effdf315d6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045536 Aug 10 12:50:23.713918 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 668/1331] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:23 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:50:23.714033 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a114c746-b0a7-4739-b5b4-40aba948f103 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:23.719967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a114c746-b0a7-4739-b5b4-40aba948f103 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:23.720450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a114c746-b0a7-4739-b5b4-40aba948f103 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:23.720880 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a114c746-b0a7-4739-b5b4-40aba948f103 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:23.721567 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a114c746-b0a7-4739-b5b4-40aba948f103 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:23.722015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a114c746-b0a7-4739-b5b4-40aba948f103 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:23.722436 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a114c746-b0a7-4739-b5b4-40aba948f103 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:23.751222 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a114c746-b0a7-4739-b5b4-40aba948f103 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043024 Aug 10 12:50:23.751760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 664/1332] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:23 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:50:24.722614 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2fecd826-0ed1-4fe1-8d5e-e6b4c35b2ca2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:24.724797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2fecd826-0ed1-4fe1-8d5e-e6b4c35b2ca2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:24.725821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-56a0ed04-fdfa-49f2-9433-6a9fc5ec2ae6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:24.728096 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-56a0ed04-fdfa-49f2-9433-6a9fc5ec2ae6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:24.731984 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2fecd826-0ed1-4fe1-8d5e-e6b4c35b2ca2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:24.732469 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2fecd826-0ed1-4fe1-8d5e-e6b4c35b2ca2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:24.732904 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2fecd826-0ed1-4fe1-8d5e-e6b4c35b2ca2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:24.734250 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2fecd826-0ed1-4fe1-8d5e-e6b4c35b2ca2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:24.734700 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2fecd826-0ed1-4fe1-8d5e-e6b4c35b2ca2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:24.735128 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2fecd826-0ed1-4fe1-8d5e-e6b4c35b2ca2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:24.735346 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56a0ed04-fdfa-49f2-9433-6a9fc5ec2ae6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:24.735673 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56a0ed04-fdfa-49f2-9433-6a9fc5ec2ae6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:24.736104 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56a0ed04-fdfa-49f2-9433-6a9fc5ec2ae6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:24.736791 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56a0ed04-fdfa-49f2-9433-6a9fc5ec2ae6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:24.737237 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56a0ed04-fdfa-49f2-9433-6a9fc5ec2ae6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:24.737683 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56a0ed04-fdfa-49f2-9433-6a9fc5ec2ae6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:24.764713 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2fecd826-0ed1-4fe1-8d5e-e6b4c35b2ca2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046754 Aug 10 12:50:24.765303 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 669/1333] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:24 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:24.766472 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-56a0ed04-fdfa-49f2-9433-6a9fc5ec2ae6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045068 Aug 10 12:50:24.767209 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 665/1334] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:24 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:50:24.770052 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5a7b80b7-9123-474f-9bda-e1f3e5f8afd4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:24.772269 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5a7b80b7-9123-474f-9bda-e1f3e5f8afd4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:24.777913 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a7b80b7-9123-474f-9bda-e1f3e5f8afd4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:24.778397 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a7b80b7-9123-474f-9bda-e1f3e5f8afd4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:24.778827 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a7b80b7-9123-474f-9bda-e1f3e5f8afd4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:24.779576 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a7b80b7-9123-474f-9bda-e1f3e5f8afd4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:24.780022 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a7b80b7-9123-474f-9bda-e1f3e5f8afd4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:24.780449 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a7b80b7-9123-474f-9bda-e1f3e5f8afd4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:24.808876 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5a7b80b7-9123-474f-9bda-e1f3e5f8afd4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042611 Aug 10 12:50:24.809413 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 670/1335] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:24 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:25.778409 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e92d9bb8-cf66-48f9-8e05-4027e071a4ee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:25.779025 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-27392384-28ee-4b0f-8b49-f9b0c3f58a79 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:25.781233 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e92d9bb8-cf66-48f9-8e05-4027e071a4ee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:25.781754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-27392384-28ee-4b0f-8b49-f9b0c3f58a79 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:25.788015 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e92d9bb8-cf66-48f9-8e05-4027e071a4ee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:25.788567 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e92d9bb8-cf66-48f9-8e05-4027e071a4ee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:25.788751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27392384-28ee-4b0f-8b49-f9b0c3f58a79 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:25.788999 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e92d9bb8-cf66-48f9-8e05-4027e071a4ee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:25.789183 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27392384-28ee-4b0f-8b49-f9b0c3f58a79 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:25.789597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27392384-28ee-4b0f-8b49-f9b0c3f58a79 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:25.789708 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e92d9bb8-cf66-48f9-8e05-4027e071a4ee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:25.790155 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e92d9bb8-cf66-48f9-8e05-4027e071a4ee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:25.790262 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27392384-28ee-4b0f-8b49-f9b0c3f58a79 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:25.790574 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e92d9bb8-cf66-48f9-8e05-4027e071a4ee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:25.790694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27392384-28ee-4b0f-8b49-f9b0c3f58a79 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:25.791109 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27392384-28ee-4b0f-8b49-f9b0c3f58a79 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:25.820926 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e92d9bb8-cf66-48f9-8e05-4027e071a4ee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046304 Aug 10 12:50:25.821140 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-27392384-28ee-4b0f-8b49-f9b0c3f58a79 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047815 Aug 10 12:50:25.821655 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 671/1337] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:25 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:25.821772 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 666/1337] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:25 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:25.826032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2b4f4afd-d218-4af6-a69c-52e6ec9b05c6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:25.829048 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2b4f4afd-d218-4af6-a69c-52e6ec9b05c6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:25.834755 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b4f4afd-d218-4af6-a69c-52e6ec9b05c6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:25.835271 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b4f4afd-d218-4af6-a69c-52e6ec9b05c6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:25.835711 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b4f4afd-d218-4af6-a69c-52e6ec9b05c6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:25.836411 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b4f4afd-d218-4af6-a69c-52e6ec9b05c6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:25.836863 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b4f4afd-d218-4af6-a69c-52e6ec9b05c6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:25.837290 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b4f4afd-d218-4af6-a69c-52e6ec9b05c6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:25.865676 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2b4f4afd-d218-4af6-a69c-52e6ec9b05c6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043208 Aug 10 12:50:25.866229 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 672/1338] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:25 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:26.833920 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f68358ed-3087-421a-b8ef-d326bf16e50b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:26.834449 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-09b33514-c931-484e-a40c-1f218e190252 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:26.836161 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f68358ed-3087-421a-b8ef-d326bf16e50b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:26.836326 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-09b33514-c931-484e-a40c-1f218e190252 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:26.842562 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09b33514-c931-484e-a40c-1f218e190252 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:26.843101 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09b33514-c931-484e-a40c-1f218e190252 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:26.843564 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09b33514-c931-484e-a40c-1f218e190252 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:26.844292 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09b33514-c931-484e-a40c-1f218e190252 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:26.844742 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09b33514-c931-484e-a40c-1f218e190252 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:26.845193 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09b33514-c931-484e-a40c-1f218e190252 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:26.847998 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f68358ed-3087-421a-b8ef-d326bf16e50b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:26.848489 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f68358ed-3087-421a-b8ef-d326bf16e50b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:26.848926 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f68358ed-3087-421a-b8ef-d326bf16e50b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:26.849629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f68358ed-3087-421a-b8ef-d326bf16e50b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:26.850082 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f68358ed-3087-421a-b8ef-d326bf16e50b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:26.850507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f68358ed-3087-421a-b8ef-d326bf16e50b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:26.874808 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-09b33514-c931-484e-a40c-1f218e190252 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044082 Aug 10 12:50:26.875289 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 673/1339] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:26 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:50:26.879862 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2e95ffdb-196d-422d-ad99-f3a2d947e4bb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:26.880970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f68358ed-3087-421a-b8ef-d326bf16e50b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050972 Aug 10 12:50:26.881530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 667/1340] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:26 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:50:26.881978 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2e95ffdb-196d-422d-ad99-f3a2d947e4bb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:26.887626 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2e95ffdb-196d-422d-ad99-f3a2d947e4bb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:26.888108 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2e95ffdb-196d-422d-ad99-f3a2d947e4bb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:26.888540 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2e95ffdb-196d-422d-ad99-f3a2d947e4bb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:26.889231 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2e95ffdb-196d-422d-ad99-f3a2d947e4bb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:26.889683 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2e95ffdb-196d-422d-ad99-f3a2d947e4bb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:26.890737 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2e95ffdb-196d-422d-ad99-f3a2d947e4bb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:26.919257 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2e95ffdb-196d-422d-ad99-f3a2d947e4bb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042922 Aug 10 12:50:26.919814 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 674/1341] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:26 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:27.885762 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f77cf5cc-ba98-41ea-b09e-56dbbf8afbb2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:27.888160 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f77cf5cc-ba98-41ea-b09e-56dbbf8afbb2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:27.893763 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-04dd26d9-fb23-4b9d-95cf-e5d35d611e92 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:27.894911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f77cf5cc-ba98-41ea-b09e-56dbbf8afbb2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:27.895430 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f77cf5cc-ba98-41ea-b09e-56dbbf8afbb2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:27.895858 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f77cf5cc-ba98-41ea-b09e-56dbbf8afbb2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:27.896550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f77cf5cc-ba98-41ea-b09e-56dbbf8afbb2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:27.896996 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f77cf5cc-ba98-41ea-b09e-56dbbf8afbb2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:27.897412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f77cf5cc-ba98-41ea-b09e-56dbbf8afbb2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:27.901068 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-04dd26d9-fb23-4b9d-95cf-e5d35d611e92 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:27.907303 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-04dd26d9-fb23-4b9d-95cf-e5d35d611e92 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:27.907797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-04dd26d9-fb23-4b9d-95cf-e5d35d611e92 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:27.908234 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-04dd26d9-fb23-4b9d-95cf-e5d35d611e92 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:27.908935 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-04dd26d9-fb23-4b9d-95cf-e5d35d611e92 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:27.909523 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-04dd26d9-fb23-4b9d-95cf-e5d35d611e92 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:27.909951 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-04dd26d9-fb23-4b9d-95cf-e5d35d611e92 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:27.927256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f77cf5cc-ba98-41ea-b09e-56dbbf8afbb2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045277 Aug 10 12:50:27.927810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 668/1342] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:27 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:27.932504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ba75001a-c4e3-4b5e-9fb4-189d3ea5dec3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:27.934580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ba75001a-c4e3-4b5e-9fb4-189d3ea5dec3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:27.940926 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-04dd26d9-fb23-4b9d-95cf-e5d35d611e92 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051409 Aug 10 12:50:27.941095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ba75001a-c4e3-4b5e-9fb4-189d3ea5dec3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:27.941415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ba75001a-c4e3-4b5e-9fb4-189d3ea5dec3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:27.941525 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 675/1343] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:27 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:50:27.941914 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ba75001a-c4e3-4b5e-9fb4-189d3ea5dec3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:27.942665 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ba75001a-c4e3-4b5e-9fb4-189d3ea5dec3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:27.943114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ba75001a-c4e3-4b5e-9fb4-189d3ea5dec3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:27.943556 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ba75001a-c4e3-4b5e-9fb4-189d3ea5dec3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:27.972073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ba75001a-c4e3-4b5e-9fb4-189d3ea5dec3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043273 Aug 10 12:50:27.972622 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 669/1344] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:27 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:28.939427 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-620cd623-fe9e-4cb9-b343-b7daa09c4813 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:28.941549 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-620cd623-fe9e-4cb9-b343-b7daa09c4813 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:28.947952 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-620cd623-fe9e-4cb9-b343-b7daa09c4813 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:28.948489 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-620cd623-fe9e-4cb9-b343-b7daa09c4813 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:28.948777 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-620cd623-fe9e-4cb9-b343-b7daa09c4813 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:28.949499 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-620cd623-fe9e-4cb9-b343-b7daa09c4813 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:28.949950 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-620cd623-fe9e-4cb9-b343-b7daa09c4813 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:28.950367 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-620cd623-fe9e-4cb9-b343-b7daa09c4813 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:28.953618 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2ddd4728-57f7-41b0-97c7-4f06244af011 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:28.955921 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2ddd4728-57f7-41b0-97c7-4f06244af011 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:28.962111 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2ddd4728-57f7-41b0-97c7-4f06244af011 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:28.962661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2ddd4728-57f7-41b0-97c7-4f06244af011 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:28.963158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2ddd4728-57f7-41b0-97c7-4f06244af011 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:28.963946 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2ddd4728-57f7-41b0-97c7-4f06244af011 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:28.964468 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2ddd4728-57f7-41b0-97c7-4f06244af011 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:28.964958 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2ddd4728-57f7-41b0-97c7-4f06244af011 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:28.981718 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-620cd623-fe9e-4cb9-b343-b7daa09c4813 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046219 Aug 10 12:50:28.982274 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 676/1345] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:28 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:28.987445 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-28f2df2a-75b3-4c6e-b09a-510322e1806a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:28.989543 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-28f2df2a-75b3-4c6e-b09a-510322e1806a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:28.995153 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-28f2df2a-75b3-4c6e-b09a-510322e1806a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:28.995655 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-28f2df2a-75b3-4c6e-b09a-510322e1806a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:28.996084 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-28f2df2a-75b3-4c6e-b09a-510322e1806a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:28.996482 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2ddd4728-57f7-41b0-97c7-4f06244af011 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047222 Aug 10 12:50:28.996764 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-28f2df2a-75b3-4c6e-b09a-510322e1806a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:28.997053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 670/1346] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:28 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:28.997210 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-28f2df2a-75b3-4c6e-b09a-510322e1806a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:28.997626 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-28f2df2a-75b3-4c6e-b09a-510322e1806a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:29.026113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-28f2df2a-75b3-4c6e-b09a-510322e1806a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042841 Aug 10 12:50:29.026666 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 677/1347] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:28 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:29.994189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ce6a34da-dc72-4ad2-822b-31cf25efd835 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:29.996346 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ce6a34da-dc72-4ad2-822b-31cf25efd835 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:29.998637 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=88 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:50:30.005010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce6a34da-dc72-4ad2-822b-31cf25efd835 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:30.005510 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce6a34da-dc72-4ad2-822b-31cf25efd835 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:30.005952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce6a34da-dc72-4ad2-822b-31cf25efd835 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:30.006643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce6a34da-dc72-4ad2-822b-31cf25efd835 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:30.012880 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce6a34da-dc72-4ad2-822b-31cf25efd835 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:30.012880 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce6a34da-dc72-4ad2-822b-31cf25efd835 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:30.013204 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e6feecc9-5a1c-4052-b4cf-177d9874f759 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:30.013204 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e6feecc9-5a1c-4052-b4cf-177d9874f759 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:30.017673 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e6feecc9-5a1c-4052-b4cf-177d9874f759 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:30.018151 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e6feecc9-5a1c-4052-b4cf-177d9874f759 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:30.018583 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e6feecc9-5a1c-4052-b4cf-177d9874f759 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:30.019295 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e6feecc9-5a1c-4052-b4cf-177d9874f759 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:30.019744 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e6feecc9-5a1c-4052-b4cf-177d9874f759 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:30.020191 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e6feecc9-5a1c-4052-b4cf-177d9874f759 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:30.037841 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ce6a34da-dc72-4ad2-822b-31cf25efd835 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047759 Aug 10 12:50:30.038399 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 671/1348] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:29 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:30.043041 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-008fac98-26ac-4a6a-8674-ef0a94904864 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:30.045179 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-008fac98-26ac-4a6a-8674-ef0a94904864 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:30.050400 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e6feecc9-5a1c-4052-b4cf-177d9874f759 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045557 Aug 10 12:50:30.051139 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 678/1349] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:30 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:50:30.051440 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-008fac98-26ac-4a6a-8674-ef0a94904864 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:30.051986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-008fac98-26ac-4a6a-8674-ef0a94904864 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:30.052429 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-008fac98-26ac-4a6a-8674-ef0a94904864 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:30.053117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-008fac98-26ac-4a6a-8674-ef0a94904864 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:30.053566 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-008fac98-26ac-4a6a-8674-ef0a94904864 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:30.053987 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-008fac98-26ac-4a6a-8674-ef0a94904864 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:30.083933 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-008fac98-26ac-4a6a-8674-ef0a94904864 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044537 Aug 10 12:50:30.084476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 672/1350] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:30 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:31.050118 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c783548f-3fa5-4107-94be-6457e432f802 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:31.052608 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c783548f-3fa5-4107-94be-6457e432f802 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:31.059423 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c783548f-3fa5-4107-94be-6457e432f802 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:31.059941 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c783548f-3fa5-4107-94be-6457e432f802 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:31.060377 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c783548f-3fa5-4107-94be-6457e432f802 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:31.061090 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c783548f-3fa5-4107-94be-6457e432f802 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:31.061525 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c783548f-3fa5-4107-94be-6457e432f802 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:31.062023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c783548f-3fa5-4107-94be-6457e432f802 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:31.063143 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4dcb5885-1e72-4490-808c-c7cea717b24a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:31.065750 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4dcb5885-1e72-4490-808c-c7cea717b24a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:31.072302 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4dcb5885-1e72-4490-808c-c7cea717b24a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:31.072789 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4dcb5885-1e72-4490-808c-c7cea717b24a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:31.073225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4dcb5885-1e72-4490-808c-c7cea717b24a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:31.073914 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4dcb5885-1e72-4490-808c-c7cea717b24a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:31.074387 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4dcb5885-1e72-4490-808c-c7cea717b24a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:31.074854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4dcb5885-1e72-4490-808c-c7cea717b24a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:31.077562 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:50:31.094799 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c783548f-3fa5-4107-94be-6457e432f802 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048747 Aug 10 12:50:31.095394 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 679/1351] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:31 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:31.099987 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c145caec-3ce5-430a-959c-2860d51d65e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:31.102066 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c145caec-3ce5-430a-959c-2860d51d65e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:31.106358 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4dcb5885-1e72-4490-808c-c7cea717b24a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048278 Aug 10 12:50:31.106920 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 673/1352] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:31 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:31.108260 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c145caec-3ce5-430a-959c-2860d51d65e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:31.108732 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c145caec-3ce5-430a-959c-2860d51d65e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:31.109778 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c145caec-3ce5-430a-959c-2860d51d65e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:31.110468 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c145caec-3ce5-430a-959c-2860d51d65e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:31.110915 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c145caec-3ce5-430a-959c-2860d51d65e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:31.111362 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c145caec-3ce5-430a-959c-2860d51d65e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:31.139500 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c145caec-3ce5-430a-959c-2860d51d65e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043078 Aug 10 12:50:31.140063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 680/1353] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:31 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:32.109529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5cb0b7ee-224c-4732-b09f-9f7c2cae1256 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:32.110314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5cb0b7ee-224c-4732-b09f-9f7c2cae1256 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:32.117997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5cb0b7ee-224c-4732-b09f-9f7c2cae1256 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:32.118694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5cb0b7ee-224c-4732-b09f-9f7c2cae1256 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:32.119281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5cb0b7ee-224c-4732-b09f-9f7c2cae1256 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:32.120039 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5cb0b7ee-224c-4732-b09f-9f7c2cae1256 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:32.120451 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-314ab14c-8b97-49f8-aa36-63c2e62cad85 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:32.120925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5cb0b7ee-224c-4732-b09f-9f7c2cae1256 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:32.121297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5cb0b7ee-224c-4732-b09f-9f7c2cae1256 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:32.122843 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-314ab14c-8b97-49f8-aa36-63c2e62cad85 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:32.132791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-314ab14c-8b97-49f8-aa36-63c2e62cad85 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:32.133634 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-314ab14c-8b97-49f8-aa36-63c2e62cad85 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:32.134505 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-314ab14c-8b97-49f8-aa36-63c2e62cad85 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:32.135846 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-314ab14c-8b97-49f8-aa36-63c2e62cad85 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:32.136460 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-314ab14c-8b97-49f8-aa36-63c2e62cad85 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:32.137400 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-314ab14c-8b97-49f8-aa36-63c2e62cad85 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:32.159647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5cb0b7ee-224c-4732-b09f-9f7c2cae1256 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056445 Aug 10 12:50:32.164704 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 674/1354] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:32 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:32.169216 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-314ab14c-8b97-49f8-aa36-63c2e62cad85 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053416 Aug 10 12:50:32.169902 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 681/1355] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:32 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:32.170158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d9b47fb2-c859-455a-8b21-8583c7808b29 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:32.173073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d9b47fb2-c859-455a-8b21-8583c7808b29 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:32.179265 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d9b47fb2-c859-455a-8b21-8583c7808b29 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:32.179723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d9b47fb2-c859-455a-8b21-8583c7808b29 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:32.180151 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d9b47fb2-c859-455a-8b21-8583c7808b29 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:32.180837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d9b47fb2-c859-455a-8b21-8583c7808b29 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:32.181279 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d9b47fb2-c859-455a-8b21-8583c7808b29 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:32.181693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d9b47fb2-c859-455a-8b21-8583c7808b29 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:32.211409 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d9b47fb2-c859-455a-8b21-8583c7808b29 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045585 Aug 10 12:50:32.211941 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 675/1356] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:32 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:33.172825 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4bd71af9-b620-4cb3-aaa1-85cce92f0206 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:33.181209 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4bd71af9-b620-4cb3-aaa1-85cce92f0206 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:33.181858 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bd71af9-b620-4cb3-aaa1-85cce92f0206 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:33.182222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bd71af9-b620-4cb3-aaa1-85cce92f0206 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:33.182659 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bd71af9-b620-4cb3-aaa1-85cce92f0206 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:33.183388 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bd71af9-b620-4cb3-aaa1-85cce92f0206 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:33.183841 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bd71af9-b620-4cb3-aaa1-85cce92f0206 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:33.184264 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bd71af9-b620-4cb3-aaa1-85cce92f0206 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:33.185133 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5d3d8b2b-313d-43cf-8a2a-364b2a2a2cb5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:33.188115 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5d3d8b2b-313d-43cf-8a2a-364b2a2a2cb5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:33.194458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d3d8b2b-313d-43cf-8a2a-364b2a2a2cb5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:33.194938 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d3d8b2b-313d-43cf-8a2a-364b2a2a2cb5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:33.195416 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d3d8b2b-313d-43cf-8a2a-364b2a2a2cb5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:33.196107 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d3d8b2b-313d-43cf-8a2a-364b2a2a2cb5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:33.196554 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d3d8b2b-313d-43cf-8a2a-364b2a2a2cb5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:33.196975 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d3d8b2b-313d-43cf-8a2a-364b2a2a2cb5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:33.215274 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4bd71af9-b620-4cb3-aaa1-85cce92f0206 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047054 Aug 10 12:50:33.215848 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 682/1357] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:33 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:33.225827 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1c297788-7ab5-42ed-9ece-8072ff7477d5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:33.228024 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1c297788-7ab5-42ed-9ece-8072ff7477d5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:33.234260 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c297788-7ab5-42ed-9ece-8072ff7477d5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:33.235000 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c297788-7ab5-42ed-9ece-8072ff7477d5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:33.235346 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5d3d8b2b-313d-43cf-8a2a-364b2a2a2cb5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057264 Aug 10 12:50:33.235457 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c297788-7ab5-42ed-9ece-8072ff7477d5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:33.235961 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 676/1358] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:33 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:50:33.236165 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c297788-7ab5-42ed-9ece-8072ff7477d5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:33.236663 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c297788-7ab5-42ed-9ece-8072ff7477d5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:33.237040 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c297788-7ab5-42ed-9ece-8072ff7477d5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:33.267193 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1c297788-7ab5-42ed-9ece-8072ff7477d5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045294 Aug 10 12:50:33.267772 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 683/1359] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:33 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:50:34.228113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-958b4fba-f010-4327-a95e-63c92c59e0ad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:34.230277 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-958b4fba-f010-4327-a95e-63c92c59e0ad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:34.237838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-958b4fba-f010-4327-a95e-63c92c59e0ad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:34.238326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-958b4fba-f010-4327-a95e-63c92c59e0ad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:34.238762 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-958b4fba-f010-4327-a95e-63c92c59e0ad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:34.239488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-958b4fba-f010-4327-a95e-63c92c59e0ad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:34.239942 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-958b4fba-f010-4327-a95e-63c92c59e0ad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:34.240369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-958b4fba-f010-4327-a95e-63c92c59e0ad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:34.247674 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4cd747e4-d2b9-402d-8430-b7ca6d9d1b58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:34.249825 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4cd747e4-d2b9-402d-8430-b7ca6d9d1b58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:34.256553 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4cd747e4-d2b9-402d-8430-b7ca6d9d1b58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:34.257034 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4cd747e4-d2b9-402d-8430-b7ca6d9d1b58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:34.257632 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4cd747e4-d2b9-402d-8430-b7ca6d9d1b58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:34.258342 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4cd747e4-d2b9-402d-8430-b7ca6d9d1b58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:34.258794 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4cd747e4-d2b9-402d-8430-b7ca6d9d1b58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:34.259240 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4cd747e4-d2b9-402d-8430-b7ca6d9d1b58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:34.269921 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-958b4fba-f010-4327-a95e-63c92c59e0ad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045659 Aug 10 12:50:34.270490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 677/1360] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:34 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:34.278992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2325baa2-585a-4a16-84b8-2bbdd43c1579 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:34.281883 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2325baa2-585a-4a16-84b8-2bbdd43c1579 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:34.287803 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2325baa2-585a-4a16-84b8-2bbdd43c1579 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:34.288290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2325baa2-585a-4a16-84b8-2bbdd43c1579 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:34.288730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2325baa2-585a-4a16-84b8-2bbdd43c1579 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:34.289436 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2325baa2-585a-4a16-84b8-2bbdd43c1579 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:34.289887 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2325baa2-585a-4a16-84b8-2bbdd43c1579 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:34.290310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2325baa2-585a-4a16-84b8-2bbdd43c1579 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:34.291206 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4cd747e4-d2b9-402d-8430-b7ca6d9d1b58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047426 Aug 10 12:50:34.291791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 684/1361] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:34 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:50:34.320686 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2325baa2-585a-4a16-84b8-2bbdd43c1579 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045384 Aug 10 12:50:34.321231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 678/1362] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:34 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:35.285019 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-15b51981-46c2-4fb8-9577-ecd2a74294e5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:35.287281 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-15b51981-46c2-4fb8-9577-ecd2a74294e5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:35.294026 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15b51981-46c2-4fb8-9577-ecd2a74294e5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:35.294809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15b51981-46c2-4fb8-9577-ecd2a74294e5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:35.295374 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15b51981-46c2-4fb8-9577-ecd2a74294e5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:35.296082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15b51981-46c2-4fb8-9577-ecd2a74294e5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:35.298781 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15b51981-46c2-4fb8-9577-ecd2a74294e5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:35.298781 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15b51981-46c2-4fb8-9577-ecd2a74294e5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:35.305813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f7b41f05-ebea-4b25-a18f-a0ce86a6cc2c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:35.306758 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f7b41f05-ebea-4b25-a18f-a0ce86a6cc2c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:35.313824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f7b41f05-ebea-4b25-a18f-a0ce86a6cc2c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:35.314391 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f7b41f05-ebea-4b25-a18f-a0ce86a6cc2c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:35.314917 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f7b41f05-ebea-4b25-a18f-a0ce86a6cc2c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:35.315660 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f7b41f05-ebea-4b25-a18f-a0ce86a6cc2c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:35.316115 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f7b41f05-ebea-4b25-a18f-a0ce86a6cc2c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:35.316543 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f7b41f05-ebea-4b25-a18f-a0ce86a6cc2c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:35.328185 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-15b51981-46c2-4fb8-9577-ecd2a74294e5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049636 Aug 10 12:50:35.328761 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 685/1363] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:35 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:35.333431 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6ab65de7-ead9-41cc-bed9-567215beab62 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:35.335582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6ab65de7-ead9-41cc-bed9-567215beab62 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:35.341304 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6ab65de7-ead9-41cc-bed9-567215beab62 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:35.341785 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6ab65de7-ead9-41cc-bed9-567215beab62 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:35.342218 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6ab65de7-ead9-41cc-bed9-567215beab62 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:35.342908 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6ab65de7-ead9-41cc-bed9-567215beab62 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:35.343415 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6ab65de7-ead9-41cc-bed9-567215beab62 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:35.343846 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6ab65de7-ead9-41cc-bed9-567215beab62 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:35.345909 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f7b41f05-ebea-4b25-a18f-a0ce86a6cc2c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045810 Aug 10 12:50:35.346665 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 679/1364] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:35 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:35.373069 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6ab65de7-ead9-41cc-bed9-567215beab62 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043303 Aug 10 12:50:35.373625 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 686/1365] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:35 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:36.340571 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1697383e-3ccc-44eb-8441-b1e4dceb28fa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:36.342802 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1697383e-3ccc-44eb-8441-b1e4dceb28fa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:36.349397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1697383e-3ccc-44eb-8441-b1e4dceb28fa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:36.349871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1697383e-3ccc-44eb-8441-b1e4dceb28fa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:36.350300 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1697383e-3ccc-44eb-8441-b1e4dceb28fa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:36.350981 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1697383e-3ccc-44eb-8441-b1e4dceb28fa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:36.351512 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1697383e-3ccc-44eb-8441-b1e4dceb28fa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:36.351860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1697383e-3ccc-44eb-8441-b1e4dceb28fa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:36.358655 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5d3a7be9-07d5-4419-b3e5-8ab30d8eef9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:36.361393 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5d3a7be9-07d5-4419-b3e5-8ab30d8eef9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:36.365989 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:50:36.367848 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d3a7be9-07d5-4419-b3e5-8ab30d8eef9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:36.368328 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d3a7be9-07d5-4419-b3e5-8ab30d8eef9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:36.368759 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d3a7be9-07d5-4419-b3e5-8ab30d8eef9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:36.369451 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d3a7be9-07d5-4419-b3e5-8ab30d8eef9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:36.369896 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d3a7be9-07d5-4419-b3e5-8ab30d8eef9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:36.370312 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d3a7be9-07d5-4419-b3e5-8ab30d8eef9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:36.382884 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1697383e-3ccc-44eb-8441-b1e4dceb28fa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046381 Aug 10 12:50:36.387444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 680/1366] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:36 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:36.388321 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6f389fef-3cd4-4283-a7af-a945682c19fd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:36.390035 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6f389fef-3cd4-4283-a7af-a945682c19fd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:36.396333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f389fef-3cd4-4283-a7af-a945682c19fd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:36.396812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f389fef-3cd4-4283-a7af-a945682c19fd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:36.397242 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f389fef-3cd4-4283-a7af-a945682c19fd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:36.397951 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f389fef-3cd4-4283-a7af-a945682c19fd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:36.398393 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f389fef-3cd4-4283-a7af-a945682c19fd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:36.398811 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f389fef-3cd4-4283-a7af-a945682c19fd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:36.401361 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5d3a7be9-07d5-4419-b3e5-8ab30d8eef9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047226 Aug 10 12:50:36.401932 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 687/1367] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:36 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:50:36.429679 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6f389fef-3cd4-4283-a7af-a945682c19fd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045177 Aug 10 12:50:36.430254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 681/1368] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:36 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:37.396955 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6f844fbb-fb08-4a56-b4ea-faa83ad961d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:37.399571 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6f844fbb-fb08-4a56-b4ea-faa83ad961d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:37.406922 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f844fbb-fb08-4a56-b4ea-faa83ad961d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:37.411395 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f844fbb-fb08-4a56-b4ea-faa83ad961d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:37.411395 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f844fbb-fb08-4a56-b4ea-faa83ad961d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:37.411395 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f844fbb-fb08-4a56-b4ea-faa83ad961d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:37.411395 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f844fbb-fb08-4a56-b4ea-faa83ad961d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:37.412223 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f844fbb-fb08-4a56-b4ea-faa83ad961d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:37.415736 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c0a898d4-9fe7-4aa5-856e-bb9d96ab98aa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:37.418464 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c0a898d4-9fe7-4aa5-856e-bb9d96ab98aa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:37.426351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c0a898d4-9fe7-4aa5-856e-bb9d96ab98aa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:37.426870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c0a898d4-9fe7-4aa5-856e-bb9d96ab98aa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:37.427344 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c0a898d4-9fe7-4aa5-856e-bb9d96ab98aa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:37.428067 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c0a898d4-9fe7-4aa5-856e-bb9d96ab98aa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:37.428521 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c0a898d4-9fe7-4aa5-856e-bb9d96ab98aa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:37.428947 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c0a898d4-9fe7-4aa5-856e-bb9d96ab98aa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:37.449518 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6f844fbb-fb08-4a56-b4ea-faa83ad961d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056524 Aug 10 12:50:37.455455 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 688/1369] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:37 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:37.460901 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c2ec6d39-9975-4219-be67-146ce1b55f89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:37.462367 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c0a898d4-9fe7-4aa5-856e-bb9d96ab98aa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052271 Aug 10 12:50:37.462941 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 682/1370] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:37 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:37.463148 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c2ec6d39-9975-4219-be67-146ce1b55f89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:37.469885 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c2ec6d39-9975-4219-be67-146ce1b55f89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:37.470358 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c2ec6d39-9975-4219-be67-146ce1b55f89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:37.470789 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c2ec6d39-9975-4219-be67-146ce1b55f89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:37.471513 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c2ec6d39-9975-4219-be67-146ce1b55f89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:37.471957 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c2ec6d39-9975-4219-be67-146ce1b55f89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:37.472373 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c2ec6d39-9975-4219-be67-146ce1b55f89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:37.500799 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c2ec6d39-9975-4219-be67-146ce1b55f89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043877 Aug 10 12:50:37.501347 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 689/1371] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:37 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:38.461865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9d3926cb-af6e-4e85-b781-f7134590ba10 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:38.464152 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9d3926cb-af6e-4e85-b781-f7134590ba10 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:38.470919 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d3926cb-af6e-4e85-b781-f7134590ba10 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:38.471439 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d3926cb-af6e-4e85-b781-f7134590ba10 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:38.471999 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d3926cb-af6e-4e85-b781-f7134590ba10 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:38.472841 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d3926cb-af6e-4e85-b781-f7134590ba10 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:38.473298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d3926cb-af6e-4e85-b781-f7134590ba10 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:38.473883 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d3926cb-af6e-4e85-b781-f7134590ba10 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:38.474331 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ee84374e-16dd-4caf-8e4b-2fc8a212e66c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:38.476517 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ee84374e-16dd-4caf-8e4b-2fc8a212e66c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:38.483371 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee84374e-16dd-4caf-8e4b-2fc8a212e66c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:38.484413 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee84374e-16dd-4caf-8e4b-2fc8a212e66c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:38.485373 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee84374e-16dd-4caf-8e4b-2fc8a212e66c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:38.486090 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee84374e-16dd-4caf-8e4b-2fc8a212e66c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:38.486546 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee84374e-16dd-4caf-8e4b-2fc8a212e66c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:38.486974 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee84374e-16dd-4caf-8e4b-2fc8a212e66c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:38.504870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9d3926cb-af6e-4e85-b781-f7134590ba10 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046879 Aug 10 12:50:38.505472 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 683/1372] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:38 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:38.516064 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d54a804d-06d4-4770-83b1-4b154b8810ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:38.516935 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ee84374e-16dd-4caf-8e4b-2fc8a212e66c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046630 Aug 10 12:50:38.517504 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 690/1373] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:38 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:38.518237 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d54a804d-06d4-4770-83b1-4b154b8810ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:38.524086 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d54a804d-06d4-4770-83b1-4b154b8810ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:38.524553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d54a804d-06d4-4770-83b1-4b154b8810ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:38.524995 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d54a804d-06d4-4770-83b1-4b154b8810ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:38.525674 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d54a804d-06d4-4770-83b1-4b154b8810ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:38.526128 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d54a804d-06d4-4770-83b1-4b154b8810ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:38.526551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d54a804d-06d4-4770-83b1-4b154b8810ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:38.555368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d54a804d-06d4-4770-83b1-4b154b8810ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043302 Aug 10 12:50:38.555856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 684/1374] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:38 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:50:39.517443 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e21355e9-185b-4857-bdb9-81b5f32f6a42 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:39.519715 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e21355e9-185b-4857-bdb9-81b5f32f6a42 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:39.526691 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e21355e9-185b-4857-bdb9-81b5f32f6a42 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:39.527195 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e21355e9-185b-4857-bdb9-81b5f32f6a42 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:39.527625 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e21355e9-185b-4857-bdb9-81b5f32f6a42 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:39.528337 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e21355e9-185b-4857-bdb9-81b5f32f6a42 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:39.528827 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e21355e9-185b-4857-bdb9-81b5f32f6a42 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:39.529435 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e21355e9-185b-4857-bdb9-81b5f32f6a42 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:39.529589 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3814f521-80a6-48a6-8b63-f26403f2feed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:39.531917 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3814f521-80a6-48a6-8b63-f26403f2feed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:39.538352 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3814f521-80a6-48a6-8b63-f26403f2feed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:39.538837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3814f521-80a6-48a6-8b63-f26403f2feed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:39.539298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3814f521-80a6-48a6-8b63-f26403f2feed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:39.539993 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3814f521-80a6-48a6-8b63-f26403f2feed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:39.540446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3814f521-80a6-48a6-8b63-f26403f2feed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:39.540898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3814f521-80a6-48a6-8b63-f26403f2feed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:39.558113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e21355e9-185b-4857-bdb9-81b5f32f6a42 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045189 Aug 10 12:50:39.558665 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 691/1375] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:39 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:39.567950 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2999b03b-a1d6-437e-9e7d-d8a8135b611e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:39.570057 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2999b03b-a1d6-437e-9e7d-d8a8135b611e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:39.570778 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3814f521-80a6-48a6-8b63-f26403f2feed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045571 Aug 10 12:50:39.571391 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 685/1376] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:39 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:50:39.576260 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2999b03b-a1d6-437e-9e7d-d8a8135b611e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:39.576738 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2999b03b-a1d6-437e-9e7d-d8a8135b611e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:39.577171 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2999b03b-a1d6-437e-9e7d-d8a8135b611e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:39.578499 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2999b03b-a1d6-437e-9e7d-d8a8135b611e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:39.578947 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2999b03b-a1d6-437e-9e7d-d8a8135b611e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:39.579396 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2999b03b-a1d6-437e-9e7d-d8a8135b611e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:39.608554 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2999b03b-a1d6-437e-9e7d-d8a8135b611e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044525 Aug 10 12:50:39.609538 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 692/1377] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:39 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:50:40.570007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a19dbcc4-9963-4a8b-9087-c34f3e9e3a58 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:40.572258 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a19dbcc4-9963-4a8b-9087-c34f3e9e3a58 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:40.582060 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a19dbcc4-9963-4a8b-9087-c34f3e9e3a58 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:40.582060 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a19dbcc4-9963-4a8b-9087-c34f3e9e3a58 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:40.582060 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a19dbcc4-9963-4a8b-9087-c34f3e9e3a58 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:40.582060 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a19dbcc4-9963-4a8b-9087-c34f3e9e3a58 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:40.582451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a19dbcc4-9963-4a8b-9087-c34f3e9e3a58 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:40.582546 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a19dbcc4-9963-4a8b-9087-c34f3e9e3a58 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:40.584285 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d081bb97-adad-4fef-9d75-e6b33114bbde tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:40.586409 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d081bb97-adad-4fef-9d75-e6b33114bbde tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:40.592711 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d081bb97-adad-4fef-9d75-e6b33114bbde tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:40.593237 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d081bb97-adad-4fef-9d75-e6b33114bbde tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:40.594461 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d081bb97-adad-4fef-9d75-e6b33114bbde tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:40.595216 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d081bb97-adad-4fef-9d75-e6b33114bbde tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:40.595670 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d081bb97-adad-4fef-9d75-e6b33114bbde tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:40.596091 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d081bb97-adad-4fef-9d75-e6b33114bbde tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:40.612867 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a19dbcc4-9963-4a8b-9087-c34f3e9e3a58 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046769 Aug 10 12:50:40.613612 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 686/1378] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:40 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:40.621854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5a1c2c87-e1bb-4c77-bd75-2d2d10b4c3d6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:40.623966 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5a1c2c87-e1bb-4c77-bd75-2d2d10b4c3d6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:40.626056 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d081bb97-adad-4fef-9d75-e6b33114bbde tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045914 Aug 10 12:50:40.626757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 693/1379] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:40 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:50:40.630027 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a1c2c87-e1bb-4c77-bd75-2d2d10b4c3d6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:40.630497 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a1c2c87-e1bb-4c77-bd75-2d2d10b4c3d6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:40.630919 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a1c2c87-e1bb-4c77-bd75-2d2d10b4c3d6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:40.631631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a1c2c87-e1bb-4c77-bd75-2d2d10b4c3d6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:40.632073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a1c2c87-e1bb-4c77-bd75-2d2d10b4c3d6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:40.632490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a1c2c87-e1bb-4c77-bd75-2d2d10b4c3d6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:40.662612 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5a1c2c87-e1bb-4c77-bd75-2d2d10b4c3d6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044335 Aug 10 12:50:40.663159 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 687/1380] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:40 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:41.625752 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ebfc5b7d-9c9a-4b46-b6de-de8afdcec666 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:41.627942 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ebfc5b7d-9c9a-4b46-b6de-de8afdcec666 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:41.636023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebfc5b7d-9c9a-4b46-b6de-de8afdcec666 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:41.636513 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebfc5b7d-9c9a-4b46-b6de-de8afdcec666 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:41.636954 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebfc5b7d-9c9a-4b46-b6de-de8afdcec666 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:41.637663 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebfc5b7d-9c9a-4b46-b6de-de8afdcec666 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:41.638145 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebfc5b7d-9c9a-4b46-b6de-de8afdcec666 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:41.638576 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebfc5b7d-9c9a-4b46-b6de-de8afdcec666 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:41.643414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7197e1e1-f3ed-4983-b504-35744a8fbfee tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:41.645558 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7197e1e1-f3ed-4983-b504-35744a8fbfee tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:41.651535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7197e1e1-f3ed-4983-b504-35744a8fbfee tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:41.652017 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7197e1e1-f3ed-4983-b504-35744a8fbfee tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:41.652448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7197e1e1-f3ed-4983-b504-35744a8fbfee tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:41.653144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7197e1e1-f3ed-4983-b504-35744a8fbfee tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:41.653593 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7197e1e1-f3ed-4983-b504-35744a8fbfee tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:41.654016 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7197e1e1-f3ed-4983-b504-35744a8fbfee tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:41.669397 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ebfc5b7d-9c9a-4b46-b6de-de8afdcec666 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048359 Aug 10 12:50:41.669969 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 694/1381] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:41 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:41.677960 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-25e26064-3a68-471c-a6ea-65dbc2327489 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:41.680129 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-25e26064-3a68-471c-a6ea-65dbc2327489 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:41.682864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7197e1e1-f3ed-4983-b504-35744a8fbfee tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048823 Aug 10 12:50:41.683449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 688/1382] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:41 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:50:41.686431 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-25e26064-3a68-471c-a6ea-65dbc2327489 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:41.687454 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-25e26064-3a68-471c-a6ea-65dbc2327489 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:41.687899 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-25e26064-3a68-471c-a6ea-65dbc2327489 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:41.688593 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-25e26064-3a68-471c-a6ea-65dbc2327489 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:41.689113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-25e26064-3a68-471c-a6ea-65dbc2327489 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:41.689548 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-25e26064-3a68-471c-a6ea-65dbc2327489 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:41.718454 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-25e26064-3a68-471c-a6ea-65dbc2327489 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047162 Aug 10 12:50:41.718998 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 695/1383] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:41 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:42.681884 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5aa20a6a-faba-48b7-8392-29447abe2a61 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:42.684207 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5aa20a6a-faba-48b7-8392-29447abe2a61 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:42.692049 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5aa20a6a-faba-48b7-8392-29447abe2a61 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:42.692543 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5aa20a6a-faba-48b7-8392-29447abe2a61 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:42.692984 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5aa20a6a-faba-48b7-8392-29447abe2a61 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:42.693717 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5aa20a6a-faba-48b7-8392-29447abe2a61 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:42.694170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5aa20a6a-faba-48b7-8392-29447abe2a61 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:42.694593 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5aa20a6a-faba-48b7-8392-29447abe2a61 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:42.696098 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6604f1f9-ab6a-4920-a594-9d92b3f631e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:42.698212 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6604f1f9-ab6a-4920-a594-9d92b3f631e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:42.700526 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=88 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:50:42.705166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6604f1f9-ab6a-4920-a594-9d92b3f631e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:42.705647 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6604f1f9-ab6a-4920-a594-9d92b3f631e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:42.706081 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6604f1f9-ab6a-4920-a594-9d92b3f631e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:42.706782 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6604f1f9-ab6a-4920-a594-9d92b3f631e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:42.707250 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6604f1f9-ab6a-4920-a594-9d92b3f631e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:42.707674 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6604f1f9-ab6a-4920-a594-9d92b3f631e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:42.711308 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:50:42.723833 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5aa20a6a-faba-48b7-8392-29447abe2a61 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045818 Aug 10 12:50:42.735296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 689/1384] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:42 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:42.735296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5736ced6-c182-45ae-8061-32eb1b88487b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:42.735296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5736ced6-c182-45ae-8061-32eb1b88487b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:42.737751 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6604f1f9-ab6a-4920-a594-9d92b3f631e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045549 Aug 10 12:50:42.738326 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 696/1385] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:42 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:50:42.738532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5736ced6-c182-45ae-8061-32eb1b88487b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:42.739016 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5736ced6-c182-45ae-8061-32eb1b88487b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:42.739491 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5736ced6-c182-45ae-8061-32eb1b88487b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:42.740191 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5736ced6-c182-45ae-8061-32eb1b88487b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:42.740645 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5736ced6-c182-45ae-8061-32eb1b88487b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:42.741068 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5736ced6-c182-45ae-8061-32eb1b88487b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:42.770343 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5736ced6-c182-45ae-8061-32eb1b88487b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044290 Aug 10 12:50:42.770889 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 690/1386] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:42 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:50:43.743239 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f6c0e987-ac3f-474a-905e-4b6ade336234 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:43.745266 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f6c0e987-ac3f-474a-905e-4b6ade336234 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:43.750254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-41f5a326-c7cf-472c-b8a1-459bde6d0d2f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:43.753232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-41f5a326-c7cf-472c-b8a1-459bde6d0d2f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:43.753366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f6c0e987-ac3f-474a-905e-4b6ade336234 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:43.753733 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f6c0e987-ac3f-474a-905e-4b6ade336234 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:43.754175 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f6c0e987-ac3f-474a-905e-4b6ade336234 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:43.754875 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f6c0e987-ac3f-474a-905e-4b6ade336234 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:43.755352 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f6c0e987-ac3f-474a-905e-4b6ade336234 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:43.755779 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f6c0e987-ac3f-474a-905e-4b6ade336234 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:43.759632 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41f5a326-c7cf-472c-b8a1-459bde6d0d2f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:43.760108 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41f5a326-c7cf-472c-b8a1-459bde6d0d2f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:43.760541 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41f5a326-c7cf-472c-b8a1-459bde6d0d2f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:43.761225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41f5a326-c7cf-472c-b8a1-459bde6d0d2f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:43.761673 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41f5a326-c7cf-472c-b8a1-459bde6d0d2f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:43.762092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41f5a326-c7cf-472c-b8a1-459bde6d0d2f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:43.786127 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f6c0e987-ac3f-474a-905e-4b6ade336234 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047774 Aug 10 12:50:43.786685 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 697/1387] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:43 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:43.792110 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3cfb87a7-4a19-479f-ac02-1052ccf74553 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:43.792602 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-41f5a326-c7cf-472c-b8a1-459bde6d0d2f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046435 Aug 10 12:50:43.793244 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 691/1388] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:43 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:50:43.794280 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3cfb87a7-4a19-479f-ac02-1052ccf74553 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:43.800157 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3cfb87a7-4a19-479f-ac02-1052ccf74553 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:43.800652 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3cfb87a7-4a19-479f-ac02-1052ccf74553 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:43.801080 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3cfb87a7-4a19-479f-ac02-1052ccf74553 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:43.801777 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3cfb87a7-4a19-479f-ac02-1052ccf74553 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:43.802229 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3cfb87a7-4a19-479f-ac02-1052ccf74553 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:43.802659 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3cfb87a7-4a19-479f-ac02-1052ccf74553 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:43.831721 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3cfb87a7-4a19-479f-ac02-1052ccf74553 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043306 Aug 10 12:50:43.832274 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 698/1389] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:43 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:44.799797 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5bf90ae9-c83e-417b-8955-52b1bae81620 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:44.800898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5bf90ae9-c83e-417b-8955-52b1bae81620 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:44.805820 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1affd60c-784b-4bdd-ab49-d9519d9b1307 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:44.807947 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5bf90ae9-c83e-417b-8955-52b1bae81620 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:44.808441 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5bf90ae9-c83e-417b-8955-52b1bae81620 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:44.808879 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5bf90ae9-c83e-417b-8955-52b1bae81620 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:44.809128 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1affd60c-784b-4bdd-ab49-d9519d9b1307 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:44.809583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5bf90ae9-c83e-417b-8955-52b1bae81620 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:44.810037 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5bf90ae9-c83e-417b-8955-52b1bae81620 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:44.810464 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5bf90ae9-c83e-417b-8955-52b1bae81620 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:44.815491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1affd60c-784b-4bdd-ab49-d9519d9b1307 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:44.815974 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1affd60c-784b-4bdd-ab49-d9519d9b1307 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:44.816409 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1affd60c-784b-4bdd-ab49-d9519d9b1307 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:44.817139 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1affd60c-784b-4bdd-ab49-d9519d9b1307 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:44.817593 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1affd60c-784b-4bdd-ab49-d9519d9b1307 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:44.818017 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1affd60c-784b-4bdd-ab49-d9519d9b1307 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:44.839424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5bf90ae9-c83e-417b-8955-52b1bae81620 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045457 Aug 10 12:50:44.839995 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 692/1390] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:44 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:44.845210 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8897a7a9-5c0d-4060-9ce4-58dc4c2e6df1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:44.847603 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8897a7a9-5c0d-4060-9ce4-58dc4c2e6df1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:44.848375 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1affd60c-784b-4bdd-ab49-d9519d9b1307 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046389 Aug 10 12:50:44.849039 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 699/1391] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:44 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:44.853308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8897a7a9-5c0d-4060-9ce4-58dc4c2e6df1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:44.853785 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8897a7a9-5c0d-4060-9ce4-58dc4c2e6df1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:44.854220 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8897a7a9-5c0d-4060-9ce4-58dc4c2e6df1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:44.854911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8897a7a9-5c0d-4060-9ce4-58dc4c2e6df1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:44.855651 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8897a7a9-5c0d-4060-9ce4-58dc4c2e6df1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:44.856077 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8897a7a9-5c0d-4060-9ce4-58dc4c2e6df1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:44.885299 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8897a7a9-5c0d-4060-9ce4-58dc4c2e6df1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044331 Aug 10 12:50:44.886069 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 693/1392] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:44 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:45.852007 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4215aff3-3003-47e4-a163-d4e7cb1a7b9f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:45.854173 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4215aff3-3003-47e4-a163-d4e7cb1a7b9f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:45.861169 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4215aff3-3003-47e4-a163-d4e7cb1a7b9f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:45.861717 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4215aff3-3003-47e4-a163-d4e7cb1a7b9f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:45.861878 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6b740645-0554-4c5a-82eb-dee20f032487 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:45.862786 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4215aff3-3003-47e4-a163-d4e7cb1a7b9f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:45.863707 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4215aff3-3003-47e4-a163-d4e7cb1a7b9f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:45.864072 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6b740645-0554-4c5a-82eb-dee20f032487 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:45.864192 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4215aff3-3003-47e4-a163-d4e7cb1a7b9f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:45.864575 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4215aff3-3003-47e4-a163-d4e7cb1a7b9f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:45.870457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b740645-0554-4c5a-82eb-dee20f032487 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:45.870935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b740645-0554-4c5a-82eb-dee20f032487 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:45.871444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b740645-0554-4c5a-82eb-dee20f032487 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:45.872139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b740645-0554-4c5a-82eb-dee20f032487 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:45.872592 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b740645-0554-4c5a-82eb-dee20f032487 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:45.873014 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b740645-0554-4c5a-82eb-dee20f032487 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:45.894272 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4215aff3-3003-47e4-a163-d4e7cb1a7b9f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046270 Aug 10 12:50:45.894843 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 700/1393] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:45 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:45.899411 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-37a83c20-76bb-465c-a0cf-3526e39a47f7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:45.901527 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-37a83c20-76bb-465c-a0cf-3526e39a47f7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:45.904382 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6b740645-0554-4c5a-82eb-dee20f032487 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046947 Aug 10 12:50:45.904943 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 694/1394] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:45 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:50:45.908051 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-37a83c20-76bb-465c-a0cf-3526e39a47f7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:45.908536 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-37a83c20-76bb-465c-a0cf-3526e39a47f7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:45.908969 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-37a83c20-76bb-465c-a0cf-3526e39a47f7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:45.909662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-37a83c20-76bb-465c-a0cf-3526e39a47f7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:45.910111 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-37a83c20-76bb-465c-a0cf-3526e39a47f7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:45.910533 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-37a83c20-76bb-465c-a0cf-3526e39a47f7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:45.938813 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-37a83c20-76bb-465c-a0cf-3526e39a47f7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042846 Aug 10 12:50:45.939382 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 701/1395] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:45 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:46.905806 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2574fd4b-4a67-432f-80b7-86c4392d7941 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:46.908555 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2574fd4b-4a67-432f-80b7-86c4392d7941 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:46.914979 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2574fd4b-4a67-432f-80b7-86c4392d7941 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:46.915486 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2574fd4b-4a67-432f-80b7-86c4392d7941 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:46.915909 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2574fd4b-4a67-432f-80b7-86c4392d7941 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:46.916765 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2574fd4b-4a67-432f-80b7-86c4392d7941 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:46.917235 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bfada686-dd83-46bf-a7ff-41278975ae5f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:46.917662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2574fd4b-4a67-432f-80b7-86c4392d7941 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:46.917829 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2574fd4b-4a67-432f-80b7-86c4392d7941 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:46.919421 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bfada686-dd83-46bf-a7ff-41278975ae5f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:46.926926 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bfada686-dd83-46bf-a7ff-41278975ae5f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:46.927432 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bfada686-dd83-46bf-a7ff-41278975ae5f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:46.927861 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bfada686-dd83-46bf-a7ff-41278975ae5f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:46.928551 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bfada686-dd83-46bf-a7ff-41278975ae5f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:46.928998 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bfada686-dd83-46bf-a7ff-41278975ae5f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:46.929416 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bfada686-dd83-46bf-a7ff-41278975ae5f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:46.949190 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2574fd4b-4a67-432f-80b7-86c4392d7941 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047105 Aug 10 12:50:46.949757 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 695/1396] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:46 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:50:46.954681 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4bb45d55-cdb1-4683-964d-55ffc5395865 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:46.956820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4bb45d55-cdb1-4683-964d-55ffc5395865 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:46.958749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bfada686-dd83-46bf-a7ff-41278975ae5f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045367 Aug 10 12:50:46.959484 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 702/1397] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:46 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:50:46.962678 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4bb45d55-cdb1-4683-964d-55ffc5395865 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:46.963165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4bb45d55-cdb1-4683-964d-55ffc5395865 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:46.963643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4bb45d55-cdb1-4683-964d-55ffc5395865 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:46.964341 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4bb45d55-cdb1-4683-964d-55ffc5395865 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:46.964795 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4bb45d55-cdb1-4683-964d-55ffc5395865 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:46.965218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4bb45d55-cdb1-4683-964d-55ffc5395865 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:46.994786 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4bb45d55-cdb1-4683-964d-55ffc5395865 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044048 Aug 10 12:50:46.995383 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 696/1398] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:46 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:47.960755 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-54cda485-9a5a-4ffb-bbf9-0498ff017fc5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:47.963000 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-54cda485-9a5a-4ffb-bbf9-0498ff017fc5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:47.970983 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54cda485-9a5a-4ffb-bbf9-0498ff017fc5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:47.971205 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6bfa2960-da86-4361-adf3-3c5ffd3b71fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:47.971651 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54cda485-9a5a-4ffb-bbf9-0498ff017fc5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:47.971915 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54cda485-9a5a-4ffb-bbf9-0498ff017fc5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:47.972600 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54cda485-9a5a-4ffb-bbf9-0498ff017fc5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:47.973044 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54cda485-9a5a-4ffb-bbf9-0498ff017fc5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:47.973459 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54cda485-9a5a-4ffb-bbf9-0498ff017fc5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:47.973860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6bfa2960-da86-4361-adf3-3c5ffd3b71fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:47.982183 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6bfa2960-da86-4361-adf3-3c5ffd3b71fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:47.982740 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6bfa2960-da86-4361-adf3-3c5ffd3b71fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:47.983283 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6bfa2960-da86-4361-adf3-3c5ffd3b71fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:47.984071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6bfa2960-da86-4361-adf3-3c5ffd3b71fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:47.984529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6bfa2960-da86-4361-adf3-3c5ffd3b71fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:47.984957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6bfa2960-da86-4361-adf3-3c5ffd3b71fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:47.988246 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:50:48.005427 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-54cda485-9a5a-4ffb-bbf9-0498ff017fc5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048663 Aug 10 12:50:48.006033 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 703/1399] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:47 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:48.010821 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a94dfe0d-dacf-4ee3-b43c-8cc51c1664f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:48.013023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a94dfe0d-dacf-4ee3-b43c-8cc51c1664f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:48.018959 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a94dfe0d-dacf-4ee3-b43c-8cc51c1664f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:48.019469 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a94dfe0d-dacf-4ee3-b43c-8cc51c1664f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:48.019906 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a94dfe0d-dacf-4ee3-b43c-8cc51c1664f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:48.020594 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a94dfe0d-dacf-4ee3-b43c-8cc51c1664f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:48.020696 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6bfa2960-da86-4361-adf3-3c5ffd3b71fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054710 Aug 10 12:50:48.021044 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a94dfe0d-dacf-4ee3-b43c-8cc51c1664f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:48.021365 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 697/1400] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:47 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:50:48.021529 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a94dfe0d-dacf-4ee3-b43c-8cc51c1664f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:48.049970 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a94dfe0d-dacf-4ee3-b43c-8cc51c1664f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042819 Aug 10 12:50:48.050508 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 704/1401] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:48 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:49.020935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e0f0d585-a40f-4c59-9951-316379995ecf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:49.023079 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e0f0d585-a40f-4c59-9951-316379995ecf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:49.029327 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0f0d585-a40f-4c59-9951-316379995ecf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:49.029691 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0f0d585-a40f-4c59-9951-316379995ecf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:49.030107 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0f0d585-a40f-4c59-9951-316379995ecf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:49.030932 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0f0d585-a40f-4c59-9951-316379995ecf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:49.031416 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0f0d585-a40f-4c59-9951-316379995ecf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:49.032427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0f0d585-a40f-4c59-9951-316379995ecf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:49.033912 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0f641ccf-fb1b-4cb4-bebf-2c3220e1e43a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:49.036453 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0f641ccf-fb1b-4cb4-bebf-2c3220e1e43a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:49.042619 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f641ccf-fb1b-4cb4-bebf-2c3220e1e43a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:49.043092 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f641ccf-fb1b-4cb4-bebf-2c3220e1e43a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:49.043543 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f641ccf-fb1b-4cb4-bebf-2c3220e1e43a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:49.044228 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f641ccf-fb1b-4cb4-bebf-2c3220e1e43a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:49.044797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f641ccf-fb1b-4cb4-bebf-2c3220e1e43a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:49.045218 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f641ccf-fb1b-4cb4-bebf-2c3220e1e43a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:49.062584 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e0f0d585-a40f-4c59-9951-316379995ecf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045938 Aug 10 12:50:49.063240 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 698/1402] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:49 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:49.067953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b179b80e-6fe3-4c8a-b368-fb30686ce3c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:49.070148 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b179b80e-6fe3-4c8a-b368-fb30686ce3c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:49.075228 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0f641ccf-fb1b-4cb4-bebf-2c3220e1e43a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046249 Aug 10 12:50:49.075833 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 705/1403] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:49 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:49.075976 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b179b80e-6fe3-4c8a-b368-fb30686ce3c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:49.076357 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b179b80e-6fe3-4c8a-b368-fb30686ce3c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:49.076795 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b179b80e-6fe3-4c8a-b368-fb30686ce3c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:49.077487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b179b80e-6fe3-4c8a-b368-fb30686ce3c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:49.077937 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b179b80e-6fe3-4c8a-b368-fb30686ce3c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:49.078361 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b179b80e-6fe3-4c8a-b368-fb30686ce3c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:49.107459 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b179b80e-6fe3-4c8a-b368-fb30686ce3c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043092 Aug 10 12:50:49.108006 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 699/1404] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:49 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:50.074371 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5624cdc2-733e-4924-a1ef-1116f89ad5de tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:50.076862 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5624cdc2-733e-4924-a1ef-1116f89ad5de tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:50.084191 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5624cdc2-733e-4924-a1ef-1116f89ad5de tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:50.084680 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5624cdc2-733e-4924-a1ef-1116f89ad5de tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:50.085305 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5624cdc2-733e-4924-a1ef-1116f89ad5de tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:50.086013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5624cdc2-733e-4924-a1ef-1116f89ad5de tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:50.086471 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5624cdc2-733e-4924-a1ef-1116f89ad5de tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:50.086876 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5624cdc2-733e-4924-a1ef-1116f89ad5de tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:50.098141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2561e7d1-2416-4a78-9a9a-8da1c1d755e2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:50.098141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2561e7d1-2416-4a78-9a9a-8da1c1d755e2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:50.098141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2561e7d1-2416-4a78-9a9a-8da1c1d755e2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:50.098141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2561e7d1-2416-4a78-9a9a-8da1c1d755e2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:50.098844 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2561e7d1-2416-4a78-9a9a-8da1c1d755e2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:50.098844 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2561e7d1-2416-4a78-9a9a-8da1c1d755e2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:50.098844 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2561e7d1-2416-4a78-9a9a-8da1c1d755e2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:50.099107 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2561e7d1-2416-4a78-9a9a-8da1c1d755e2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:50.117363 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5624cdc2-733e-4924-a1ef-1116f89ad5de tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047037 Aug 10 12:50:50.117938 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 706/1405] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:50 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:50.122506 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ba117608-4dcb-4d69-b36d-ca9f37c66372 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:50.124757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ba117608-4dcb-4d69-b36d-ca9f37c66372 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:50.130843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2561e7d1-2416-4a78-9a9a-8da1c1d755e2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047615 Aug 10 12:50:50.131090 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ba117608-4dcb-4d69-b36d-ca9f37c66372 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:50.131405 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 700/1406] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:50 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:50.131621 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ba117608-4dcb-4d69-b36d-ca9f37c66372 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:50.132041 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ba117608-4dcb-4d69-b36d-ca9f37c66372 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:50.132741 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ba117608-4dcb-4d69-b36d-ca9f37c66372 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:50.133193 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ba117608-4dcb-4d69-b36d-ca9f37c66372 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:50.133615 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ba117608-4dcb-4d69-b36d-ca9f37c66372 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:50.162509 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ba117608-4dcb-4d69-b36d-ca9f37c66372 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043587 Aug 10 12:50:50.163058 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 707/1407] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:50 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:51.129886 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-171d6746-8def-4bc7-a90f-d2428e144f48 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:51.132324 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-171d6746-8def-4bc7-a90f-d2428e144f48 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:51.138977 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-171d6746-8def-4bc7-a90f-d2428e144f48 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:51.139488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-171d6746-8def-4bc7-a90f-d2428e144f48 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:51.139925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-171d6746-8def-4bc7-a90f-d2428e144f48 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:51.140619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-171d6746-8def-4bc7-a90f-d2428e144f48 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:51.141126 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-171d6746-8def-4bc7-a90f-d2428e144f48 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:51.142093 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-171d6746-8def-4bc7-a90f-d2428e144f48 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:51.148722 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f1129c27-1ee4-4ffb-b95d-5033782bfd15 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:51.148722 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f1129c27-1ee4-4ffb-b95d-5033782bfd15 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:51.152189 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f1129c27-1ee4-4ffb-b95d-5033782bfd15 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:51.152682 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f1129c27-1ee4-4ffb-b95d-5033782bfd15 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:51.153120 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f1129c27-1ee4-4ffb-b95d-5033782bfd15 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:51.153825 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f1129c27-1ee4-4ffb-b95d-5033782bfd15 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:51.154278 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f1129c27-1ee4-4ffb-b95d-5033782bfd15 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:51.154705 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f1129c27-1ee4-4ffb-b95d-5033782bfd15 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:51.176508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-171d6746-8def-4bc7-a90f-d2428e144f48 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050897 Aug 10 12:50:51.177069 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 701/1408] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:51 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:51.181731 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b7dab3b4-e72a-4daf-ace7-595dc8011255 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:51.183874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b7dab3b4-e72a-4daf-ace7-595dc8011255 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:51.184667 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f1129c27-1ee4-4ffb-b95d-5033782bfd15 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045681 Aug 10 12:50:51.185386 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 708/1409] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:51 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:50:51.189691 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b7dab3b4-e72a-4daf-ace7-595dc8011255 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:51.190160 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b7dab3b4-e72a-4daf-ace7-595dc8011255 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:51.190589 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b7dab3b4-e72a-4daf-ace7-595dc8011255 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:51.191297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b7dab3b4-e72a-4daf-ace7-595dc8011255 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:51.191740 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b7dab3b4-e72a-4daf-ace7-595dc8011255 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:51.192160 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b7dab3b4-e72a-4daf-ace7-595dc8011255 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:51.221352 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b7dab3b4-e72a-4daf-ace7-595dc8011255 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043312 Aug 10 12:50:51.221879 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 702/1410] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:51 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:52.188020 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d480e706-812a-4b88-b985-e684d3ef770f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:52.191501 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d480e706-812a-4b88-b985-e684d3ef770f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:52.196814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ebbc464d-77ca-4373-9f1f-242cd4aac8c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:52.198582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d480e706-812a-4b88-b985-e684d3ef770f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:52.198957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ebbc464d-77ca-4373-9f1f-242cd4aac8c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:52.199107 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d480e706-812a-4b88-b985-e684d3ef770f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:52.199508 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d480e706-812a-4b88-b985-e684d3ef770f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:52.200201 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d480e706-812a-4b88-b985-e684d3ef770f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:52.200647 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d480e706-812a-4b88-b985-e684d3ef770f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:52.201066 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d480e706-812a-4b88-b985-e684d3ef770f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:52.206246 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ebbc464d-77ca-4373-9f1f-242cd4aac8c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:52.206733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ebbc464d-77ca-4373-9f1f-242cd4aac8c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:52.207164 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ebbc464d-77ca-4373-9f1f-242cd4aac8c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:52.207875 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ebbc464d-77ca-4373-9f1f-242cd4aac8c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:52.208322 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ebbc464d-77ca-4373-9f1f-242cd4aac8c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:52.208739 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ebbc464d-77ca-4373-9f1f-242cd4aac8c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:52.230925 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d480e706-812a-4b88-b985-e684d3ef770f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046825 Aug 10 12:50:52.231521 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 709/1411] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:52 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:52.236872 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bbfe5ffc-12b3-4849-a1bc-a0aa216de1f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:52.238975 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bbfe5ffc-12b3-4849-a1bc-a0aa216de1f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:52.244608 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bbfe5ffc-12b3-4849-a1bc-a0aa216de1f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:52.244806 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ebbc464d-77ca-4373-9f1f-242cd4aac8c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051867 Aug 10 12:50:52.245079 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bbfe5ffc-12b3-4849-a1bc-a0aa216de1f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:52.245357 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 703/1412] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:52 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:50:52.245549 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bbfe5ffc-12b3-4849-a1bc-a0aa216de1f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:52.246184 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bbfe5ffc-12b3-4849-a1bc-a0aa216de1f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:52.246626 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bbfe5ffc-12b3-4849-a1bc-a0aa216de1f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:52.247048 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bbfe5ffc-12b3-4849-a1bc-a0aa216de1f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:52.281409 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bbfe5ffc-12b3-4849-a1bc-a0aa216de1f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048846 Aug 10 12:50:52.282693 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 710/1413] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:52 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:53.244094 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d6b9e331-834e-452b-82bd-2a97a1b5e41b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:53.246268 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d6b9e331-834e-452b-82bd-2a97a1b5e41b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:53.252692 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6b9e331-834e-452b-82bd-2a97a1b5e41b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:53.253177 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6b9e331-834e-452b-82bd-2a97a1b5e41b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:53.253612 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6b9e331-834e-452b-82bd-2a97a1b5e41b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:53.254349 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6b9e331-834e-452b-82bd-2a97a1b5e41b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:53.254797 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6b9e331-834e-452b-82bd-2a97a1b5e41b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:53.255240 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6b9e331-834e-452b-82bd-2a97a1b5e41b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:53.262205 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0ad94627-1d47-4081-9c6a-54f16b8fbb0b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:53.264455 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0ad94627-1d47-4081-9c6a-54f16b8fbb0b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:53.271707 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ad94627-1d47-4081-9c6a-54f16b8fbb0b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:53.272189 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ad94627-1d47-4081-9c6a-54f16b8fbb0b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:53.278716 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ad94627-1d47-4081-9c6a-54f16b8fbb0b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:53.279545 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ad94627-1d47-4081-9c6a-54f16b8fbb0b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:53.280162 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ad94627-1d47-4081-9c6a-54f16b8fbb0b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:53.280592 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ad94627-1d47-4081-9c6a-54f16b8fbb0b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:53.295264 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d6b9e331-834e-452b-82bd-2a97a1b5e41b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055068 Aug 10 12:50:53.295840 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 704/1414] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:53 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:53.301330 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d838b539-b363-47f0-9bc9-8a183ee7d4b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:53.303501 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d838b539-b363-47f0-9bc9-8a183ee7d4b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:53.309708 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d838b539-b363-47f0-9bc9-8a183ee7d4b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:53.310203 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d838b539-b363-47f0-9bc9-8a183ee7d4b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:53.310642 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d838b539-b363-47f0-9bc9-8a183ee7d4b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:53.311428 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d838b539-b363-47f0-9bc9-8a183ee7d4b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:53.311882 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d838b539-b363-47f0-9bc9-8a183ee7d4b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:53.312314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d838b539-b363-47f0-9bc9-8a183ee7d4b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:53.315520 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0ad94627-1d47-4081-9c6a-54f16b8fbb0b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057313 Aug 10 12:50:53.316101 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 711/1415] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:53 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:50:53.343332 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d838b539-b363-47f0-9bc9-8a183ee7d4b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046427 Aug 10 12:50:53.343888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 705/1416] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:53 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:54.312805 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6f3c2a64-fba1-41f0-bbd0-f385d5fe11dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:54.312805 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6f3c2a64-fba1-41f0-bbd0-f385d5fe11dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:54.317366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f3c2a64-fba1-41f0-bbd0-f385d5fe11dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:54.317846 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f3c2a64-fba1-41f0-bbd0-f385d5fe11dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:54.318290 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f3c2a64-fba1-41f0-bbd0-f385d5fe11dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:54.318966 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f3c2a64-fba1-41f0-bbd0-f385d5fe11dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:54.319490 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f3c2a64-fba1-41f0-bbd0-f385d5fe11dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:54.319957 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f3c2a64-fba1-41f0-bbd0-f385d5fe11dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:54.328139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ab28a980-4681-4646-81cd-a01e7977aebc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:54.330433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ab28a980-4681-4646-81cd-a01e7977aebc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:54.336832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ab28a980-4681-4646-81cd-a01e7977aebc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:54.337310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ab28a980-4681-4646-81cd-a01e7977aebc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:54.337745 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ab28a980-4681-4646-81cd-a01e7977aebc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:54.338431 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ab28a980-4681-4646-81cd-a01e7977aebc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:54.338886 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ab28a980-4681-4646-81cd-a01e7977aebc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:54.339462 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ab28a980-4681-4646-81cd-a01e7977aebc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:54.346540 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:50:54.351014 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6f3c2a64-fba1-41f0-bbd0-f385d5fe11dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046766 Aug 10 12:50:54.351721 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 712/1417] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:54 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:54.356695 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a2eff866-caa6-41ea-adff-a169e76d2a6a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:54.358870 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a2eff866-caa6-41ea-adff-a169e76d2a6a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:54.365369 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2eff866-caa6-41ea-adff-a169e76d2a6a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:54.365895 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2eff866-caa6-41ea-adff-a169e76d2a6a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:54.366329 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2eff866-caa6-41ea-adff-a169e76d2a6a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:54.367079 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2eff866-caa6-41ea-adff-a169e76d2a6a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:54.367480 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2eff866-caa6-41ea-adff-a169e76d2a6a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:54.367898 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2eff866-caa6-41ea-adff-a169e76d2a6a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:54.370328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ab28a980-4681-4646-81cd-a01e7977aebc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046056 Aug 10 12:50:54.370893 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 706/1418] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:54 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:50:54.399152 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a2eff866-caa6-41ea-adff-a169e76d2a6a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046419 Aug 10 12:50:54.399723 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 713/1419] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:54 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:55.364531 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-214fcd1f-b243-4e91-9b6a-682c0dad7ac7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:55.367757 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-214fcd1f-b243-4e91-9b6a-682c0dad7ac7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:55.374024 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-214fcd1f-b243-4e91-9b6a-682c0dad7ac7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:55.374558 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-214fcd1f-b243-4e91-9b6a-682c0dad7ac7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:55.374930 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-214fcd1f-b243-4e91-9b6a-682c0dad7ac7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:55.380860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-214fcd1f-b243-4e91-9b6a-682c0dad7ac7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:55.380860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-214fcd1f-b243-4e91-9b6a-682c0dad7ac7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:55.380860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-214fcd1f-b243-4e91-9b6a-682c0dad7ac7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:55.382661 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b889b52a-0134-4e63-a74f-1b0933a3da34 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:55.384898 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b889b52a-0134-4e63-a74f-1b0933a3da34 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:55.390835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b889b52a-0134-4e63-a74f-1b0933a3da34 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:55.391964 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b889b52a-0134-4e63-a74f-1b0933a3da34 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:55.392393 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b889b52a-0134-4e63-a74f-1b0933a3da34 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:55.393080 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b889b52a-0134-4e63-a74f-1b0933a3da34 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:55.393523 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b889b52a-0134-4e63-a74f-1b0933a3da34 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:55.393937 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b889b52a-0134-4e63-a74f-1b0933a3da34 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:55.406837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-214fcd1f-b243-4e91-9b6a-682c0dad7ac7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047205 Aug 10 12:50:55.407439 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 707/1420] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:55 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:55.414966 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fee802f7-20b4-4b26-9a4d-81e7dec19be5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:55.417149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fee802f7-20b4-4b26-9a4d-81e7dec19be5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:55.423272 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b889b52a-0134-4e63-a74f-1b0933a3da34 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043701 Aug 10 12:50:55.423741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fee802f7-20b4-4b26-9a4d-81e7dec19be5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:55.423866 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 714/1421] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:55 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:50:55.424146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fee802f7-20b4-4b26-9a4d-81e7dec19be5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:55.424581 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fee802f7-20b4-4b26-9a4d-81e7dec19be5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:55.425280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fee802f7-20b4-4b26-9a4d-81e7dec19be5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:55.425733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fee802f7-20b4-4b26-9a4d-81e7dec19be5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:55.426161 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fee802f7-20b4-4b26-9a4d-81e7dec19be5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:55.455821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fee802f7-20b4-4b26-9a4d-81e7dec19be5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044577 Aug 10 12:50:55.456292 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 708/1422] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:55 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:56.417934 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f549fd1e-b754-44ac-9694-7b0217afc996 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:56.420162 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f549fd1e-b754-44ac-9694-7b0217afc996 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:56.426811 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f549fd1e-b754-44ac-9694-7b0217afc996 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:56.427330 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f549fd1e-b754-44ac-9694-7b0217afc996 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:56.427766 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f549fd1e-b754-44ac-9694-7b0217afc996 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:56.428463 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f549fd1e-b754-44ac-9694-7b0217afc996 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:56.430523 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f549fd1e-b754-44ac-9694-7b0217afc996 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:56.430968 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f549fd1e-b754-44ac-9694-7b0217afc996 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:56.437134 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6a118597-fec1-4db4-9ddc-0fa209cb36fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:56.438652 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6a118597-fec1-4db4-9ddc-0fa209cb36fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:56.445069 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6a118597-fec1-4db4-9ddc-0fa209cb36fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:56.445773 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6a118597-fec1-4db4-9ddc-0fa209cb36fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:56.446211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6a118597-fec1-4db4-9ddc-0fa209cb36fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:56.446907 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6a118597-fec1-4db4-9ddc-0fa209cb36fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:56.447385 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6a118597-fec1-4db4-9ddc-0fa209cb36fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:56.447809 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6a118597-fec1-4db4-9ddc-0fa209cb36fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:56.461527 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f549fd1e-b754-44ac-9694-7b0217afc996 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047479 Aug 10 12:50:56.462102 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 715/1423] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:56 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:56.471944 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6595f03e-9c2a-4a88-9444-f8c268e0768b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:56.474067 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6595f03e-9c2a-4a88-9444-f8c268e0768b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:56.478401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6a118597-fec1-4db4-9ddc-0fa209cb36fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046626 Aug 10 12:50:56.478963 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 709/1424] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:56 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:50:56.480307 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6595f03e-9c2a-4a88-9444-f8c268e0768b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:56.480794 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6595f03e-9c2a-4a88-9444-f8c268e0768b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:56.481224 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6595f03e-9c2a-4a88-9444-f8c268e0768b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:56.481912 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6595f03e-9c2a-4a88-9444-f8c268e0768b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:56.482360 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6595f03e-9c2a-4a88-9444-f8c268e0768b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:56.482780 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6595f03e-9c2a-4a88-9444-f8c268e0768b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:56.511924 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6595f03e-9c2a-4a88-9444-f8c268e0768b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044895 Aug 10 12:50:56.512477 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 716/1425] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:56 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:57.474392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-946110a6-32f6-4b72-ab71-fd89fd63b3b6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:57.476989 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-946110a6-32f6-4b72-ab71-fd89fd63b3b6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:57.483870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-946110a6-32f6-4b72-ab71-fd89fd63b3b6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:57.484351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-946110a6-32f6-4b72-ab71-fd89fd63b3b6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:57.484848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-946110a6-32f6-4b72-ab71-fd89fd63b3b6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:57.485829 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-946110a6-32f6-4b72-ab71-fd89fd63b3b6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:57.486517 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-946110a6-32f6-4b72-ab71-fd89fd63b3b6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:57.487204 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-946110a6-32f6-4b72-ab71-fd89fd63b3b6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:57.490585 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f338f855-4d78-46f4-a983-162a301f59ab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:57.492789 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f338f855-4d78-46f4-a983-162a301f59ab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:57.499323 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f338f855-4d78-46f4-a983-162a301f59ab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:57.499801 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f338f855-4d78-46f4-a983-162a301f59ab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:57.501903 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f338f855-4d78-46f4-a983-162a301f59ab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:57.501903 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f338f855-4d78-46f4-a983-162a301f59ab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:57.502224 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f338f855-4d78-46f4-a983-162a301f59ab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:57.502371 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f338f855-4d78-46f4-a983-162a301f59ab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:57.519771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-946110a6-32f6-4b72-ab71-fd89fd63b3b6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050083 Aug 10 12:50:57.520329 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 710/1426] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:57 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:57.525036 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-78c49d3d-470e-47b0-a8ed-2e76d16eb8f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:57.527118 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-78c49d3d-470e-47b0-a8ed-2e76d16eb8f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:57.533557 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-78c49d3d-470e-47b0-a8ed-2e76d16eb8f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:57.533971 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-78c49d3d-470e-47b0-a8ed-2e76d16eb8f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:57.534402 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-78c49d3d-470e-47b0-a8ed-2e76d16eb8f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:57.534662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f338f855-4d78-46f4-a983-162a301f59ab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048550 Aug 10 12:50:57.535086 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-78c49d3d-470e-47b0-a8ed-2e76d16eb8f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:57.535528 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 717/1427] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:57 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:50:57.535647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-78c49d3d-470e-47b0-a8ed-2e76d16eb8f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:57.536102 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-78c49d3d-470e-47b0-a8ed-2e76d16eb8f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:57.565641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-78c49d3d-470e-47b0-a8ed-2e76d16eb8f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044311 Aug 10 12:50:57.566182 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 711/1428] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:57 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:58.531819 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c83fd38c-0b7f-4ec8-a309-8c5faccf7ca1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:58.535715 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c83fd38c-0b7f-4ec8-a309-8c5faccf7ca1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:58.542507 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c83fd38c-0b7f-4ec8-a309-8c5faccf7ca1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:58.542993 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c83fd38c-0b7f-4ec8-a309-8c5faccf7ca1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:58.543485 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c83fd38c-0b7f-4ec8-a309-8c5faccf7ca1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:58.549844 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bb44fd3b-6857-4a84-9182-4579efc6b758 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:58.550273 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c83fd38c-0b7f-4ec8-a309-8c5faccf7ca1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:58.550273 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c83fd38c-0b7f-4ec8-a309-8c5faccf7ca1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:58.550458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bb44fd3b-6857-4a84-9182-4579efc6b758 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:58.550541 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c83fd38c-0b7f-4ec8-a309-8c5faccf7ca1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:58.555869 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bb44fd3b-6857-4a84-9182-4579efc6b758 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:58.556352 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bb44fd3b-6857-4a84-9182-4579efc6b758 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:58.556788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bb44fd3b-6857-4a84-9182-4579efc6b758 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:58.557485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bb44fd3b-6857-4a84-9182-4579efc6b758 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:58.557939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bb44fd3b-6857-4a84-9182-4579efc6b758 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:58.558364 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bb44fd3b-6857-4a84-9182-4579efc6b758 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:58.579380 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c83fd38c-0b7f-4ec8-a309-8c5faccf7ca1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051388 Aug 10 12:50:58.580797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 718/1429] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:58 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:58.585571 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4bf12d2d-4b58-4832-b122-c0ac3565bec7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:58.587737 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4bf12d2d-4b58-4832-b122-c0ac3565bec7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:58.588333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bb44fd3b-6857-4a84-9182-4579efc6b758 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045301 Aug 10 12:50:58.588903 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 712/1430] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:58 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:50:58.593474 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bf12d2d-4b58-4832-b122-c0ac3565bec7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:58.593947 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bf12d2d-4b58-4832-b122-c0ac3565bec7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:58.594380 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bf12d2d-4b58-4832-b122-c0ac3565bec7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:58.596074 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bf12d2d-4b58-4832-b122-c0ac3565bec7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:58.596796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bf12d2d-4b58-4832-b122-c0ac3565bec7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:58.597220 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bf12d2d-4b58-4832-b122-c0ac3565bec7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:58.625431 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4bf12d2d-4b58-4832-b122-c0ac3565bec7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043574 Aug 10 12:50:58.625958 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 719/1431] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:58 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:59.592253 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-745e3156-867c-483b-b42c-6da4e45524d3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:59.594394 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-745e3156-867c-483b-b42c-6da4e45524d3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:59.602267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-745e3156-867c-483b-b42c-6da4e45524d3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:59.602821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-745e3156-867c-483b-b42c-6da4e45524d3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:59.603374 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-745e3156-867c-483b-b42c-6da4e45524d3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:59.604142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-745e3156-867c-483b-b42c-6da4e45524d3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:59.604661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-745e3156-867c-483b-b42c-6da4e45524d3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:59.605419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-745e3156-867c-483b-b42c-6da4e45524d3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:59.606310 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7a3c88d0-5653-48dd-9585-5e24f090e894 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:59.608626 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7a3c88d0-5653-48dd-9585-5e24f090e894 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:59.615633 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7a3c88d0-5653-48dd-9585-5e24f090e894 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:59.616114 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7a3c88d0-5653-48dd-9585-5e24f090e894 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:59.616548 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7a3c88d0-5653-48dd-9585-5e24f090e894 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:59.617247 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7a3c88d0-5653-48dd-9585-5e24f090e894 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:59.617692 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7a3c88d0-5653-48dd-9585-5e24f090e894 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:59.618109 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7a3c88d0-5653-48dd-9585-5e24f090e894 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:59.633706 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:50:59.638170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-745e3156-867c-483b-b42c-6da4e45524d3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049857 Aug 10 12:50:59.638736 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 713/1432] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:59 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:50:59.644216 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bfb590fd-c512-4f37-8d5c-003696472149 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:50:59.646322 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bfb590fd-c512-4f37-8d5c-003696472149 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:50:59.649522 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7a3c88d0-5653-48dd-9585-5e24f090e894 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052354 Aug 10 12:50:59.656202 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 720/1433] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:50:59 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:50:59.656328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bfb590fd-c512-4f37-8d5c-003696472149 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:59.656328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bfb590fd-c512-4f37-8d5c-003696472149 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:59.656328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bfb590fd-c512-4f37-8d5c-003696472149 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:59.656328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bfb590fd-c512-4f37-8d5c-003696472149 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:50:59.656652 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bfb590fd-c512-4f37-8d5c-003696472149 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:50:59.656652 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bfb590fd-c512-4f37-8d5c-003696472149 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:50:59.682860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bfb590fd-c512-4f37-8d5c-003696472149 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043100 Aug 10 12:50:59.683434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 714/1434] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:50:59 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:00.657592 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3ad52cea-e1d4-4a88-9197-3742849c7275 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:00.657592 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3ad52cea-e1d4-4a88-9197-3742849c7275 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:00.661124 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ad52cea-e1d4-4a88-9197-3742849c7275 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:00.661640 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ad52cea-e1d4-4a88-9197-3742849c7275 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:00.662018 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ad52cea-e1d4-4a88-9197-3742849c7275 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:00.662712 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ad52cea-e1d4-4a88-9197-3742849c7275 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:00.663157 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ad52cea-e1d4-4a88-9197-3742849c7275 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:00.663631 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ad52cea-e1d4-4a88-9197-3742849c7275 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:00.668683 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b8e5115e-19ab-4561-afd4-b1ea64497fad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:00.670809 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b8e5115e-19ab-4561-afd4-b1ea64497fad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:00.673708 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=88 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:51:00.679334 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8e5115e-19ab-4561-afd4-b1ea64497fad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:00.684052 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8e5115e-19ab-4561-afd4-b1ea64497fad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:00.684052 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8e5115e-19ab-4561-afd4-b1ea64497fad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:00.684052 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8e5115e-19ab-4561-afd4-b1ea64497fad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:00.684052 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8e5115e-19ab-4561-afd4-b1ea64497fad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:00.684459 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8e5115e-19ab-4561-afd4-b1ea64497fad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:00.696015 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3ad52cea-e1d4-4a88-9197-3742849c7275 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048557 Aug 10 12:51:00.696584 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 721/1435] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:00 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:00.701143 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8b71ae81-a615-45e4-8650-69cc1ff233fd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:00.703255 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8b71ae81-a615-45e4-8650-69cc1ff233fd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:00.709367 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b71ae81-a615-45e4-8650-69cc1ff233fd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:00.709840 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b71ae81-a615-45e4-8650-69cc1ff233fd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:00.710656 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b71ae81-a615-45e4-8650-69cc1ff233fd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:00.710988 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b71ae81-a615-45e4-8650-69cc1ff233fd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:00.711451 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b71ae81-a615-45e4-8650-69cc1ff233fd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:00.711873 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b71ae81-a615-45e4-8650-69cc1ff233fd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:00.712562 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b8e5115e-19ab-4561-afd4-b1ea64497fad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048376 Aug 10 12:51:00.713130 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 715/1436] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:00 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:51:00.741936 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8b71ae81-a615-45e4-8650-69cc1ff233fd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044347 Aug 10 12:51:00.742480 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 722/1437] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:00 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:01.708885 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-97b3f3a4-ca57-4778-86a0-d938f19986e4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:01.711169 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-97b3f3a4-ca57-4778-86a0-d938f19986e4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:01.717725 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97b3f3a4-ca57-4778-86a0-d938f19986e4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:01.718214 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97b3f3a4-ca57-4778-86a0-d938f19986e4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:01.718651 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97b3f3a4-ca57-4778-86a0-d938f19986e4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:01.719460 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97b3f3a4-ca57-4778-86a0-d938f19986e4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:01.719911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97b3f3a4-ca57-4778-86a0-d938f19986e4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:01.720992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-97b3f3a4-ca57-4778-86a0-d938f19986e4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:01.725075 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7de1d846-00d5-4458-aa4a-897c8cc045b7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:01.727248 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7de1d846-00d5-4458-aa4a-897c8cc045b7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:01.733718 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7de1d846-00d5-4458-aa4a-897c8cc045b7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:01.734198 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7de1d846-00d5-4458-aa4a-897c8cc045b7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:01.734632 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7de1d846-00d5-4458-aa4a-897c8cc045b7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:01.735355 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7de1d846-00d5-4458-aa4a-897c8cc045b7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:01.735856 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7de1d846-00d5-4458-aa4a-897c8cc045b7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:01.736283 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7de1d846-00d5-4458-aa4a-897c8cc045b7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:01.750014 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-97b3f3a4-ca57-4778-86a0-d938f19986e4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045716 Aug 10 12:51:01.750853 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 716/1438] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:01 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:01.756040 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bbd644c4-8bbc-4652-bd9d-7811f39fba3f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:01.758142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bbd644c4-8bbc-4652-bd9d-7811f39fba3f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:01.764120 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bbd644c4-8bbc-4652-bd9d-7811f39fba3f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:01.764598 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bbd644c4-8bbc-4652-bd9d-7811f39fba3f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:01.765027 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bbd644c4-8bbc-4652-bd9d-7811f39fba3f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:01.765714 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bbd644c4-8bbc-4652-bd9d-7811f39fba3f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:01.766158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bbd644c4-8bbc-4652-bd9d-7811f39fba3f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:01.766564 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7de1d846-00d5-4458-aa4a-897c8cc045b7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046236 Aug 10 12:51:01.766686 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bbd644c4-8bbc-4652-bd9d-7811f39fba3f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:01.768014 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 723/1439] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:01 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:51:01.798986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bbd644c4-8bbc-4652-bd9d-7811f39fba3f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046181 Aug 10 12:51:01.800961 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 717/1440] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:01 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:02.761857 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-46ff8219-a6c6-4ae2-878d-7555fd780a7a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:02.764301 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-46ff8219-a6c6-4ae2-878d-7555fd780a7a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:02.770969 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46ff8219-a6c6-4ae2-878d-7555fd780a7a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:02.771475 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46ff8219-a6c6-4ae2-878d-7555fd780a7a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:02.771903 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46ff8219-a6c6-4ae2-878d-7555fd780a7a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:02.772595 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46ff8219-a6c6-4ae2-878d-7555fd780a7a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:02.773161 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46ff8219-a6c6-4ae2-878d-7555fd780a7a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:02.773584 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46ff8219-a6c6-4ae2-878d-7555fd780a7a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:02.781300 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-45d121af-ee25-468b-813d-efc42dec595e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:02.782231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-45d121af-ee25-468b-813d-efc42dec595e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:02.789447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-45d121af-ee25-468b-813d-efc42dec595e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:02.789924 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-45d121af-ee25-468b-813d-efc42dec595e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:02.790358 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-45d121af-ee25-468b-813d-efc42dec595e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:02.791049 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-45d121af-ee25-468b-813d-efc42dec595e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:02.791524 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-45d121af-ee25-468b-813d-efc42dec595e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:02.791946 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-45d121af-ee25-468b-813d-efc42dec595e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:02.803909 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-46ff8219-a6c6-4ae2-878d-7555fd780a7a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045976 Aug 10 12:51:02.804672 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 724/1441] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:02 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:02.811036 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1d60f63b-739d-4022-be3b-493b066ae566 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:02.813223 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1d60f63b-739d-4022-be3b-493b066ae566 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:02.819234 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d60f63b-739d-4022-be3b-493b066ae566 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:02.819719 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d60f63b-739d-4022-be3b-493b066ae566 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:02.820150 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d60f63b-739d-4022-be3b-493b066ae566 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:02.820840 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d60f63b-739d-4022-be3b-493b066ae566 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:02.821285 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d60f63b-739d-4022-be3b-493b066ae566 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:02.821402 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-45d121af-ee25-468b-813d-efc42dec595e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045454 Aug 10 12:51:02.821702 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d60f63b-739d-4022-be3b-493b066ae566 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:02.822210 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 718/1442] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:02 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:51:02.850497 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1d60f63b-739d-4022-be3b-493b066ae566 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043170 Aug 10 12:51:02.851047 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 725/1443] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:02 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:03.820729 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5354cf9b-433d-4138-aa91-060248287a68 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:03.820729 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5354cf9b-433d-4138-aa91-060248287a68 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:03.825804 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5354cf9b-433d-4138-aa91-060248287a68 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:03.826286 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5354cf9b-433d-4138-aa91-060248287a68 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:03.826718 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5354cf9b-433d-4138-aa91-060248287a68 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:03.827570 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5354cf9b-433d-4138-aa91-060248287a68 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:03.828028 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5354cf9b-433d-4138-aa91-060248287a68 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:03.828641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5354cf9b-433d-4138-aa91-060248287a68 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:03.833914 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b01b0e06-e4a9-4bf3-8ac9-19c2a6e3b693 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:03.836173 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b01b0e06-e4a9-4bf3-8ac9-19c2a6e3b693 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:03.842277 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b01b0e06-e4a9-4bf3-8ac9-19c2a6e3b693 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:03.842752 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b01b0e06-e4a9-4bf3-8ac9-19c2a6e3b693 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:03.843197 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b01b0e06-e4a9-4bf3-8ac9-19c2a6e3b693 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:03.843889 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b01b0e06-e4a9-4bf3-8ac9-19c2a6e3b693 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:03.844332 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b01b0e06-e4a9-4bf3-8ac9-19c2a6e3b693 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:03.844746 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b01b0e06-e4a9-4bf3-8ac9-19c2a6e3b693 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:03.859441 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5354cf9b-433d-4138-aa91-060248287a68 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047221 Aug 10 12:51:03.860048 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 719/1444] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:03 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:03.865447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a3ae8b19-f54b-40f8-8192-deec36abd0cf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:03.867650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a3ae8b19-f54b-40f8-8192-deec36abd0cf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:03.873297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3ae8b19-f54b-40f8-8192-deec36abd0cf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:03.873774 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3ae8b19-f54b-40f8-8192-deec36abd0cf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:03.874207 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3ae8b19-f54b-40f8-8192-deec36abd0cf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:03.874891 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3ae8b19-f54b-40f8-8192-deec36abd0cf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:03.875004 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b01b0e06-e4a9-4bf3-8ac9-19c2a6e3b693 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045146 Aug 10 12:51:03.875364 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3ae8b19-f54b-40f8-8192-deec36abd0cf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:03.875498 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 726/1445] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:03 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:51:03.875786 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3ae8b19-f54b-40f8-8192-deec36abd0cf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:03.904819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a3ae8b19-f54b-40f8-8192-deec36abd0cf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043207 Aug 10 12:51:03.905386 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 720/1446] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:03 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:04.871483 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a5b4b04a-7efe-4bb0-8373-8c6cefdac5c0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:04.873863 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a5b4b04a-7efe-4bb0-8373-8c6cefdac5c0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:04.880950 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a5b4b04a-7efe-4bb0-8373-8c6cefdac5c0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:04.881440 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a5b4b04a-7efe-4bb0-8373-8c6cefdac5c0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:04.882113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a5b4b04a-7efe-4bb0-8373-8c6cefdac5c0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:04.884173 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a5b4b04a-7efe-4bb0-8373-8c6cefdac5c0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:04.884636 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a5b4b04a-7efe-4bb0-8373-8c6cefdac5c0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:04.885069 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a5b4b04a-7efe-4bb0-8373-8c6cefdac5c0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:04.888116 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-36c5458f-79d1-4907-9902-e308c00fd012 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:04.890238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-36c5458f-79d1-4907-9902-e308c00fd012 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:04.896645 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36c5458f-79d1-4907-9902-e308c00fd012 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:04.897170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36c5458f-79d1-4907-9902-e308c00fd012 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:04.897596 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36c5458f-79d1-4907-9902-e308c00fd012 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:04.898282 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36c5458f-79d1-4907-9902-e308c00fd012 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:04.898730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36c5458f-79d1-4907-9902-e308c00fd012 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:04.899144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36c5458f-79d1-4907-9902-e308c00fd012 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:04.920337 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a5b4b04a-7efe-4bb0-8373-8c6cefdac5c0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052786 Aug 10 12:51:04.920904 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 727/1447] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:04 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:04.926440 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5473e8b4-44f5-4b12-9c95-66fd73407039 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:04.928582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5473e8b4-44f5-4b12-9c95-66fd73407039 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:04.929432 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-36c5458f-79d1-4907-9902-e308c00fd012 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045497 Aug 10 12:51:04.930004 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 721/1448] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:04 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:51:04.934684 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5473e8b4-44f5-4b12-9c95-66fd73407039 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:04.935163 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5473e8b4-44f5-4b12-9c95-66fd73407039 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:04.935621 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5473e8b4-44f5-4b12-9c95-66fd73407039 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:04.936316 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5473e8b4-44f5-4b12-9c95-66fd73407039 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:04.936763 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5473e8b4-44f5-4b12-9c95-66fd73407039 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:04.937181 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5473e8b4-44f5-4b12-9c95-66fd73407039 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:04.965431 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5473e8b4-44f5-4b12-9c95-66fd73407039 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043551 Aug 10 12:51:04.965975 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 728/1449] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:04 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:05.933452 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-977c1d0d-338d-492c-999e-21f7b5fb5896 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:05.936748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-977c1d0d-338d-492c-999e-21f7b5fb5896 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:05.943047 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3e48f201-64d7-4d69-821d-9b3cd78bfe45 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:05.944248 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-977c1d0d-338d-492c-999e-21f7b5fb5896 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:05.945032 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-977c1d0d-338d-492c-999e-21f7b5fb5896 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:05.945307 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3e48f201-64d7-4d69-821d-9b3cd78bfe45 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:05.945480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-977c1d0d-338d-492c-999e-21f7b5fb5896 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:05.946190 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-977c1d0d-338d-492c-999e-21f7b5fb5896 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:05.946648 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-977c1d0d-338d-492c-999e-21f7b5fb5896 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:05.947078 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-977c1d0d-338d-492c-999e-21f7b5fb5896 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:05.951834 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e48f201-64d7-4d69-821d-9b3cd78bfe45 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:05.952307 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e48f201-64d7-4d69-821d-9b3cd78bfe45 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:05.952732 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e48f201-64d7-4d69-821d-9b3cd78bfe45 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:05.953416 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e48f201-64d7-4d69-821d-9b3cd78bfe45 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:05.953858 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e48f201-64d7-4d69-821d-9b3cd78bfe45 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:05.954284 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e48f201-64d7-4d69-821d-9b3cd78bfe45 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:05.968516 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:51:05.979470 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-977c1d0d-338d-492c-999e-21f7b5fb5896 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050379 Aug 10 12:51:05.980296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 722/1450] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:05 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:05.984824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-61bebd94-8ddd-403d-93c0-9728544d84b6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:05.985489 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3e48f201-64d7-4d69-821d-9b3cd78bfe45 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047625 Aug 10 12:51:05.990137 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 729/1451] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:05 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:51:05.990268 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-61bebd94-8ddd-403d-93c0-9728544d84b6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:05.993655 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61bebd94-8ddd-403d-93c0-9728544d84b6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:05.994137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61bebd94-8ddd-403d-93c0-9728544d84b6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:05.994572 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61bebd94-8ddd-403d-93c0-9728544d84b6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:05.995285 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61bebd94-8ddd-403d-93c0-9728544d84b6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:05.995743 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61bebd94-8ddd-403d-93c0-9728544d84b6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:05.996164 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61bebd94-8ddd-403d-93c0-9728544d84b6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:06.024604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-61bebd94-8ddd-403d-93c0-9728544d84b6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043334 Aug 10 12:51:06.025202 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 723/1452] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:05 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:06.999979 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6d5b8baa-3586-4a99-be9a-c0d90673902d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:07.001597 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-cc81f18c-c454-46c6-bd89-eaaea7d8a8e4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:07.002440 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6d5b8baa-3586-4a99-be9a-c0d90673902d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:07.004049 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-cc81f18c-c454-46c6-bd89-eaaea7d8a8e4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:07.008848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6d5b8baa-3586-4a99-be9a-c0d90673902d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:07.009332 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6d5b8baa-3586-4a99-be9a-c0d90673902d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:07.009798 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6d5b8baa-3586-4a99-be9a-c0d90673902d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:07.010524 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6d5b8baa-3586-4a99-be9a-c0d90673902d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:07.010635 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc81f18c-c454-46c6-bd89-eaaea7d8a8e4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:07.010979 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6d5b8baa-3586-4a99-be9a-c0d90673902d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:07.011105 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc81f18c-c454-46c6-bd89-eaaea7d8a8e4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:07.011422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6d5b8baa-3586-4a99-be9a-c0d90673902d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:07.011524 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc81f18c-c454-46c6-bd89-eaaea7d8a8e4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:07.012219 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc81f18c-c454-46c6-bd89-eaaea7d8a8e4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:07.012668 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc81f18c-c454-46c6-bd89-eaaea7d8a8e4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:07.013091 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc81f18c-c454-46c6-bd89-eaaea7d8a8e4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:07.042351 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-cc81f18c-c454-46c6-bd89-eaaea7d8a8e4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046089 Aug 10 12:51:07.042594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6d5b8baa-3586-4a99-be9a-c0d90673902d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046312 Aug 10 12:51:07.042902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 724/1453] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:06 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:07.046686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 730/1454] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:06 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:51:07.047650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4987282a-9049-4228-a061-dfa5a7ef55eb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:07.050791 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4987282a-9049-4228-a061-dfa5a7ef55eb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:07.056600 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4987282a-9049-4228-a061-dfa5a7ef55eb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:07.057095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4987282a-9049-4228-a061-dfa5a7ef55eb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:07.057527 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4987282a-9049-4228-a061-dfa5a7ef55eb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:07.058210 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4987282a-9049-4228-a061-dfa5a7ef55eb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:07.058656 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4987282a-9049-4228-a061-dfa5a7ef55eb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:07.059075 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4987282a-9049-4228-a061-dfa5a7ef55eb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:07.087074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4987282a-9049-4228-a061-dfa5a7ef55eb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043164 Aug 10 12:51:07.087645 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 725/1455] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:07 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:08.055035 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-523114a8-72f5-41ad-8ca0-93b72dbb0aaf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:08.055902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-47acff14-7488-46b4-8c5e-971068885811 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:08.062188 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-523114a8-72f5-41ad-8ca0-93b72dbb0aaf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:08.062476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-47acff14-7488-46b4-8c5e-971068885811 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:08.065050 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-523114a8-72f5-41ad-8ca0-93b72dbb0aaf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:08.065537 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-523114a8-72f5-41ad-8ca0-93b72dbb0aaf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:08.065658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-47acff14-7488-46b4-8c5e-971068885811 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:08.065968 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-523114a8-72f5-41ad-8ca0-93b72dbb0aaf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:08.066101 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-47acff14-7488-46b4-8c5e-971068885811 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:08.066489 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-47acff14-7488-46b4-8c5e-971068885811 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:08.066665 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-523114a8-72f5-41ad-8ca0-93b72dbb0aaf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:08.067111 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-523114a8-72f5-41ad-8ca0-93b72dbb0aaf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:08.067264 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-47acff14-7488-46b4-8c5e-971068885811 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:08.067557 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-523114a8-72f5-41ad-8ca0-93b72dbb0aaf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:08.067669 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-47acff14-7488-46b4-8c5e-971068885811 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:08.068056 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-47acff14-7488-46b4-8c5e-971068885811 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:08.096208 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-523114a8-72f5-41ad-8ca0-93b72dbb0aaf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045563 Aug 10 12:51:08.096769 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 731/1456] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:08 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:08.096928 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-47acff14-7488-46b4-8c5e-971068885811 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044829 Aug 10 12:51:08.097619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 726/1457] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:08 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:51:08.104025 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b80b2aab-b85e-4e31-92d3-82e871415d56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:08.106408 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b80b2aab-b85e-4e31-92d3-82e871415d56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:08.112783 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b80b2aab-b85e-4e31-92d3-82e871415d56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:08.113255 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b80b2aab-b85e-4e31-92d3-82e871415d56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:08.113684 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b80b2aab-b85e-4e31-92d3-82e871415d56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:08.114359 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b80b2aab-b85e-4e31-92d3-82e871415d56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:08.114802 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b80b2aab-b85e-4e31-92d3-82e871415d56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:08.115257 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b80b2aab-b85e-4e31-92d3-82e871415d56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:08.143533 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b80b2aab-b85e-4e31-92d3-82e871415d56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045768 Aug 10 12:51:08.144075 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 732/1458] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:08 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:09.108707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-967f54c8-e56f-4e76-8b8e-8623bb83d941 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:09.109203 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a5d29f06-5224-4d05-9c61-eff70cf174e4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:09.111769 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a5d29f06-5224-4d05-9c61-eff70cf174e4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:09.112966 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-967f54c8-e56f-4e76-8b8e-8623bb83d941 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:09.118011 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a5d29f06-5224-4d05-9c61-eff70cf174e4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:09.118501 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a5d29f06-5224-4d05-9c61-eff70cf174e4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:09.118934 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a5d29f06-5224-4d05-9c61-eff70cf174e4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:09.119571 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-967f54c8-e56f-4e76-8b8e-8623bb83d941 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:09.119697 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a5d29f06-5224-4d05-9c61-eff70cf174e4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:09.120050 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-967f54c8-e56f-4e76-8b8e-8623bb83d941 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:09.120163 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a5d29f06-5224-4d05-9c61-eff70cf174e4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:09.120478 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-967f54c8-e56f-4e76-8b8e-8623bb83d941 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:09.120597 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a5d29f06-5224-4d05-9c61-eff70cf174e4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:09.121162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-967f54c8-e56f-4e76-8b8e-8623bb83d941 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:09.121609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-967f54c8-e56f-4e76-8b8e-8623bb83d941 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:09.122025 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-967f54c8-e56f-4e76-8b8e-8623bb83d941 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:09.150068 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a5d29f06-5224-4d05-9c61-eff70cf174e4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045691 Aug 10 12:51:09.150724 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-967f54c8-e56f-4e76-8b8e-8623bb83d941 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046166 Aug 10 12:51:09.150864 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 733/1459] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:09 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:09.154886 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 727/1460] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:09 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:51:09.155261 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6de53828-8224-4b3e-b97f-f4311ad07610 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:09.157947 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6de53828-8224-4b3e-b97f-f4311ad07610 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:09.163636 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6de53828-8224-4b3e-b97f-f4311ad07610 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:09.164110 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6de53828-8224-4b3e-b97f-f4311ad07610 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:09.164540 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6de53828-8224-4b3e-b97f-f4311ad07610 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:09.165242 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6de53828-8224-4b3e-b97f-f4311ad07610 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:09.165673 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6de53828-8224-4b3e-b97f-f4311ad07610 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:09.166094 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6de53828-8224-4b3e-b97f-f4311ad07610 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:09.194449 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6de53828-8224-4b3e-b97f-f4311ad07610 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042745 Aug 10 12:51:09.194994 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 734/1461] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:09 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:10.163573 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5399a30c-8435-4fdb-ab32-82e4a099104c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:10.164044 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d54d1f95-1095-49e3-a03b-99a7ab04a14c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:10.165759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5399a30c-8435-4fdb-ab32-82e4a099104c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:10.165886 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d54d1f95-1095-49e3-a03b-99a7ab04a14c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:10.172460 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5399a30c-8435-4fdb-ab32-82e4a099104c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:10.172571 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d54d1f95-1095-49e3-a03b-99a7ab04a14c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:10.172858 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5399a30c-8435-4fdb-ab32-82e4a099104c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:10.173498 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d54d1f95-1095-49e3-a03b-99a7ab04a14c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:10.173718 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5399a30c-8435-4fdb-ab32-82e4a099104c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:10.173919 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d54d1f95-1095-49e3-a03b-99a7ab04a14c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:10.174422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5399a30c-8435-4fdb-ab32-82e4a099104c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:10.174812 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d54d1f95-1095-49e3-a03b-99a7ab04a14c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:10.175022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5399a30c-8435-4fdb-ab32-82e4a099104c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:10.175303 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d54d1f95-1095-49e3-a03b-99a7ab04a14c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:10.175496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5399a30c-8435-4fdb-ab32-82e4a099104c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:10.175736 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d54d1f95-1095-49e3-a03b-99a7ab04a14c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:10.205265 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5399a30c-8435-4fdb-ab32-82e4a099104c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047191 Aug 10 12:51:10.205824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 728/1462] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:10 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:10.206046 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d54d1f95-1095-49e3-a03b-99a7ab04a14c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046280 Aug 10 12:51:10.206757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 735/1463] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:10 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:51:10.210507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2e3e171f-5944-497f-89ee-6f18ff6cee61 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:10.212602 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2e3e171f-5944-497f-89ee-6f18ff6cee61 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:10.218137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e3e171f-5944-497f-89ee-6f18ff6cee61 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:10.218606 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e3e171f-5944-497f-89ee-6f18ff6cee61 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:10.219033 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e3e171f-5944-497f-89ee-6f18ff6cee61 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:10.219737 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e3e171f-5944-497f-89ee-6f18ff6cee61 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:10.220183 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e3e171f-5944-497f-89ee-6f18ff6cee61 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:10.220600 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e3e171f-5944-497f-89ee-6f18ff6cee61 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:10.249321 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2e3e171f-5944-497f-89ee-6f18ff6cee61 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042530 Aug 10 12:51:10.249851 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 729/1464] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:10 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:11.217665 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-28dee5c7-fd4b-4738-bc7b-a941907a6f00 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:11.218194 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-abc830d5-5294-4c5b-9716-31779d9623af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:11.219835 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-abc830d5-5294-4c5b-9716-31779d9623af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:11.219950 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-28dee5c7-fd4b-4738-bc7b-a941907a6f00 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:11.231059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abc830d5-5294-4c5b-9716-31779d9623af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:11.231218 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-28dee5c7-fd4b-4738-bc7b-a941907a6f00 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:11.231334 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abc830d5-5294-4c5b-9716-31779d9623af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:11.231334 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abc830d5-5294-4c5b-9716-31779d9623af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:11.231523 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-28dee5c7-fd4b-4738-bc7b-a941907a6f00 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:11.231523 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-28dee5c7-fd4b-4738-bc7b-a941907a6f00 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:11.231722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abc830d5-5294-4c5b-9716-31779d9623af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:11.231722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abc830d5-5294-4c5b-9716-31779d9623af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:11.231878 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-28dee5c7-fd4b-4738-bc7b-a941907a6f00 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:11.231960 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abc830d5-5294-4c5b-9716-31779d9623af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:11.232039 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-28dee5c7-fd4b-4738-bc7b-a941907a6f00 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:11.232039 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-28dee5c7-fd4b-4738-bc7b-a941907a6f00 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:11.244316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:51:11.260442 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-28dee5c7-fd4b-4738-bc7b-a941907a6f00 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046552 Aug 10 12:51:11.261362 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 736/1465] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:11 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:11.265982 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5478e7c1-36d3-4c43-a967-dfed35fec672 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:11.267710 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-abc830d5-5294-4c5b-9716-31779d9623af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053754 Aug 10 12:51:11.268167 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5478e7c1-36d3-4c43-a967-dfed35fec672 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:11.268609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 730/1466] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:11 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:51:11.273984 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5478e7c1-36d3-4c43-a967-dfed35fec672 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:11.274468 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5478e7c1-36d3-4c43-a967-dfed35fec672 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:11.274922 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5478e7c1-36d3-4c43-a967-dfed35fec672 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:11.275638 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5478e7c1-36d3-4c43-a967-dfed35fec672 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:11.276090 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5478e7c1-36d3-4c43-a967-dfed35fec672 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:11.276513 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5478e7c1-36d3-4c43-a967-dfed35fec672 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:11.306230 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5478e7c1-36d3-4c43-a967-dfed35fec672 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043854 Aug 10 12:51:11.306792 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 737/1467] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:11 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:12.272490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d718fa4a-7a75-4acf-93cc-c35f3509c347 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:12.274782 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d718fa4a-7a75-4acf-93cc-c35f3509c347 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:12.281901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d718fa4a-7a75-4acf-93cc-c35f3509c347 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:12.282668 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d718fa4a-7a75-4acf-93cc-c35f3509c347 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:12.282817 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d718fa4a-7a75-4acf-93cc-c35f3509c347 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:12.284646 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d718fa4a-7a75-4acf-93cc-c35f3509c347 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:12.285242 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d718fa4a-7a75-4acf-93cc-c35f3509c347 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:12.285702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d718fa4a-7a75-4acf-93cc-c35f3509c347 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:12.288570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e4db98cc-683b-4868-b24f-57d77c609be2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:12.290792 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e4db98cc-683b-4868-b24f-57d77c609be2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:12.296995 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4db98cc-683b-4868-b24f-57d77c609be2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:12.297472 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4db98cc-683b-4868-b24f-57d77c609be2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:12.297907 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4db98cc-683b-4868-b24f-57d77c609be2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:12.298604 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4db98cc-683b-4868-b24f-57d77c609be2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:12.299053 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4db98cc-683b-4868-b24f-57d77c609be2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:12.299586 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4db98cc-683b-4868-b24f-57d77c609be2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:12.315643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d718fa4a-7a75-4acf-93cc-c35f3509c347 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047710 Aug 10 12:51:12.316200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 731/1468] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:12 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:12.321568 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8f242ebf-2bd2-47e9-bc4d-2f23cbedbf11 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:12.323099 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8f242ebf-2bd2-47e9-bc4d-2f23cbedbf11 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:12.328826 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f242ebf-2bd2-47e9-bc4d-2f23cbedbf11 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:12.329312 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f242ebf-2bd2-47e9-bc4d-2f23cbedbf11 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:12.329751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f242ebf-2bd2-47e9-bc4d-2f23cbedbf11 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:12.329983 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e4db98cc-683b-4868-b24f-57d77c609be2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053512 Aug 10 12:51:12.330448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f242ebf-2bd2-47e9-bc4d-2f23cbedbf11 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:12.331414 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 738/1469] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:12 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:51:12.331568 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f242ebf-2bd2-47e9-bc4d-2f23cbedbf11 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:12.331886 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f242ebf-2bd2-47e9-bc4d-2f23cbedbf11 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:12.361129 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8f242ebf-2bd2-47e9-bc4d-2f23cbedbf11 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043932 Aug 10 12:51:12.361687 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 732/1470] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:12 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:13.331076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-86ff6263-5519-48bf-92ce-efbe2d09fd15 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:13.331076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-86ff6263-5519-48bf-92ce-efbe2d09fd15 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:13.342603 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-83280993-2757-4add-8cae-2f8a6b194043 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:13.349438 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86ff6263-5519-48bf-92ce-efbe2d09fd15 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:13.349438 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86ff6263-5519-48bf-92ce-efbe2d09fd15 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:13.349438 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86ff6263-5519-48bf-92ce-efbe2d09fd15 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:13.349438 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86ff6263-5519-48bf-92ce-efbe2d09fd15 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:13.349882 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-83280993-2757-4add-8cae-2f8a6b194043 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:13.349998 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86ff6263-5519-48bf-92ce-efbe2d09fd15 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:13.349998 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86ff6263-5519-48bf-92ce-efbe2d09fd15 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:13.352268 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83280993-2757-4add-8cae-2f8a6b194043 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:13.352752 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83280993-2757-4add-8cae-2f8a6b194043 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:13.353213 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83280993-2757-4add-8cae-2f8a6b194043 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:13.353912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83280993-2757-4add-8cae-2f8a6b194043 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:13.354362 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83280993-2757-4add-8cae-2f8a6b194043 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:13.354785 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83280993-2757-4add-8cae-2f8a6b194043 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:13.376526 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-86ff6263-5519-48bf-92ce-efbe2d09fd15 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052876 Aug 10 12:51:13.377090 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 739/1471] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:13 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:13.382445 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-51298f6d-9014-4601-a782-895c96d233b5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:13.384589 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-51298f6d-9014-4601-a782-895c96d233b5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:13.385814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-83280993-2757-4add-8cae-2f8a6b194043 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046991 Aug 10 12:51:13.386388 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 733/1472] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:13 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:51:13.390194 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51298f6d-9014-4601-a782-895c96d233b5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:13.390673 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51298f6d-9014-4601-a782-895c96d233b5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:13.391107 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51298f6d-9014-4601-a782-895c96d233b5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:13.391836 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51298f6d-9014-4601-a782-895c96d233b5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:13.392270 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51298f6d-9014-4601-a782-895c96d233b5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:13.392689 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51298f6d-9014-4601-a782-895c96d233b5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:13.421086 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-51298f6d-9014-4601-a782-895c96d233b5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042402 Aug 10 12:51:13.421626 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 740/1473] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:13 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:14.391292 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-cfb35c47-ebc4-45a3-a899-628ab4fc61cd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:14.394124 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-cfb35c47-ebc4-45a3-a899-628ab4fc61cd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:14.397948 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2f2700bb-f2ae-4683-92f0-71e555a54dde tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:14.400642 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cfb35c47-ebc4-45a3-a899-628ab4fc61cd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:14.401363 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cfb35c47-ebc4-45a3-a899-628ab4fc61cd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:14.401807 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cfb35c47-ebc4-45a3-a899-628ab4fc61cd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:14.402556 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cfb35c47-ebc4-45a3-a899-628ab4fc61cd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:14.403013 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cfb35c47-ebc4-45a3-a899-628ab4fc61cd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:14.403492 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cfb35c47-ebc4-45a3-a899-628ab4fc61cd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:14.405310 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2f2700bb-f2ae-4683-92f0-71e555a54dde tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:14.408660 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=90 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:51:14.412491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2f2700bb-f2ae-4683-92f0-71e555a54dde tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:14.412977 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2f2700bb-f2ae-4683-92f0-71e555a54dde tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:14.413411 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2f2700bb-f2ae-4683-92f0-71e555a54dde tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:14.414111 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2f2700bb-f2ae-4683-92f0-71e555a54dde tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:14.414779 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2f2700bb-f2ae-4683-92f0-71e555a54dde tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:14.415228 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2f2700bb-f2ae-4683-92f0-71e555a54dde tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:14.434493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-cfb35c47-ebc4-45a3-a899-628ab4fc61cd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049236 Aug 10 12:51:14.439026 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 734/1474] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:14 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:14.445056 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6a0eac2b-162b-42a7-81fd-598720095a4b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:14.447375 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6a0eac2b-162b-42a7-81fd-598720095a4b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:14.453157 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6a0eac2b-162b-42a7-81fd-598720095a4b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:14.453643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6a0eac2b-162b-42a7-81fd-598720095a4b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:14.454081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6a0eac2b-162b-42a7-81fd-598720095a4b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:14.454773 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6a0eac2b-162b-42a7-81fd-598720095a4b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:14.455332 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6a0eac2b-162b-42a7-81fd-598720095a4b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:14.455939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6a0eac2b-162b-42a7-81fd-598720095a4b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:14.460995 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2f2700bb-f2ae-4683-92f0-71e555a54dde tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066944 Aug 10 12:51:14.465119 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 741/1475] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:14 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:51:14.466314 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d5cbcec2-f09d-4c0e-985d-85bf02bc76d6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:14.468465 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d5cbcec2-f09d-4c0e-985d-85bf02bc76d6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:14.474451 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d5cbcec2-f09d-4c0e-985d-85bf02bc76d6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:14.474937 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d5cbcec2-f09d-4c0e-985d-85bf02bc76d6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:14.475400 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d5cbcec2-f09d-4c0e-985d-85bf02bc76d6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:14.476235 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d5cbcec2-f09d-4c0e-985d-85bf02bc76d6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:14.476746 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d5cbcec2-f09d-4c0e-985d-85bf02bc76d6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:14.477177 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d5cbcec2-f09d-4c0e-985d-85bf02bc76d6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:14.485620 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6a0eac2b-162b-42a7-81fd-598720095a4b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045354 Aug 10 12:51:14.487420 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 735/1476] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:14 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:14.507011 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d5cbcec2-f09d-4c0e-985d-85bf02bc76d6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044430 Aug 10 12:51:14.507603 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 742/1477] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:14 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:15.445087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8ddd978e-b828-406b-989f-165487406157 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:15.445641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8ddd978e-b828-406b-989f-165487406157 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:15.447393 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2c78fde7-5f90-4360-9fd4-95d036f5a818 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:15.449637 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2c78fde7-5f90-4360-9fd4-95d036f5a818 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:15.452029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ddd978e-b828-406b-989f-165487406157 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:15.452504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ddd978e-b828-406b-989f-165487406157 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:15.452937 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ddd978e-b828-406b-989f-165487406157 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:15.453642 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ddd978e-b828-406b-989f-165487406157 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:15.454093 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ddd978e-b828-406b-989f-165487406157 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:15.454509 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ddd978e-b828-406b-989f-165487406157 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:15.456598 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c78fde7-5f90-4360-9fd4-95d036f5a818 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:15.457096 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c78fde7-5f90-4360-9fd4-95d036f5a818 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:15.457530 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c78fde7-5f90-4360-9fd4-95d036f5a818 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:15.458216 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c78fde7-5f90-4360-9fd4-95d036f5a818 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:15.458666 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c78fde7-5f90-4360-9fd4-95d036f5a818 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:15.459092 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c78fde7-5f90-4360-9fd4-95d036f5a818 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:15.489363 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2c78fde7-5f90-4360-9fd4-95d036f5a818 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045901 Aug 10 12:51:15.489928 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 743/1478] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:15 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:15.494746 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-41fd49bf-7882-4c5f-8eb7-c61453916098 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:15.496825 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-41fd49bf-7882-4c5f-8eb7-c61453916098 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:15.502502 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-41fd49bf-7882-4c5f-8eb7-c61453916098 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:15.503221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-41fd49bf-7882-4c5f-8eb7-c61453916098 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:15.503669 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-41fd49bf-7882-4c5f-8eb7-c61453916098 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:15.504364 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-41fd49bf-7882-4c5f-8eb7-c61453916098 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:15.504820 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-41fd49bf-7882-4c5f-8eb7-c61453916098 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:15.505245 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-41fd49bf-7882-4c5f-8eb7-c61453916098 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:15.534224 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-41fd49bf-7882-4c5f-8eb7-c61453916098 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042741 Aug 10 12:51:15.534967 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 744/1479] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:15 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:51:15.539705 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fc68a4eb-71d0-416a-b5ab-69d1f3c9e46f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:15.539850 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.objects.instance [None req-8ddd978e-b828-406b-989f-165487406157 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lazy-loading 'services' on Instance uuid 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a {{(pid=124643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 12:51:15.541796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fc68a4eb-71d0-416a-b5ab-69d1f3c9e46f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:15.547420 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fc68a4eb-71d0-416a-b5ab-69d1f3c9e46f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:15.547892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fc68a4eb-71d0-416a-b5ab-69d1f3c9e46f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:15.548324 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fc68a4eb-71d0-416a-b5ab-69d1f3c9e46f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:15.549005 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fc68a4eb-71d0-416a-b5ab-69d1f3c9e46f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:15.550062 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fc68a4eb-71d0-416a-b5ab-69d1f3c9e46f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:15.550483 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fc68a4eb-71d0-416a-b5ab-69d1f3c9e46f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:15.579025 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fc68a4eb-71d0-416a-b5ab-69d1f3c9e46f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042841 Aug 10 12:51:15.579926 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 745/1480] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:15 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:15.584477 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ca6c848f-53b1-426d-b06c-36fb8e07f9cb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:15.586574 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ca6c848f-53b1-426d-b06c-36fb8e07f9cb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:15.592126 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca6c848f-53b1-426d-b06c-36fb8e07f9cb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:15.592603 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca6c848f-53b1-426d-b06c-36fb8e07f9cb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:15.593033 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca6c848f-53b1-426d-b06c-36fb8e07f9cb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:15.593719 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca6c848f-53b1-426d-b06c-36fb8e07f9cb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:15.594169 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca6c848f-53b1-426d-b06c-36fb8e07f9cb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:15.594593 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca6c848f-53b1-426d-b06c-36fb8e07f9cb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:15.599675 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:51:15.623613 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ca6c848f-53b1-426d-b06c-36fb8e07f9cb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042641 Aug 10 12:51:15.624166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 746/1481] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:15 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:15.779726 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8ddd978e-b828-406b-989f-165487406157 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [7e044c67-15e3-4fc7-bc18-3c975a9c203b] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 12:51:16.501694 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-061ae6ad-39fe-445a-9b24-355f5a1b6455 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:16.504113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-061ae6ad-39fe-445a-9b24-355f5a1b6455 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:16.510497 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-061ae6ad-39fe-445a-9b24-355f5a1b6455 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:16.510978 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-061ae6ad-39fe-445a-9b24-355f5a1b6455 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:16.511437 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-061ae6ad-39fe-445a-9b24-355f5a1b6455 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:16.512149 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-061ae6ad-39fe-445a-9b24-355f5a1b6455 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:16.512599 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-061ae6ad-39fe-445a-9b24-355f5a1b6455 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:16.513022 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-061ae6ad-39fe-445a-9b24-355f5a1b6455 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:16.545724 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-061ae6ad-39fe-445a-9b24-355f5a1b6455 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044802 Aug 10 12:51:16.545724 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 747/1482] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:16 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:16.547637 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ef54b480-0fa0-4f72-9223-d793dbc20d87 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:16.550595 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ef54b480-0fa0-4f72-9223-d793dbc20d87 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:16.556404 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef54b480-0fa0-4f72-9223-d793dbc20d87 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:16.556872 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef54b480-0fa0-4f72-9223-d793dbc20d87 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:16.557306 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef54b480-0fa0-4f72-9223-d793dbc20d87 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:16.557993 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef54b480-0fa0-4f72-9223-d793dbc20d87 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:16.558440 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef54b480-0fa0-4f72-9223-d793dbc20d87 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:16.558867 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef54b480-0fa0-4f72-9223-d793dbc20d87 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:16.588263 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ef54b480-0fa0-4f72-9223-d793dbc20d87 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044143 Aug 10 12:51:16.588827 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 748/1483] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:16 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:51:16.593359 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8335e98b-c7df-4583-9a0b-6e0ad04eab30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:16.595481 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8335e98b-c7df-4583-9a0b-6e0ad04eab30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:16.601736 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8335e98b-c7df-4583-9a0b-6e0ad04eab30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:16.602277 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8335e98b-c7df-4583-9a0b-6e0ad04eab30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:16.602711 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8335e98b-c7df-4583-9a0b-6e0ad04eab30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:16.603440 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8335e98b-c7df-4583-9a0b-6e0ad04eab30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:16.603893 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8335e98b-c7df-4583-9a0b-6e0ad04eab30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:16.604322 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8335e98b-c7df-4583-9a0b-6e0ad04eab30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:16.633385 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8335e98b-c7df-4583-9a0b-6e0ad04eab30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043552 Aug 10 12:51:16.633942 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 749/1484] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:16 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:16.638476 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bf6c191f-de8d-42b6-82ae-c3a004d10b44 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:16.640609 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bf6c191f-de8d-42b6-82ae-c3a004d10b44 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:16.646826 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf6c191f-de8d-42b6-82ae-c3a004d10b44 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:16.647344 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf6c191f-de8d-42b6-82ae-c3a004d10b44 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:16.647783 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf6c191f-de8d-42b6-82ae-c3a004d10b44 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:16.648474 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf6c191f-de8d-42b6-82ae-c3a004d10b44 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:16.648929 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf6c191f-de8d-42b6-82ae-c3a004d10b44 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:16.649375 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf6c191f-de8d-42b6-82ae-c3a004d10b44 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:16.678052 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bf6c191f-de8d-42b6-82ae-c3a004d10b44 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043126 Aug 10 12:51:16.678598 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 750/1485] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:16 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:16.787201 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [None req-8ddd978e-b828-406b-989f-165487406157 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [7e044c67-15e3-4fc7-bc18-3c975a9c203b] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 41898. Aug 10 12:51:16.790657 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8ddd978e-b828-406b-989f-165487406157 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a/os-volume_attachments/f20fae1b-31eb-4842-96ec-e2b76745be2d" status: 202 len: 0 microversion: 2.1 time: 1.349544 Aug 10 12:51:16.791272 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 736/1486] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 10 12:51:15 2022] DELETE /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a/os-volume_attachments/f20fae1b-31eb-4842-96ec-e2b76745be2d => generated 0 bytes in 1351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:51:17.555854 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bb0c0655-c01a-4185-bcc4-2282341cf7fc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:17.558292 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bb0c0655-c01a-4185-bcc4-2282341cf7fc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:17.564659 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb0c0655-c01a-4185-bcc4-2282341cf7fc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:17.565540 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb0c0655-c01a-4185-bcc4-2282341cf7fc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:17.566036 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb0c0655-c01a-4185-bcc4-2282341cf7fc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:17.566721 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb0c0655-c01a-4185-bcc4-2282341cf7fc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:17.567207 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb0c0655-c01a-4185-bcc4-2282341cf7fc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:17.567613 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb0c0655-c01a-4185-bcc4-2282341cf7fc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:17.596989 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bb0c0655-c01a-4185-bcc4-2282341cf7fc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044106 Aug 10 12:51:17.597837 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 751/1487] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:17 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:17.601996 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a88e3369-9c22-4e99-824f-791abd339443 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:17.604333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a88e3369-9c22-4e99-824f-791abd339443 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:17.610898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a88e3369-9c22-4e99-824f-791abd339443 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:17.611431 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a88e3369-9c22-4e99-824f-791abd339443 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:17.611900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a88e3369-9c22-4e99-824f-791abd339443 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:17.612591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a88e3369-9c22-4e99-824f-791abd339443 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:17.613038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a88e3369-9c22-4e99-824f-791abd339443 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:17.613492 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a88e3369-9c22-4e99-824f-791abd339443 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:17.642881 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a88e3369-9c22-4e99-824f-791abd339443 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046458 Aug 10 12:51:17.648072 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 737/1488] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:17 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:51:17.648218 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f9b63eb2-c121-45f8-8367-46c2977dae60 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:17.648400 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f9b63eb2-c121-45f8-8367-46c2977dae60 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:17.654244 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f9b63eb2-c121-45f8-8367-46c2977dae60 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:17.654725 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f9b63eb2-c121-45f8-8367-46c2977dae60 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:17.655163 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f9b63eb2-c121-45f8-8367-46c2977dae60 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:17.655882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f9b63eb2-c121-45f8-8367-46c2977dae60 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:17.656339 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f9b63eb2-c121-45f8-8367-46c2977dae60 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:17.656771 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f9b63eb2-c121-45f8-8367-46c2977dae60 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:17.685556 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f9b63eb2-c121-45f8-8367-46c2977dae60 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043885 Aug 10 12:51:17.686114 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 752/1489] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:17 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:17.691281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9e921cf6-438b-4fa3-b00c-d70df73cad39 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:17.693405 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9e921cf6-438b-4fa3-b00c-d70df73cad39 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:17.699247 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e921cf6-438b-4fa3-b00c-d70df73cad39 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:17.699720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e921cf6-438b-4fa3-b00c-d70df73cad39 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:17.700149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e921cf6-438b-4fa3-b00c-d70df73cad39 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:17.700828 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e921cf6-438b-4fa3-b00c-d70df73cad39 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:17.701273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e921cf6-438b-4fa3-b00c-d70df73cad39 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:17.701689 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e921cf6-438b-4fa3-b00c-d70df73cad39 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:17.731506 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9e921cf6-438b-4fa3-b00c-d70df73cad39 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045294 Aug 10 12:51:17.732095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 738/1490] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:17 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:18.609897 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2679e556-9915-499c-a60a-bf1cd50a7424 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:18.612105 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2679e556-9915-499c-a60a-bf1cd50a7424 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:18.618461 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2679e556-9915-499c-a60a-bf1cd50a7424 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:18.618942 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2679e556-9915-499c-a60a-bf1cd50a7424 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:18.619423 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2679e556-9915-499c-a60a-bf1cd50a7424 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:18.620121 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2679e556-9915-499c-a60a-bf1cd50a7424 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:18.620576 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2679e556-9915-499c-a60a-bf1cd50a7424 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:18.621004 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2679e556-9915-499c-a60a-bf1cd50a7424 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:18.650527 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2679e556-9915-499c-a60a-bf1cd50a7424 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044688 Aug 10 12:51:18.651084 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 753/1491] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:18 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:18.655140 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-11f37062-8772-4309-9b0a-1659ec8d70b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:18.657306 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-11f37062-8772-4309-9b0a-1659ec8d70b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:18.663279 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11f37062-8772-4309-9b0a-1659ec8d70b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:18.663753 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11f37062-8772-4309-9b0a-1659ec8d70b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:18.664183 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11f37062-8772-4309-9b0a-1659ec8d70b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:18.664858 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11f37062-8772-4309-9b0a-1659ec8d70b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:18.665300 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11f37062-8772-4309-9b0a-1659ec8d70b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:18.665714 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11f37062-8772-4309-9b0a-1659ec8d70b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:18.694819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-11f37062-8772-4309-9b0a-1659ec8d70b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043622 Aug 10 12:51:18.695396 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 739/1492] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:18 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:51:18.697897 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5b59cb83-82b2-40b2-9a36-2746f05ae05f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:18.700061 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5b59cb83-82b2-40b2-9a36-2746f05ae05f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:18.706632 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b59cb83-82b2-40b2-9a36-2746f05ae05f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:18.707220 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b59cb83-82b2-40b2-9a36-2746f05ae05f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:18.707667 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b59cb83-82b2-40b2-9a36-2746f05ae05f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:18.708368 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b59cb83-82b2-40b2-9a36-2746f05ae05f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:18.708821 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b59cb83-82b2-40b2-9a36-2746f05ae05f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:18.709246 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b59cb83-82b2-40b2-9a36-2746f05ae05f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:18.738546 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5b59cb83-82b2-40b2-9a36-2746f05ae05f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044442 Aug 10 12:51:18.739026 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 754/1493] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:18 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:18.743808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-56ad56ac-b2eb-424b-b579-aa5b4e037a95 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:18.745957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-56ad56ac-b2eb-424b-b579-aa5b4e037a95 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:18.751855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56ad56ac-b2eb-424b-b579-aa5b4e037a95 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:18.752848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56ad56ac-b2eb-424b-b579-aa5b4e037a95 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:18.753291 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56ad56ac-b2eb-424b-b579-aa5b4e037a95 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:18.753976 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56ad56ac-b2eb-424b-b579-aa5b4e037a95 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:18.754420 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56ad56ac-b2eb-424b-b579-aa5b4e037a95 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:18.754838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56ad56ac-b2eb-424b-b579-aa5b4e037a95 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:18.784492 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-56ad56ac-b2eb-424b-b579-aa5b4e037a95 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044539 Aug 10 12:51:18.785085 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 740/1494] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:18 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:19.662513 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-82e03474-6b04-4854-9c8c-3a9477efcfef tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:19.664728 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-82e03474-6b04-4854-9c8c-3a9477efcfef tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:19.671124 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82e03474-6b04-4854-9c8c-3a9477efcfef tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:19.671624 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82e03474-6b04-4854-9c8c-3a9477efcfef tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:19.672053 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82e03474-6b04-4854-9c8c-3a9477efcfef tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:19.672732 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82e03474-6b04-4854-9c8c-3a9477efcfef tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:19.673175 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82e03474-6b04-4854-9c8c-3a9477efcfef tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:19.673591 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82e03474-6b04-4854-9c8c-3a9477efcfef tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:19.704509 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-82e03474-6b04-4854-9c8c-3a9477efcfef tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046509 Aug 10 12:51:19.707813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-46dd2186-f5f6-4408-bce2-93f42131264f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:19.710631 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 755/1495] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:19 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:19.711107 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-46dd2186-f5f6-4408-bce2-93f42131264f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:19.719416 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-46dd2186-f5f6-4408-bce2-93f42131264f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:19.720239 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-46dd2186-f5f6-4408-bce2-93f42131264f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:19.720865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-46dd2186-f5f6-4408-bce2-93f42131264f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:19.722158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-46dd2186-f5f6-4408-bce2-93f42131264f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:19.722616 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-46dd2186-f5f6-4408-bce2-93f42131264f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:19.723043 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-46dd2186-f5f6-4408-bce2-93f42131264f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:19.750035 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f75dec34-7158-4c03-85d6-2edd91ac41b5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:19.752334 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f75dec34-7158-4c03-85d6-2edd91ac41b5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:19.758506 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f75dec34-7158-4c03-85d6-2edd91ac41b5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:19.759097 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f75dec34-7158-4c03-85d6-2edd91ac41b5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:19.759681 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f75dec34-7158-4c03-85d6-2edd91ac41b5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:19.760476 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f75dec34-7158-4c03-85d6-2edd91ac41b5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:19.761035 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f75dec34-7158-4c03-85d6-2edd91ac41b5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:19.761674 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f75dec34-7158-4c03-85d6-2edd91ac41b5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:19.764799 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-46dd2186-f5f6-4408-bce2-93f42131264f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061635 Aug 10 12:51:19.765659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 741/1496] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:19 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:51:19.792660 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f75dec34-7158-4c03-85d6-2edd91ac41b5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046566 Aug 10 12:51:19.797211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2c0d861c-5dfa-4849-a68d-835274828c7a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:19.797721 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 756/1497] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:19 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:19.799965 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2c0d861c-5dfa-4849-a68d-835274828c7a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:19.806024 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c0d861c-5dfa-4849-a68d-835274828c7a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:19.806531 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c0d861c-5dfa-4849-a68d-835274828c7a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:19.806962 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c0d861c-5dfa-4849-a68d-835274828c7a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:19.807721 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c0d861c-5dfa-4849-a68d-835274828c7a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:19.808177 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c0d861c-5dfa-4849-a68d-835274828c7a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:19.808600 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c0d861c-5dfa-4849-a68d-835274828c7a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:19.839396 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2c0d861c-5dfa-4849-a68d-835274828c7a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046480 Aug 10 12:51:19.844019 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 742/1498] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:19 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:20.718040 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0bca97be-fa81-42ce-a30f-f1f5b03b9844 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:20.720239 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0bca97be-fa81-42ce-a30f-f1f5b03b9844 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:20.726568 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0bca97be-fa81-42ce-a30f-f1f5b03b9844 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:20.727046 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0bca97be-fa81-42ce-a30f-f1f5b03b9844 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:20.727520 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0bca97be-fa81-42ce-a30f-f1f5b03b9844 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:20.728203 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0bca97be-fa81-42ce-a30f-f1f5b03b9844 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:20.728648 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0bca97be-fa81-42ce-a30f-f1f5b03b9844 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:20.729058 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0bca97be-fa81-42ce-a30f-f1f5b03b9844 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:20.759065 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0bca97be-fa81-42ce-a30f-f1f5b03b9844 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044945 Aug 10 12:51:20.759665 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 757/1499] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:20 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:20.777536 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-24063db4-655e-4472-b5a2-b7971ce479d4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:20.779739 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-24063db4-655e-4472-b5a2-b7971ce479d4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:20.786422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24063db4-655e-4472-b5a2-b7971ce479d4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:20.786908 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24063db4-655e-4472-b5a2-b7971ce479d4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:20.787376 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24063db4-655e-4472-b5a2-b7971ce479d4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:20.788092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24063db4-655e-4472-b5a2-b7971ce479d4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:20.788548 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24063db4-655e-4472-b5a2-b7971ce479d4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:20.788973 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24063db4-655e-4472-b5a2-b7971ce479d4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:20.804478 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9825606b-2747-4265-bd5a-2184b669ca0e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:20.806636 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9825606b-2747-4265-bd5a-2184b669ca0e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:20.812548 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9825606b-2747-4265-bd5a-2184b669ca0e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:20.813027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9825606b-2747-4265-bd5a-2184b669ca0e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:20.813459 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9825606b-2747-4265-bd5a-2184b669ca0e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:20.814150 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9825606b-2747-4265-bd5a-2184b669ca0e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:20.814597 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9825606b-2747-4265-bd5a-2184b669ca0e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:20.815549 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9825606b-2747-4265-bd5a-2184b669ca0e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:20.818600 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-24063db4-655e-4472-b5a2-b7971ce479d4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045002 Aug 10 12:51:20.819167 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 743/1500] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:20 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:51:20.844663 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9825606b-2747-4265-bd5a-2184b669ca0e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044134 Aug 10 12:51:20.845224 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 758/1501] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:20 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:20.851479 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b8e31d6c-4e04-455b-bc2f-7ef406d1b12e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:20.853601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b8e31d6c-4e04-455b-bc2f-7ef406d1b12e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:20.859642 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8e31d6c-4e04-455b-bc2f-7ef406d1b12e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:20.860170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8e31d6c-4e04-455b-bc2f-7ef406d1b12e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:20.860600 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8e31d6c-4e04-455b-bc2f-7ef406d1b12e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:20.863687 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8e31d6c-4e04-455b-bc2f-7ef406d1b12e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:20.863687 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8e31d6c-4e04-455b-bc2f-7ef406d1b12e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:20.863687 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8e31d6c-4e04-455b-bc2f-7ef406d1b12e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:20.892335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b8e31d6c-4e04-455b-bc2f-7ef406d1b12e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043382 Aug 10 12:51:20.892335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 744/1502] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:20 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:21.771959 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3e32dc9e-3780-4b24-bd5f-2510f6cbdf9b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:21.774102 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3e32dc9e-3780-4b24-bd5f-2510f6cbdf9b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:21.780520 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e32dc9e-3780-4b24-bd5f-2510f6cbdf9b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:21.781004 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e32dc9e-3780-4b24-bd5f-2510f6cbdf9b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:21.781438 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e32dc9e-3780-4b24-bd5f-2510f6cbdf9b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:21.782137 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e32dc9e-3780-4b24-bd5f-2510f6cbdf9b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:21.782606 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e32dc9e-3780-4b24-bd5f-2510f6cbdf9b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:21.783009 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e32dc9e-3780-4b24-bd5f-2510f6cbdf9b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:21.813796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3e32dc9e-3780-4b24-bd5f-2510f6cbdf9b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046398 Aug 10 12:51:21.814343 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 759/1503] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:21 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:21.829796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-936b6584-5c0c-404b-9199-d0edd877832a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:21.831940 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-936b6584-5c0c-404b-9199-d0edd877832a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:21.838548 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-936b6584-5c0c-404b-9199-d0edd877832a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:21.839032 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-936b6584-5c0c-404b-9199-d0edd877832a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:21.839531 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-936b6584-5c0c-404b-9199-d0edd877832a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:21.840258 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-936b6584-5c0c-404b-9199-d0edd877832a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:21.840711 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-936b6584-5c0c-404b-9199-d0edd877832a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:21.841181 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-936b6584-5c0c-404b-9199-d0edd877832a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:21.857335 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5a24752a-9850-4134-885e-e60f211bad30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:21.859597 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5a24752a-9850-4134-885e-e60f211bad30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:21.865929 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a24752a-9850-4134-885e-e60f211bad30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:21.866403 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a24752a-9850-4134-885e-e60f211bad30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:21.866827 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a24752a-9850-4134-885e-e60f211bad30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:21.867568 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a24752a-9850-4134-885e-e60f211bad30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:21.868041 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a24752a-9850-4134-885e-e60f211bad30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:21.868458 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a24752a-9850-4134-885e-e60f211bad30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:21.870872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-936b6584-5c0c-404b-9199-d0edd877832a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044922 Aug 10 12:51:21.871464 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 745/1504] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:21 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:51:21.897813 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5a24752a-9850-4134-885e-e60f211bad30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044648 Aug 10 12:51:21.898438 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 760/1505] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:21 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:21.903674 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5e7a17ac-d5c1-419d-835e-66051001b312 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:21.905806 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5e7a17ac-d5c1-419d-835e-66051001b312 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:21.911881 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e7a17ac-d5c1-419d-835e-66051001b312 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:21.912366 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e7a17ac-d5c1-419d-835e-66051001b312 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:21.912805 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e7a17ac-d5c1-419d-835e-66051001b312 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:21.913491 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e7a17ac-d5c1-419d-835e-66051001b312 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:21.913944 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e7a17ac-d5c1-419d-835e-66051001b312 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:21.914369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e7a17ac-d5c1-419d-835e-66051001b312 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:21.928333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:51:21.943766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5e7a17ac-d5c1-419d-835e-66051001b312 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043923 Aug 10 12:51:21.944314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 746/1506] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:21 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:22.825769 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2c658da3-5ba9-4b95-a981-575cd70af756 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:22.827967 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2c658da3-5ba9-4b95-a981-575cd70af756 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:22.835108 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c658da3-5ba9-4b95-a981-575cd70af756 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:22.835626 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c658da3-5ba9-4b95-a981-575cd70af756 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:22.836061 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c658da3-5ba9-4b95-a981-575cd70af756 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:22.836749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c658da3-5ba9-4b95-a981-575cd70af756 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:22.837199 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c658da3-5ba9-4b95-a981-575cd70af756 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:22.837623 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c658da3-5ba9-4b95-a981-575cd70af756 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:22.866621 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2c658da3-5ba9-4b95-a981-575cd70af756 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044721 Aug 10 12:51:22.867192 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 761/1507] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:22 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:22.883477 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5698ae37-4305-47e9-b265-9f53d11da66e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:22.885668 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5698ae37-4305-47e9-b265-9f53d11da66e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:22.892313 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5698ae37-4305-47e9-b265-9f53d11da66e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:22.892793 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5698ae37-4305-47e9-b265-9f53d11da66e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:22.893761 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5698ae37-4305-47e9-b265-9f53d11da66e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:22.894541 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5698ae37-4305-47e9-b265-9f53d11da66e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:22.894993 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5698ae37-4305-47e9-b265-9f53d11da66e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:22.895452 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5698ae37-4305-47e9-b265-9f53d11da66e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:22.910308 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-50a198e0-7eab-420f-931b-98cf78d303f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:22.912489 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-50a198e0-7eab-420f-931b-98cf78d303f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:22.918501 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50a198e0-7eab-420f-931b-98cf78d303f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:22.918989 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50a198e0-7eab-420f-931b-98cf78d303f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:22.919489 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50a198e0-7eab-420f-931b-98cf78d303f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:22.920250 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50a198e0-7eab-420f-931b-98cf78d303f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:22.920878 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50a198e0-7eab-420f-931b-98cf78d303f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:22.921306 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50a198e0-7eab-420f-931b-98cf78d303f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:22.926052 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5698ae37-4305-47e9-b265-9f53d11da66e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046882 Aug 10 12:51:22.926641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 747/1508] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:22 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:51:22.946781 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:51:22.951210 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-50a198e0-7eab-420f-931b-98cf78d303f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045522 Aug 10 12:51:22.951759 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 762/1509] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:22 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:22.956868 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-78a05eb6-56f3-4f74-8533-ccfce8e49009 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:22.959022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-78a05eb6-56f3-4f74-8533-ccfce8e49009 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:22.965495 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-78a05eb6-56f3-4f74-8533-ccfce8e49009 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:22.965967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-78a05eb6-56f3-4f74-8533-ccfce8e49009 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:22.966398 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-78a05eb6-56f3-4f74-8533-ccfce8e49009 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:22.967144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-78a05eb6-56f3-4f74-8533-ccfce8e49009 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:22.967603 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-78a05eb6-56f3-4f74-8533-ccfce8e49009 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:22.968022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-78a05eb6-56f3-4f74-8533-ccfce8e49009 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:22.996795 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-78a05eb6-56f3-4f74-8533-ccfce8e49009 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044666 Aug 10 12:51:22.997340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 748/1510] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:22 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:23.879346 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-894c57ec-9694-4b10-82dc-fc48410b2037 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:23.881549 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-894c57ec-9694-4b10-82dc-fc48410b2037 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:23.888449 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-894c57ec-9694-4b10-82dc-fc48410b2037 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:23.888933 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-894c57ec-9694-4b10-82dc-fc48410b2037 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:23.889368 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-894c57ec-9694-4b10-82dc-fc48410b2037 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:23.890056 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-894c57ec-9694-4b10-82dc-fc48410b2037 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:23.890541 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-894c57ec-9694-4b10-82dc-fc48410b2037 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:23.890968 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-894c57ec-9694-4b10-82dc-fc48410b2037 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:23.919514 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-894c57ec-9694-4b10-82dc-fc48410b2037 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044664 Aug 10 12:51:23.920071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 763/1511] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:23 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:23.937817 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2fe63832-777e-4d66-9b8c-5cd529b350a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:23.940468 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2fe63832-777e-4d66-9b8c-5cd529b350a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:23.946702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2fe63832-777e-4d66-9b8c-5cd529b350a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:23.947197 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2fe63832-777e-4d66-9b8c-5cd529b350a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:23.947641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2fe63832-777e-4d66-9b8c-5cd529b350a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:23.948320 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2fe63832-777e-4d66-9b8c-5cd529b350a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:23.948773 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2fe63832-777e-4d66-9b8c-5cd529b350a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:23.949195 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2fe63832-777e-4d66-9b8c-5cd529b350a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:23.965880 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-63c70d15-41ba-4ff8-9f02-5b788d538708 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:23.968041 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-63c70d15-41ba-4ff8-9f02-5b788d538708 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:23.973875 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63c70d15-41ba-4ff8-9f02-5b788d538708 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:23.974369 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63c70d15-41ba-4ff8-9f02-5b788d538708 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:23.974781 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63c70d15-41ba-4ff8-9f02-5b788d538708 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:23.975497 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63c70d15-41ba-4ff8-9f02-5b788d538708 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:23.975944 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63c70d15-41ba-4ff8-9f02-5b788d538708 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:23.976363 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63c70d15-41ba-4ff8-9f02-5b788d538708 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:23.978479 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2fe63832-777e-4d66-9b8c-5cd529b350a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044541 Aug 10 12:51:23.979036 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 749/1512] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:23 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 12:51:24.005959 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-63c70d15-41ba-4ff8-9f02-5b788d538708 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043912 Aug 10 12:51:24.006520 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 764/1513] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:23 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:24.009296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-452888ac-c89c-4f67-8a35-17ba74d0cf61 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:24.011446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-452888ac-c89c-4f67-8a35-17ba74d0cf61 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:24.017371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-452888ac-c89c-4f67-8a35-17ba74d0cf61 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:24.017849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-452888ac-c89c-4f67-8a35-17ba74d0cf61 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:24.018997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-452888ac-c89c-4f67-8a35-17ba74d0cf61 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:24.019723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-452888ac-c89c-4f67-8a35-17ba74d0cf61 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:24.020175 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-452888ac-c89c-4f67-8a35-17ba74d0cf61 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:24.020596 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-452888ac-c89c-4f67-8a35-17ba74d0cf61 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:24.048455 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-452888ac-c89c-4f67-8a35-17ba74d0cf61 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042882 Aug 10 12:51:24.048936 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 750/1514] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:24 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:24.931574 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-87f8a2df-59bd-4f78-9601-f7679c148c4e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:24.933981 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-87f8a2df-59bd-4f78-9601-f7679c148c4e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:24.940530 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-87f8a2df-59bd-4f78-9601-f7679c148c4e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:24.941001 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-87f8a2df-59bd-4f78-9601-f7679c148c4e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:24.941431 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-87f8a2df-59bd-4f78-9601-f7679c148c4e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:24.942112 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-87f8a2df-59bd-4f78-9601-f7679c148c4e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:24.942560 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-87f8a2df-59bd-4f78-9601-f7679c148c4e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:24.942975 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-87f8a2df-59bd-4f78-9601-f7679c148c4e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:24.971944 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-87f8a2df-59bd-4f78-9601-f7679c148c4e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043700 Aug 10 12:51:24.972494 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 765/1515] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:24 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:24.989820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3ac7df79-31a6-410e-9f0b-8a3b41786690 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:24.992007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3ac7df79-31a6-410e-9f0b-8a3b41786690 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:24.998378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ac7df79-31a6-410e-9f0b-8a3b41786690 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:24.998858 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ac7df79-31a6-410e-9f0b-8a3b41786690 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:24.999322 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ac7df79-31a6-410e-9f0b-8a3b41786690 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:25.000013 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ac7df79-31a6-410e-9f0b-8a3b41786690 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:25.000465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ac7df79-31a6-410e-9f0b-8a3b41786690 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:25.000890 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ac7df79-31a6-410e-9f0b-8a3b41786690 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:25.018719 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-79eb9762-2f00-4cce-8fa7-4c523d765a9b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:25.020886 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-79eb9762-2f00-4cce-8fa7-4c523d765a9b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:25.026927 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-79eb9762-2f00-4cce-8fa7-4c523d765a9b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:25.027451 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-79eb9762-2f00-4cce-8fa7-4c523d765a9b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:25.027888 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-79eb9762-2f00-4cce-8fa7-4c523d765a9b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:25.028630 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-79eb9762-2f00-4cce-8fa7-4c523d765a9b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:25.029079 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-79eb9762-2f00-4cce-8fa7-4c523d765a9b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:25.029499 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-79eb9762-2f00-4cce-8fa7-4c523d765a9b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:25.030309 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3ac7df79-31a6-410e-9f0b-8a3b41786690 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044359 Aug 10 12:51:25.030869 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 751/1516] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:24 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:51:25.058851 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-79eb9762-2f00-4cce-8fa7-4c523d765a9b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044738 Aug 10 12:51:25.059433 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 766/1517] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:25 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:25.060823 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7769c3c6-3671-44a4-a0a1-6c0743874fab tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:25.062950 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7769c3c6-3671-44a4-a0a1-6c0743874fab tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:25.068822 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7769c3c6-3671-44a4-a0a1-6c0743874fab tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:25.069306 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7769c3c6-3671-44a4-a0a1-6c0743874fab tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:25.069791 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7769c3c6-3671-44a4-a0a1-6c0743874fab tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:25.070490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7769c3c6-3671-44a4-a0a1-6c0743874fab tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:25.070940 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7769c3c6-3671-44a4-a0a1-6c0743874fab tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:25.071392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7769c3c6-3671-44a4-a0a1-6c0743874fab tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:25.100635 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7769c3c6-3671-44a4-a0a1-6c0743874fab tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043626 Aug 10 12:51:25.101185 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 752/1518] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:25 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:25.984395 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ab3aa411-8cc3-4f06-9ae9-74a9fcdca54c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:25.986594 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ab3aa411-8cc3-4f06-9ae9-74a9fcdca54c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:25.993631 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab3aa411-8cc3-4f06-9ae9-74a9fcdca54c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:25.994111 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab3aa411-8cc3-4f06-9ae9-74a9fcdca54c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:25.994544 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab3aa411-8cc3-4f06-9ae9-74a9fcdca54c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:25.995255 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab3aa411-8cc3-4f06-9ae9-74a9fcdca54c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:25.995708 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab3aa411-8cc3-4f06-9ae9-74a9fcdca54c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:25.996130 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab3aa411-8cc3-4f06-9ae9-74a9fcdca54c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:26.024675 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ab3aa411-8cc3-4f06-9ae9-74a9fcdca54c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044565 Aug 10 12:51:26.025226 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 767/1519] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:25 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:26.043607 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3de6877e-3c2d-4e99-a28b-ff6dd5ab66cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:26.045688 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3de6877e-3c2d-4e99-a28b-ff6dd5ab66cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:26.052643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3de6877e-3c2d-4e99-a28b-ff6dd5ab66cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:26.053116 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3de6877e-3c2d-4e99-a28b-ff6dd5ab66cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:26.053541 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3de6877e-3c2d-4e99-a28b-ff6dd5ab66cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:26.054216 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3de6877e-3c2d-4e99-a28b-ff6dd5ab66cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:26.054685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3de6877e-3c2d-4e99-a28b-ff6dd5ab66cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:26.055103 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3de6877e-3c2d-4e99-a28b-ff6dd5ab66cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:26.071537 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1d59bd8e-1d80-4570-b18b-c19532eeef91 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:26.073670 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1d59bd8e-1d80-4570-b18b-c19532eeef91 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:26.079583 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d59bd8e-1d80-4570-b18b-c19532eeef91 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:26.080067 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d59bd8e-1d80-4570-b18b-c19532eeef91 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:26.081092 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d59bd8e-1d80-4570-b18b-c19532eeef91 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:26.081791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d59bd8e-1d80-4570-b18b-c19532eeef91 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:26.082241 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d59bd8e-1d80-4570-b18b-c19532eeef91 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:26.082663 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d59bd8e-1d80-4570-b18b-c19532eeef91 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:26.084579 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3de6877e-3c2d-4e99-a28b-ff6dd5ab66cd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044937 Aug 10 12:51:26.085113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 753/1520] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:26 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:51:26.111520 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1d59bd8e-1d80-4570-b18b-c19532eeef91 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043813 Aug 10 12:51:26.112079 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 768/1521] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:26 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:26.113251 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-21a099f1-ec39-4fb5-abfa-0e5f5e4fe4ce tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:26.115398 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-21a099f1-ec39-4fb5-abfa-0e5f5e4fe4ce tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:26.121210 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-21a099f1-ec39-4fb5-abfa-0e5f5e4fe4ce tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:26.121692 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-21a099f1-ec39-4fb5-abfa-0e5f5e4fe4ce tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:26.122253 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-21a099f1-ec39-4fb5-abfa-0e5f5e4fe4ce tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:26.122948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-21a099f1-ec39-4fb5-abfa-0e5f5e4fe4ce tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:26.123465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-21a099f1-ec39-4fb5-abfa-0e5f5e4fe4ce tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:26.123891 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-21a099f1-ec39-4fb5-abfa-0e5f5e4fe4ce tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:26.153140 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-21a099f1-ec39-4fb5-abfa-0e5f5e4fe4ce tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044023 Aug 10 12:51:26.153685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 754/1522] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:26 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:27.036387 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a3082a6b-37b8-4a1b-b790-7a7620566388 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:27.038540 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a3082a6b-37b8-4a1b-b790-7a7620566388 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:27.044691 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a3082a6b-37b8-4a1b-b790-7a7620566388 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:27.045174 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a3082a6b-37b8-4a1b-b790-7a7620566388 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:27.045639 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a3082a6b-37b8-4a1b-b790-7a7620566388 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:27.046332 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a3082a6b-37b8-4a1b-b790-7a7620566388 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:27.046787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a3082a6b-37b8-4a1b-b790-7a7620566388 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:27.047233 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a3082a6b-37b8-4a1b-b790-7a7620566388 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:27.076361 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a3082a6b-37b8-4a1b-b790-7a7620566388 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043990 Aug 10 12:51:27.076905 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 769/1523] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:27 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:27.097235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a5fb513e-6116-4de0-b178-b869e72721dc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:27.099444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a5fb513e-6116-4de0-b178-b869e72721dc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:27.105937 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5fb513e-6116-4de0-b178-b869e72721dc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:27.106444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5fb513e-6116-4de0-b178-b869e72721dc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:27.106883 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5fb513e-6116-4de0-b178-b869e72721dc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:27.107590 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5fb513e-6116-4de0-b178-b869e72721dc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:27.108041 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5fb513e-6116-4de0-b178-b869e72721dc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:27.108461 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5fb513e-6116-4de0-b178-b869e72721dc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:27.124014 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2b8ea920-798c-42f1-b2d0-4e2869b08e89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:27.126210 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2b8ea920-798c-42f1-b2d0-4e2869b08e89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:27.132910 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b8ea920-798c-42f1-b2d0-4e2869b08e89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:27.133392 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b8ea920-798c-42f1-b2d0-4e2869b08e89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:27.133832 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b8ea920-798c-42f1-b2d0-4e2869b08e89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:27.134529 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b8ea920-798c-42f1-b2d0-4e2869b08e89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:27.134983 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b8ea920-798c-42f1-b2d0-4e2869b08e89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:27.135441 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b8ea920-798c-42f1-b2d0-4e2869b08e89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:27.138193 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a5fb513e-6116-4de0-b178-b869e72721dc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044938 Aug 10 12:51:27.138967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 755/1524] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:27 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:51:27.164826 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2b8ea920-798c-42f1-b2d0-4e2869b08e89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044508 Aug 10 12:51:27.165089 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-952bc337-cd92-44e7-b6d8-0d8f215b34fe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:27.165318 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 770/1525] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:27 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:27.167342 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-952bc337-cd92-44e7-b6d8-0d8f215b34fe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:27.173109 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-952bc337-cd92-44e7-b6d8-0d8f215b34fe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:27.173585 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-952bc337-cd92-44e7-b6d8-0d8f215b34fe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:27.174017 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-952bc337-cd92-44e7-b6d8-0d8f215b34fe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:27.175346 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-952bc337-cd92-44e7-b6d8-0d8f215b34fe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:27.175800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-952bc337-cd92-44e7-b6d8-0d8f215b34fe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:27.176222 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-952bc337-cd92-44e7-b6d8-0d8f215b34fe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:27.204445 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-952bc337-cd92-44e7-b6d8-0d8f215b34fe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043149 Aug 10 12:51:27.204988 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 756/1526] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:27 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:28.088674 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-56d09fd2-a19a-46bc-8fad-52f9178a1707 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:28.090713 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-56d09fd2-a19a-46bc-8fad-52f9178a1707 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:28.097683 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56d09fd2-a19a-46bc-8fad-52f9178a1707 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:28.098153 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56d09fd2-a19a-46bc-8fad-52f9178a1707 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:28.098583 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56d09fd2-a19a-46bc-8fad-52f9178a1707 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:28.099284 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56d09fd2-a19a-46bc-8fad-52f9178a1707 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:28.099730 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56d09fd2-a19a-46bc-8fad-52f9178a1707 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:28.100150 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56d09fd2-a19a-46bc-8fad-52f9178a1707 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:28.128596 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-56d09fd2-a19a-46bc-8fad-52f9178a1707 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043997 Aug 10 12:51:28.129141 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 771/1527] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:28 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:28.150025 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-74c57293-ca4f-453e-8bce-704e156c6d6f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:28.152175 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-74c57293-ca4f-453e-8bce-704e156c6d6f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:28.159082 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-74c57293-ca4f-453e-8bce-704e156c6d6f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:28.159648 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-74c57293-ca4f-453e-8bce-704e156c6d6f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:28.160084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-74c57293-ca4f-453e-8bce-704e156c6d6f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:28.160763 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-74c57293-ca4f-453e-8bce-704e156c6d6f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:28.161212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-74c57293-ca4f-453e-8bce-704e156c6d6f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:28.161633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-74c57293-ca4f-453e-8bce-704e156c6d6f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:28.177191 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-84a2160a-ceac-4d83-8933-a622b3ba5a95 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:28.179377 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-84a2160a-ceac-4d83-8933-a622b3ba5a95 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:28.185122 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-84a2160a-ceac-4d83-8933-a622b3ba5a95 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:28.185592 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-84a2160a-ceac-4d83-8933-a622b3ba5a95 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:28.186028 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-84a2160a-ceac-4d83-8933-a622b3ba5a95 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:28.186708 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-84a2160a-ceac-4d83-8933-a622b3ba5a95 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:28.187149 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-84a2160a-ceac-4d83-8933-a622b3ba5a95 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:28.187591 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-84a2160a-ceac-4d83-8933-a622b3ba5a95 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:28.190959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-74c57293-ca4f-453e-8bce-704e156c6d6f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044701 Aug 10 12:51:28.191551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 757/1528] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:28 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:51:28.217114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ae18d378-a936-48f3-99ba-b75a6bde7185 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:28.217825 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-84a2160a-ceac-4d83-8933-a622b3ba5a95 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044825 Aug 10 12:51:28.218420 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 772/1529] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:28 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:28.219252 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ae18d378-a936-48f3-99ba-b75a6bde7185 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:28.225071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ae18d378-a936-48f3-99ba-b75a6bde7185 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:28.225551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ae18d378-a936-48f3-99ba-b75a6bde7185 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:28.225987 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ae18d378-a936-48f3-99ba-b75a6bde7185 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:28.226672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ae18d378-a936-48f3-99ba-b75a6bde7185 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:28.227123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ae18d378-a936-48f3-99ba-b75a6bde7185 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:28.227579 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ae18d378-a936-48f3-99ba-b75a6bde7185 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:28.256033 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ae18d378-a936-48f3-99ba-b75a6bde7185 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042798 Aug 10 12:51:28.256581 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 758/1530] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:28 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:29.140873 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5d5cbe54-131c-41af-89a5-77f2ac40399c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:29.143675 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5d5cbe54-131c-41af-89a5-77f2ac40399c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:29.150098 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d5cbe54-131c-41af-89a5-77f2ac40399c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:29.150587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d5cbe54-131c-41af-89a5-77f2ac40399c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:29.151009 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d5cbe54-131c-41af-89a5-77f2ac40399c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:29.151721 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d5cbe54-131c-41af-89a5-77f2ac40399c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:29.152173 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d5cbe54-131c-41af-89a5-77f2ac40399c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:29.152596 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d5cbe54-131c-41af-89a5-77f2ac40399c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:29.180781 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5d5cbe54-131c-41af-89a5-77f2ac40399c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043923 Aug 10 12:51:29.181325 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 773/1531] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:29 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:29.203357 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a21d532a-58c7-4357-869f-b784ac969684 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:29.206137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a21d532a-58c7-4357-869f-b784ac969684 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:29.212493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a21d532a-58c7-4357-869f-b784ac969684 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:29.212968 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a21d532a-58c7-4357-869f-b784ac969684 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:29.213401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a21d532a-58c7-4357-869f-b784ac969684 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:29.214084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a21d532a-58c7-4357-869f-b784ac969684 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:29.214533 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a21d532a-58c7-4357-869f-b784ac969684 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:29.214952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a21d532a-58c7-4357-869f-b784ac969684 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:29.230291 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7544bf1a-8775-432b-97cb-23a2e2a71d57 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:29.232406 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7544bf1a-8775-432b-97cb-23a2e2a71d57 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:29.238201 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7544bf1a-8775-432b-97cb-23a2e2a71d57 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:29.238680 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7544bf1a-8775-432b-97cb-23a2e2a71d57 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:29.239122 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7544bf1a-8775-432b-97cb-23a2e2a71d57 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:29.239851 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7544bf1a-8775-432b-97cb-23a2e2a71d57 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:29.240303 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7544bf1a-8775-432b-97cb-23a2e2a71d57 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:29.240739 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7544bf1a-8775-432b-97cb-23a2e2a71d57 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:29.244643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a21d532a-58c7-4357-869f-b784ac969684 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045284 Aug 10 12:51:29.245213 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 759/1532] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:29 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:51:29.268814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1afebc86-6f64-4bb4-a87e-56877f4ea22b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:29.270740 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7544bf1a-8775-432b-97cb-23a2e2a71d57 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044642 Aug 10 12:51:29.270995 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1afebc86-6f64-4bb4-a87e-56877f4ea22b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:29.271509 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 774/1533] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:29 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:29.277311 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1afebc86-6f64-4bb4-a87e-56877f4ea22b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:29.277786 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1afebc86-6f64-4bb4-a87e-56877f4ea22b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:29.278216 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1afebc86-6f64-4bb4-a87e-56877f4ea22b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:29.278913 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1afebc86-6f64-4bb4-a87e-56877f4ea22b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:29.279389 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1afebc86-6f64-4bb4-a87e-56877f4ea22b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:29.279807 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1afebc86-6f64-4bb4-a87e-56877f4ea22b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:29.309145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1afebc86-6f64-4bb4-a87e-56877f4ea22b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044861 Aug 10 12:51:29.309693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 760/1534] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:29 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:30.193566 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bb65861b-36c9-45c0-a07d-109bbe7fee3a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:30.195731 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bb65861b-36c9-45c0-a07d-109bbe7fee3a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:30.202113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb65861b-36c9-45c0-a07d-109bbe7fee3a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:30.202597 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb65861b-36c9-45c0-a07d-109bbe7fee3a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:30.203038 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb65861b-36c9-45c0-a07d-109bbe7fee3a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:30.203764 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb65861b-36c9-45c0-a07d-109bbe7fee3a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:30.204217 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb65861b-36c9-45c0-a07d-109bbe7fee3a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:30.204642 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb65861b-36c9-45c0-a07d-109bbe7fee3a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:30.233187 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bb65861b-36c9-45c0-a07d-109bbe7fee3a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044296 Aug 10 12:51:30.233738 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 775/1535] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:30 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:30.257429 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4c5f06ab-a531-4991-b4e3-6eebae26ee32 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:30.259579 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4c5f06ab-a531-4991-b4e3-6eebae26ee32 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:30.265954 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4c5f06ab-a531-4991-b4e3-6eebae26ee32 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:30.266430 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4c5f06ab-a531-4991-b4e3-6eebae26ee32 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:30.266860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4c5f06ab-a531-4991-b4e3-6eebae26ee32 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:30.267585 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4c5f06ab-a531-4991-b4e3-6eebae26ee32 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:30.268090 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4c5f06ab-a531-4991-b4e3-6eebae26ee32 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:30.268090 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4c5f06ab-a531-4991-b4e3-6eebae26ee32 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:30.283226 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9ec09fed-235a-484a-b935-79d95898e449 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:30.285542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9ec09fed-235a-484a-b935-79d95898e449 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:30.291435 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ec09fed-235a-484a-b935-79d95898e449 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:30.291923 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ec09fed-235a-484a-b935-79d95898e449 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:30.292357 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ec09fed-235a-484a-b935-79d95898e449 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:30.293058 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ec09fed-235a-484a-b935-79d95898e449 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:30.293508 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ec09fed-235a-484a-b935-79d95898e449 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:30.293933 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ec09fed-235a-484a-b935-79d95898e449 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:30.297882 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4c5f06ab-a531-4991-b4e3-6eebae26ee32 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044329 Aug 10 12:51:30.298620 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 761/1536] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:30 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:51:30.321852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6343d0b9-a755-4450-a15e-326e49f991dd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:30.323755 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9ec09fed-235a-484a-b935-79d95898e449 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044649 Aug 10 12:51:30.323985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6343d0b9-a755-4450-a15e-326e49f991dd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:30.324322 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 776/1537] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:30 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:30.329841 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6343d0b9-a755-4450-a15e-326e49f991dd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:30.330356 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6343d0b9-a755-4450-a15e-326e49f991dd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:30.330789 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6343d0b9-a755-4450-a15e-326e49f991dd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:30.331506 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6343d0b9-a755-4450-a15e-326e49f991dd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:30.331976 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6343d0b9-a755-4450-a15e-326e49f991dd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:30.332380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6343d0b9-a755-4450-a15e-326e49f991dd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:30.360351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6343d0b9-a755-4450-a15e-326e49f991dd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042375 Aug 10 12:51:30.360887 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 762/1538] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:30 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:31.246264 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1be1f38f-05b0-4301-81fa-551b367b8459 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:31.248376 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1be1f38f-05b0-4301-81fa-551b367b8459 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:31.254908 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1be1f38f-05b0-4301-81fa-551b367b8459 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:31.255443 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1be1f38f-05b0-4301-81fa-551b367b8459 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:31.255885 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1be1f38f-05b0-4301-81fa-551b367b8459 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:31.256585 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1be1f38f-05b0-4301-81fa-551b367b8459 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:31.257034 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1be1f38f-05b0-4301-81fa-551b367b8459 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:31.257457 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1be1f38f-05b0-4301-81fa-551b367b8459 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:31.287670 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1be1f38f-05b0-4301-81fa-551b367b8459 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045599 Aug 10 12:51:31.288230 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 777/1539] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:31 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:31.309892 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c2743103-46e5-4813-9534-0d86189bfadb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:31.312072 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c2743103-46e5-4813-9534-0d86189bfadb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:31.314494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=96 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:51:31.319699 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2743103-46e5-4813-9534-0d86189bfadb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:31.320185 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2743103-46e5-4813-9534-0d86189bfadb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:31.320648 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2743103-46e5-4813-9534-0d86189bfadb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:31.321334 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2743103-46e5-4813-9534-0d86189bfadb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:31.321789 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2743103-46e5-4813-9534-0d86189bfadb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:31.322210 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2743103-46e5-4813-9534-0d86189bfadb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:31.325797 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:51:31.335575 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4c0d3088-85aa-4fdd-8efa-885f194a62e9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:31.337700 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4c0d3088-85aa-4fdd-8efa-885f194a62e9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:31.343783 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c0d3088-85aa-4fdd-8efa-885f194a62e9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:31.344399 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c0d3088-85aa-4fdd-8efa-885f194a62e9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:31.344842 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c0d3088-85aa-4fdd-8efa-885f194a62e9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:31.345539 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c0d3088-85aa-4fdd-8efa-885f194a62e9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:31.346021 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c0d3088-85aa-4fdd-8efa-885f194a62e9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:31.346449 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c0d3088-85aa-4fdd-8efa-885f194a62e9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:31.353326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c2743103-46e5-4813-9534-0d86189bfadb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047336 Aug 10 12:51:31.353876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 763/1540] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:31 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:51:31.371997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2e3d4cb5-601b-4b4c-83ee-73710c230d89 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:31.374306 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2e3d4cb5-601b-4b4c-83ee-73710c230d89 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:31.375894 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4c0d3088-85aa-4fdd-8efa-885f194a62e9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044133 Aug 10 12:51:31.376461 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 778/1541] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:31 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:31.381717 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e3d4cb5-601b-4b4c-83ee-73710c230d89 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:31.382191 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e3d4cb5-601b-4b4c-83ee-73710c230d89 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:31.382640 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e3d4cb5-601b-4b4c-83ee-73710c230d89 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:31.383360 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e3d4cb5-601b-4b4c-83ee-73710c230d89 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:31.383811 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e3d4cb5-601b-4b4c-83ee-73710c230d89 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:31.384224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e3d4cb5-601b-4b4c-83ee-73710c230d89 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:31.413192 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2e3d4cb5-601b-4b4c-83ee-73710c230d89 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044998 Aug 10 12:51:31.413736 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 764/1542] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:31 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:32.300319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-742c1753-9bbb-42f2-9e32-2bb78da2aa21 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:32.302481 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-742c1753-9bbb-42f2-9e32-2bb78da2aa21 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:32.308881 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-742c1753-9bbb-42f2-9e32-2bb78da2aa21 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:32.309362 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-742c1753-9bbb-42f2-9e32-2bb78da2aa21 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:32.309798 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-742c1753-9bbb-42f2-9e32-2bb78da2aa21 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:32.310487 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-742c1753-9bbb-42f2-9e32-2bb78da2aa21 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:32.310937 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-742c1753-9bbb-42f2-9e32-2bb78da2aa21 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:32.311463 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-742c1753-9bbb-42f2-9e32-2bb78da2aa21 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:32.325343 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:51:32.340645 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-742c1753-9bbb-42f2-9e32-2bb78da2aa21 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044780 Aug 10 12:51:32.345343 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 779/1543] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:32 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:32.366602 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-967d126b-4a0d-44e6-8e12-810d2b340e89 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:32.368764 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-967d126b-4a0d-44e6-8e12-810d2b340e89 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:32.375062 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-967d126b-4a0d-44e6-8e12-810d2b340e89 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:32.375679 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-967d126b-4a0d-44e6-8e12-810d2b340e89 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:32.376106 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-967d126b-4a0d-44e6-8e12-810d2b340e89 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:32.376785 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-967d126b-4a0d-44e6-8e12-810d2b340e89 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:32.378149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-967d126b-4a0d-44e6-8e12-810d2b340e89 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:32.378745 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-967d126b-4a0d-44e6-8e12-810d2b340e89 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:32.388138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-eb49c855-a0e6-4740-9d8f-513381c829e5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:32.390253 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-eb49c855-a0e6-4740-9d8f-513381c829e5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:32.396748 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eb49c855-a0e6-4740-9d8f-513381c829e5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:32.397225 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eb49c855-a0e6-4740-9d8f-513381c829e5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:32.397657 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eb49c855-a0e6-4740-9d8f-513381c829e5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:32.398343 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eb49c855-a0e6-4740-9d8f-513381c829e5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:32.398795 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eb49c855-a0e6-4740-9d8f-513381c829e5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:32.399237 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eb49c855-a0e6-4740-9d8f-513381c829e5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:32.407567 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-967d126b-4a0d-44e6-8e12-810d2b340e89 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045606 Aug 10 12:51:32.408472 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 765/1544] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:32 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:51:32.426293 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fe262a09-f604-44cb-ac38-80f194215213 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:32.428226 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-eb49c855-a0e6-4740-9d8f-513381c829e5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043894 Aug 10 12:51:32.428411 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fe262a09-f604-44cb-ac38-80f194215213 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:32.428794 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 780/1545] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:32 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:32.434293 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe262a09-f604-44cb-ac38-80f194215213 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:32.434767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe262a09-f604-44cb-ac38-80f194215213 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:32.435227 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe262a09-f604-44cb-ac38-80f194215213 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:32.435899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe262a09-f604-44cb-ac38-80f194215213 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:32.436341 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe262a09-f604-44cb-ac38-80f194215213 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:32.436759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe262a09-f604-44cb-ac38-80f194215213 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:32.465122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fe262a09-f604-44cb-ac38-80f194215213 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043196 Aug 10 12:51:32.465655 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 766/1546] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:32 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:33.353748 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-454f7a64-3d8e-43e6-9064-3fd2ae456733 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:33.356095 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-454f7a64-3d8e-43e6-9064-3fd2ae456733 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:33.362502 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-454f7a64-3d8e-43e6-9064-3fd2ae456733 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:33.363211 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-454f7a64-3d8e-43e6-9064-3fd2ae456733 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:33.363690 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-454f7a64-3d8e-43e6-9064-3fd2ae456733 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:33.364380 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-454f7a64-3d8e-43e6-9064-3fd2ae456733 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:33.364832 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-454f7a64-3d8e-43e6-9064-3fd2ae456733 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:33.365254 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-454f7a64-3d8e-43e6-9064-3fd2ae456733 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:33.393045 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-454f7a64-3d8e-43e6-9064-3fd2ae456733 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043358 Aug 10 12:51:33.393591 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 781/1547] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:33 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:33.420117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2d49ede7-222a-49f7-b06c-3d68de20adf0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:33.422295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2d49ede7-222a-49f7-b06c-3d68de20adf0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:33.428759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2d49ede7-222a-49f7-b06c-3d68de20adf0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:33.429241 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2d49ede7-222a-49f7-b06c-3d68de20adf0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:33.429669 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2d49ede7-222a-49f7-b06c-3d68de20adf0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:33.430357 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2d49ede7-222a-49f7-b06c-3d68de20adf0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:33.430804 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2d49ede7-222a-49f7-b06c-3d68de20adf0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:33.431248 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2d49ede7-222a-49f7-b06c-3d68de20adf0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:33.440213 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5d85dc4e-d4dd-4c47-a463-e574fda2ccb2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:33.443061 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5d85dc4e-d4dd-4c47-a463-e574fda2ccb2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:33.448936 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d85dc4e-d4dd-4c47-a463-e574fda2ccb2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:33.449423 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d85dc4e-d4dd-4c47-a463-e574fda2ccb2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:33.449864 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d85dc4e-d4dd-4c47-a463-e574fda2ccb2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:33.450560 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d85dc4e-d4dd-4c47-a463-e574fda2ccb2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:33.451013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d85dc4e-d4dd-4c47-a463-e574fda2ccb2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:33.451468 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d85dc4e-d4dd-4c47-a463-e574fda2ccb2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:33.461543 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2d49ede7-222a-49f7-b06c-3d68de20adf0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045285 Aug 10 12:51:33.462308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 767/1548] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:33 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:51:33.477113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-298881df-0a2b-477e-b124-f8927c967b0d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:33.479291 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-298881df-0a2b-477e-b124-f8927c967b0d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:33.482280 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5d85dc4e-d4dd-4c47-a463-e574fda2ccb2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045892 Aug 10 12:51:33.482850 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 782/1549] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:33 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:33.485704 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-298881df-0a2b-477e-b124-f8927c967b0d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:33.486186 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-298881df-0a2b-477e-b124-f8927c967b0d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:33.486638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-298881df-0a2b-477e-b124-f8927c967b0d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:33.487351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-298881df-0a2b-477e-b124-f8927c967b0d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:33.487810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-298881df-0a2b-477e-b124-f8927c967b0d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:33.488235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-298881df-0a2b-477e-b124-f8927c967b0d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:33.516905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-298881df-0a2b-477e-b124-f8927c967b0d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043663 Aug 10 12:51:33.517450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 768/1550] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:33 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:34.406187 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-dc691b9a-dff1-4b35-8221-1b928ca5ef85 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:34.408316 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-dc691b9a-dff1-4b35-8221-1b928ca5ef85 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:34.415135 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc691b9a-dff1-4b35-8221-1b928ca5ef85 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:34.415645 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc691b9a-dff1-4b35-8221-1b928ca5ef85 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:34.416080 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc691b9a-dff1-4b35-8221-1b928ca5ef85 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:34.416764 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc691b9a-dff1-4b35-8221-1b928ca5ef85 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:34.417212 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc691b9a-dff1-4b35-8221-1b928ca5ef85 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:34.417631 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc691b9a-dff1-4b35-8221-1b928ca5ef85 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:34.446530 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-dc691b9a-dff1-4b35-8221-1b928ca5ef85 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044473 Aug 10 12:51:34.447085 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 783/1551] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:34 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:34.474620 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bf88f535-4e97-4f4f-b40c-1795da0fe1c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:34.476832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bf88f535-4e97-4f4f-b40c-1795da0fe1c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:34.483420 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf88f535-4e97-4f4f-b40c-1795da0fe1c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:34.483947 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf88f535-4e97-4f4f-b40c-1795da0fe1c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:34.484400 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf88f535-4e97-4f4f-b40c-1795da0fe1c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:34.485090 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf88f535-4e97-4f4f-b40c-1795da0fe1c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:34.485542 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf88f535-4e97-4f4f-b40c-1795da0fe1c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:34.485965 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf88f535-4e97-4f4f-b40c-1795da0fe1c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:34.494506 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b0445534-3e0f-4788-9595-d8ba8cde73e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:34.496767 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b0445534-3e0f-4788-9595-d8ba8cde73e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:34.502625 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b0445534-3e0f-4788-9595-d8ba8cde73e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:34.503105 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b0445534-3e0f-4788-9595-d8ba8cde73e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:34.503579 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b0445534-3e0f-4788-9595-d8ba8cde73e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:34.504350 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b0445534-3e0f-4788-9595-d8ba8cde73e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:34.504835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b0445534-3e0f-4788-9595-d8ba8cde73e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:34.505285 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b0445534-3e0f-4788-9595-d8ba8cde73e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:34.515335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bf88f535-4e97-4f4f-b40c-1795da0fe1c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045440 Aug 10 12:51:34.515904 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 769/1552] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:34 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:51:34.528343 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6623674e-6d75-44b6-afc5-b6eb14680fee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:34.530449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6623674e-6d75-44b6-afc5-b6eb14680fee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:34.535121 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b0445534-3e0f-4788-9595-d8ba8cde73e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043882 Aug 10 12:51:34.535922 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 784/1553] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:34 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:34.537048 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6623674e-6d75-44b6-afc5-b6eb14680fee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:34.537532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6623674e-6d75-44b6-afc5-b6eb14680fee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:34.537968 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6623674e-6d75-44b6-afc5-b6eb14680fee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:34.538666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6623674e-6d75-44b6-afc5-b6eb14680fee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:34.539117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6623674e-6d75-44b6-afc5-b6eb14680fee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:34.539564 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6623674e-6d75-44b6-afc5-b6eb14680fee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:34.567925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6623674e-6d75-44b6-afc5-b6eb14680fee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043422 Aug 10 12:51:34.568471 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 770/1554] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:34 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:35.458160 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e771c388-4890-49ec-8f26-889bc6e0f283 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:35.460238 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e771c388-4890-49ec-8f26-889bc6e0f283 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:35.466600 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e771c388-4890-49ec-8f26-889bc6e0f283 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:35.467078 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e771c388-4890-49ec-8f26-889bc6e0f283 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:35.467549 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e771c388-4890-49ec-8f26-889bc6e0f283 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:35.468237 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e771c388-4890-49ec-8f26-889bc6e0f283 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:35.468714 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e771c388-4890-49ec-8f26-889bc6e0f283 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:35.469134 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e771c388-4890-49ec-8f26-889bc6e0f283 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:35.498195 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e771c388-4890-49ec-8f26-889bc6e0f283 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044180 Aug 10 12:51:35.498942 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 785/1555] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:35 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:35.528552 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b8eb8022-9ee4-4437-92da-0defc8c504c9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:35.530694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b8eb8022-9ee4-4437-92da-0defc8c504c9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:35.537656 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8eb8022-9ee4-4437-92da-0defc8c504c9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:35.538122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8eb8022-9ee4-4437-92da-0defc8c504c9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:35.538548 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8eb8022-9ee4-4437-92da-0defc8c504c9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:35.539256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8eb8022-9ee4-4437-92da-0defc8c504c9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:35.539699 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8eb8022-9ee4-4437-92da-0defc8c504c9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:35.540114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8eb8022-9ee4-4437-92da-0defc8c504c9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:35.547154 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7123800a-d9ce-4a43-89e4-4ea056e69f49 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:35.549328 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7123800a-d9ce-4a43-89e4-4ea056e69f49 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:35.555813 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7123800a-d9ce-4a43-89e4-4ea056e69f49 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:35.556295 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7123800a-d9ce-4a43-89e4-4ea056e69f49 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:35.556729 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7123800a-d9ce-4a43-89e4-4ea056e69f49 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:35.557456 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7123800a-d9ce-4a43-89e4-4ea056e69f49 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:35.557912 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7123800a-d9ce-4a43-89e4-4ea056e69f49 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:35.558341 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7123800a-d9ce-4a43-89e4-4ea056e69f49 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:35.571093 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b8eb8022-9ee4-4437-92da-0defc8c504c9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046817 Aug 10 12:51:35.575576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 771/1556] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 10 12:51:35 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:51:35.579664 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a1f59d17-6b6f-4764-8aee-6ed897b0db48 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:35.582361 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a1f59d17-6b6f-4764-8aee-6ed897b0db48 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:35.588159 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7123800a-d9ce-4a43-89e4-4ea056e69f49 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044829 Aug 10 12:51:35.588324 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a1f59d17-6b6f-4764-8aee-6ed897b0db48 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:35.588644 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a1f59d17-6b6f-4764-8aee-6ed897b0db48 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:35.588762 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 786/1557] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:35 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:35.589144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a1f59d17-6b6f-4764-8aee-6ed897b0db48 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:35.589900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a1f59d17-6b6f-4764-8aee-6ed897b0db48 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:35.590348 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a1f59d17-6b6f-4764-8aee-6ed897b0db48 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:35.590765 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a1f59d17-6b6f-4764-8aee-6ed897b0db48 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:35.620304 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a1f59d17-6b6f-4764-8aee-6ed897b0db48 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044362 Aug 10 12:51:35.620842 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 772/1558] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:35 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:36.510514 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d8d2b785-eadc-4b29-bd89-88d79dec5e27 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:36.512688 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d8d2b785-eadc-4b29-bd89-88d79dec5e27 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:36.519759 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d8d2b785-eadc-4b29-bd89-88d79dec5e27 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:36.520237 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d8d2b785-eadc-4b29-bd89-88d79dec5e27 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:36.520677 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d8d2b785-eadc-4b29-bd89-88d79dec5e27 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:36.521368 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d8d2b785-eadc-4b29-bd89-88d79dec5e27 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:36.521817 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d8d2b785-eadc-4b29-bd89-88d79dec5e27 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:36.522241 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d8d2b785-eadc-4b29-bd89-88d79dec5e27 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:36.550810 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d8d2b785-eadc-4b29-bd89-88d79dec5e27 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044109 Aug 10 12:51:36.551407 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 787/1559] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:36 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:36.584480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-06f081c5-5885-443f-8fa6-4aff41df2647 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:51:36.586799 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-06f081c5-5885-443f-8fa6-4aff41df2647 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:36.593179 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-06f081c5-5885-443f-8fa6-4aff41df2647 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:36.593659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-06f081c5-5885-443f-8fa6-4aff41df2647 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:36.594094 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-06f081c5-5885-443f-8fa6-4aff41df2647 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:36.594874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-06f081c5-5885-443f-8fa6-4aff41df2647 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:36.595404 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-06f081c5-5885-443f-8fa6-4aff41df2647 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:36.595829 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-06f081c5-5885-443f-8fa6-4aff41df2647 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:36.601355 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7c9b7c2f-5406-4f0f-80ad-5cca34b661bc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:36.603501 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7c9b7c2f-5406-4f0f-80ad-5cca34b661bc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:36.609712 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c9b7c2f-5406-4f0f-80ad-5cca34b661bc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:36.610189 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c9b7c2f-5406-4f0f-80ad-5cca34b661bc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:36.610615 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c9b7c2f-5406-4f0f-80ad-5cca34b661bc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:36.611326 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c9b7c2f-5406-4f0f-80ad-5cca34b661bc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:36.611766 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c9b7c2f-5406-4f0f-80ad-5cca34b661bc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:36.612196 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c9b7c2f-5406-4f0f-80ad-5cca34b661bc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:36.642551 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7c9b7c2f-5406-4f0f-80ad-5cca34b661bc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045672 Aug 10 12:51:36.643106 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 788/1560] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:36 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:36.648253 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ba82382a-9d79-486a-b9c0-a712b8785971 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:36.650324 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ba82382a-9d79-486a-b9c0-a712b8785971 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:36.656066 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ba82382a-9d79-486a-b9c0-a712b8785971 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:36.656552 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ba82382a-9d79-486a-b9c0-a712b8785971 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:36.656983 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ba82382a-9d79-486a-b9c0-a712b8785971 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:36.657765 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ba82382a-9d79-486a-b9c0-a712b8785971 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:36.658221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ba82382a-9d79-486a-b9c0-a712b8785971 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:36.658640 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ba82382a-9d79-486a-b9c0-a712b8785971 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:36.674880 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-06f081c5-5885-443f-8fa6-4aff41df2647 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "POST /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/action" status: 200 len: 38145 microversion: 2.20 time: 0.095309 Aug 10 12:51:36.675593 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 773/1561] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Aug 10 12:51:36 2022] POST /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5/action => generated 38145 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 12:51:36.688945 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ba82382a-9d79-486a-b9c0-a712b8785971 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044777 Aug 10 12:51:36.689507 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 789/1562] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:36 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:37.562848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7f63a0a1-a7f1-435b-b0de-ef990160cc2f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:37.565077 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7f63a0a1-a7f1-435b-b0de-ef990160cc2f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:37.572070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f63a0a1-a7f1-435b-b0de-ef990160cc2f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:37.572552 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f63a0a1-a7f1-435b-b0de-ef990160cc2f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:37.572998 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f63a0a1-a7f1-435b-b0de-ef990160cc2f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:37.573689 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f63a0a1-a7f1-435b-b0de-ef990160cc2f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:37.574142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f63a0a1-a7f1-435b-b0de-ef990160cc2f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:37.574567 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f63a0a1-a7f1-435b-b0de-ef990160cc2f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:37.605801 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7f63a0a1-a7f1-435b-b0de-ef990160cc2f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047303 Aug 10 12:51:37.606439 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 774/1563] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:37 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:37.655734 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b2dc4cc6-b377-44ab-a0f1-afc9a598b83b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:37.657940 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b2dc4cc6-b377-44ab-a0f1-afc9a598b83b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:37.664778 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2dc4cc6-b377-44ab-a0f1-afc9a598b83b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:37.665259 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2dc4cc6-b377-44ab-a0f1-afc9a598b83b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:37.665688 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2dc4cc6-b377-44ab-a0f1-afc9a598b83b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:37.666374 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2dc4cc6-b377-44ab-a0f1-afc9a598b83b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:37.666818 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2dc4cc6-b377-44ab-a0f1-afc9a598b83b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:37.667254 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2dc4cc6-b377-44ab-a0f1-afc9a598b83b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:37.695129 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b2dc4cc6-b377-44ab-a0f1-afc9a598b83b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043264 Aug 10 12:51:37.695695 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 790/1564] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:37 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:37.701738 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c42b031b-ceee-4a0b-9552-c59ba8d8da35 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:37.703898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c42b031b-ceee-4a0b-9552-c59ba8d8da35 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:37.710991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c42b031b-ceee-4a0b-9552-c59ba8d8da35 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:37.711512 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c42b031b-ceee-4a0b-9552-c59ba8d8da35 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:37.711934 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c42b031b-ceee-4a0b-9552-c59ba8d8da35 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:37.712621 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c42b031b-ceee-4a0b-9552-c59ba8d8da35 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:37.713070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c42b031b-ceee-4a0b-9552-c59ba8d8da35 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:37.713494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c42b031b-ceee-4a0b-9552-c59ba8d8da35 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:37.742718 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c42b031b-ceee-4a0b-9552-c59ba8d8da35 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044890 Aug 10 12:51:37.743297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 775/1565] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:37 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:38.618284 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ae34109a-8d17-4b89-8662-5bb766b38f61 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:38.620461 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ae34109a-8d17-4b89-8662-5bb766b38f61 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:38.622337 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:51:38.626941 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ae34109a-8d17-4b89-8662-5bb766b38f61 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:38.635037 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ae34109a-8d17-4b89-8662-5bb766b38f61 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:38.635037 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ae34109a-8d17-4b89-8662-5bb766b38f61 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:38.635037 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ae34109a-8d17-4b89-8662-5bb766b38f61 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:38.635037 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ae34109a-8d17-4b89-8662-5bb766b38f61 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:38.635575 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ae34109a-8d17-4b89-8662-5bb766b38f61 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:38.659407 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ae34109a-8d17-4b89-8662-5bb766b38f61 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045069 Aug 10 12:51:38.660096 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 791/1566] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:38 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:38.708048 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a4e5010f-cb9e-4e6d-b992-2a29d61e08d3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:38.710287 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a4e5010f-cb9e-4e6d-b992-2a29d61e08d3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:38.716910 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4e5010f-cb9e-4e6d-b992-2a29d61e08d3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:38.717395 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4e5010f-cb9e-4e6d-b992-2a29d61e08d3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:38.717846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4e5010f-cb9e-4e6d-b992-2a29d61e08d3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:38.718531 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4e5010f-cb9e-4e6d-b992-2a29d61e08d3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:38.718982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4e5010f-cb9e-4e6d-b992-2a29d61e08d3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:38.719427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4e5010f-cb9e-4e6d-b992-2a29d61e08d3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:38.749263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a4e5010f-cb9e-4e6d-b992-2a29d61e08d3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045794 Aug 10 12:51:38.750013 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 776/1567] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:38 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:38.754580 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-83c9f97e-bcfa-4326-ab27-ea19a3e2de1b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:38.756815 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-83c9f97e-bcfa-4326-ab27-ea19a3e2de1b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:38.762944 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83c9f97e-bcfa-4326-ab27-ea19a3e2de1b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:38.763875 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83c9f97e-bcfa-4326-ab27-ea19a3e2de1b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:38.763875 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83c9f97e-bcfa-4326-ab27-ea19a3e2de1b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:38.764549 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83c9f97e-bcfa-4326-ab27-ea19a3e2de1b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:38.764998 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83c9f97e-bcfa-4326-ab27-ea19a3e2de1b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:38.765421 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83c9f97e-bcfa-4326-ab27-ea19a3e2de1b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:38.794914 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-83c9f97e-bcfa-4326-ab27-ea19a3e2de1b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044757 Aug 10 12:51:38.795570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 792/1568] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:38 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:39.671598 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f30aa6ab-ff9d-4a3c-b176-ffd55fddc368 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:39.673824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f30aa6ab-ff9d-4a3c-b176-ffd55fddc368 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:39.680304 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f30aa6ab-ff9d-4a3c-b176-ffd55fddc368 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:39.680786 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f30aa6ab-ff9d-4a3c-b176-ffd55fddc368 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:39.681233 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f30aa6ab-ff9d-4a3c-b176-ffd55fddc368 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:39.681922 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f30aa6ab-ff9d-4a3c-b176-ffd55fddc368 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:39.682374 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f30aa6ab-ff9d-4a3c-b176-ffd55fddc368 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:39.682800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f30aa6ab-ff9d-4a3c-b176-ffd55fddc368 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:39.712004 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f30aa6ab-ff9d-4a3c-b176-ffd55fddc368 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044377 Aug 10 12:51:39.712644 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 777/1569] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:39 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:39.761573 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a7fed184-bd99-4a2f-b83d-3c7551abd401 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:39.763764 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a7fed184-bd99-4a2f-b83d-3c7551abd401 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:39.770858 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a7fed184-bd99-4a2f-b83d-3c7551abd401 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:39.771357 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a7fed184-bd99-4a2f-b83d-3c7551abd401 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:39.771788 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a7fed184-bd99-4a2f-b83d-3c7551abd401 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:39.772472 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a7fed184-bd99-4a2f-b83d-3c7551abd401 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:39.772921 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a7fed184-bd99-4a2f-b83d-3c7551abd401 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:39.773343 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a7fed184-bd99-4a2f-b83d-3c7551abd401 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:39.802267 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a7fed184-bd99-4a2f-b83d-3c7551abd401 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044637 Aug 10 12:51:39.802822 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 793/1570] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:39 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:39.806232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0caa36a2-e556-4a93-8eea-9bddbcf63147 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:39.808381 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0caa36a2-e556-4a93-8eea-9bddbcf63147 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:39.814232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0caa36a2-e556-4a93-8eea-9bddbcf63147 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:39.814708 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0caa36a2-e556-4a93-8eea-9bddbcf63147 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:39.815143 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0caa36a2-e556-4a93-8eea-9bddbcf63147 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:39.815854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0caa36a2-e556-4a93-8eea-9bddbcf63147 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:39.816342 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0caa36a2-e556-4a93-8eea-9bddbcf63147 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:39.817003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0caa36a2-e556-4a93-8eea-9bddbcf63147 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:39.845538 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0caa36a2-e556-4a93-8eea-9bddbcf63147 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043292 Aug 10 12:51:39.846064 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 778/1571] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:39 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:40.724940 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f8eb8d57-a235-4dd3-9407-fbbee258e769 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:40.727053 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f8eb8d57-a235-4dd3-9407-fbbee258e769 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:40.733163 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f8eb8d57-a235-4dd3-9407-fbbee258e769 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:40.733635 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f8eb8d57-a235-4dd3-9407-fbbee258e769 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:40.734062 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f8eb8d57-a235-4dd3-9407-fbbee258e769 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:40.734742 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f8eb8d57-a235-4dd3-9407-fbbee258e769 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:40.735212 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f8eb8d57-a235-4dd3-9407-fbbee258e769 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:40.735635 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f8eb8d57-a235-4dd3-9407-fbbee258e769 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:40.763740 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f8eb8d57-a235-4dd3-9407-fbbee258e769 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043462 Aug 10 12:51:40.764343 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 794/1572] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:40 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:40.814350 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2a542178-7c6e-4e93-a387-30bb6c4fa502 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:40.816515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2a542178-7c6e-4e93-a387-30bb6c4fa502 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:40.822809 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a542178-7c6e-4e93-a387-30bb6c4fa502 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:40.823321 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a542178-7c6e-4e93-a387-30bb6c4fa502 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:40.823758 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a542178-7c6e-4e93-a387-30bb6c4fa502 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:40.824448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a542178-7c6e-4e93-a387-30bb6c4fa502 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:40.824894 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a542178-7c6e-4e93-a387-30bb6c4fa502 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:40.825313 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a542178-7c6e-4e93-a387-30bb6c4fa502 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:40.855234 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2a542178-7c6e-4e93-a387-30bb6c4fa502 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044539 Aug 10 12:51:40.855793 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 779/1573] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:40 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:40.858225 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-55f6e85e-914a-4864-a13a-40079768eaba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:40.860390 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-55f6e85e-914a-4864-a13a-40079768eaba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:40.867600 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-55f6e85e-914a-4864-a13a-40079768eaba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:40.868086 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-55f6e85e-914a-4864-a13a-40079768eaba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:40.868520 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-55f6e85e-914a-4864-a13a-40079768eaba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:40.869212 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-55f6e85e-914a-4864-a13a-40079768eaba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:40.873050 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-55f6e85e-914a-4864-a13a-40079768eaba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:40.873050 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-55f6e85e-914a-4864-a13a-40079768eaba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:40.900306 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-55f6e85e-914a-4864-a13a-40079768eaba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046195 Aug 10 12:51:40.900870 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 795/1574] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:40 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:41.776047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-efb820f7-4155-4520-b7b2-1577a80e2241 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:41.778178 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-efb820f7-4155-4520-b7b2-1577a80e2241 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:41.784683 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-efb820f7-4155-4520-b7b2-1577a80e2241 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:41.785159 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-efb820f7-4155-4520-b7b2-1577a80e2241 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:41.785590 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-efb820f7-4155-4520-b7b2-1577a80e2241 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:41.786274 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-efb820f7-4155-4520-b7b2-1577a80e2241 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:41.786726 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-efb820f7-4155-4520-b7b2-1577a80e2241 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:41.787145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-efb820f7-4155-4520-b7b2-1577a80e2241 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:41.789968 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:51:41.818128 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-efb820f7-4155-4520-b7b2-1577a80e2241 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045967 Aug 10 12:51:41.818719 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 780/1575] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:41 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:41.867502 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8534ab6d-f1c4-4d4a-a870-93f611d6987b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:41.869678 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8534ab6d-f1c4-4d4a-a870-93f611d6987b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:41.876039 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8534ab6d-f1c4-4d4a-a870-93f611d6987b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:41.876518 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8534ab6d-f1c4-4d4a-a870-93f611d6987b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:41.876952 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8534ab6d-f1c4-4d4a-a870-93f611d6987b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:41.877640 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8534ab6d-f1c4-4d4a-a870-93f611d6987b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:41.878090 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8534ab6d-f1c4-4d4a-a870-93f611d6987b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:41.878512 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8534ab6d-f1c4-4d4a-a870-93f611d6987b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:41.882413 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:51:41.909774 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8534ab6d-f1c4-4d4a-a870-93f611d6987b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046345 Aug 10 12:51:41.910615 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 796/1576] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:41 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:41.975988 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-09afa4a2-6585-468d-bc45-ef05cbd346c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:41.978109 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-09afa4a2-6585-468d-bc45-ef05cbd346c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:41.984259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-09afa4a2-6585-468d-bc45-ef05cbd346c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:41.984728 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-09afa4a2-6585-468d-bc45-ef05cbd346c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:41.985158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-09afa4a2-6585-468d-bc45-ef05cbd346c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:41.985835 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-09afa4a2-6585-468d-bc45-ef05cbd346c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:41.986284 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-09afa4a2-6585-468d-bc45-ef05cbd346c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:41.986707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-09afa4a2-6585-468d-bc45-ef05cbd346c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:42.015826 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-09afa4a2-6585-468d-bc45-ef05cbd346c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107283 Aug 10 12:51:42.016367 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 781/1577] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:41 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:42.830143 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-891d42e8-0f5d-4eff-8d8c-3f73342adff9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:42.832969 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-891d42e8-0f5d-4eff-8d8c-3f73342adff9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:42.839391 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-891d42e8-0f5d-4eff-8d8c-3f73342adff9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:42.839865 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-891d42e8-0f5d-4eff-8d8c-3f73342adff9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:42.840289 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-891d42e8-0f5d-4eff-8d8c-3f73342adff9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:42.840963 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-891d42e8-0f5d-4eff-8d8c-3f73342adff9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:42.841413 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-891d42e8-0f5d-4eff-8d8c-3f73342adff9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:42.841838 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-891d42e8-0f5d-4eff-8d8c-3f73342adff9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:42.871015 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-891d42e8-0f5d-4eff-8d8c-3f73342adff9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044875 Aug 10 12:51:42.871687 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 797/1578] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:42 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:42.985517 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-808e3401-60e7-4b43-a82e-07064b62c522 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:42.987655 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-808e3401-60e7-4b43-a82e-07064b62c522 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:42.993504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-808e3401-60e7-4b43-a82e-07064b62c522 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:42.993983 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-808e3401-60e7-4b43-a82e-07064b62c522 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:42.994418 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-808e3401-60e7-4b43-a82e-07064b62c522 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:42.995101 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-808e3401-60e7-4b43-a82e-07064b62c522 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:42.995583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-808e3401-60e7-4b43-a82e-07064b62c522 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:42.996006 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-808e3401-60e7-4b43-a82e-07064b62c522 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:43.024497 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-808e3401-60e7-4b43-a82e-07064b62c522 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106231 Aug 10 12:51:43.025049 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 782/1579] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:42 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:43.028025 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0ecc27cd-7b4d-4c7c-93ad-f6038bbcfa3a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:43.030194 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0ecc27cd-7b4d-4c7c-93ad-f6038bbcfa3a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:43.037693 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ecc27cd-7b4d-4c7c-93ad-f6038bbcfa3a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:43.038168 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ecc27cd-7b4d-4c7c-93ad-f6038bbcfa3a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:43.038597 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ecc27cd-7b4d-4c7c-93ad-f6038bbcfa3a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:43.039302 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ecc27cd-7b4d-4c7c-93ad-f6038bbcfa3a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:43.039753 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ecc27cd-7b4d-4c7c-93ad-f6038bbcfa3a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:43.040167 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ecc27cd-7b4d-4c7c-93ad-f6038bbcfa3a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:43.068413 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0ecc27cd-7b4d-4c7c-93ad-f6038bbcfa3a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044569 Aug 10 12:51:43.068963 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 798/1580] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:43 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:43.884017 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-131b56c5-acc5-4050-aa19-c781f2b53905 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:43.886193 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-131b56c5-acc5-4050-aa19-c781f2b53905 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:43.892114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-131b56c5-acc5-4050-aa19-c781f2b53905 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:43.892598 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-131b56c5-acc5-4050-aa19-c781f2b53905 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:43.893037 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-131b56c5-acc5-4050-aa19-c781f2b53905 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:43.893727 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-131b56c5-acc5-4050-aa19-c781f2b53905 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:43.894180 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-131b56c5-acc5-4050-aa19-c781f2b53905 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:43.894674 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-131b56c5-acc5-4050-aa19-c781f2b53905 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:43.923296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-131b56c5-acc5-4050-aa19-c781f2b53905 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044037 Aug 10 12:51:43.923874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 783/1581] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:43 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:44.037655 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ee722ec0-43f0-4a2a-afa4-051494bd47fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:44.039830 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ee722ec0-43f0-4a2a-afa4-051494bd47fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:44.046343 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee722ec0-43f0-4a2a-afa4-051494bd47fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:44.046761 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee722ec0-43f0-4a2a-afa4-051494bd47fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:44.047205 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee722ec0-43f0-4a2a-afa4-051494bd47fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:44.047893 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee722ec0-43f0-4a2a-afa4-051494bd47fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:44.048335 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee722ec0-43f0-4a2a-afa4-051494bd47fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:44.048753 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee722ec0-43f0-4a2a-afa4-051494bd47fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:44.078194 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ee722ec0-43f0-4a2a-afa4-051494bd47fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045556 Aug 10 12:51:44.078740 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 799/1582] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:44 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:44.080830 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-73f2689b-48e8-4bdc-9c82-4490a9654a73 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:44.082989 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-73f2689b-48e8-4bdc-9c82-4490a9654a73 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:44.089331 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73f2689b-48e8-4bdc-9c82-4490a9654a73 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:44.089805 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73f2689b-48e8-4bdc-9c82-4490a9654a73 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:44.090238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73f2689b-48e8-4bdc-9c82-4490a9654a73 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:44.090953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73f2689b-48e8-4bdc-9c82-4490a9654a73 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:44.091428 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73f2689b-48e8-4bdc-9c82-4490a9654a73 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:44.091851 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73f2689b-48e8-4bdc-9c82-4490a9654a73 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:44.122091 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-73f2689b-48e8-4bdc-9c82-4490a9654a73 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045217 Aug 10 12:51:44.122632 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 784/1583] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:44 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:44.936310 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-70149e02-1864-4982-a238-750e1fa36ad8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:44.938546 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-70149e02-1864-4982-a238-750e1fa36ad8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:44.945368 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70149e02-1864-4982-a238-750e1fa36ad8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:44.945848 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70149e02-1864-4982-a238-750e1fa36ad8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:44.946280 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70149e02-1864-4982-a238-750e1fa36ad8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:44.946987 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70149e02-1864-4982-a238-750e1fa36ad8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:44.947456 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70149e02-1864-4982-a238-750e1fa36ad8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:44.947874 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70149e02-1864-4982-a238-750e1fa36ad8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:44.977012 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-70149e02-1864-4982-a238-750e1fa36ad8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044685 Aug 10 12:51:44.977559 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 800/1584] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:44 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:45.089746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-52330ed1-ba34-43b8-a0cc-05bf728f24b9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:45.091938 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-52330ed1-ba34-43b8-a0cc-05bf728f24b9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:45.098643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-52330ed1-ba34-43b8-a0cc-05bf728f24b9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:45.099120 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-52330ed1-ba34-43b8-a0cc-05bf728f24b9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:45.099581 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-52330ed1-ba34-43b8-a0cc-05bf728f24b9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:45.100258 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-52330ed1-ba34-43b8-a0cc-05bf728f24b9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:45.100701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-52330ed1-ba34-43b8-a0cc-05bf728f24b9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:45.101113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-52330ed1-ba34-43b8-a0cc-05bf728f24b9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:45.130522 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-52330ed1-ba34-43b8-a0cc-05bf728f24b9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044679 Aug 10 12:51:45.131257 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 785/1585] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:45 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:45.134843 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5d3d743a-8197-4e28-8da0-c455791ef13a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:45.136991 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5d3d743a-8197-4e28-8da0-c455791ef13a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:45.143502 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d3d743a-8197-4e28-8da0-c455791ef13a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:45.143978 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d3d743a-8197-4e28-8da0-c455791ef13a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:45.144453 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d3d743a-8197-4e28-8da0-c455791ef13a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:45.145228 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d3d743a-8197-4e28-8da0-c455791ef13a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:45.145678 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d3d743a-8197-4e28-8da0-c455791ef13a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:45.146097 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5d3d743a-8197-4e28-8da0-c455791ef13a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:45.173878 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5d3d743a-8197-4e28-8da0-c455791ef13a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043023 Aug 10 12:51:45.174419 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 801/1586] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:45 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:45.990010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6ed94a47-5cd0-415a-8d05-276113a2948e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:45.992210 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6ed94a47-5cd0-415a-8d05-276113a2948e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:45.998070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ed94a47-5cd0-415a-8d05-276113a2948e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:45.998550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ed94a47-5cd0-415a-8d05-276113a2948e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:45.998986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ed94a47-5cd0-415a-8d05-276113a2948e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:45.999698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ed94a47-5cd0-415a-8d05-276113a2948e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:46.000152 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ed94a47-5cd0-415a-8d05-276113a2948e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:46.000577 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ed94a47-5cd0-415a-8d05-276113a2948e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:46.029366 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6ed94a47-5cd0-415a-8d05-276113a2948e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043864 Aug 10 12:51:46.029933 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 786/1587] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:45 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:46.141938 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8169a16b-901f-4bb1-8aa2-40e1883d5ea8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:46.144126 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8169a16b-901f-4bb1-8aa2-40e1883d5ea8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:46.150485 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8169a16b-901f-4bb1-8aa2-40e1883d5ea8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:46.150965 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8169a16b-901f-4bb1-8aa2-40e1883d5ea8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:46.151436 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8169a16b-901f-4bb1-8aa2-40e1883d5ea8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:46.152126 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8169a16b-901f-4bb1-8aa2-40e1883d5ea8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:46.152608 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8169a16b-901f-4bb1-8aa2-40e1883d5ea8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:46.153032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8169a16b-901f-4bb1-8aa2-40e1883d5ea8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:46.181937 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8169a16b-901f-4bb1-8aa2-40e1883d5ea8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043971 Aug 10 12:51:46.182489 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 802/1588] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:46 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:46.186149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e43232f1-40ea-484e-9e6c-cfc1036fc411 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:46.188307 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e43232f1-40ea-484e-9e6c-cfc1036fc411 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:46.194832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e43232f1-40ea-484e-9e6c-cfc1036fc411 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:46.195355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e43232f1-40ea-484e-9e6c-cfc1036fc411 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:46.195795 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e43232f1-40ea-484e-9e6c-cfc1036fc411 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:46.196507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e43232f1-40ea-484e-9e6c-cfc1036fc411 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:46.196959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e43232f1-40ea-484e-9e6c-cfc1036fc411 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:46.197381 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e43232f1-40ea-484e-9e6c-cfc1036fc411 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:46.226358 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e43232f1-40ea-484e-9e6c-cfc1036fc411 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044455 Aug 10 12:51:46.226911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 787/1589] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:46 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:47.104236 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-caf8e6f5-7723-4474-ae0f-7647ec442379 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:47.106637 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-caf8e6f5-7723-4474-ae0f-7647ec442379 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:47.112518 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-caf8e6f5-7723-4474-ae0f-7647ec442379 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:47.112994 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-caf8e6f5-7723-4474-ae0f-7647ec442379 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:47.114146 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-caf8e6f5-7723-4474-ae0f-7647ec442379 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:47.114837 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-caf8e6f5-7723-4474-ae0f-7647ec442379 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:47.115314 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-caf8e6f5-7723-4474-ae0f-7647ec442379 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:47.115736 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-caf8e6f5-7723-4474-ae0f-7647ec442379 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:47.146372 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-caf8e6f5-7723-4474-ae0f-7647ec442379 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108621 Aug 10 12:51:47.146987 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 803/1590] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:47 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:47.194613 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9d1b129f-df6a-4172-9d76-001d4b155790 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:47.196815 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9d1b129f-df6a-4172-9d76-001d4b155790 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:47.203068 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d1b129f-df6a-4172-9d76-001d4b155790 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:47.203571 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d1b129f-df6a-4172-9d76-001d4b155790 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:47.204000 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d1b129f-df6a-4172-9d76-001d4b155790 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:47.204676 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d1b129f-df6a-4172-9d76-001d4b155790 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:47.205124 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d1b129f-df6a-4172-9d76-001d4b155790 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:47.205540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d1b129f-df6a-4172-9d76-001d4b155790 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:47.235142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9d1b129f-df6a-4172-9d76-001d4b155790 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045185 Aug 10 12:51:47.235718 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 788/1591] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:47 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:47.237894 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1b21226d-3947-437b-b2f6-389115334d7c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:47.240600 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1b21226d-3947-437b-b2f6-389115334d7c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:47.246934 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1b21226d-3947-437b-b2f6-389115334d7c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:47.247447 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1b21226d-3947-437b-b2f6-389115334d7c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:47.247888 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1b21226d-3947-437b-b2f6-389115334d7c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:47.248582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1b21226d-3947-437b-b2f6-389115334d7c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:47.249037 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1b21226d-3947-437b-b2f6-389115334d7c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:47.249462 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1b21226d-3947-437b-b2f6-389115334d7c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:47.279462 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1b21226d-3947-437b-b2f6-389115334d7c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045367 Aug 10 12:51:47.280027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 804/1592] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:47 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:48.157974 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f4ca4c14-59d4-4133-8b85-293ef9838bb5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:48.160893 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f4ca4c14-59d4-4133-8b85-293ef9838bb5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:48.166882 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f4ca4c14-59d4-4133-8b85-293ef9838bb5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:48.167401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f4ca4c14-59d4-4133-8b85-293ef9838bb5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:48.167872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f4ca4c14-59d4-4133-8b85-293ef9838bb5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:48.168547 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f4ca4c14-59d4-4133-8b85-293ef9838bb5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:48.169307 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f4ca4c14-59d4-4133-8b85-293ef9838bb5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:48.169728 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f4ca4c14-59d4-4133-8b85-293ef9838bb5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:48.198421 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f4ca4c14-59d4-4133-8b85-293ef9838bb5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044456 Aug 10 12:51:48.199003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 789/1593] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:48 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:48.248021 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-89f10722-0643-48b0-b4a4-c02b2b397877 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:48.250170 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-89f10722-0643-48b0-b4a4-c02b2b397877 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:48.257264 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-89f10722-0643-48b0-b4a4-c02b2b397877 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:48.257743 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-89f10722-0643-48b0-b4a4-c02b2b397877 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:48.258169 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-89f10722-0643-48b0-b4a4-c02b2b397877 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:48.258888 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-89f10722-0643-48b0-b4a4-c02b2b397877 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:48.259359 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-89f10722-0643-48b0-b4a4-c02b2b397877 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:48.259776 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-89f10722-0643-48b0-b4a4-c02b2b397877 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:48.290581 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-89f10722-0643-48b0-b4a4-c02b2b397877 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046400 Aug 10 12:51:48.291144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 805/1594] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:48 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:48.292558 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0509a73b-e2a9-4f00-abb9-a94837f2596d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:48.294812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0509a73b-e2a9-4f00-abb9-a94837f2596d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:48.301181 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0509a73b-e2a9-4f00-abb9-a94837f2596d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:48.301661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0509a73b-e2a9-4f00-abb9-a94837f2596d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:48.302087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0509a73b-e2a9-4f00-abb9-a94837f2596d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:48.302774 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0509a73b-e2a9-4f00-abb9-a94837f2596d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:48.303247 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0509a73b-e2a9-4f00-abb9-a94837f2596d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:48.303679 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0509a73b-e2a9-4f00-abb9-a94837f2596d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:48.331335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0509a73b-e2a9-4f00-abb9-a94837f2596d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042897 Aug 10 12:51:48.331885 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 790/1595] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:48 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:49.211126 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f204faed-0715-4882-963d-0f5276e007b6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:49.213268 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f204faed-0715-4882-963d-0f5276e007b6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:49.219385 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f204faed-0715-4882-963d-0f5276e007b6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:49.219860 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f204faed-0715-4882-963d-0f5276e007b6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:49.220290 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f204faed-0715-4882-963d-0f5276e007b6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:49.220970 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f204faed-0715-4882-963d-0f5276e007b6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:49.221412 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f204faed-0715-4882-963d-0f5276e007b6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:49.221828 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f204faed-0715-4882-963d-0f5276e007b6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:49.252485 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f204faed-0715-4882-963d-0f5276e007b6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045977 Aug 10 12:51:49.254551 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 806/1596] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:49 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:49.303371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e42369b1-c41b-409f-bfd1-3b6138652173 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:49.305504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e42369b1-c41b-409f-bfd1-3b6138652173 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:49.311867 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e42369b1-c41b-409f-bfd1-3b6138652173 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:49.312347 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e42369b1-c41b-409f-bfd1-3b6138652173 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:49.312781 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e42369b1-c41b-409f-bfd1-3b6138652173 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:49.313463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e42369b1-c41b-409f-bfd1-3b6138652173 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:49.313914 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e42369b1-c41b-409f-bfd1-3b6138652173 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:49.314335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e42369b1-c41b-409f-bfd1-3b6138652173 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:49.342420 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e42369b1-c41b-409f-bfd1-3b6138652173 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043731 Aug 10 12:51:49.342974 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 791/1597] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:49 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:49.344017 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-00e6971a-1cd8-444e-9f51-f8eb409838fb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:49.346161 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-00e6971a-1cd8-444e-9f51-f8eb409838fb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:49.353340 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-00e6971a-1cd8-444e-9f51-f8eb409838fb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:49.353813 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-00e6971a-1cd8-444e-9f51-f8eb409838fb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:49.354245 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-00e6971a-1cd8-444e-9f51-f8eb409838fb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:49.355201 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-00e6971a-1cd8-444e-9f51-f8eb409838fb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:49.355652 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-00e6971a-1cd8-444e-9f51-f8eb409838fb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:49.356066 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-00e6971a-1cd8-444e-9f51-f8eb409838fb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:49.385942 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-00e6971a-1cd8-444e-9f51-f8eb409838fb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045968 Aug 10 12:51:49.386481 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 807/1598] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:49 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:50.265316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2e27f57f-0b4d-4b62-b58c-4f662685e737 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:50.267477 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2e27f57f-0b4d-4b62-b58c-4f662685e737 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:50.273462 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e27f57f-0b4d-4b62-b58c-4f662685e737 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:50.273943 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e27f57f-0b4d-4b62-b58c-4f662685e737 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:50.274379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e27f57f-0b4d-4b62-b58c-4f662685e737 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:50.275079 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e27f57f-0b4d-4b62-b58c-4f662685e737 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:50.275561 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e27f57f-0b4d-4b62-b58c-4f662685e737 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:50.275992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e27f57f-0b4d-4b62-b58c-4f662685e737 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:50.305396 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2e27f57f-0b4d-4b62-b58c-4f662685e737 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044058 Aug 10 12:51:50.305958 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 792/1599] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:50 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:50.353799 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4e6a7c6e-2cc6-4802-9f17-6fe9140412f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:50.356284 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4e6a7c6e-2cc6-4802-9f17-6fe9140412f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:50.362569 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4e6a7c6e-2cc6-4802-9f17-6fe9140412f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:50.363070 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4e6a7c6e-2cc6-4802-9f17-6fe9140412f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:50.364033 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4e6a7c6e-2cc6-4802-9f17-6fe9140412f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:50.364712 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4e6a7c6e-2cc6-4802-9f17-6fe9140412f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:50.365162 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4e6a7c6e-2cc6-4802-9f17-6fe9140412f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:50.365583 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4e6a7c6e-2cc6-4802-9f17-6fe9140412f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:50.394387 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4e6a7c6e-2cc6-4802-9f17-6fe9140412f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044464 Aug 10 12:51:50.395162 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 808/1600] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:50 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:50.397827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-da66dfd9-6727-4b2a-b257-dc22f24dd335 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:50.399972 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-da66dfd9-6727-4b2a-b257-dc22f24dd335 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:50.406288 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-da66dfd9-6727-4b2a-b257-dc22f24dd335 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:50.406751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-da66dfd9-6727-4b2a-b257-dc22f24dd335 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:50.407206 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-da66dfd9-6727-4b2a-b257-dc22f24dd335 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:50.407888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-da66dfd9-6727-4b2a-b257-dc22f24dd335 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:50.408329 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-da66dfd9-6727-4b2a-b257-dc22f24dd335 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:50.408747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-da66dfd9-6727-4b2a-b257-dc22f24dd335 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:50.437229 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-da66dfd9-6727-4b2a-b257-dc22f24dd335 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043223 Aug 10 12:51:50.437770 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 793/1601] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:50 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:51.318045 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c81f5194-ec40-4de7-b447-c553eb202a68 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:51.320206 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c81f5194-ec40-4de7-b447-c553eb202a68 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:51.326317 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c81f5194-ec40-4de7-b447-c553eb202a68 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:51.326797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c81f5194-ec40-4de7-b447-c553eb202a68 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:51.327296 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c81f5194-ec40-4de7-b447-c553eb202a68 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:51.327981 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c81f5194-ec40-4de7-b447-c553eb202a68 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:51.328425 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c81f5194-ec40-4de7-b447-c553eb202a68 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:51.328842 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c81f5194-ec40-4de7-b447-c553eb202a68 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:51.358609 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c81f5194-ec40-4de7-b447-c553eb202a68 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044523 Aug 10 12:51:51.359234 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 809/1602] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:51 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:51.406112 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f2114fd9-f4f3-4479-a228-2f3d9b91fc74 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:51.408317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f2114fd9-f4f3-4479-a228-2f3d9b91fc74 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:51.414794 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2114fd9-f4f3-4479-a228-2f3d9b91fc74 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:51.415302 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2114fd9-f4f3-4479-a228-2f3d9b91fc74 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:51.415738 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2114fd9-f4f3-4479-a228-2f3d9b91fc74 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:51.416415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2114fd9-f4f3-4479-a228-2f3d9b91fc74 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:51.416861 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2114fd9-f4f3-4479-a228-2f3d9b91fc74 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:51.417280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2114fd9-f4f3-4479-a228-2f3d9b91fc74 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:51.446095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f2114fd9-f4f3-4479-a228-2f3d9b91fc74 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043936 Aug 10 12:51:51.446642 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 794/1603] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:51 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:51.450245 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-685c5b71-b0ee-4344-a4a7-d2f94b9f61b9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:51.452431 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-685c5b71-b0ee-4344-a4a7-d2f94b9f61b9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:51.460508 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-685c5b71-b0ee-4344-a4a7-d2f94b9f61b9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:51.460990 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-685c5b71-b0ee-4344-a4a7-d2f94b9f61b9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:51.461650 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-685c5b71-b0ee-4344-a4a7-d2f94b9f61b9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:51.462445 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-685c5b71-b0ee-4344-a4a7-d2f94b9f61b9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:51.462894 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-685c5b71-b0ee-4344-a4a7-d2f94b9f61b9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:51.463341 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-685c5b71-b0ee-4344-a4a7-d2f94b9f61b9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:51.492682 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-685c5b71-b0ee-4344-a4a7-d2f94b9f61b9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046650 Aug 10 12:51:51.493233 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 810/1604] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:51 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:52.370661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-739aa566-01e2-46c0-bf85-590207006c6a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:52.372799 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-739aa566-01e2-46c0-bf85-590207006c6a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:52.378797 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-739aa566-01e2-46c0-bf85-590207006c6a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:52.379513 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-739aa566-01e2-46c0-bf85-590207006c6a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:52.379959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-739aa566-01e2-46c0-bf85-590207006c6a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:52.380644 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-739aa566-01e2-46c0-bf85-590207006c6a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:52.381096 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-739aa566-01e2-46c0-bf85-590207006c6a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:52.381516 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-739aa566-01e2-46c0-bf85-590207006c6a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:52.409319 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-739aa566-01e2-46c0-bf85-590207006c6a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042690 Aug 10 12:51:52.409910 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 795/1605] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:52 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:52.457948 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fe41a40c-c9a2-4b65-b3d9-455d3ccad4c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:52.460362 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fe41a40c-c9a2-4b65-b3d9-455d3ccad4c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:52.466637 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe41a40c-c9a2-4b65-b3d9-455d3ccad4c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:52.467115 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe41a40c-c9a2-4b65-b3d9-455d3ccad4c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:52.467584 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe41a40c-c9a2-4b65-b3d9-455d3ccad4c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:52.468265 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe41a40c-c9a2-4b65-b3d9-455d3ccad4c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:52.468737 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe41a40c-c9a2-4b65-b3d9-455d3ccad4c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:52.469136 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe41a40c-c9a2-4b65-b3d9-455d3ccad4c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:52.498456 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fe41a40c-c9a2-4b65-b3d9-455d3ccad4c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044554 Aug 10 12:51:52.499002 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 811/1606] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:52 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:52.504911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f4242413-4ebd-4f3b-b4d6-d9d11e52942d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:52.507008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f4242413-4ebd-4f3b-b4d6-d9d11e52942d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:52.513284 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f4242413-4ebd-4f3b-b4d6-d9d11e52942d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:52.513783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f4242413-4ebd-4f3b-b4d6-d9d11e52942d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:52.514217 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f4242413-4ebd-4f3b-b4d6-d9d11e52942d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:52.514897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f4242413-4ebd-4f3b-b4d6-d9d11e52942d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:52.515366 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f4242413-4ebd-4f3b-b4d6-d9d11e52942d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:52.515785 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f4242413-4ebd-4f3b-b4d6-d9d11e52942d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:52.541311 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:51:52.545614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f4242413-4ebd-4f3b-b4d6-d9d11e52942d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044742 Aug 10 12:51:52.546177 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 796/1607] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:52 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:53.422004 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fe51d0d8-62f6-42ac-8c56-8f6052398970 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:53.424189 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fe51d0d8-62f6-42ac-8c56-8f6052398970 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:53.430697 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe51d0d8-62f6-42ac-8c56-8f6052398970 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:53.431198 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe51d0d8-62f6-42ac-8c56-8f6052398970 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:53.431655 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe51d0d8-62f6-42ac-8c56-8f6052398970 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:53.432326 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe51d0d8-62f6-42ac-8c56-8f6052398970 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:53.432777 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe51d0d8-62f6-42ac-8c56-8f6052398970 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:53.433197 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe51d0d8-62f6-42ac-8c56-8f6052398970 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:53.457376 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:51:53.461698 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fe51d0d8-62f6-42ac-8c56-8f6052398970 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043694 Aug 10 12:51:53.462270 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 812/1608] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:53 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:53.511515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-73a9d7b7-27b5-4874-aaa0-b4b26704d02d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:53.513674 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-73a9d7b7-27b5-4874-aaa0-b4b26704d02d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:53.520300 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73a9d7b7-27b5-4874-aaa0-b4b26704d02d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:53.520783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73a9d7b7-27b5-4874-aaa0-b4b26704d02d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:53.521220 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73a9d7b7-27b5-4874-aaa0-b4b26704d02d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:53.521915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73a9d7b7-27b5-4874-aaa0-b4b26704d02d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:53.522365 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73a9d7b7-27b5-4874-aaa0-b4b26704d02d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:53.522789 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-73a9d7b7-27b5-4874-aaa0-b4b26704d02d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:53.551463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-73a9d7b7-27b5-4874-aaa0-b4b26704d02d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043764 Aug 10 12:51:53.552115 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 797/1609] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:53 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:53.558071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ee7e68ce-8f6a-45ee-a26d-a5f66e2674c0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:53.560412 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ee7e68ce-8f6a-45ee-a26d-a5f66e2674c0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:53.568403 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee7e68ce-8f6a-45ee-a26d-a5f66e2674c0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:53.568909 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee7e68ce-8f6a-45ee-a26d-a5f66e2674c0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:53.569343 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee7e68ce-8f6a-45ee-a26d-a5f66e2674c0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:53.570029 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee7e68ce-8f6a-45ee-a26d-a5f66e2674c0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:53.570480 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee7e68ce-8f6a-45ee-a26d-a5f66e2674c0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:53.570902 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee7e68ce-8f6a-45ee-a26d-a5f66e2674c0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:53.599072 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ee7e68ce-8f6a-45ee-a26d-a5f66e2674c0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044947 Aug 10 12:51:53.599655 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 813/1610] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:53 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:54.475151 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bb3f6ad7-7b71-4748-8684-7c5378ef4ff5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:54.477292 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bb3f6ad7-7b71-4748-8684-7c5378ef4ff5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:54.483525 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bb3f6ad7-7b71-4748-8684-7c5378ef4ff5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:54.484002 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bb3f6ad7-7b71-4748-8684-7c5378ef4ff5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:54.484433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bb3f6ad7-7b71-4748-8684-7c5378ef4ff5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:54.485116 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bb3f6ad7-7b71-4748-8684-7c5378ef4ff5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:54.485561 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bb3f6ad7-7b71-4748-8684-7c5378ef4ff5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:54.485978 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bb3f6ad7-7b71-4748-8684-7c5378ef4ff5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:54.519872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bb3f6ad7-7b71-4748-8684-7c5378ef4ff5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049136 Aug 10 12:51:54.521656 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 798/1611] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:54 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:54.564231 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b5fe227d-37a6-447b-8af7-8aed39614749 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:54.566273 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b5fe227d-37a6-447b-8af7-8aed39614749 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:54.574204 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b5fe227d-37a6-447b-8af7-8aed39614749 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:54.574739 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b5fe227d-37a6-447b-8af7-8aed39614749 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:54.575542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b5fe227d-37a6-447b-8af7-8aed39614749 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:54.577683 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b5fe227d-37a6-447b-8af7-8aed39614749 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:54.577683 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b5fe227d-37a6-447b-8af7-8aed39614749 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:54.577683 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b5fe227d-37a6-447b-8af7-8aed39614749 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:54.610318 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b5fe227d-37a6-447b-8af7-8aed39614749 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050091 Aug 10 12:51:54.610930 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 814/1612] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:54 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:54.612243 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9b7f169b-3c29-4e62-8767-034b54011f67 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:54.614538 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9b7f169b-3c29-4e62-8767-034b54011f67 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:54.620842 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9b7f169b-3c29-4e62-8767-034b54011f67 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:54.621318 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9b7f169b-3c29-4e62-8767-034b54011f67 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:54.621759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9b7f169b-3c29-4e62-8767-034b54011f67 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:54.622458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9b7f169b-3c29-4e62-8767-034b54011f67 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:54.622916 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9b7f169b-3c29-4e62-8767-034b54011f67 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:54.623366 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9b7f169b-3c29-4e62-8767-034b54011f67 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:54.658067 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9b7f169b-3c29-4e62-8767-034b54011f67 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049870 Aug 10 12:51:54.658636 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 799/1613] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:54 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:51:55.500750 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:51:55.501082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Wed Aug 10 12:51:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 12:51:55.533012 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3acf67bc-1638-4ffd-9349-96eb25be2662 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:55.535093 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3acf67bc-1638-4ffd-9349-96eb25be2662 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:55.541654 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3acf67bc-1638-4ffd-9349-96eb25be2662 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:55.542132 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3acf67bc-1638-4ffd-9349-96eb25be2662 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:55.542562 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3acf67bc-1638-4ffd-9349-96eb25be2662 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:55.543280 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3acf67bc-1638-4ffd-9349-96eb25be2662 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:55.543731 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3acf67bc-1638-4ffd-9349-96eb25be2662 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:55.544156 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3acf67bc-1638-4ffd-9349-96eb25be2662 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:55.572455 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3acf67bc-1638-4ffd-9349-96eb25be2662 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043382 Aug 10 12:51:55.573037 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 815/1614] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:55 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:55.622729 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-cc3e0bd1-5169-4a05-bd89-b94ddbe17f7e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:55.624947 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-cc3e0bd1-5169-4a05-bd89-b94ddbe17f7e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:55.631446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cc3e0bd1-5169-4a05-bd89-b94ddbe17f7e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:55.631957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cc3e0bd1-5169-4a05-bd89-b94ddbe17f7e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:55.632396 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cc3e0bd1-5169-4a05-bd89-b94ddbe17f7e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:55.633085 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cc3e0bd1-5169-4a05-bd89-b94ddbe17f7e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:55.633537 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cc3e0bd1-5169-4a05-bd89-b94ddbe17f7e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:55.633961 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cc3e0bd1-5169-4a05-bd89-b94ddbe17f7e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:55.663115 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-cc3e0bd1-5169-4a05-bd89-b94ddbe17f7e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044282 Aug 10 12:51:55.663708 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 800/1615] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:55 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:55.669879 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-87f01712-abbd-4e6f-8589-b039fcdce141 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:55.672107 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-87f01712-abbd-4e6f-8589-b039fcdce141 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:55.677993 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-87f01712-abbd-4e6f-8589-b039fcdce141 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:55.678471 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-87f01712-abbd-4e6f-8589-b039fcdce141 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:55.678907 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-87f01712-abbd-4e6f-8589-b039fcdce141 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:55.679628 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-87f01712-abbd-4e6f-8589-b039fcdce141 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:55.680084 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-87f01712-abbd-4e6f-8589-b039fcdce141 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:55.680508 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-87f01712-abbd-4e6f-8589-b039fcdce141 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:55.708927 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-87f01712-abbd-4e6f-8589-b039fcdce141 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042966 Aug 10 12:51:55.709464 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 816/1616] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:55 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:56.211234 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:51:56.211422 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Wed Aug 10 12:51:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 12:51:56.584764 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-860b825c-ff9a-474a-bd76-19866d6d5b7b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:56.586891 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-860b825c-ff9a-474a-bd76-19866d6d5b7b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:56.592819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-860b825c-ff9a-474a-bd76-19866d6d5b7b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:56.593301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-860b825c-ff9a-474a-bd76-19866d6d5b7b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:56.593733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-860b825c-ff9a-474a-bd76-19866d6d5b7b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:56.594422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-860b825c-ff9a-474a-bd76-19866d6d5b7b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:56.594868 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-860b825c-ff9a-474a-bd76-19866d6d5b7b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:56.595356 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-860b825c-ff9a-474a-bd76-19866d6d5b7b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:56.625411 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-860b825c-ff9a-474a-bd76-19866d6d5b7b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044703 Aug 10 12:51:56.626071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 801/1617] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:56 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:56.675676 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-aae11a1d-e233-4a4f-9059-4662afbe3669 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:56.678511 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-aae11a1d-e233-4a4f-9059-4662afbe3669 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:56.684617 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aae11a1d-e233-4a4f-9059-4662afbe3669 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:56.685089 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aae11a1d-e233-4a4f-9059-4662afbe3669 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:56.685514 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aae11a1d-e233-4a4f-9059-4662afbe3669 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:56.686323 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aae11a1d-e233-4a4f-9059-4662afbe3669 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:56.686769 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aae11a1d-e233-4a4f-9059-4662afbe3669 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:56.687201 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aae11a1d-e233-4a4f-9059-4662afbe3669 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:56.716113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-aae11a1d-e233-4a4f-9059-4662afbe3669 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043851 Aug 10 12:51:56.716113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 817/1618] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:56 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:56.721371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8c203210-6f79-4211-abaa-4e893d86c385 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:56.724105 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8c203210-6f79-4211-abaa-4e893d86c385 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:56.730555 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c203210-6f79-4211-abaa-4e893d86c385 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:56.731038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c203210-6f79-4211-abaa-4e893d86c385 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:56.731509 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c203210-6f79-4211-abaa-4e893d86c385 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:56.732202 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c203210-6f79-4211-abaa-4e893d86c385 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:56.732716 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c203210-6f79-4211-abaa-4e893d86c385 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:56.733146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c203210-6f79-4211-abaa-4e893d86c385 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:56.762017 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8c203210-6f79-4211-abaa-4e893d86c385 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044424 Aug 10 12:51:56.762569 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 802/1619] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:56 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:57.638043 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1cb0b07f-0365-42bd-94cc-78d850eaa499 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:57.640224 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1cb0b07f-0365-42bd-94cc-78d850eaa499 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:57.646866 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1cb0b07f-0365-42bd-94cc-78d850eaa499 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:57.647387 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1cb0b07f-0365-42bd-94cc-78d850eaa499 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:57.647818 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1cb0b07f-0365-42bd-94cc-78d850eaa499 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:57.648505 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1cb0b07f-0365-42bd-94cc-78d850eaa499 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:57.648956 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1cb0b07f-0365-42bd-94cc-78d850eaa499 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:57.649376 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1cb0b07f-0365-42bd-94cc-78d850eaa499 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:57.677886 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1cb0b07f-0365-42bd-94cc-78d850eaa499 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043842 Aug 10 12:51:57.678505 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 818/1620] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:57 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:57.727499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-651a0b80-18a4-4631-b72c-ecd6f23dcb2b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:57.729886 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-651a0b80-18a4-4631-b72c-ecd6f23dcb2b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:57.736136 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-651a0b80-18a4-4631-b72c-ecd6f23dcb2b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:57.736618 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-651a0b80-18a4-4631-b72c-ecd6f23dcb2b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:57.737052 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-651a0b80-18a4-4631-b72c-ecd6f23dcb2b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:57.737733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-651a0b80-18a4-4631-b72c-ecd6f23dcb2b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:57.738185 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-651a0b80-18a4-4631-b72c-ecd6f23dcb2b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:57.739130 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-651a0b80-18a4-4631-b72c-ecd6f23dcb2b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:57.767267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-651a0b80-18a4-4631-b72c-ecd6f23dcb2b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043639 Aug 10 12:51:57.767814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 803/1621] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:57 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:57.775053 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-710b64f7-3617-4f05-90cc-fa767592226a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:57.777257 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-710b64f7-3617-4f05-90cc-fa767592226a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:57.783614 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-710b64f7-3617-4f05-90cc-fa767592226a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:57.784095 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-710b64f7-3617-4f05-90cc-fa767592226a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:57.784531 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-710b64f7-3617-4f05-90cc-fa767592226a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:57.785218 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-710b64f7-3617-4f05-90cc-fa767592226a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:57.786295 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-710b64f7-3617-4f05-90cc-fa767592226a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:57.786721 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-710b64f7-3617-4f05-90cc-fa767592226a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:57.814916 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-710b64f7-3617-4f05-90cc-fa767592226a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044904 Aug 10 12:51:57.815508 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 819/1622] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:57 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:58.690082 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a4a185e0-026d-4854-81a5-c0e839233fc2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:58.692745 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a4a185e0-026d-4854-81a5-c0e839233fc2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:58.698601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4a185e0-026d-4854-81a5-c0e839233fc2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:58.699077 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4a185e0-026d-4854-81a5-c0e839233fc2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:58.699550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4a185e0-026d-4854-81a5-c0e839233fc2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:58.700233 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4a185e0-026d-4854-81a5-c0e839233fc2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:58.700681 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4a185e0-026d-4854-81a5-c0e839233fc2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:58.701103 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4a185e0-026d-4854-81a5-c0e839233fc2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:58.728876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a4a185e0-026d-4854-81a5-c0e839233fc2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042846 Aug 10 12:51:58.729732 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 804/1623] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:58 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:58.779893 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7e8b1ec5-3701-445e-a8bf-1fdf73eb1e8f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:58.782051 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7e8b1ec5-3701-445e-a8bf-1fdf73eb1e8f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:58.788498 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7e8b1ec5-3701-445e-a8bf-1fdf73eb1e8f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:58.788975 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7e8b1ec5-3701-445e-a8bf-1fdf73eb1e8f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:58.789415 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7e8b1ec5-3701-445e-a8bf-1fdf73eb1e8f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:58.790096 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7e8b1ec5-3701-445e-a8bf-1fdf73eb1e8f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:58.790573 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7e8b1ec5-3701-445e-a8bf-1fdf73eb1e8f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:58.790992 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7e8b1ec5-3701-445e-a8bf-1fdf73eb1e8f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:58.819889 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7e8b1ec5-3701-445e-a8bf-1fdf73eb1e8f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043853 Aug 10 12:51:58.820432 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 820/1624] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:58 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:58.827141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fe51f3b7-1dd9-485d-b1a6-567844ee07c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:58.829309 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fe51f3b7-1dd9-485d-b1a6-567844ee07c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:58.835643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe51f3b7-1dd9-485d-b1a6-567844ee07c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:58.836130 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe51f3b7-1dd9-485d-b1a6-567844ee07c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:58.836567 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe51f3b7-1dd9-485d-b1a6-567844ee07c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:58.837257 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe51f3b7-1dd9-485d-b1a6-567844ee07c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:58.837712 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe51f3b7-1dd9-485d-b1a6-567844ee07c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:58.838136 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe51f3b7-1dd9-485d-b1a6-567844ee07c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:58.867284 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fe51f3b7-1dd9-485d-b1a6-567844ee07c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044014 Aug 10 12:51:58.867844 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 805/1625] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:58 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:59.742168 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fcfbf102-ab0f-4197-a071-64a41b76096f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:59.744278 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fcfbf102-ab0f-4197-a071-64a41b76096f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:59.750158 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fcfbf102-ab0f-4197-a071-64a41b76096f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:59.750644 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fcfbf102-ab0f-4197-a071-64a41b76096f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:59.751078 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fcfbf102-ab0f-4197-a071-64a41b76096f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:59.751784 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fcfbf102-ab0f-4197-a071-64a41b76096f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:59.752235 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fcfbf102-ab0f-4197-a071-64a41b76096f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:59.752657 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fcfbf102-ab0f-4197-a071-64a41b76096f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:59.780787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fcfbf102-ab0f-4197-a071-64a41b76096f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043364 Aug 10 12:51:59.781427 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 821/1626] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:59 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:59.832025 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f2e725ea-18a7-4d19-b558-c624ff4469ba tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:59.834361 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f2e725ea-18a7-4d19-b558-c624ff4469ba tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:59.840702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2e725ea-18a7-4d19-b558-c624ff4469ba tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:59.841181 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2e725ea-18a7-4d19-b558-c624ff4469ba tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:59.841618 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2e725ea-18a7-4d19-b558-c624ff4469ba tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:59.842302 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2e725ea-18a7-4d19-b558-c624ff4469ba tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:59.842752 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2e725ea-18a7-4d19-b558-c624ff4469ba tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:59.843187 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2e725ea-18a7-4d19-b558-c624ff4469ba tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:59.872362 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f2e725ea-18a7-4d19-b558-c624ff4469ba tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044355 Aug 10 12:51:59.872942 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 806/1627] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:59 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:51:59.879493 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7cb9209d-5aa3-4a00-9acb-2ead2a06d6af tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:51:59.881683 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7cb9209d-5aa3-4a00-9acb-2ead2a06d6af tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:51:59.888317 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7cb9209d-5aa3-4a00-9acb-2ead2a06d6af tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:59.888799 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7cb9209d-5aa3-4a00-9acb-2ead2a06d6af tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:59.889236 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7cb9209d-5aa3-4a00-9acb-2ead2a06d6af tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:59.889930 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7cb9209d-5aa3-4a00-9acb-2ead2a06d6af tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:51:59.890382 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7cb9209d-5aa3-4a00-9acb-2ead2a06d6af tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:51:59.890807 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7cb9209d-5aa3-4a00-9acb-2ead2a06d6af tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:51:59.919941 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7cb9209d-5aa3-4a00-9acb-2ead2a06d6af tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044420 Aug 10 12:51:59.920492 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 822/1628] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:51:59 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:00.792166 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5d791ac5-8600-48e2-b05a-065e22ad6b7f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:00.794341 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5d791ac5-8600-48e2-b05a-065e22ad6b7f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:00.800224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d791ac5-8600-48e2-b05a-065e22ad6b7f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:00.800704 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d791ac5-8600-48e2-b05a-065e22ad6b7f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:00.801669 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d791ac5-8600-48e2-b05a-065e22ad6b7f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:00.802353 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d791ac5-8600-48e2-b05a-065e22ad6b7f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:00.802802 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d791ac5-8600-48e2-b05a-065e22ad6b7f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:00.803258 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d791ac5-8600-48e2-b05a-065e22ad6b7f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:00.831801 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5d791ac5-8600-48e2-b05a-065e22ad6b7f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043557 Aug 10 12:52:00.832314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 807/1629] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:00 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:00.885244 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b8b5edca-5af1-4f81-94c2-c03adf968df4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:00.887514 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b8b5edca-5af1-4f81-94c2-c03adf968df4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:00.893904 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b8b5edca-5af1-4f81-94c2-c03adf968df4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:00.894383 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b8b5edca-5af1-4f81-94c2-c03adf968df4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:00.894845 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b8b5edca-5af1-4f81-94c2-c03adf968df4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:00.895570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b8b5edca-5af1-4f81-94c2-c03adf968df4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:00.896017 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b8b5edca-5af1-4f81-94c2-c03adf968df4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:00.896522 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b8b5edca-5af1-4f81-94c2-c03adf968df4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:00.924806 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b8b5edca-5af1-4f81-94c2-c03adf968df4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043661 Aug 10 12:52:00.925531 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 823/1630] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:00 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:00.932630 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5ef6bd6b-848f-4ab0-a154-af153da3f7a4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:00.934826 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5ef6bd6b-848f-4ab0-a154-af153da3f7a4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:00.941165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ef6bd6b-848f-4ab0-a154-af153da3f7a4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:00.942297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ef6bd6b-848f-4ab0-a154-af153da3f7a4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:00.943083 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ef6bd6b-848f-4ab0-a154-af153da3f7a4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:00.943798 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ef6bd6b-848f-4ab0-a154-af153da3f7a4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:00.944252 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ef6bd6b-848f-4ab0-a154-af153da3f7a4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:00.950479 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ef6bd6b-848f-4ab0-a154-af153da3f7a4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:00.974091 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5ef6bd6b-848f-4ab0-a154-af153da3f7a4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045459 Aug 10 12:52:00.974660 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 808/1631] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:00 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:01.844380 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c95d7fd6-9b38-434c-aeb0-3e4e19b20237 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:01.846529 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c95d7fd6-9b38-434c-aeb0-3e4e19b20237 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:01.853374 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c95d7fd6-9b38-434c-aeb0-3e4e19b20237 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:01.853855 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c95d7fd6-9b38-434c-aeb0-3e4e19b20237 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:01.855087 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c95d7fd6-9b38-434c-aeb0-3e4e19b20237 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:01.855234 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c95d7fd6-9b38-434c-aeb0-3e4e19b20237 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:01.855689 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c95d7fd6-9b38-434c-aeb0-3e4e19b20237 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:01.856124 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c95d7fd6-9b38-434c-aeb0-3e4e19b20237 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:01.885522 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c95d7fd6-9b38-434c-aeb0-3e4e19b20237 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045160 Aug 10 12:52:01.886143 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 824/1632] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:01 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:01.936990 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-105fc624-85c8-4ffa-87dd-fc576cca8706 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:01.939104 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-105fc624-85c8-4ffa-87dd-fc576cca8706 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:01.941442 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=92 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:52:01.947128 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-105fc624-85c8-4ffa-87dd-fc576cca8706 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:01.947683 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-105fc624-85c8-4ffa-87dd-fc576cca8706 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:01.948117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-105fc624-85c8-4ffa-87dd-fc576cca8706 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:01.948798 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-105fc624-85c8-4ffa-87dd-fc576cca8706 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:01.949242 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-105fc624-85c8-4ffa-87dd-fc576cca8706 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:01.949657 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-105fc624-85c8-4ffa-87dd-fc576cca8706 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:01.979772 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-105fc624-85c8-4ffa-87dd-fc576cca8706 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046374 Aug 10 12:52:01.980313 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 809/1633] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:01 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:01.986328 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-78302f49-fff3-475b-bf2f-7b19f91dc723 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:01.988563 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-78302f49-fff3-475b-bf2f-7b19f91dc723 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:01.995021 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-78302f49-fff3-475b-bf2f-7b19f91dc723 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:01.995610 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-78302f49-fff3-475b-bf2f-7b19f91dc723 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:01.996047 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-78302f49-fff3-475b-bf2f-7b19f91dc723 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:01.996733 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-78302f49-fff3-475b-bf2f-7b19f91dc723 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:01.997178 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-78302f49-fff3-475b-bf2f-7b19f91dc723 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:01.997602 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-78302f49-fff3-475b-bf2f-7b19f91dc723 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:02.027244 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-78302f49-fff3-475b-bf2f-7b19f91dc723 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044876 Aug 10 12:52:02.027792 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 825/1634] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:01 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:02.898312 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d64e07bc-dda0-46d0-aed7-639d3e148a80 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:02.900482 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d64e07bc-dda0-46d0-aed7-639d3e148a80 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:02.906376 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d64e07bc-dda0-46d0-aed7-639d3e148a80 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:02.906846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d64e07bc-dda0-46d0-aed7-639d3e148a80 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:02.907317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d64e07bc-dda0-46d0-aed7-639d3e148a80 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:02.907992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d64e07bc-dda0-46d0-aed7-639d3e148a80 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:02.908437 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d64e07bc-dda0-46d0-aed7-639d3e148a80 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:02.908853 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d64e07bc-dda0-46d0-aed7-639d3e148a80 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:02.938724 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d64e07bc-dda0-46d0-aed7-639d3e148a80 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045193 Aug 10 12:52:02.939361 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 810/1635] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:02 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:02.991954 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6b0c6fb0-c657-4a5f-a7f5-c0b70a328344 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:02.994110 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6b0c6fb0-c657-4a5f-a7f5-c0b70a328344 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:03.001634 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6b0c6fb0-c657-4a5f-a7f5-c0b70a328344 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:03.002113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6b0c6fb0-c657-4a5f-a7f5-c0b70a328344 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:03.002542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6b0c6fb0-c657-4a5f-a7f5-c0b70a328344 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:03.003258 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6b0c6fb0-c657-4a5f-a7f5-c0b70a328344 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:03.003702 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6b0c6fb0-c657-4a5f-a7f5-c0b70a328344 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:03.004162 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6b0c6fb0-c657-4a5f-a7f5-c0b70a328344 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:03.033632 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6b0c6fb0-c657-4a5f-a7f5-c0b70a328344 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046190 Aug 10 12:52:03.034357 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 826/1636] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:02 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:03.040169 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b1426d33-9f4d-40aa-a20f-2784c8b84302 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:03.042370 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b1426d33-9f4d-40aa-a20f-2784c8b84302 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:03.049201 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1426d33-9f4d-40aa-a20f-2784c8b84302 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:03.049687 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1426d33-9f4d-40aa-a20f-2784c8b84302 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:03.050120 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1426d33-9f4d-40aa-a20f-2784c8b84302 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:03.050826 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1426d33-9f4d-40aa-a20f-2784c8b84302 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:03.052551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1426d33-9f4d-40aa-a20f-2784c8b84302 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:03.052996 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1426d33-9f4d-40aa-a20f-2784c8b84302 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:03.086138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b1426d33-9f4d-40aa-a20f-2784c8b84302 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051067 Aug 10 12:52:03.087039 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 811/1637] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:03 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:03.949932 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bb8a6c10-1985-4770-b714-95beaf2f8d2d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:03.952127 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bb8a6c10-1985-4770-b714-95beaf2f8d2d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:03.958101 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb8a6c10-1985-4770-b714-95beaf2f8d2d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:03.958581 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb8a6c10-1985-4770-b714-95beaf2f8d2d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:03.959059 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb8a6c10-1985-4770-b714-95beaf2f8d2d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:03.959753 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb8a6c10-1985-4770-b714-95beaf2f8d2d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:03.960205 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb8a6c10-1985-4770-b714-95beaf2f8d2d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:03.960628 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb8a6c10-1985-4770-b714-95beaf2f8d2d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:03.989174 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bb8a6c10-1985-4770-b714-95beaf2f8d2d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042704 Aug 10 12:52:03.989809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 827/1638] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:03 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:04.046310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-578dedfc-add2-4add-9796-57a2813fcb43 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:04.048576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-578dedfc-add2-4add-9796-57a2813fcb43 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:04.055690 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-578dedfc-add2-4add-9796-57a2813fcb43 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:04.056104 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-578dedfc-add2-4add-9796-57a2813fcb43 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:04.056539 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-578dedfc-add2-4add-9796-57a2813fcb43 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:04.057228 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-578dedfc-add2-4add-9796-57a2813fcb43 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:04.057680 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-578dedfc-add2-4add-9796-57a2813fcb43 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:04.058105 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-578dedfc-add2-4add-9796-57a2813fcb43 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:04.086640 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-578dedfc-add2-4add-9796-57a2813fcb43 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044335 Aug 10 12:52:04.087260 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 812/1639] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:04 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:04.098426 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d7a2738c-07e4-4ce6-bd3a-f470a2d56ce3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:04.100672 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d7a2738c-07e4-4ce6-bd3a-f470a2d56ce3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:04.107277 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7a2738c-07e4-4ce6-bd3a-f470a2d56ce3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:04.107752 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7a2738c-07e4-4ce6-bd3a-f470a2d56ce3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:04.108182 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7a2738c-07e4-4ce6-bd3a-f470a2d56ce3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:04.108859 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7a2738c-07e4-4ce6-bd3a-f470a2d56ce3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:04.109305 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7a2738c-07e4-4ce6-bd3a-f470a2d56ce3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:04.109722 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7a2738c-07e4-4ce6-bd3a-f470a2d56ce3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:04.138755 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d7a2738c-07e4-4ce6-bd3a-f470a2d56ce3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044789 Aug 10 12:52:04.139309 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 828/1640] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:04 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:05.001627 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b0975dcb-c2c7-4cb4-b9c3-b1b07887052c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:05.003766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b0975dcb-c2c7-4cb4-b9c3-b1b07887052c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:05.010594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b0975dcb-c2c7-4cb4-b9c3-b1b07887052c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:05.011167 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b0975dcb-c2c7-4cb4-b9c3-b1b07887052c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:05.011633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b0975dcb-c2c7-4cb4-b9c3-b1b07887052c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:05.012312 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b0975dcb-c2c7-4cb4-b9c3-b1b07887052c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:05.012759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b0975dcb-c2c7-4cb4-b9c3-b1b07887052c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:05.013180 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b0975dcb-c2c7-4cb4-b9c3-b1b07887052c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:05.027896 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:52:05.043775 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b0975dcb-c2c7-4cb4-b9c3-b1b07887052c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046074 Aug 10 12:52:05.047655 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 813/1641] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:04 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:05.097852 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4a76f7fd-77e4-4148-b0ae-48049fa59296 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:05.100248 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4a76f7fd-77e4-4148-b0ae-48049fa59296 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:05.106664 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4a76f7fd-77e4-4148-b0ae-48049fa59296 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:05.107142 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4a76f7fd-77e4-4148-b0ae-48049fa59296 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:05.107601 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4a76f7fd-77e4-4148-b0ae-48049fa59296 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:05.108288 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4a76f7fd-77e4-4148-b0ae-48049fa59296 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:05.108741 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4a76f7fd-77e4-4148-b0ae-48049fa59296 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:05.109162 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4a76f7fd-77e4-4148-b0ae-48049fa59296 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:05.122759 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:52:05.139550 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4a76f7fd-77e4-4148-b0ae-48049fa59296 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045605 Aug 10 12:52:05.140160 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 829/1642] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:05 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:05.150578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-71ed2e61-6942-4a2b-b792-cc71bd52f7c0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:05.152782 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-71ed2e61-6942-4a2b-b792-cc71bd52f7c0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:05.159489 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71ed2e61-6942-4a2b-b792-cc71bd52f7c0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:05.159972 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71ed2e61-6942-4a2b-b792-cc71bd52f7c0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:05.160459 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71ed2e61-6942-4a2b-b792-cc71bd52f7c0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:05.161150 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71ed2e61-6942-4a2b-b792-cc71bd52f7c0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:05.161604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71ed2e61-6942-4a2b-b792-cc71bd52f7c0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:05.162030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71ed2e61-6942-4a2b-b792-cc71bd52f7c0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:05.190276 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-71ed2e61-6942-4a2b-b792-cc71bd52f7c0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043729 Aug 10 12:52:05.190833 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 814/1643] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:05 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:06.056673 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3fb915f9-d5f0-4eda-80a0-762a39c327bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:06.058726 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3fb915f9-d5f0-4eda-80a0-762a39c327bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:06.065016 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3fb915f9-d5f0-4eda-80a0-762a39c327bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:06.065493 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3fb915f9-d5f0-4eda-80a0-762a39c327bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:06.065927 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3fb915f9-d5f0-4eda-80a0-762a39c327bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:06.067267 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3fb915f9-d5f0-4eda-80a0-762a39c327bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:06.067727 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3fb915f9-d5f0-4eda-80a0-762a39c327bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:06.068147 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3fb915f9-d5f0-4eda-80a0-762a39c327bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:06.096021 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3fb915f9-d5f0-4eda-80a0-762a39c327bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044898 Aug 10 12:52:06.096569 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 830/1644] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:06 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:06.152007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2a917bf8-137e-413f-a803-ee1cba8fc2c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:06.154131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2a917bf8-137e-413f-a803-ee1cba8fc2c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:06.160570 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a917bf8-137e-413f-a803-ee1cba8fc2c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:06.161057 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a917bf8-137e-413f-a803-ee1cba8fc2c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:06.161492 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a917bf8-137e-413f-a803-ee1cba8fc2c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:06.162175 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a917bf8-137e-413f-a803-ee1cba8fc2c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:06.162624 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a917bf8-137e-413f-a803-ee1cba8fc2c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:06.163046 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a917bf8-137e-413f-a803-ee1cba8fc2c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:06.191335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2a917bf8-137e-413f-a803-ee1cba8fc2c5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043540 Aug 10 12:52:06.192535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 815/1645] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:06 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:06.203469 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-83b7e569-5da1-4703-9135-56c58482483d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:06.205622 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-83b7e569-5da1-4703-9135-56c58482483d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:06.211995 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83b7e569-5da1-4703-9135-56c58482483d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:06.212467 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83b7e569-5da1-4703-9135-56c58482483d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:06.212892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83b7e569-5da1-4703-9135-56c58482483d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:06.213568 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83b7e569-5da1-4703-9135-56c58482483d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:06.214012 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83b7e569-5da1-4703-9135-56c58482483d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:06.214428 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83b7e569-5da1-4703-9135-56c58482483d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:06.242855 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-83b7e569-5da1-4703-9135-56c58482483d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043299 Aug 10 12:52:06.243434 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 831/1646] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:06 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:07.108529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-500a29e2-4ed8-4377-a1c7-f89b7a39fdd7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:07.110636 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-500a29e2-4ed8-4377-a1c7-f89b7a39fdd7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:07.117443 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-500a29e2-4ed8-4377-a1c7-f89b7a39fdd7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:07.117918 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-500a29e2-4ed8-4377-a1c7-f89b7a39fdd7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:07.118349 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-500a29e2-4ed8-4377-a1c7-f89b7a39fdd7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:07.119022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-500a29e2-4ed8-4377-a1c7-f89b7a39fdd7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:07.119499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-500a29e2-4ed8-4377-a1c7-f89b7a39fdd7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:07.119916 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-500a29e2-4ed8-4377-a1c7-f89b7a39fdd7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:07.148812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-500a29e2-4ed8-4377-a1c7-f89b7a39fdd7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044449 Aug 10 12:52:07.149348 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 816/1647] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:07 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:07.204340 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4c0eefb9-aab9-460f-bb0d-bc57fd9722c9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:07.206397 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4c0eefb9-aab9-460f-bb0d-bc57fd9722c9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:07.212757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c0eefb9-aab9-460f-bb0d-bc57fd9722c9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:07.213235 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c0eefb9-aab9-460f-bb0d-bc57fd9722c9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:07.213668 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c0eefb9-aab9-460f-bb0d-bc57fd9722c9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:07.214354 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c0eefb9-aab9-460f-bb0d-bc57fd9722c9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:07.214804 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c0eefb9-aab9-460f-bb0d-bc57fd9722c9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:07.215253 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c0eefb9-aab9-460f-bb0d-bc57fd9722c9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:07.244596 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4c0eefb9-aab9-460f-bb0d-bc57fd9722c9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044317 Aug 10 12:52:07.245126 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 832/1648] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:07 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:07.255503 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b3123698-ee2b-42a6-bb8b-b5adcde0f895 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:07.257787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b3123698-ee2b-42a6-bb8b-b5adcde0f895 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:07.264547 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b3123698-ee2b-42a6-bb8b-b5adcde0f895 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:07.265033 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b3123698-ee2b-42a6-bb8b-b5adcde0f895 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:07.265478 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b3123698-ee2b-42a6-bb8b-b5adcde0f895 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:07.266167 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b3123698-ee2b-42a6-bb8b-b5adcde0f895 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:07.266618 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b3123698-ee2b-42a6-bb8b-b5adcde0f895 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:07.267044 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b3123698-ee2b-42a6-bb8b-b5adcde0f895 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:07.296846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b3123698-ee2b-42a6-bb8b-b5adcde0f895 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045888 Aug 10 12:52:07.297401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 817/1649] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:07 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:08.162907 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0ab207bd-f99a-407e-8dbe-c0c302bff9de tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:08.165100 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0ab207bd-f99a-407e-8dbe-c0c302bff9de tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:08.170990 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ab207bd-f99a-407e-8dbe-c0c302bff9de tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:08.171501 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ab207bd-f99a-407e-8dbe-c0c302bff9de tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:08.171937 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ab207bd-f99a-407e-8dbe-c0c302bff9de tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:08.172620 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ab207bd-f99a-407e-8dbe-c0c302bff9de tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:08.173073 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ab207bd-f99a-407e-8dbe-c0c302bff9de tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:08.173492 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ab207bd-f99a-407e-8dbe-c0c302bff9de tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:08.201927 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0ab207bd-f99a-407e-8dbe-c0c302bff9de tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043543 Aug 10 12:52:08.202465 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 833/1650] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:08 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:08.257081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-736f051c-439d-4bf7-8e02-05546ef70df3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:08.259263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-736f051c-439d-4bf7-8e02-05546ef70df3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:08.265642 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-736f051c-439d-4bf7-8e02-05546ef70df3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:08.266118 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-736f051c-439d-4bf7-8e02-05546ef70df3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:08.266556 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-736f051c-439d-4bf7-8e02-05546ef70df3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:08.267272 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-736f051c-439d-4bf7-8e02-05546ef70df3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:08.267716 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-736f051c-439d-4bf7-8e02-05546ef70df3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:08.268134 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-736f051c-439d-4bf7-8e02-05546ef70df3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:08.298178 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-736f051c-439d-4bf7-8e02-05546ef70df3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045355 Aug 10 12:52:08.300450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 818/1651] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:08 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:08.309922 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-53319565-5928-4742-be87-ca67aef5c37a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:08.312201 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-53319565-5928-4742-be87-ca67aef5c37a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:08.318833 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53319565-5928-4742-be87-ca67aef5c37a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:08.319355 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53319565-5928-4742-be87-ca67aef5c37a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:08.319797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53319565-5928-4742-be87-ca67aef5c37a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:08.320492 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53319565-5928-4742-be87-ca67aef5c37a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:08.320949 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53319565-5928-4742-be87-ca67aef5c37a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:08.321381 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53319565-5928-4742-be87-ca67aef5c37a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:08.351060 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-53319565-5928-4742-be87-ca67aef5c37a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045104 Aug 10 12:52:08.351651 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 834/1652] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:08 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:09.214983 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a28c9c64-e15c-4151-9dda-a55410d18a29 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:09.217049 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a28c9c64-e15c-4151-9dda-a55410d18a29 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:09.223898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a28c9c64-e15c-4151-9dda-a55410d18a29 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:09.224510 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a28c9c64-e15c-4151-9dda-a55410d18a29 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:09.224984 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a28c9c64-e15c-4151-9dda-a55410d18a29 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:09.225686 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a28c9c64-e15c-4151-9dda-a55410d18a29 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:09.226145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a28c9c64-e15c-4151-9dda-a55410d18a29 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:09.226567 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a28c9c64-e15c-4151-9dda-a55410d18a29 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:09.255927 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a28c9c64-e15c-4151-9dda-a55410d18a29 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044959 Aug 10 12:52:09.256489 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 819/1653] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:09 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:09.311161 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-01462d35-570f-491b-92e7-dc96b73ded6f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:52:09.313317 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-01462d35-570f-491b-92e7-dc96b73ded6f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:09.315639 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=88 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:52:09.320323 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01462d35-570f-491b-92e7-dc96b73ded6f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:09.320804 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01462d35-570f-491b-92e7-dc96b73ded6f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:09.321235 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01462d35-570f-491b-92e7-dc96b73ded6f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:09.321923 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01462d35-570f-491b-92e7-dc96b73ded6f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:09.322373 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01462d35-570f-491b-92e7-dc96b73ded6f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:09.322796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01462d35-570f-491b-92e7-dc96b73ded6f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:09.363703 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a8aed6db-6598-43f1-8b64-e1e1c78c4ae5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:09.365906 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a8aed6db-6598-43f1-8b64-e1e1c78c4ae5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:09.372327 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a8aed6db-6598-43f1-8b64-e1e1c78c4ae5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:09.372814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a8aed6db-6598-43f1-8b64-e1e1c78c4ae5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:09.373247 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a8aed6db-6598-43f1-8b64-e1e1c78c4ae5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:09.373937 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a8aed6db-6598-43f1-8b64-e1e1c78c4ae5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:09.374389 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a8aed6db-6598-43f1-8b64-e1e1c78c4ae5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:09.374813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a8aed6db-6598-43f1-8b64-e1e1c78c4ae5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:09.397404 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-01462d35-570f-491b-92e7-dc96b73ded6f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "POST /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/action" status: 200 len: 41131 microversion: 2.1 time: 0.089919 Aug 10 12:52:09.400793 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 835/1654] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 10 12:52:09 2022] POST /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566/action => generated 41131 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:52:09.405217 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a8aed6db-6598-43f1-8b64-e1e1c78c4ae5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045542 Aug 10 12:52:09.405772 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 820/1655] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:09 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:52:10.268508 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e9b36626-fdd2-4908-9946-648ee8038f1a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:10.270885 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e9b36626-fdd2-4908-9946-648ee8038f1a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:10.277899 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e9b36626-fdd2-4908-9946-648ee8038f1a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:10.278375 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e9b36626-fdd2-4908-9946-648ee8038f1a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:10.278810 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e9b36626-fdd2-4908-9946-648ee8038f1a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:10.279528 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e9b36626-fdd2-4908-9946-648ee8038f1a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:10.279979 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e9b36626-fdd2-4908-9946-648ee8038f1a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:10.280404 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e9b36626-fdd2-4908-9946-648ee8038f1a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:10.311378 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e9b36626-fdd2-4908-9946-648ee8038f1a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047180 Aug 10 12:52:10.311988 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 836/1656] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:10 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:10.417475 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-26e0a883-9819-4a25-841d-0c3d890fb482 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:10.419656 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-26e0a883-9819-4a25-841d-0c3d890fb482 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:10.426633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26e0a883-9819-4a25-841d-0c3d890fb482 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:10.427107 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26e0a883-9819-4a25-841d-0c3d890fb482 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:10.427560 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26e0a883-9819-4a25-841d-0c3d890fb482 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:10.428244 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26e0a883-9819-4a25-841d-0c3d890fb482 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:10.428728 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26e0a883-9819-4a25-841d-0c3d890fb482 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:10.429152 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26e0a883-9819-4a25-841d-0c3d890fb482 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:10.457447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-26e0a883-9819-4a25-841d-0c3d890fb482 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043880 Aug 10 12:52:10.458145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 821/1657] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:10 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:11.323767 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5302ca9e-026a-440e-a459-88977220bc44 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:11.325918 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5302ca9e-026a-440e-a459-88977220bc44 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:11.332301 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5302ca9e-026a-440e-a459-88977220bc44 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:11.332865 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5302ca9e-026a-440e-a459-88977220bc44 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:11.333301 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5302ca9e-026a-440e-a459-88977220bc44 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:11.333994 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5302ca9e-026a-440e-a459-88977220bc44 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:11.334443 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5302ca9e-026a-440e-a459-88977220bc44 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:11.334864 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5302ca9e-026a-440e-a459-88977220bc44 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:11.364547 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5302ca9e-026a-440e-a459-88977220bc44 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044891 Aug 10 12:52:11.365094 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 837/1658] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:11 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:11.468748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-30d00aa4-1530-4af2-82e0-8db8096bfba0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:11.470912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-30d00aa4-1530-4af2-82e0-8db8096bfba0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:11.477407 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-30d00aa4-1530-4af2-82e0-8db8096bfba0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:11.477877 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-30d00aa4-1530-4af2-82e0-8db8096bfba0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:11.478313 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-30d00aa4-1530-4af2-82e0-8db8096bfba0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:11.478988 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-30d00aa4-1530-4af2-82e0-8db8096bfba0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:11.479789 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-30d00aa4-1530-4af2-82e0-8db8096bfba0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:11.480209 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-30d00aa4-1530-4af2-82e0-8db8096bfba0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:11.509162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-30d00aa4-1530-4af2-82e0-8db8096bfba0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044394 Aug 10 12:52:11.509694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 822/1659] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:11 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:12.376047 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-cf8a2fe2-7ae5-446a-9083-c57591027bcf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:12.378196 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-cf8a2fe2-7ae5-446a-9083-c57591027bcf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:12.385174 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf8a2fe2-7ae5-446a-9083-c57591027bcf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:12.385661 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf8a2fe2-7ae5-446a-9083-c57591027bcf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:12.386100 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf8a2fe2-7ae5-446a-9083-c57591027bcf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:12.386834 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf8a2fe2-7ae5-446a-9083-c57591027bcf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:12.387327 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf8a2fe2-7ae5-446a-9083-c57591027bcf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:12.387758 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf8a2fe2-7ae5-446a-9083-c57591027bcf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:12.418189 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-cf8a2fe2-7ae5-446a-9083-c57591027bcf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046104 Aug 10 12:52:12.418732 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 838/1660] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:12 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:12.521972 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-15beaae5-6656-4be6-a809-64347a2d796d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:12.524143 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-15beaae5-6656-4be6-a809-64347a2d796d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:12.530522 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-15beaae5-6656-4be6-a809-64347a2d796d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:12.530947 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-15beaae5-6656-4be6-a809-64347a2d796d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:12.531414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-15beaae5-6656-4be6-a809-64347a2d796d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:12.532129 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-15beaae5-6656-4be6-a809-64347a2d796d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:12.532579 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-15beaae5-6656-4be6-a809-64347a2d796d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:12.533003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-15beaae5-6656-4be6-a809-64347a2d796d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:12.561015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-15beaae5-6656-4be6-a809-64347a2d796d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043749 Aug 10 12:52:12.561557 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 823/1661] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:12 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:13.431024 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-33acbd9f-95ef-48c3-82ad-3533a6eb49d5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:13.433103 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-33acbd9f-95ef-48c3-82ad-3533a6eb49d5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:13.439642 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-33acbd9f-95ef-48c3-82ad-3533a6eb49d5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:13.440133 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-33acbd9f-95ef-48c3-82ad-3533a6eb49d5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:13.440603 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-33acbd9f-95ef-48c3-82ad-3533a6eb49d5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:13.441299 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-33acbd9f-95ef-48c3-82ad-3533a6eb49d5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:13.441854 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-33acbd9f-95ef-48c3-82ad-3533a6eb49d5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:13.442286 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-33acbd9f-95ef-48c3-82ad-3533a6eb49d5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:13.470209 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-33acbd9f-95ef-48c3-82ad-3533a6eb49d5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043273 Aug 10 12:52:13.470767 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 839/1662] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:13 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:13.573122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-71cc4ebb-a346-4456-ab4a-5fffe2d9faa7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:13.575354 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-71cc4ebb-a346-4456-ab4a-5fffe2d9faa7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:13.581750 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71cc4ebb-a346-4456-ab4a-5fffe2d9faa7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:13.582874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71cc4ebb-a346-4456-ab4a-5fffe2d9faa7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:13.583469 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71cc4ebb-a346-4456-ab4a-5fffe2d9faa7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:13.584219 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71cc4ebb-a346-4456-ab4a-5fffe2d9faa7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:13.584677 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71cc4ebb-a346-4456-ab4a-5fffe2d9faa7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:13.585097 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71cc4ebb-a346-4456-ab4a-5fffe2d9faa7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:13.621135 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-71cc4ebb-a346-4456-ab4a-5fffe2d9faa7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051894 Aug 10 12:52:13.621685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 824/1663] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:13 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:14.483443 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e137af1e-e91c-4299-af28-9d9143bb1f01 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:14.485553 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e137af1e-e91c-4299-af28-9d9143bb1f01 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:14.492209 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e137af1e-e91c-4299-af28-9d9143bb1f01 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:14.492688 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e137af1e-e91c-4299-af28-9d9143bb1f01 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:14.493122 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e137af1e-e91c-4299-af28-9d9143bb1f01 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:14.493808 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e137af1e-e91c-4299-af28-9d9143bb1f01 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:14.494258 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e137af1e-e91c-4299-af28-9d9143bb1f01 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:14.494679 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e137af1e-e91c-4299-af28-9d9143bb1f01 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:14.523292 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e137af1e-e91c-4299-af28-9d9143bb1f01 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044134 Aug 10 12:52:14.523842 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 840/1664] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:14 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:14.634069 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ce8007f1-bec0-47ad-9d4d-e283ae75eee1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:14.636244 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ce8007f1-bec0-47ad-9d4d-e283ae75eee1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:14.642472 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce8007f1-bec0-47ad-9d4d-e283ae75eee1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:14.642941 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce8007f1-bec0-47ad-9d4d-e283ae75eee1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:14.643412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce8007f1-bec0-47ad-9d4d-e283ae75eee1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:14.644091 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce8007f1-bec0-47ad-9d4d-e283ae75eee1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:14.644537 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce8007f1-bec0-47ad-9d4d-e283ae75eee1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:14.645594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce8007f1-bec0-47ad-9d4d-e283ae75eee1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:14.673401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ce8007f1-bec0-47ad-9d4d-e283ae75eee1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043397 Aug 10 12:52:14.673937 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 825/1665] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:14 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:15.535503 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-df3673d6-0a91-4726-acee-c76afca37244 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:15.537623 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-df3673d6-0a91-4726-acee-c76afca37244 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:15.544098 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-df3673d6-0a91-4726-acee-c76afca37244 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:15.544572 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-df3673d6-0a91-4726-acee-c76afca37244 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:15.545001 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-df3673d6-0a91-4726-acee-c76afca37244 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:15.545678 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-df3673d6-0a91-4726-acee-c76afca37244 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:15.546120 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-df3673d6-0a91-4726-acee-c76afca37244 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:15.546536 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-df3673d6-0a91-4726-acee-c76afca37244 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:15.576412 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-df3673d6-0a91-4726-acee-c76afca37244 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044933 Aug 10 12:52:15.576964 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 841/1666] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:15 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:15.685964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c3aaf5b1-c47d-4e0d-aa46-f51490aa9e84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:15.688185 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c3aaf5b1-c47d-4e0d-aa46-f51490aa9e84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:15.695027 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c3aaf5b1-c47d-4e0d-aa46-f51490aa9e84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:15.695537 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c3aaf5b1-c47d-4e0d-aa46-f51490aa9e84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:15.695969 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c3aaf5b1-c47d-4e0d-aa46-f51490aa9e84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:15.696656 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c3aaf5b1-c47d-4e0d-aa46-f51490aa9e84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:15.697106 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c3aaf5b1-c47d-4e0d-aa46-f51490aa9e84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:15.697529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c3aaf5b1-c47d-4e0d-aa46-f51490aa9e84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:15.726123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c3aaf5b1-c47d-4e0d-aa46-f51490aa9e84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044114 Aug 10 12:52:15.726661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 826/1667] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:15 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:16.589304 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c4e5d412-da23-4859-8e8f-e0cefa4c10b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:16.591482 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c4e5d412-da23-4859-8e8f-e0cefa4c10b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:16.598664 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c4e5d412-da23-4859-8e8f-e0cefa4c10b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:16.599147 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c4e5d412-da23-4859-8e8f-e0cefa4c10b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:16.599606 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c4e5d412-da23-4859-8e8f-e0cefa4c10b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:16.600430 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c4e5d412-da23-4859-8e8f-e0cefa4c10b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:16.600887 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c4e5d412-da23-4859-8e8f-e0cefa4c10b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:16.601310 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c4e5d412-da23-4859-8e8f-e0cefa4c10b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:16.630616 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c4e5d412-da23-4859-8e8f-e0cefa4c10b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045283 Aug 10 12:52:16.631192 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 842/1668] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:16 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:16.738525 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4937611f-5fdb-4fc6-930c-b3c9cfa5a331 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:16.740666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4937611f-5fdb-4fc6-930c-b3c9cfa5a331 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:16.746978 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4937611f-5fdb-4fc6-930c-b3c9cfa5a331 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:16.747489 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4937611f-5fdb-4fc6-930c-b3c9cfa5a331 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:16.747922 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4937611f-5fdb-4fc6-930c-b3c9cfa5a331 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:16.748609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4937611f-5fdb-4fc6-930c-b3c9cfa5a331 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:16.749059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4937611f-5fdb-4fc6-930c-b3c9cfa5a331 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:16.749488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4937611f-5fdb-4fc6-930c-b3c9cfa5a331 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:16.778062 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4937611f-5fdb-4fc6-930c-b3c9cfa5a331 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043589 Aug 10 12:52:16.778601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 827/1669] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:16 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:17.642833 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ede80a62-71fb-41df-8591-098ba6622ff4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:17.645021 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ede80a62-71fb-41df-8591-098ba6622ff4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:17.651359 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ede80a62-71fb-41df-8591-098ba6622ff4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:17.651839 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ede80a62-71fb-41df-8591-098ba6622ff4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:17.652273 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ede80a62-71fb-41df-8591-098ba6622ff4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:17.654549 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ede80a62-71fb-41df-8591-098ba6622ff4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:17.654549 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ede80a62-71fb-41df-8591-098ba6622ff4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:17.654549 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ede80a62-71fb-41df-8591-098ba6622ff4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:17.684253 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ede80a62-71fb-41df-8591-098ba6622ff4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045429 Aug 10 12:52:17.684809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 843/1670] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:17 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:17.790538 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-cf1df8f8-834b-4fd2-8846-f08951aca41e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:17.792686 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-cf1df8f8-834b-4fd2-8846-f08951aca41e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:17.798844 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cf1df8f8-834b-4fd2-8846-f08951aca41e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:17.799355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cf1df8f8-834b-4fd2-8846-f08951aca41e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:17.799796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cf1df8f8-834b-4fd2-8846-f08951aca41e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:17.800490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cf1df8f8-834b-4fd2-8846-f08951aca41e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:17.801662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cf1df8f8-834b-4fd2-8846-f08951aca41e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:17.802098 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cf1df8f8-834b-4fd2-8846-f08951aca41e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:17.830418 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-cf1df8f8-834b-4fd2-8846-f08951aca41e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043771 Aug 10 12:52:17.830965 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 828/1671] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:17 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:18.697229 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-439056bd-f6a1-41ab-963f-ccc5f766b8cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:18.699342 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-439056bd-f6a1-41ab-963f-ccc5f766b8cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:18.705664 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-439056bd-f6a1-41ab-963f-ccc5f766b8cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:18.706147 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-439056bd-f6a1-41ab-963f-ccc5f766b8cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:18.706581 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-439056bd-f6a1-41ab-963f-ccc5f766b8cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:18.707959 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-439056bd-f6a1-41ab-963f-ccc5f766b8cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:18.708414 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-439056bd-f6a1-41ab-963f-ccc5f766b8cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:18.708838 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-439056bd-f6a1-41ab-963f-ccc5f766b8cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:18.737942 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-439056bd-f6a1-41ab-963f-ccc5f766b8cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044739 Aug 10 12:52:18.739195 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 844/1672] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:18 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:52:18.842150 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d22ea925-37a8-4eea-a2ac-8c9a233e6ac3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:18.844293 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d22ea925-37a8-4eea-a2ac-8c9a233e6ac3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:18.850859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d22ea925-37a8-4eea-a2ac-8c9a233e6ac3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:18.851374 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d22ea925-37a8-4eea-a2ac-8c9a233e6ac3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:18.851811 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d22ea925-37a8-4eea-a2ac-8c9a233e6ac3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:18.852496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d22ea925-37a8-4eea-a2ac-8c9a233e6ac3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:18.852945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d22ea925-37a8-4eea-a2ac-8c9a233e6ac3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:18.853364 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d22ea925-37a8-4eea-a2ac-8c9a233e6ac3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:18.881579 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d22ea925-37a8-4eea-a2ac-8c9a233e6ac3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043609 Aug 10 12:52:18.882114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 829/1673] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:18 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:19.750950 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3749af6d-28b8-4c23-8adb-09e5ea4a2b8a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:19.753065 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3749af6d-28b8-4c23-8adb-09e5ea4a2b8a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:19.760049 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3749af6d-28b8-4c23-8adb-09e5ea4a2b8a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:19.760531 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3749af6d-28b8-4c23-8adb-09e5ea4a2b8a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:19.760970 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3749af6d-28b8-4c23-8adb-09e5ea4a2b8a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:19.761654 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3749af6d-28b8-4c23-8adb-09e5ea4a2b8a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:19.762104 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3749af6d-28b8-4c23-8adb-09e5ea4a2b8a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:19.762525 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3749af6d-28b8-4c23-8adb-09e5ea4a2b8a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:19.790916 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3749af6d-28b8-4c23-8adb-09e5ea4a2b8a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043953 Aug 10 12:52:19.791489 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 845/1674] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:19 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:19.893872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b4c9b986-c5c4-4757-ac3e-0c714b6d01e6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:19.896063 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b4c9b986-c5c4-4757-ac3e-0c714b6d01e6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:19.902323 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4c9b986-c5c4-4757-ac3e-0c714b6d01e6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:19.902800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4c9b986-c5c4-4757-ac3e-0c714b6d01e6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:19.903533 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4c9b986-c5c4-4757-ac3e-0c714b6d01e6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:19.904209 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4c9b986-c5c4-4757-ac3e-0c714b6d01e6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:19.904653 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4c9b986-c5c4-4757-ac3e-0c714b6d01e6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:19.905071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4c9b986-c5c4-4757-ac3e-0c714b6d01e6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:19.908546 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:52:19.936290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b4c9b986-c5c4-4757-ac3e-0c714b6d01e6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046369 Aug 10 12:52:19.936877 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 830/1675] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:19 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:20.803335 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3bf96255-2958-445c-8e37-f1c56497afee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:20.805467 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3bf96255-2958-445c-8e37-f1c56497afee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:20.811806 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3bf96255-2958-445c-8e37-f1c56497afee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:20.812301 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3bf96255-2958-445c-8e37-f1c56497afee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:20.812720 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3bf96255-2958-445c-8e37-f1c56497afee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:20.813408 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3bf96255-2958-445c-8e37-f1c56497afee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:20.813856 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3bf96255-2958-445c-8e37-f1c56497afee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:20.814280 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3bf96255-2958-445c-8e37-f1c56497afee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:20.828276 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:52:20.844456 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3bf96255-2958-445c-8e37-f1c56497afee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045409 Aug 10 12:52:20.845008 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 846/1676] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:20 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:20.949060 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1aef62f7-d1dc-4af6-8dc2-c95fd13390b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:20.951290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1aef62f7-d1dc-4af6-8dc2-c95fd13390b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:20.958433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1aef62f7-d1dc-4af6-8dc2-c95fd13390b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:20.958926 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1aef62f7-d1dc-4af6-8dc2-c95fd13390b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:20.961693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1aef62f7-d1dc-4af6-8dc2-c95fd13390b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:20.961693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1aef62f7-d1dc-4af6-8dc2-c95fd13390b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:20.961693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1aef62f7-d1dc-4af6-8dc2-c95fd13390b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:20.961693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1aef62f7-d1dc-4af6-8dc2-c95fd13390b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:20.990835 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1aef62f7-d1dc-4af6-8dc2-c95fd13390b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046090 Aug 10 12:52:20.991420 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 831/1677] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:20 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:21.857401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0e6601f4-487c-4313-b658-8e8d172a8fce tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:21.859573 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0e6601f4-487c-4313-b658-8e8d172a8fce tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:21.866697 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e6601f4-487c-4313-b658-8e8d172a8fce tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:21.867197 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e6601f4-487c-4313-b658-8e8d172a8fce tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:21.867633 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e6601f4-487c-4313-b658-8e8d172a8fce tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:21.868317 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e6601f4-487c-4313-b658-8e8d172a8fce tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:21.868769 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e6601f4-487c-4313-b658-8e8d172a8fce tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:21.869190 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e6601f4-487c-4313-b658-8e8d172a8fce tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:21.897933 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0e6601f4-487c-4313-b658-8e8d172a8fce tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045046 Aug 10 12:52:21.898491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 847/1678] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:21 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:52:22.003266 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-eec3975e-99f1-4cdb-9d4f-cb9b768c51b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:22.005408 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-eec3975e-99f1-4cdb-9d4f-cb9b768c51b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:22.011811 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eec3975e-99f1-4cdb-9d4f-cb9b768c51b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:22.012285 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eec3975e-99f1-4cdb-9d4f-cb9b768c51b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:22.012713 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eec3975e-99f1-4cdb-9d4f-cb9b768c51b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:22.013390 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eec3975e-99f1-4cdb-9d4f-cb9b768c51b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:22.013834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eec3975e-99f1-4cdb-9d4f-cb9b768c51b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:22.014254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eec3975e-99f1-4cdb-9d4f-cb9b768c51b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:22.043504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-eec3975e-99f1-4cdb-9d4f-cb9b768c51b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044182 Aug 10 12:52:22.044228 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 832/1679] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:21 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:22.909952 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d467e4af-5b21-44b0-9616-e27cd3ccfa32 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:22.912733 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d467e4af-5b21-44b0-9616-e27cd3ccfa32 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:22.919019 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d467e4af-5b21-44b0-9616-e27cd3ccfa32 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:22.919529 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d467e4af-5b21-44b0-9616-e27cd3ccfa32 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:22.919965 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d467e4af-5b21-44b0-9616-e27cd3ccfa32 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:22.920650 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d467e4af-5b21-44b0-9616-e27cd3ccfa32 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:22.921108 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d467e4af-5b21-44b0-9616-e27cd3ccfa32 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:22.921532 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d467e4af-5b21-44b0-9616-e27cd3ccfa32 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:22.950051 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d467e4af-5b21-44b0-9616-e27cd3ccfa32 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044095 Aug 10 12:52:22.950603 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 848/1680] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:22 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:23.055331 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0131b863-c319-4833-a1c4-c28b2876abef tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:23.057488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0131b863-c319-4833-a1c4-c28b2876abef tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:23.063969 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0131b863-c319-4833-a1c4-c28b2876abef tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:23.064448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0131b863-c319-4833-a1c4-c28b2876abef tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:23.064882 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0131b863-c319-4833-a1c4-c28b2876abef tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:23.065571 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0131b863-c319-4833-a1c4-c28b2876abef tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:23.066022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0131b863-c319-4833-a1c4-c28b2876abef tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:23.066849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0131b863-c319-4833-a1c4-c28b2876abef tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:23.095380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0131b863-c319-4833-a1c4-c28b2876abef tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044627 Aug 10 12:52:23.095925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 833/1681] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:23 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:23.962651 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e5e926ab-a8bd-49b8-9e39-ad7077a57d66 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:23.964750 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e5e926ab-a8bd-49b8-9e39-ad7077a57d66 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:23.971037 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5e926ab-a8bd-49b8-9e39-ad7077a57d66 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:23.971544 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5e926ab-a8bd-49b8-9e39-ad7077a57d66 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:23.971966 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5e926ab-a8bd-49b8-9e39-ad7077a57d66 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:23.972636 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5e926ab-a8bd-49b8-9e39-ad7077a57d66 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:23.973077 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5e926ab-a8bd-49b8-9e39-ad7077a57d66 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:23.973492 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5e926ab-a8bd-49b8-9e39-ad7077a57d66 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:24.003038 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e5e926ab-a8bd-49b8-9e39-ad7077a57d66 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044450 Aug 10 12:52:24.003624 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 849/1682] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:23 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:52:24.108208 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b1539958-9701-4076-a5b8-c0ad73db3cbb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:24.110348 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b1539958-9701-4076-a5b8-c0ad73db3cbb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:24.117032 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1539958-9701-4076-a5b8-c0ad73db3cbb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:24.117513 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1539958-9701-4076-a5b8-c0ad73db3cbb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:24.117946 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1539958-9701-4076-a5b8-c0ad73db3cbb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:24.118626 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1539958-9701-4076-a5b8-c0ad73db3cbb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:24.119075 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1539958-9701-4076-a5b8-c0ad73db3cbb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:24.119591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1539958-9701-4076-a5b8-c0ad73db3cbb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:24.147720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b1539958-9701-4076-a5b8-c0ad73db3cbb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043655 Aug 10 12:52:24.148263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 834/1683] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:24 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:25.015973 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-43995055-530b-4f74-8f1e-1c8e9dd48487 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:25.018106 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-43995055-530b-4f74-8f1e-1c8e9dd48487 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:25.024667 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-43995055-530b-4f74-8f1e-1c8e9dd48487 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:25.025494 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-43995055-530b-4f74-8f1e-1c8e9dd48487 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:25.025923 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-43995055-530b-4f74-8f1e-1c8e9dd48487 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:25.026600 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-43995055-530b-4f74-8f1e-1c8e9dd48487 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:25.027043 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-43995055-530b-4f74-8f1e-1c8e9dd48487 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:25.027483 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-43995055-530b-4f74-8f1e-1c8e9dd48487 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:25.056219 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-43995055-530b-4f74-8f1e-1c8e9dd48487 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044201 Aug 10 12:52:25.056770 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 850/1684] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:25 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:25.160517 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a302fdab-ef34-4eb1-95af-f0a9e21ead4a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:25.163005 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a302fdab-ef34-4eb1-95af-f0a9e21ead4a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:25.169384 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a302fdab-ef34-4eb1-95af-f0a9e21ead4a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:25.169865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a302fdab-ef34-4eb1-95af-f0a9e21ead4a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:25.170301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a302fdab-ef34-4eb1-95af-f0a9e21ead4a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:25.170994 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a302fdab-ef34-4eb1-95af-f0a9e21ead4a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:25.171470 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a302fdab-ef34-4eb1-95af-f0a9e21ead4a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:25.171895 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a302fdab-ef34-4eb1-95af-f0a9e21ead4a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:25.201032 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a302fdab-ef34-4eb1-95af-f0a9e21ead4a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044930 Aug 10 12:52:25.201592 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 835/1685] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:25 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:26.068456 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ca34b53b-e579-44d9-a52b-d21efd24aa7e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:26.070587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ca34b53b-e579-44d9-a52b-d21efd24aa7e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:26.077126 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca34b53b-e579-44d9-a52b-d21efd24aa7e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:26.077604 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca34b53b-e579-44d9-a52b-d21efd24aa7e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:26.078036 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca34b53b-e579-44d9-a52b-d21efd24aa7e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:26.078722 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca34b53b-e579-44d9-a52b-d21efd24aa7e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:26.079187 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca34b53b-e579-44d9-a52b-d21efd24aa7e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:26.079615 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca34b53b-e579-44d9-a52b-d21efd24aa7e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:26.108366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ca34b53b-e579-44d9-a52b-d21efd24aa7e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043963 Aug 10 12:52:26.108912 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 851/1686] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:26 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:26.214611 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0c68ad9a-5382-4bc9-ae2b-4a8ee6c770fd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:26.216776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0c68ad9a-5382-4bc9-ae2b-4a8ee6c770fd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:26.223646 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0c68ad9a-5382-4bc9-ae2b-4a8ee6c770fd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:26.224263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0c68ad9a-5382-4bc9-ae2b-4a8ee6c770fd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:26.224695 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0c68ad9a-5382-4bc9-ae2b-4a8ee6c770fd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:26.225382 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0c68ad9a-5382-4bc9-ae2b-4a8ee6c770fd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:26.225825 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0c68ad9a-5382-4bc9-ae2b-4a8ee6c770fd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:26.226253 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0c68ad9a-5382-4bc9-ae2b-4a8ee6c770fd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:26.255372 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0c68ad9a-5382-4bc9-ae2b-4a8ee6c770fd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044626 Aug 10 12:52:26.255926 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 836/1687] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:26 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:27.120692 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1d44fb70-4356-4488-aa02-995d223a5a0d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:27.122831 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1d44fb70-4356-4488-aa02-995d223a5a0d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:27.130027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d44fb70-4356-4488-aa02-995d223a5a0d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:27.130534 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d44fb70-4356-4488-aa02-995d223a5a0d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:27.130970 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d44fb70-4356-4488-aa02-995d223a5a0d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:27.131697 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d44fb70-4356-4488-aa02-995d223a5a0d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:27.132152 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d44fb70-4356-4488-aa02-995d223a5a0d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:27.132579 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d44fb70-4356-4488-aa02-995d223a5a0d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:27.160961 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1d44fb70-4356-4488-aa02-995d223a5a0d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044290 Aug 10 12:52:27.161517 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 852/1688] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:27 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:27.267525 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7ddc7ed8-d2ab-4b28-8a26-97ede14d5694 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:27.270127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7ddc7ed8-d2ab-4b28-8a26-97ede14d5694 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:27.276534 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7ddc7ed8-d2ab-4b28-8a26-97ede14d5694 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:27.277010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7ddc7ed8-d2ab-4b28-8a26-97ede14d5694 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:27.277436 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7ddc7ed8-d2ab-4b28-8a26-97ede14d5694 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:27.278122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7ddc7ed8-d2ab-4b28-8a26-97ede14d5694 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:27.278566 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7ddc7ed8-d2ab-4b28-8a26-97ede14d5694 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:27.278986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7ddc7ed8-d2ab-4b28-8a26-97ede14d5694 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:27.308722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7ddc7ed8-d2ab-4b28-8a26-97ede14d5694 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045189 Aug 10 12:52:27.309270 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 837/1689] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:27 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:28.173155 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-890ca655-02ba-4879-89d1-41a68fdee7b3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:28.175215 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-890ca655-02ba-4879-89d1-41a68fdee7b3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:28.182510 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-890ca655-02ba-4879-89d1-41a68fdee7b3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:28.182982 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-890ca655-02ba-4879-89d1-41a68fdee7b3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:28.183525 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-890ca655-02ba-4879-89d1-41a68fdee7b3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:28.184205 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-890ca655-02ba-4879-89d1-41a68fdee7b3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:28.184649 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-890ca655-02ba-4879-89d1-41a68fdee7b3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:28.185065 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-890ca655-02ba-4879-89d1-41a68fdee7b3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:28.214171 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-890ca655-02ba-4879-89d1-41a68fdee7b3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045008 Aug 10 12:52:28.214725 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 853/1690] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:28 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:52:28.321083 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6ede3fa4-bb9c-4a18-984e-fabe4f748a56 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:28.323214 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6ede3fa4-bb9c-4a18-984e-fabe4f748a56 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:28.329463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ede3fa4-bb9c-4a18-984e-fabe4f748a56 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:28.329938 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ede3fa4-bb9c-4a18-984e-fabe4f748a56 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:28.330364 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ede3fa4-bb9c-4a18-984e-fabe4f748a56 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:28.331043 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ede3fa4-bb9c-4a18-984e-fabe4f748a56 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:28.331513 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ede3fa4-bb9c-4a18-984e-fabe4f748a56 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:28.331961 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ede3fa4-bb9c-4a18-984e-fabe4f748a56 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:28.360588 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6ede3fa4-bb9c-4a18-984e-fabe4f748a56 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043625 Aug 10 12:52:28.361120 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 838/1691] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:28 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:29.226510 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-07db5e16-a50f-40b3-ab27-02c349b85da6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:29.228622 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-07db5e16-a50f-40b3-ab27-02c349b85da6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:29.235247 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-07db5e16-a50f-40b3-ab27-02c349b85da6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:29.235730 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-07db5e16-a50f-40b3-ab27-02c349b85da6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:29.236163 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-07db5e16-a50f-40b3-ab27-02c349b85da6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:29.236854 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-07db5e16-a50f-40b3-ab27-02c349b85da6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:29.237299 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-07db5e16-a50f-40b3-ab27-02c349b85da6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:29.237727 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-07db5e16-a50f-40b3-ab27-02c349b85da6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:29.267534 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-07db5e16-a50f-40b3-ab27-02c349b85da6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045163 Aug 10 12:52:29.268090 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 854/1692] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:29 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:29.372540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-32bc145f-30ae-4639-912c-69e1b07dc4c0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:29.374714 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-32bc145f-30ae-4639-912c-69e1b07dc4c0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:29.381882 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-32bc145f-30ae-4639-912c-69e1b07dc4c0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:29.382366 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-32bc145f-30ae-4639-912c-69e1b07dc4c0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:29.382807 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-32bc145f-30ae-4639-912c-69e1b07dc4c0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:29.383536 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-32bc145f-30ae-4639-912c-69e1b07dc4c0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:29.383993 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-32bc145f-30ae-4639-912c-69e1b07dc4c0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:29.384422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-32bc145f-30ae-4639-912c-69e1b07dc4c0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:29.412508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-32bc145f-30ae-4639-912c-69e1b07dc4c0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044019 Aug 10 12:52:29.413080 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 839/1693] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:29 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:30.280368 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f9e3be08-ecc0-4a76-9466-7980084344e3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:30.282503 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f9e3be08-ecc0-4a76-9466-7980084344e3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:30.289522 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f9e3be08-ecc0-4a76-9466-7980084344e3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:30.289995 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f9e3be08-ecc0-4a76-9466-7980084344e3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:30.290423 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f9e3be08-ecc0-4a76-9466-7980084344e3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:30.291106 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f9e3be08-ecc0-4a76-9466-7980084344e3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:30.291576 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f9e3be08-ecc0-4a76-9466-7980084344e3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:30.291990 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f9e3be08-ecc0-4a76-9466-7980084344e3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:30.319760 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f9e3be08-ecc0-4a76-9466-7980084344e3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043362 Aug 10 12:52:30.320304 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 855/1694] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:30 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:52:30.424676 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9c2f2154-754d-4979-8974-2dfeccb92218 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:30.427081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9c2f2154-754d-4979-8974-2dfeccb92218 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:30.433406 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9c2f2154-754d-4979-8974-2dfeccb92218 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:30.433879 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9c2f2154-754d-4979-8974-2dfeccb92218 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:30.434306 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9c2f2154-754d-4979-8974-2dfeccb92218 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:30.434981 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9c2f2154-754d-4979-8974-2dfeccb92218 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:30.435449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9c2f2154-754d-4979-8974-2dfeccb92218 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:30.435867 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9c2f2154-754d-4979-8974-2dfeccb92218 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:30.465067 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9c2f2154-754d-4979-8974-2dfeccb92218 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044490 Aug 10 12:52:30.465596 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 840/1695] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:30 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:31.332385 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b1d5762d-78c5-4fcc-841c-d2f8ef75da09 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:31.334518 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b1d5762d-78c5-4fcc-841c-d2f8ef75da09 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:31.340840 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1d5762d-78c5-4fcc-841c-d2f8ef75da09 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:31.341316 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1d5762d-78c5-4fcc-841c-d2f8ef75da09 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:31.341749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1d5762d-78c5-4fcc-841c-d2f8ef75da09 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:31.342422 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1d5762d-78c5-4fcc-841c-d2f8ef75da09 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:31.342869 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1d5762d-78c5-4fcc-841c-d2f8ef75da09 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:31.343313 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1d5762d-78c5-4fcc-841c-d2f8ef75da09 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:31.373157 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b1d5762d-78c5-4fcc-841c-d2f8ef75da09 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045162 Aug 10 12:52:31.373695 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 856/1696] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:31 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:31.477572 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a46eade1-a8d8-4154-8c78-66f132fe74b6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:31.480003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a46eade1-a8d8-4154-8c78-66f132fe74b6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:31.486272 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a46eade1-a8d8-4154-8c78-66f132fe74b6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:31.486742 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a46eade1-a8d8-4154-8c78-66f132fe74b6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:31.487225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a46eade1-a8d8-4154-8c78-66f132fe74b6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:31.487904 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a46eade1-a8d8-4154-8c78-66f132fe74b6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:31.488944 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a46eade1-a8d8-4154-8c78-66f132fe74b6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:31.489539 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a46eade1-a8d8-4154-8c78-66f132fe74b6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:31.517902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a46eade1-a8d8-4154-8c78-66f132fe74b6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044219 Aug 10 12:52:31.518451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 841/1697] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:31 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:32.385304 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-10b4ca85-5e9f-4be9-8c3d-4f28ae0ddef3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:32.387526 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-10b4ca85-5e9f-4be9-8c3d-4f28ae0ddef3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:32.393867 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-10b4ca85-5e9f-4be9-8c3d-4f28ae0ddef3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:32.394903 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-10b4ca85-5e9f-4be9-8c3d-4f28ae0ddef3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:32.395378 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-10b4ca85-5e9f-4be9-8c3d-4f28ae0ddef3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:32.396061 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-10b4ca85-5e9f-4be9-8c3d-4f28ae0ddef3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:32.396507 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-10b4ca85-5e9f-4be9-8c3d-4f28ae0ddef3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:32.396930 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-10b4ca85-5e9f-4be9-8c3d-4f28ae0ddef3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:32.428899 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-10b4ca85-5e9f-4be9-8c3d-4f28ae0ddef3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047390 Aug 10 12:52:32.429476 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 857/1698] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:32 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:32.530314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-66d71aba-a5ab-46eb-a63b-38d6454997db tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:32.532425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-66d71aba-a5ab-46eb-a63b-38d6454997db tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:32.538958 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-66d71aba-a5ab-46eb-a63b-38d6454997db tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:32.539462 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-66d71aba-a5ab-46eb-a63b-38d6454997db tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:32.539893 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-66d71aba-a5ab-46eb-a63b-38d6454997db tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:32.540569 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-66d71aba-a5ab-46eb-a63b-38d6454997db tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:32.541014 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-66d71aba-a5ab-46eb-a63b-38d6454997db tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:32.541431 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-66d71aba-a5ab-46eb-a63b-38d6454997db tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:32.570046 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-66d71aba-a5ab-46eb-a63b-38d6454997db tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043782 Aug 10 12:52:32.570656 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 842/1699] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:32 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:33.442492 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ed1a2d3f-97a9-4476-99ce-edc5fb645bc6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:33.444615 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ed1a2d3f-97a9-4476-99ce-edc5fb645bc6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:33.450898 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ed1a2d3f-97a9-4476-99ce-edc5fb645bc6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:33.451409 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ed1a2d3f-97a9-4476-99ce-edc5fb645bc6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:33.451845 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ed1a2d3f-97a9-4476-99ce-edc5fb645bc6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:33.452533 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ed1a2d3f-97a9-4476-99ce-edc5fb645bc6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:33.452984 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ed1a2d3f-97a9-4476-99ce-edc5fb645bc6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:33.453406 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ed1a2d3f-97a9-4476-99ce-edc5fb645bc6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:33.482395 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ed1a2d3f-97a9-4476-99ce-edc5fb645bc6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044812 Aug 10 12:52:33.482939 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 858/1700] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:33 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:33.583317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-39b6f82d-b88a-4f12-a2b1-7b1af2b111ce tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:33.585449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-39b6f82d-b88a-4f12-a2b1-7b1af2b111ce tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:33.587753 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=68 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:52:33.592387 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-39b6f82d-b88a-4f12-a2b1-7b1af2b111ce tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:33.596873 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-39b6f82d-b88a-4f12-a2b1-7b1af2b111ce tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:33.596873 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-39b6f82d-b88a-4f12-a2b1-7b1af2b111ce tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:33.596873 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-39b6f82d-b88a-4f12-a2b1-7b1af2b111ce tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:33.596873 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-39b6f82d-b88a-4f12-a2b1-7b1af2b111ce tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:33.597236 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-39b6f82d-b88a-4f12-a2b1-7b1af2b111ce tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:33.624372 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-39b6f82d-b88a-4f12-a2b1-7b1af2b111ce tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045858 Aug 10 12:52:33.624920 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 843/1701] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:33 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:34.495166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b27a2781-7503-4f02-857b-7a13b403e546 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:34.497263 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b27a2781-7503-4f02-857b-7a13b403e546 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:34.503648 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b27a2781-7503-4f02-857b-7a13b403e546 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:34.504132 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b27a2781-7503-4f02-857b-7a13b403e546 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:34.504572 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b27a2781-7503-4f02-857b-7a13b403e546 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:34.505263 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b27a2781-7503-4f02-857b-7a13b403e546 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:34.505716 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b27a2781-7503-4f02-857b-7a13b403e546 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:34.506146 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b27a2781-7503-4f02-857b-7a13b403e546 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:34.536404 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b27a2781-7503-4f02-857b-7a13b403e546 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045049 Aug 10 12:52:34.536979 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 859/1702] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:34 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:34.637029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d81147e2-ddf5-4c71-9677-d484ba19137f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:34.639191 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d81147e2-ddf5-4c71-9677-d484ba19137f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:34.646522 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d81147e2-ddf5-4c71-9677-d484ba19137f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:34.647010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d81147e2-ddf5-4c71-9677-d484ba19137f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:34.647491 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d81147e2-ddf5-4c71-9677-d484ba19137f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:34.648189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d81147e2-ddf5-4c71-9677-d484ba19137f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:34.648646 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d81147e2-ddf5-4c71-9677-d484ba19137f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:34.649097 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d81147e2-ddf5-4c71-9677-d484ba19137f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:34.677972 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d81147e2-ddf5-4c71-9677-d484ba19137f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044889 Aug 10 12:52:34.678519 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 844/1703] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:34 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:35.548720 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2c378e87-694e-4cb5-832b-744b0b6f05b2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:35.550870 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2c378e87-694e-4cb5-832b-744b0b6f05b2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:35.557246 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c378e87-694e-4cb5-832b-744b0b6f05b2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:35.557729 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c378e87-694e-4cb5-832b-744b0b6f05b2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:35.558163 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c378e87-694e-4cb5-832b-744b0b6f05b2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:35.558855 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c378e87-694e-4cb5-832b-744b0b6f05b2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:35.559343 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c378e87-694e-4cb5-832b-744b0b6f05b2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:35.559771 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c378e87-694e-4cb5-832b-744b0b6f05b2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:35.588600 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2c378e87-694e-4cb5-832b-744b0b6f05b2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043895 Aug 10 12:52:35.589158 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 860/1704] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:35 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:35.690179 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2da838a3-23d1-46b0-bbc1-2d755e54147f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:35.693071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2da838a3-23d1-46b0-bbc1-2d755e54147f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:35.699538 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2da838a3-23d1-46b0-bbc1-2d755e54147f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:35.700017 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2da838a3-23d1-46b0-bbc1-2d755e54147f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:35.700453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2da838a3-23d1-46b0-bbc1-2d755e54147f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:35.701143 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2da838a3-23d1-46b0-bbc1-2d755e54147f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:35.701594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2da838a3-23d1-46b0-bbc1-2d755e54147f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:35.702019 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2da838a3-23d1-46b0-bbc1-2d755e54147f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:35.731722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2da838a3-23d1-46b0-bbc1-2d755e54147f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045535 Aug 10 12:52:35.732274 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 845/1705] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:35 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:36.601002 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e18ce448-ccd0-4a95-bff2-143043395e97 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:36.603056 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e18ce448-ccd0-4a95-bff2-143043395e97 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:36.610180 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e18ce448-ccd0-4a95-bff2-143043395e97 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:36.610670 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e18ce448-ccd0-4a95-bff2-143043395e97 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:36.611107 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e18ce448-ccd0-4a95-bff2-143043395e97 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:36.611857 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e18ce448-ccd0-4a95-bff2-143043395e97 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:36.612353 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e18ce448-ccd0-4a95-bff2-143043395e97 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:36.612783 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e18ce448-ccd0-4a95-bff2-143043395e97 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:36.643060 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e18ce448-ccd0-4a95-bff2-143043395e97 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046147 Aug 10 12:52:36.643663 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 861/1706] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:36 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:36.744447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1c071461-1853-4995-a2bc-e1d6dd29ac54 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:36.746575 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1c071461-1853-4995-a2bc-e1d6dd29ac54 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:36.753025 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1c071461-1853-4995-a2bc-e1d6dd29ac54 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:36.753505 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1c071461-1853-4995-a2bc-e1d6dd29ac54 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:36.754588 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1c071461-1853-4995-a2bc-e1d6dd29ac54 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:36.755316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1c071461-1853-4995-a2bc-e1d6dd29ac54 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:36.755769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1c071461-1853-4995-a2bc-e1d6dd29ac54 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:36.756193 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1c071461-1853-4995-a2bc-e1d6dd29ac54 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:36.779996 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:52:36.784397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1c071461-1853-4995-a2bc-e1d6dd29ac54 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043926 Aug 10 12:52:36.785021 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 846/1707] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:36 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:37.655370 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3d20c33d-564d-41e2-b794-75c71a806200 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:37.657449 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3d20c33d-564d-41e2-b794-75c71a806200 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:37.665132 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d20c33d-564d-41e2-b794-75c71a806200 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:37.665605 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d20c33d-564d-41e2-b794-75c71a806200 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:37.666032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d20c33d-564d-41e2-b794-75c71a806200 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:37.666750 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d20c33d-564d-41e2-b794-75c71a806200 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:37.667220 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d20c33d-564d-41e2-b794-75c71a806200 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:37.667641 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d20c33d-564d-41e2-b794-75c71a806200 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:37.696865 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3d20c33d-564d-41e2-b794-75c71a806200 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045556 Aug 10 12:52:37.697419 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 862/1708] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:37 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:37.802581 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fbcf997b-86ab-426a-8b9e-9cbcbb1ddb84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:37.804716 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fbcf997b-86ab-426a-8b9e-9cbcbb1ddb84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:37.811268 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fbcf997b-86ab-426a-8b9e-9cbcbb1ddb84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:37.811747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fbcf997b-86ab-426a-8b9e-9cbcbb1ddb84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:37.812179 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fbcf997b-86ab-426a-8b9e-9cbcbb1ddb84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:37.812857 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fbcf997b-86ab-426a-8b9e-9cbcbb1ddb84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:37.813306 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fbcf997b-86ab-426a-8b9e-9cbcbb1ddb84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:37.813730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fbcf997b-86ab-426a-8b9e-9cbcbb1ddb84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:37.843093 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fbcf997b-86ab-426a-8b9e-9cbcbb1ddb84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044761 Aug 10 12:52:37.843670 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 847/1709] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:37 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:38.708458 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-20a025b5-7687-4e13-b414-9c03d2022905 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:38.710902 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-20a025b5-7687-4e13-b414-9c03d2022905 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:38.717490 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20a025b5-7687-4e13-b414-9c03d2022905 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:38.717973 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20a025b5-7687-4e13-b414-9c03d2022905 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:38.718408 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20a025b5-7687-4e13-b414-9c03d2022905 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:38.719110 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20a025b5-7687-4e13-b414-9c03d2022905 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:38.719598 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20a025b5-7687-4e13-b414-9c03d2022905 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:38.720017 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20a025b5-7687-4e13-b414-9c03d2022905 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:38.724159 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:52:38.750921 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-20a025b5-7687-4e13-b414-9c03d2022905 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046477 Aug 10 12:52:38.751519 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 863/1710] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:38 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:38.856537 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f143104a-be38-45de-9d6c-880f27e61d34 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:38.858877 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f143104a-be38-45de-9d6c-880f27e61d34 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:38.866180 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f143104a-be38-45de-9d6c-880f27e61d34 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:38.866667 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f143104a-be38-45de-9d6c-880f27e61d34 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:38.867101 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f143104a-be38-45de-9d6c-880f27e61d34 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:38.867820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f143104a-be38-45de-9d6c-880f27e61d34 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:38.868274 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f143104a-be38-45de-9d6c-880f27e61d34 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:38.868697 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f143104a-be38-45de-9d6c-880f27e61d34 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:38.897909 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f143104a-be38-45de-9d6c-880f27e61d34 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045559 Aug 10 12:52:38.898549 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 848/1711] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:38 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:39.763640 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4c4c9cde-9c1c-4d71-bd6b-9b3687f2c92a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:39.765787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4c4c9cde-9c1c-4d71-bd6b-9b3687f2c92a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:39.768082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=58 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:52:39.773554 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c4c9cde-9c1c-4d71-bd6b-9b3687f2c92a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:39.774025 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c4c9cde-9c1c-4d71-bd6b-9b3687f2c92a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:39.774452 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c4c9cde-9c1c-4d71-bd6b-9b3687f2c92a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:39.775127 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c4c9cde-9c1c-4d71-bd6b-9b3687f2c92a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:39.775594 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c4c9cde-9c1c-4d71-bd6b-9b3687f2c92a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:39.776007 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c4c9cde-9c1c-4d71-bd6b-9b3687f2c92a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:39.804780 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4c4c9cde-9c1c-4d71-bd6b-9b3687f2c92a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045455 Aug 10 12:52:39.805324 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 864/1712] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:39 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:39.910656 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e066f53c-3236-4336-bf5d-f2c17a1fa528 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:39.912893 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e066f53c-3236-4336-bf5d-f2c17a1fa528 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:39.919248 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e066f53c-3236-4336-bf5d-f2c17a1fa528 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:39.919730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e066f53c-3236-4336-bf5d-f2c17a1fa528 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:39.920164 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e066f53c-3236-4336-bf5d-f2c17a1fa528 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:39.920850 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e066f53c-3236-4336-bf5d-f2c17a1fa528 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:39.921299 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e066f53c-3236-4336-bf5d-f2c17a1fa528 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:39.921720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e066f53c-3236-4336-bf5d-f2c17a1fa528 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:39.949917 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e066f53c-3236-4336-bf5d-f2c17a1fa528 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043920 Aug 10 12:52:39.950461 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 849/1713] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:39 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:40.817290 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ae00d4a8-88b3-4a61-8d91-6afa74e55eb2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:40.819427 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ae00d4a8-88b3-4a61-8d91-6afa74e55eb2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:40.826222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ae00d4a8-88b3-4a61-8d91-6afa74e55eb2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:40.826698 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ae00d4a8-88b3-4a61-8d91-6afa74e55eb2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:40.827127 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ae00d4a8-88b3-4a61-8d91-6afa74e55eb2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:40.827853 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ae00d4a8-88b3-4a61-8d91-6afa74e55eb2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:40.828301 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ae00d4a8-88b3-4a61-8d91-6afa74e55eb2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:40.828721 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ae00d4a8-88b3-4a61-8d91-6afa74e55eb2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:40.858107 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ae00d4a8-88b3-4a61-8d91-6afa74e55eb2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044966 Aug 10 12:52:40.858659 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 865/1714] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:40 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:40.962809 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0d0dff05-5b04-4ffc-9473-8540a81eae17 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:40.964949 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0d0dff05-5b04-4ffc-9473-8540a81eae17 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:40.971297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0d0dff05-5b04-4ffc-9473-8540a81eae17 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:40.971776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0d0dff05-5b04-4ffc-9473-8540a81eae17 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:40.972205 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0d0dff05-5b04-4ffc-9473-8540a81eae17 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:40.973127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0d0dff05-5b04-4ffc-9473-8540a81eae17 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:40.973577 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0d0dff05-5b04-4ffc-9473-8540a81eae17 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:40.974000 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0d0dff05-5b04-4ffc-9473-8540a81eae17 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:41.002011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0d0dff05-5b04-4ffc-9473-8540a81eae17 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043205 Aug 10 12:52:41.002559 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 850/1715] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:40 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:41.870266 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c255ba57-9a01-4d1d-aa40-753c00859632 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:41.872420 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c255ba57-9a01-4d1d-aa40-753c00859632 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:41.879219 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c255ba57-9a01-4d1d-aa40-753c00859632 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:41.879704 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c255ba57-9a01-4d1d-aa40-753c00859632 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:41.880130 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c255ba57-9a01-4d1d-aa40-753c00859632 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:41.880810 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c255ba57-9a01-4d1d-aa40-753c00859632 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:41.881257 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c255ba57-9a01-4d1d-aa40-753c00859632 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:41.881671 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c255ba57-9a01-4d1d-aa40-753c00859632 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:41.910343 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c255ba57-9a01-4d1d-aa40-753c00859632 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043962 Aug 10 12:52:41.910958 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 866/1716] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:41 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:42.014120 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-62b59322-5cda-4f86-a82f-9738a0ea542d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:42.016312 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-62b59322-5cda-4f86-a82f-9738a0ea542d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:42.022855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-62b59322-5cda-4f86-a82f-9738a0ea542d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:42.023366 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-62b59322-5cda-4f86-a82f-9738a0ea542d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:42.023796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-62b59322-5cda-4f86-a82f-9738a0ea542d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:42.024522 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-62b59322-5cda-4f86-a82f-9738a0ea542d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:42.024966 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-62b59322-5cda-4f86-a82f-9738a0ea542d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:42.025387 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-62b59322-5cda-4f86-a82f-9738a0ea542d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:42.054514 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-62b59322-5cda-4f86-a82f-9738a0ea542d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044569 Aug 10 12:52:42.055051 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 851/1717] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:42 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:42.922132 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2bca661c-349d-4313-9b08-fd9dfeb722ef tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:42.924233 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2bca661c-349d-4313-9b08-fd9dfeb722ef tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:42.931204 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bca661c-349d-4313-9b08-fd9dfeb722ef tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:42.931690 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bca661c-349d-4313-9b08-fd9dfeb722ef tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:42.932126 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bca661c-349d-4313-9b08-fd9dfeb722ef tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:42.932822 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bca661c-349d-4313-9b08-fd9dfeb722ef tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:42.933269 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bca661c-349d-4313-9b08-fd9dfeb722ef tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:42.933691 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bca661c-349d-4313-9b08-fd9dfeb722ef tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:42.963609 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2bca661c-349d-4313-9b08-fd9dfeb722ef tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045536 Aug 10 12:52:42.964175 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 867/1718] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:42 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:43.066217 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8d6a1143-f14e-48c4-baae-a88a6abc05eb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:43.068764 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8d6a1143-f14e-48c4-baae-a88a6abc05eb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:43.075424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d6a1143-f14e-48c4-baae-a88a6abc05eb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:43.075916 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d6a1143-f14e-48c4-baae-a88a6abc05eb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:43.076350 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d6a1143-f14e-48c4-baae-a88a6abc05eb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:43.077047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d6a1143-f14e-48c4-baae-a88a6abc05eb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:43.077498 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d6a1143-f14e-48c4-baae-a88a6abc05eb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:43.077923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d6a1143-f14e-48c4-baae-a88a6abc05eb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:43.107140 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8d6a1143-f14e-48c4-baae-a88a6abc05eb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045038 Aug 10 12:52:43.107711 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 852/1719] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:43 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:43.975875 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-34b77d3e-18b3-4cbe-8ca8-a2882967884c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:43.977926 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-34b77d3e-18b3-4cbe-8ca8-a2882967884c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:43.984524 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34b77d3e-18b3-4cbe-8ca8-a2882967884c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:43.984997 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34b77d3e-18b3-4cbe-8ca8-a2882967884c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:43.985426 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34b77d3e-18b3-4cbe-8ca8-a2882967884c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:43.986105 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34b77d3e-18b3-4cbe-8ca8-a2882967884c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:43.986572 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34b77d3e-18b3-4cbe-8ca8-a2882967884c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:43.986988 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34b77d3e-18b3-4cbe-8ca8-a2882967884c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:44.015709 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-34b77d3e-18b3-4cbe-8ca8-a2882967884c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044382 Aug 10 12:52:44.016253 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 868/1720] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:43 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:44.119771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a586303f-e8e6-4258-9031-0db931f90ef9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:44.122176 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a586303f-e8e6-4258-9031-0db931f90ef9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:44.128694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a586303f-e8e6-4258-9031-0db931f90ef9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:44.129295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a586303f-e8e6-4258-9031-0db931f90ef9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:44.129736 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a586303f-e8e6-4258-9031-0db931f90ef9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:44.130458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a586303f-e8e6-4258-9031-0db931f90ef9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:44.130907 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a586303f-e8e6-4258-9031-0db931f90ef9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:44.131359 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a586303f-e8e6-4258-9031-0db931f90ef9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:44.159382 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a586303f-e8e6-4258-9031-0db931f90ef9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043560 Aug 10 12:52:44.160429 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 853/1721] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:44 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:45.027824 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f8869537-d2ef-4c2c-abb9-bb4f0d6f4bdc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:45.029999 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f8869537-d2ef-4c2c-abb9-bb4f0d6f4bdc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:45.036543 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f8869537-d2ef-4c2c-abb9-bb4f0d6f4bdc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:45.037012 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f8869537-d2ef-4c2c-abb9-bb4f0d6f4bdc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:45.037441 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f8869537-d2ef-4c2c-abb9-bb4f0d6f4bdc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:45.038124 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f8869537-d2ef-4c2c-abb9-bb4f0d6f4bdc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:45.038570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f8869537-d2ef-4c2c-abb9-bb4f0d6f4bdc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:45.038987 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f8869537-d2ef-4c2c-abb9-bb4f0d6f4bdc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:45.067738 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f8869537-d2ef-4c2c-abb9-bb4f0d6f4bdc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043867 Aug 10 12:52:45.068284 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 869/1722] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:45 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:45.171833 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-226961d8-3169-4d2f-886e-b921b0f40972 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:45.173934 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-226961d8-3169-4d2f-886e-b921b0f40972 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:45.180906 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-226961d8-3169-4d2f-886e-b921b0f40972 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:45.181379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-226961d8-3169-4d2f-886e-b921b0f40972 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:45.181805 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-226961d8-3169-4d2f-886e-b921b0f40972 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:45.182509 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-226961d8-3169-4d2f-886e-b921b0f40972 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:45.182952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-226961d8-3169-4d2f-886e-b921b0f40972 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:45.183394 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-226961d8-3169-4d2f-886e-b921b0f40972 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:45.212151 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-226961d8-3169-4d2f-886e-b921b0f40972 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044179 Aug 10 12:52:45.212892 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 854/1723] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:45 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:46.080189 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-239bf6f3-3753-4f73-9eb7-7fc57cd1413d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:46.082814 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-239bf6f3-3753-4f73-9eb7-7fc57cd1413d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:46.089194 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-239bf6f3-3753-4f73-9eb7-7fc57cd1413d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:46.089675 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-239bf6f3-3753-4f73-9eb7-7fc57cd1413d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:46.090110 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-239bf6f3-3753-4f73-9eb7-7fc57cd1413d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:46.090799 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-239bf6f3-3753-4f73-9eb7-7fc57cd1413d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:46.091283 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-239bf6f3-3753-4f73-9eb7-7fc57cd1413d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:46.091748 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-239bf6f3-3753-4f73-9eb7-7fc57cd1413d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:46.121054 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-239bf6f3-3753-4f73-9eb7-7fc57cd1413d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044896 Aug 10 12:52:46.121614 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 870/1724] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:46 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:46.224604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4d6d6efc-5cf9-410a-8465-443f648abea0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:46.226708 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4d6d6efc-5cf9-410a-8465-443f648abea0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:46.233238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d6d6efc-5cf9-410a-8465-443f648abea0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:46.233710 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d6d6efc-5cf9-410a-8465-443f648abea0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:46.234137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d6d6efc-5cf9-410a-8465-443f648abea0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:46.234811 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d6d6efc-5cf9-410a-8465-443f648abea0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:46.235281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d6d6efc-5cf9-410a-8465-443f648abea0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:46.235702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d6d6efc-5cf9-410a-8465-443f648abea0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:46.266349 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4d6d6efc-5cf9-410a-8465-443f648abea0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045928 Aug 10 12:52:46.266911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 855/1725] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:46 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:47.133890 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-23f0f6c1-0629-423c-a13d-d71b8b1ffca0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:52:47.136263 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-23f0f6c1-0629-423c-a13d-d71b8b1ffca0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:47.143051 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23f0f6c1-0629-423c-a13d-d71b8b1ffca0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:47.143565 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23f0f6c1-0629-423c-a13d-d71b8b1ffca0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:47.143998 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23f0f6c1-0629-423c-a13d-d71b8b1ffca0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:47.145295 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23f0f6c1-0629-423c-a13d-d71b8b1ffca0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:47.145741 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23f0f6c1-0629-423c-a13d-d71b8b1ffca0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:47.146153 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23f0f6c1-0629-423c-a13d-d71b8b1ffca0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:47.225329 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-23f0f6c1-0629-423c-a13d-d71b8b1ffca0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "POST /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/action" status: 200 len: 76222 microversion: 2.1 time: 0.095315 Aug 10 12:52:47.225973 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 871/1726] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 10 12:52:47 2022] POST /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0/action => generated 76222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:52:47.281756 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-60a59b83-c930-442e-af09-7084b7a6d1f4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:47.281756 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-60a59b83-c930-442e-af09-7084b7a6d1f4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:47.288302 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60a59b83-c930-442e-af09-7084b7a6d1f4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:47.288780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60a59b83-c930-442e-af09-7084b7a6d1f4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:47.289207 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60a59b83-c930-442e-af09-7084b7a6d1f4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:47.289890 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60a59b83-c930-442e-af09-7084b7a6d1f4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:47.290332 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60a59b83-c930-442e-af09-7084b7a6d1f4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:47.290748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60a59b83-c930-442e-af09-7084b7a6d1f4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:47.320521 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-60a59b83-c930-442e-af09-7084b7a6d1f4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045215 Aug 10 12:52:47.321064 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 856/1727] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:47 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:48.333433 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c080b229-8fa7-4a47-b2f7-7b885fc7d482 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:48.335734 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c080b229-8fa7-4a47-b2f7-7b885fc7d482 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:48.342574 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c080b229-8fa7-4a47-b2f7-7b885fc7d482 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:48.343054 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c080b229-8fa7-4a47-b2f7-7b885fc7d482 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:48.343522 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c080b229-8fa7-4a47-b2f7-7b885fc7d482 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:48.344214 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c080b229-8fa7-4a47-b2f7-7b885fc7d482 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:48.344665 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c080b229-8fa7-4a47-b2f7-7b885fc7d482 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:48.345089 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c080b229-8fa7-4a47-b2f7-7b885fc7d482 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:48.375999 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c080b229-8fa7-4a47-b2f7-7b885fc7d482 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047138 Aug 10 12:52:48.376559 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 872/1728] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:48 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:49.389711 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2d965a65-5dab-4bac-b15c-527f0fde25d0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:49.391876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2d965a65-5dab-4bac-b15c-527f0fde25d0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:49.397992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2d965a65-5dab-4bac-b15c-527f0fde25d0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:49.398694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2d965a65-5dab-4bac-b15c-527f0fde25d0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:49.399133 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2d965a65-5dab-4bac-b15c-527f0fde25d0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:49.399860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2d965a65-5dab-4bac-b15c-527f0fde25d0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:49.400312 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2d965a65-5dab-4bac-b15c-527f0fde25d0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:49.400741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2d965a65-5dab-4bac-b15c-527f0fde25d0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:49.430556 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2d965a65-5dab-4bac-b15c-527f0fde25d0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045176 Aug 10 12:52:49.431102 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 857/1729] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:49 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:50.443757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c54cefe8-3144-4a00-ba17-e7b71275fe47 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:50.451393 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c54cefe8-3144-4a00-ba17-e7b71275fe47 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:50.452322 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c54cefe8-3144-4a00-ba17-e7b71275fe47 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:50.452803 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c54cefe8-3144-4a00-ba17-e7b71275fe47 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:50.453232 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c54cefe8-3144-4a00-ba17-e7b71275fe47 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:50.453917 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c54cefe8-3144-4a00-ba17-e7b71275fe47 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:50.454378 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c54cefe8-3144-4a00-ba17-e7b71275fe47 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:50.454776 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c54cefe8-3144-4a00-ba17-e7b71275fe47 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:50.483794 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c54cefe8-3144-4a00-ba17-e7b71275fe47 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044806 Aug 10 12:52:50.484346 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 873/1730] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:50 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:51.495564 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0b9a25af-e2b5-4bed-9b43-60783dee8711 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:51.497669 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0b9a25af-e2b5-4bed-9b43-60783dee8711 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:51.503970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b9a25af-e2b5-4bed-9b43-60783dee8711 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:51.504445 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b9a25af-e2b5-4bed-9b43-60783dee8711 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:51.505385 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b9a25af-e2b5-4bed-9b43-60783dee8711 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:51.506069 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b9a25af-e2b5-4bed-9b43-60783dee8711 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:51.506513 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b9a25af-e2b5-4bed-9b43-60783dee8711 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:51.506929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b9a25af-e2b5-4bed-9b43-60783dee8711 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:51.535960 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0b9a25af-e2b5-4bed-9b43-60783dee8711 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044245 Aug 10 12:52:51.536711 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 858/1731] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:51 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:52.548143 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8265f54c-ea5c-496b-b3f9-0bde5a15bdf7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:52.550357 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8265f54c-ea5c-496b-b3f9-0bde5a15bdf7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:52.556750 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8265f54c-ea5c-496b-b3f9-0bde5a15bdf7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:52.557229 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8265f54c-ea5c-496b-b3f9-0bde5a15bdf7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:52.557657 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8265f54c-ea5c-496b-b3f9-0bde5a15bdf7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:52.558345 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8265f54c-ea5c-496b-b3f9-0bde5a15bdf7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:52.558795 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8265f54c-ea5c-496b-b3f9-0bde5a15bdf7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:52.559215 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8265f54c-ea5c-496b-b3f9-0bde5a15bdf7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:52.588186 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8265f54c-ea5c-496b-b3f9-0bde5a15bdf7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043942 Aug 10 12:52:52.588763 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 874/1732] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:52 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:53.600550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c87f3533-df9b-4d17-9939-c979a042b2ed tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:53.602730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c87f3533-df9b-4d17-9939-c979a042b2ed tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:53.609286 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c87f3533-df9b-4d17-9939-c979a042b2ed tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:53.609770 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c87f3533-df9b-4d17-9939-c979a042b2ed tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:53.610205 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c87f3533-df9b-4d17-9939-c979a042b2ed tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:53.610895 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c87f3533-df9b-4d17-9939-c979a042b2ed tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:53.611376 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c87f3533-df9b-4d17-9939-c979a042b2ed tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:53.611799 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c87f3533-df9b-4d17-9939-c979a042b2ed tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:53.640892 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c87f3533-df9b-4d17-9939-c979a042b2ed tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044503 Aug 10 12:52:53.641443 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 859/1733] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:53 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:54.652942 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2738b6aa-3a28-411f-bae3-7d82845c5bb1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:54.655733 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2738b6aa-3a28-411f-bae3-7d82845c5bb1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:54.662501 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2738b6aa-3a28-411f-bae3-7d82845c5bb1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:54.663449 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2738b6aa-3a28-411f-bae3-7d82845c5bb1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:54.663890 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2738b6aa-3a28-411f-bae3-7d82845c5bb1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:54.664588 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2738b6aa-3a28-411f-bae3-7d82845c5bb1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:54.665045 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2738b6aa-3a28-411f-bae3-7d82845c5bb1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:54.665466 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2738b6aa-3a28-411f-bae3-7d82845c5bb1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:54.694587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2738b6aa-3a28-411f-bae3-7d82845c5bb1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045511 Aug 10 12:52:54.695138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 875/1734] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:54 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:55.708786 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f199e9bd-e7aa-46c4-b714-061b236c664f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:55.710911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f199e9bd-e7aa-46c4-b714-061b236c664f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:55.717471 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f199e9bd-e7aa-46c4-b714-061b236c664f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:55.717972 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f199e9bd-e7aa-46c4-b714-061b236c664f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:55.718383 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f199e9bd-e7aa-46c4-b714-061b236c664f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:55.719077 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f199e9bd-e7aa-46c4-b714-061b236c664f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:55.719548 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f199e9bd-e7aa-46c4-b714-061b236c664f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:55.720018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f199e9bd-e7aa-46c4-b714-061b236c664f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:55.753679 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f199e9bd-e7aa-46c4-b714-061b236c664f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050905 Aug 10 12:52:55.754236 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 860/1735] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:55 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:56.767152 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3109fd49-c8f0-45e6-b1dd-abacfaade33f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:56.769306 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3109fd49-c8f0-45e6-b1dd-abacfaade33f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:56.776201 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3109fd49-c8f0-45e6-b1dd-abacfaade33f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:56.776684 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3109fd49-c8f0-45e6-b1dd-abacfaade33f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:56.777115 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3109fd49-c8f0-45e6-b1dd-abacfaade33f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:56.777799 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3109fd49-c8f0-45e6-b1dd-abacfaade33f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:56.778341 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3109fd49-c8f0-45e6-b1dd-abacfaade33f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:56.778647 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3109fd49-c8f0-45e6-b1dd-abacfaade33f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:56.807032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3109fd49-c8f0-45e6-b1dd-abacfaade33f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043879 Aug 10 12:52:56.807619 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 876/1736] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:56 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:57.818814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b64d9c88-56a4-466a-b767-fde04ba3915b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:57.821123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b64d9c88-56a4-466a-b767-fde04ba3915b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:57.827376 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b64d9c88-56a4-466a-b767-fde04ba3915b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:57.827853 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b64d9c88-56a4-466a-b767-fde04ba3915b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:57.828286 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b64d9c88-56a4-466a-b767-fde04ba3915b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:57.828970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b64d9c88-56a4-466a-b767-fde04ba3915b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:57.829414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b64d9c88-56a4-466a-b767-fde04ba3915b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:57.829832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b64d9c88-56a4-466a-b767-fde04ba3915b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:57.859887 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b64d9c88-56a4-466a-b767-fde04ba3915b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044915 Aug 10 12:52:57.860423 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 861/1737] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:57 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:58.871942 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-afb6e2fa-6fc8-4f87-9c45-2991d3169969 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:58.874153 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-afb6e2fa-6fc8-4f87-9c45-2991d3169969 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:58.880832 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-afb6e2fa-6fc8-4f87-9c45-2991d3169969 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:58.881312 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-afb6e2fa-6fc8-4f87-9c45-2991d3169969 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:58.881756 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-afb6e2fa-6fc8-4f87-9c45-2991d3169969 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:58.882452 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-afb6e2fa-6fc8-4f87-9c45-2991d3169969 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:58.882902 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-afb6e2fa-6fc8-4f87-9c45-2991d3169969 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:58.883355 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-afb6e2fa-6fc8-4f87-9c45-2991d3169969 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:58.912381 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-afb6e2fa-6fc8-4f87-9c45-2991d3169969 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044328 Aug 10 12:52:58.912954 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 877/1738] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:58 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:52:59.924466 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-da02a78f-adf1-4ee9-b08d-85b4ca5406e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:52:59.926611 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-da02a78f-adf1-4ee9-b08d-85b4ca5406e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:52:59.933134 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-da02a78f-adf1-4ee9-b08d-85b4ca5406e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:59.933623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-da02a78f-adf1-4ee9-b08d-85b4ca5406e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:59.934061 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-da02a78f-adf1-4ee9-b08d-85b4ca5406e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:59.934759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-da02a78f-adf1-4ee9-b08d-85b4ca5406e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:52:59.935228 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-da02a78f-adf1-4ee9-b08d-85b4ca5406e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:52:59.935654 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-da02a78f-adf1-4ee9-b08d-85b4ca5406e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:52:59.965005 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-da02a78f-adf1-4ee9-b08d-85b4ca5406e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044539 Aug 10 12:52:59.965558 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 862/1739] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:52:59 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:53:00.978674 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-063251df-7ac5-4dfd-89da-5739b05f4d84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:00.981152 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-063251df-7ac5-4dfd-89da-5739b05f4d84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:00.987653 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-063251df-7ac5-4dfd-89da-5739b05f4d84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:00.988220 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-063251df-7ac5-4dfd-89da-5739b05f4d84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:00.988680 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-063251df-7ac5-4dfd-89da-5739b05f4d84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:00.989423 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-063251df-7ac5-4dfd-89da-5739b05f4d84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:00.989892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-063251df-7ac5-4dfd-89da-5739b05f4d84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:00.990328 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-063251df-7ac5-4dfd-89da-5739b05f4d84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:01.019494 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-063251df-7ac5-4dfd-89da-5739b05f4d84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044897 Aug 10 12:53:01.020065 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 878/1740] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:00 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:02.031751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b44c01bc-d090-4875-83c2-bd92b09d38d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:02.033929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b44c01bc-d090-4875-83c2-bd92b09d38d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:02.040655 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b44c01bc-d090-4875-83c2-bd92b09d38d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:02.041141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b44c01bc-d090-4875-83c2-bd92b09d38d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:02.041574 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b44c01bc-d090-4875-83c2-bd92b09d38d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:02.042262 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b44c01bc-d090-4875-83c2-bd92b09d38d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:02.042711 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b44c01bc-d090-4875-83c2-bd92b09d38d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:02.043134 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b44c01bc-d090-4875-83c2-bd92b09d38d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:02.057060 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:53:02.073141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b44c01bc-d090-4875-83c2-bd92b09d38d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045273 Aug 10 12:53:02.073948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 863/1741] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:02 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:03.085836 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-13071ca3-5597-4437-95ca-dd5ee24fe0ea tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:03.160557 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-13071ca3-5597-4437-95ca-dd5ee24fe0ea tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:03.160557 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-13071ca3-5597-4437-95ca-dd5ee24fe0ea tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:03.160557 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-13071ca3-5597-4437-95ca-dd5ee24fe0ea tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:03.160557 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-13071ca3-5597-4437-95ca-dd5ee24fe0ea tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:03.162061 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-13071ca3-5597-4437-95ca-dd5ee24fe0ea tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:03.162061 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-13071ca3-5597-4437-95ca-dd5ee24fe0ea tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:03.162061 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-13071ca3-5597-4437-95ca-dd5ee24fe0ea tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:03.162061 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-13071ca3-5597-4437-95ca-dd5ee24fe0ea tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044438 Aug 10 12:53:03.162397 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 879/1742] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:03 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:04.139593 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3dda6c8c-4ca3-4a9b-83da-684fd4ec6a4a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:04.141682 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3dda6c8c-4ca3-4a9b-83da-684fd4ec6a4a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:04.143931 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=42 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:53:04.149382 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3dda6c8c-4ca3-4a9b-83da-684fd4ec6a4a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:04.149865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3dda6c8c-4ca3-4a9b-83da-684fd4ec6a4a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:04.150305 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3dda6c8c-4ca3-4a9b-83da-684fd4ec6a4a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:04.151023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3dda6c8c-4ca3-4a9b-83da-684fd4ec6a4a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:04.151531 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3dda6c8c-4ca3-4a9b-83da-684fd4ec6a4a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:04.151961 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3dda6c8c-4ca3-4a9b-83da-684fd4ec6a4a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:04.181334 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3dda6c8c-4ca3-4a9b-83da-684fd4ec6a4a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046062 Aug 10 12:53:04.181896 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 864/1743] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:04 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:05.194102 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f5bba35f-ae23-46ff-a338-51231cefb819 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:05.196503 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f5bba35f-ae23-46ff-a338-51231cefb819 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:05.202679 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5bba35f-ae23-46ff-a338-51231cefb819 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:05.203162 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5bba35f-ae23-46ff-a338-51231cefb819 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:05.203627 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5bba35f-ae23-46ff-a338-51231cefb819 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:05.204326 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5bba35f-ae23-46ff-a338-51231cefb819 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:05.204777 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5bba35f-ae23-46ff-a338-51231cefb819 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:05.205200 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5bba35f-ae23-46ff-a338-51231cefb819 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:05.209618 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:53:05.236041 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f5bba35f-ae23-46ff-a338-51231cefb819 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046432 Aug 10 12:53:05.236514 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 880/1744] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:05 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:06.248213 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0e8a8c85-5bb4-4425-88e8-0fae9d23575d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:06.250309 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0e8a8c85-5bb4-4425-88e8-0fae9d23575d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:06.257570 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e8a8c85-5bb4-4425-88e8-0fae9d23575d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:06.258043 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e8a8c85-5bb4-4425-88e8-0fae9d23575d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:06.258473 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e8a8c85-5bb4-4425-88e8-0fae9d23575d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:06.259156 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e8a8c85-5bb4-4425-88e8-0fae9d23575d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:06.259748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e8a8c85-5bb4-4425-88e8-0fae9d23575d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:06.260168 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e8a8c85-5bb4-4425-88e8-0fae9d23575d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:06.289513 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0e8a8c85-5bb4-4425-88e8-0fae9d23575d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045359 Aug 10 12:53:06.290089 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 865/1745] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:06 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:07.302637 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5b80ebf2-6100-4ad6-ac62-ba80aa5f0337 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:07.304824 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5b80ebf2-6100-4ad6-ac62-ba80aa5f0337 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:07.311507 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b80ebf2-6100-4ad6-ac62-ba80aa5f0337 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:07.311980 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b80ebf2-6100-4ad6-ac62-ba80aa5f0337 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:07.312409 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b80ebf2-6100-4ad6-ac62-ba80aa5f0337 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:07.313092 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b80ebf2-6100-4ad6-ac62-ba80aa5f0337 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:07.313536 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b80ebf2-6100-4ad6-ac62-ba80aa5f0337 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:07.313951 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b80ebf2-6100-4ad6-ac62-ba80aa5f0337 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:07.342202 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5b80ebf2-6100-4ad6-ac62-ba80aa5f0337 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044154 Aug 10 12:53:07.342760 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 881/1746] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:07 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:08.353462 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8962c99c-459c-49f2-8d74-cb2274d13578 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:08.355868 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8962c99c-459c-49f2-8d74-cb2274d13578 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:08.362197 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8962c99c-459c-49f2-8d74-cb2274d13578 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:08.362677 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8962c99c-459c-49f2-8d74-cb2274d13578 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:08.363109 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8962c99c-459c-49f2-8d74-cb2274d13578 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:08.363823 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8962c99c-459c-49f2-8d74-cb2274d13578 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:08.364773 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8962c99c-459c-49f2-8d74-cb2274d13578 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:08.365197 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8962c99c-459c-49f2-8d74-cb2274d13578 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:08.393700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8962c99c-459c-49f2-8d74-cb2274d13578 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044170 Aug 10 12:53:08.394257 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 866/1747] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:08 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:09.405754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bb0690c5-d85e-4d8f-b283-21be37addf3b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:09.407913 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bb0690c5-d85e-4d8f-b283-21be37addf3b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:09.414531 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb0690c5-d85e-4d8f-b283-21be37addf3b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:09.415006 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb0690c5-d85e-4d8f-b283-21be37addf3b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:09.415456 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb0690c5-d85e-4d8f-b283-21be37addf3b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:09.416134 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb0690c5-d85e-4d8f-b283-21be37addf3b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:09.416579 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb0690c5-d85e-4d8f-b283-21be37addf3b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:09.416995 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb0690c5-d85e-4d8f-b283-21be37addf3b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:09.446176 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bb0690c5-d85e-4d8f-b283-21be37addf3b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044302 Aug 10 12:53:09.446719 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 882/1748] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:09 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:10.458791 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3b124ee7-fcb1-4260-ab3d-d70e8403dd80 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:10.460926 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3b124ee7-fcb1-4260-ab3d-d70e8403dd80 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:10.467412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3b124ee7-fcb1-4260-ab3d-d70e8403dd80 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:10.467897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3b124ee7-fcb1-4260-ab3d-d70e8403dd80 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:10.468331 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3b124ee7-fcb1-4260-ab3d-d70e8403dd80 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:10.469017 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3b124ee7-fcb1-4260-ab3d-d70e8403dd80 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:10.469484 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3b124ee7-fcb1-4260-ab3d-d70e8403dd80 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:10.469923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3b124ee7-fcb1-4260-ab3d-d70e8403dd80 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:10.499322 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3b124ee7-fcb1-4260-ab3d-d70e8403dd80 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044931 Aug 10 12:53:10.499874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 867/1749] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:10 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:11.511108 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e436b9fb-53db-48fb-901e-1cb745b58f69 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:11.513314 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e436b9fb-53db-48fb-901e-1cb745b58f69 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:11.515638 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=38 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:53:11.520798 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e436b9fb-53db-48fb-901e-1cb745b58f69 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:11.521407 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e436b9fb-53db-48fb-901e-1cb745b58f69 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:11.521850 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e436b9fb-53db-48fb-901e-1cb745b58f69 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:11.522542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e436b9fb-53db-48fb-901e-1cb745b58f69 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:11.523005 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e436b9fb-53db-48fb-901e-1cb745b58f69 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:11.523456 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e436b9fb-53db-48fb-901e-1cb745b58f69 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:11.553138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e436b9fb-53db-48fb-901e-1cb745b58f69 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045888 Aug 10 12:53:11.553616 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 883/1750] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:11 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:12.565254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5cdf9d1a-fab6-44a6-8c98-ac4e897a798b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:12.567888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5cdf9d1a-fab6-44a6-8c98-ac4e897a798b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:12.574162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5cdf9d1a-fab6-44a6-8c98-ac4e897a798b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:12.574645 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5cdf9d1a-fab6-44a6-8c98-ac4e897a798b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:12.575081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5cdf9d1a-fab6-44a6-8c98-ac4e897a798b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:12.575799 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5cdf9d1a-fab6-44a6-8c98-ac4e897a798b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:12.576256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5cdf9d1a-fab6-44a6-8c98-ac4e897a798b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:12.576682 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5cdf9d1a-fab6-44a6-8c98-ac4e897a798b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:12.606238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5cdf9d1a-fab6-44a6-8c98-ac4e897a798b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044982 Aug 10 12:53:12.606821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 868/1751] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:12 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:13.618233 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2f884edc-d8dd-4f15-8d9f-e0a0bb56cdb7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:13.620323 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2f884edc-d8dd-4f15-8d9f-e0a0bb56cdb7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:13.626591 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2f884edc-d8dd-4f15-8d9f-e0a0bb56cdb7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:13.627071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2f884edc-d8dd-4f15-8d9f-e0a0bb56cdb7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:13.627536 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2f884edc-d8dd-4f15-8d9f-e0a0bb56cdb7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:13.628227 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2f884edc-d8dd-4f15-8d9f-e0a0bb56cdb7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:13.628675 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2f884edc-d8dd-4f15-8d9f-e0a0bb56cdb7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:13.629097 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2f884edc-d8dd-4f15-8d9f-e0a0bb56cdb7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:13.657642 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2f884edc-d8dd-4f15-8d9f-e0a0bb56cdb7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043666 Aug 10 12:53:13.658199 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 884/1752] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:13 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:14.670581 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a3f3710d-0423-45bc-a173-ab362a212f28 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:14.672756 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a3f3710d-0423-45bc-a173-ab362a212f28 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:14.679724 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3f3710d-0423-45bc-a173-ab362a212f28 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:14.681090 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3f3710d-0423-45bc-a173-ab362a212f28 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:14.681502 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3f3710d-0423-45bc-a173-ab362a212f28 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:14.682229 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3f3710d-0423-45bc-a173-ab362a212f28 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:14.682685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3f3710d-0423-45bc-a173-ab362a212f28 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:14.683117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3f3710d-0423-45bc-a173-ab362a212f28 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:14.711146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a3f3710d-0423-45bc-a173-ab362a212f28 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044584 Aug 10 12:53:14.711789 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 869/1753] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:14 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:14.838717 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:53:14.839276 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Wed Aug 10 12:53:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 12:53:15.723314 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-57f94337-2d1c-40a0-b07a-9ddad29139b7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:15.725995 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-57f94337-2d1c-40a0-b07a-9ddad29139b7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:15.732581 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57f94337-2d1c-40a0-b07a-9ddad29139b7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:15.733058 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57f94337-2d1c-40a0-b07a-9ddad29139b7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:15.733487 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57f94337-2d1c-40a0-b07a-9ddad29139b7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:15.734168 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57f94337-2d1c-40a0-b07a-9ddad29139b7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:15.734615 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57f94337-2d1c-40a0-b07a-9ddad29139b7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:15.735034 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57f94337-2d1c-40a0-b07a-9ddad29139b7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:15.763046 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-57f94337-2d1c-40a0-b07a-9ddad29139b7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043775 Aug 10 12:53:15.763618 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 885/1754] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:15 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:16.774735 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f5d00a9f-0c04-49f2-8702-7b3ee4dd23a6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:16.776927 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f5d00a9f-0c04-49f2-8702-7b3ee4dd23a6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:16.783593 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f5d00a9f-0c04-49f2-8702-7b3ee4dd23a6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:16.784069 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f5d00a9f-0c04-49f2-8702-7b3ee4dd23a6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:16.784504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f5d00a9f-0c04-49f2-8702-7b3ee4dd23a6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:16.785190 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f5d00a9f-0c04-49f2-8702-7b3ee4dd23a6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:16.785644 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f5d00a9f-0c04-49f2-8702-7b3ee4dd23a6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:16.786085 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f5d00a9f-0c04-49f2-8702-7b3ee4dd23a6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:16.814969 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f5d00a9f-0c04-49f2-8702-7b3ee4dd23a6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044097 Aug 10 12:53:16.815480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 870/1755] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:16 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:17.827932 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b27bc375-ef94-4637-8495-dd097fdf116f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:17.830086 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b27bc375-ef94-4637-8495-dd097fdf116f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:17.836538 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b27bc375-ef94-4637-8495-dd097fdf116f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:17.837024 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b27bc375-ef94-4637-8495-dd097fdf116f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:17.837463 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b27bc375-ef94-4637-8495-dd097fdf116f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:17.838157 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b27bc375-ef94-4637-8495-dd097fdf116f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:17.838612 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b27bc375-ef94-4637-8495-dd097fdf116f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:17.839034 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b27bc375-ef94-4637-8495-dd097fdf116f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:17.868531 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b27bc375-ef94-4637-8495-dd097fdf116f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044513 Aug 10 12:53:17.869112 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 886/1756] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:17 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:18.499120 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:53:18.499791 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Wed Aug 10 12:53:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 12:53:18.881807 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-087cc7d6-01eb-47ba-9e53-4a88de3bf5da tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:18.883942 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-087cc7d6-01eb-47ba-9e53-4a88de3bf5da tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:18.889800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-087cc7d6-01eb-47ba-9e53-4a88de3bf5da tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:18.890273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-087cc7d6-01eb-47ba-9e53-4a88de3bf5da tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:18.890700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-087cc7d6-01eb-47ba-9e53-4a88de3bf5da tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:18.891411 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-087cc7d6-01eb-47ba-9e53-4a88de3bf5da tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:18.891857 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-087cc7d6-01eb-47ba-9e53-4a88de3bf5da tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:18.892273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-087cc7d6-01eb-47ba-9e53-4a88de3bf5da tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:18.921092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-087cc7d6-01eb-47ba-9e53-4a88de3bf5da tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044356 Aug 10 12:53:18.921632 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 871/1757] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:18 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:19.933300 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-11411774-8018-4dd9-a731-033b619f428a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:19.935538 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-11411774-8018-4dd9-a731-033b619f428a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:19.942015 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11411774-8018-4dd9-a731-033b619f428a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:19.942998 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11411774-8018-4dd9-a731-033b619f428a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:19.943469 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11411774-8018-4dd9-a731-033b619f428a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:19.944149 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11411774-8018-4dd9-a731-033b619f428a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:19.944600 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11411774-8018-4dd9-a731-033b619f428a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:19.945023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11411774-8018-4dd9-a731-033b619f428a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:19.973973 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-11411774-8018-4dd9-a731-033b619f428a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044629 Aug 10 12:53:19.974523 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 887/1758] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:19 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:20.985929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-76bb25af-016f-404e-a699-6cc06c0c3e40 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:20.988095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-76bb25af-016f-404e-a699-6cc06c0c3e40 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:20.994430 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76bb25af-016f-404e-a699-6cc06c0c3e40 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:20.994903 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76bb25af-016f-404e-a699-6cc06c0c3e40 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:20.995386 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76bb25af-016f-404e-a699-6cc06c0c3e40 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:20.996060 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76bb25af-016f-404e-a699-6cc06c0c3e40 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:20.996505 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76bb25af-016f-404e-a699-6cc06c0c3e40 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:20.996920 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76bb25af-016f-404e-a699-6cc06c0c3e40 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:21.025737 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-76bb25af-016f-404e-a699-6cc06c0c3e40 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043799 Aug 10 12:53:21.026282 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 872/1759] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:20 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:21.460371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:53:21.460534 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Wed Aug 10 12:53:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 12:53:22.038100 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-43412771-1b5a-44ff-a820-6522831ab50e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:22.040276 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-43412771-1b5a-44ff-a820-6522831ab50e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:22.046596 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-43412771-1b5a-44ff-a820-6522831ab50e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:22.047074 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-43412771-1b5a-44ff-a820-6522831ab50e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:22.047548 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-43412771-1b5a-44ff-a820-6522831ab50e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:22.048234 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-43412771-1b5a-44ff-a820-6522831ab50e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:22.048685 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-43412771-1b5a-44ff-a820-6522831ab50e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:22.049108 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-43412771-1b5a-44ff-a820-6522831ab50e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:22.078258 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-43412771-1b5a-44ff-a820-6522831ab50e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044316 Aug 10 12:53:22.078803 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 888/1760] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:22 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:23.090120 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4e8770f6-40ea-4a58-89e2-654f5a44c7a0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:23.092277 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4e8770f6-40ea-4a58-89e2-654f5a44c7a0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:23.099372 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e8770f6-40ea-4a58-89e2-654f5a44c7a0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:23.099856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e8770f6-40ea-4a58-89e2-654f5a44c7a0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:23.100292 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e8770f6-40ea-4a58-89e2-654f5a44c7a0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:23.100975 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e8770f6-40ea-4a58-89e2-654f5a44c7a0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:23.101425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e8770f6-40ea-4a58-89e2-654f5a44c7a0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:23.101880 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e8770f6-40ea-4a58-89e2-654f5a44c7a0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:23.131539 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4e8770f6-40ea-4a58-89e2-654f5a44c7a0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045276 Aug 10 12:53:23.132074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 873/1761] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:23 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:24.143938 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-487c7b2b-d74a-469a-9c5f-ea97ce21c56e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:24.146184 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-487c7b2b-d74a-469a-9c5f-ea97ce21c56e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:24.152532 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-487c7b2b-d74a-469a-9c5f-ea97ce21c56e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:24.153011 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-487c7b2b-d74a-469a-9c5f-ea97ce21c56e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:24.153444 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-487c7b2b-d74a-469a-9c5f-ea97ce21c56e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:24.154134 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-487c7b2b-d74a-469a-9c5f-ea97ce21c56e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:24.154583 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-487c7b2b-d74a-469a-9c5f-ea97ce21c56e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:24.155007 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-487c7b2b-d74a-469a-9c5f-ea97ce21c56e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:24.183196 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-487c7b2b-d74a-469a-9c5f-ea97ce21c56e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043145 Aug 10 12:53:24.183743 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 889/1762] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:24 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:25.195922 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-61f41b85-30f4-4021-84f8-7003f70f3f95 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:25.198089 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-61f41b85-30f4-4021-84f8-7003f70f3f95 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:25.204498 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61f41b85-30f4-4021-84f8-7003f70f3f95 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:25.204978 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61f41b85-30f4-4021-84f8-7003f70f3f95 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:25.205415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61f41b85-30f4-4021-84f8-7003f70f3f95 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:25.206105 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61f41b85-30f4-4021-84f8-7003f70f3f95 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:25.206557 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61f41b85-30f4-4021-84f8-7003f70f3f95 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:25.207030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61f41b85-30f4-4021-84f8-7003f70f3f95 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:25.236586 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-61f41b85-30f4-4021-84f8-7003f70f3f95 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045240 Aug 10 12:53:25.237141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 874/1763] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:25 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:26.249027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4f31eddf-e646-4a38-b998-1e20cf9c723b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:26.251184 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4f31eddf-e646-4a38-b998-1e20cf9c723b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:26.257664 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4f31eddf-e646-4a38-b998-1e20cf9c723b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:26.258138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4f31eddf-e646-4a38-b998-1e20cf9c723b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:26.258563 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4f31eddf-e646-4a38-b998-1e20cf9c723b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:26.259273 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4f31eddf-e646-4a38-b998-1e20cf9c723b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:26.259717 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4f31eddf-e646-4a38-b998-1e20cf9c723b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:26.260164 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4f31eddf-e646-4a38-b998-1e20cf9c723b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:26.289501 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4f31eddf-e646-4a38-b998-1e20cf9c723b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044402 Aug 10 12:53:26.290054 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 890/1764] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:26 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:27.301577 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5ba9277b-99eb-40ef-b3a4-c22f98aebaa9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:27.303853 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5ba9277b-99eb-40ef-b3a4-c22f98aebaa9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:27.310273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ba9277b-99eb-40ef-b3a4-c22f98aebaa9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:27.310747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ba9277b-99eb-40ef-b3a4-c22f98aebaa9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:27.311197 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ba9277b-99eb-40ef-b3a4-c22f98aebaa9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:27.311941 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ba9277b-99eb-40ef-b3a4-c22f98aebaa9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:27.312385 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ba9277b-99eb-40ef-b3a4-c22f98aebaa9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:27.312806 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ba9277b-99eb-40ef-b3a4-c22f98aebaa9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:27.341907 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5ba9277b-99eb-40ef-b3a4-c22f98aebaa9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044286 Aug 10 12:53:27.342442 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 875/1765] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:27 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:28.354794 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-129a8db4-937a-4d8f-bfec-205e8be90d66 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:28.356955 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-129a8db4-937a-4d8f-bfec-205e8be90d66 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:28.362995 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-129a8db4-937a-4d8f-bfec-205e8be90d66 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:28.363506 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-129a8db4-937a-4d8f-bfec-205e8be90d66 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:28.363943 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-129a8db4-937a-4d8f-bfec-205e8be90d66 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:28.364629 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-129a8db4-937a-4d8f-bfec-205e8be90d66 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:28.365711 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-129a8db4-937a-4d8f-bfec-205e8be90d66 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:28.366219 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-129a8db4-937a-4d8f-bfec-205e8be90d66 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:28.394572 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-129a8db4-937a-4d8f-bfec-205e8be90d66 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044005 Aug 10 12:53:28.395164 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 891/1766] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:28 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:29.407132 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-69e794f6-8390-49b3-9df2-58a0979f495d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:29.409312 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-69e794f6-8390-49b3-9df2-58a0979f495d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:29.416373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-69e794f6-8390-49b3-9df2-58a0979f495d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:29.416853 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-69e794f6-8390-49b3-9df2-58a0979f495d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:29.417289 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-69e794f6-8390-49b3-9df2-58a0979f495d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:29.417976 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-69e794f6-8390-49b3-9df2-58a0979f495d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:29.418427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-69e794f6-8390-49b3-9df2-58a0979f495d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:29.418855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-69e794f6-8390-49b3-9df2-58a0979f495d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:29.447093 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-69e794f6-8390-49b3-9df2-58a0979f495d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044045 Aug 10 12:53:29.447664 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 876/1767] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:29 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:30.459759 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-02fff8de-79d4-4073-9242-edc992ffc980 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:30.461947 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-02fff8de-79d4-4073-9242-edc992ffc980 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:30.468322 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-02fff8de-79d4-4073-9242-edc992ffc980 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:30.468791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-02fff8de-79d4-4073-9242-edc992ffc980 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:30.469220 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-02fff8de-79d4-4073-9242-edc992ffc980 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:30.469894 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-02fff8de-79d4-4073-9242-edc992ffc980 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:30.470337 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-02fff8de-79d4-4073-9242-edc992ffc980 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:30.470754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-02fff8de-79d4-4073-9242-edc992ffc980 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:30.500775 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-02fff8de-79d4-4073-9242-edc992ffc980 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045456 Aug 10 12:53:30.501316 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 892/1768] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:30 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:31.512743 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f3aa6f0f-5374-4271-9897-563b3bd9fab1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:31.514872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f3aa6f0f-5374-4271-9897-563b3bd9fab1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:31.521783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3aa6f0f-5374-4271-9897-563b3bd9fab1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:31.522308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3aa6f0f-5374-4271-9897-563b3bd9fab1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:31.522739 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3aa6f0f-5374-4271-9897-563b3bd9fab1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:31.523457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3aa6f0f-5374-4271-9897-563b3bd9fab1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:31.523911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3aa6f0f-5374-4271-9897-563b3bd9fab1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:31.524334 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3aa6f0f-5374-4271-9897-563b3bd9fab1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:31.553262 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f3aa6f0f-5374-4271-9897-563b3bd9fab1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044353 Aug 10 12:53:31.553744 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 877/1769] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:31 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:32.565234 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e3d2f74b-fbba-4c76-b9ae-5fafbb9f6358 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:32.567499 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e3d2f74b-fbba-4c76-b9ae-5fafbb9f6358 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:32.574720 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e3d2f74b-fbba-4c76-b9ae-5fafbb9f6358 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:32.575217 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e3d2f74b-fbba-4c76-b9ae-5fafbb9f6358 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:32.575655 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e3d2f74b-fbba-4c76-b9ae-5fafbb9f6358 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:32.576348 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e3d2f74b-fbba-4c76-b9ae-5fafbb9f6358 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:32.576800 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e3d2f74b-fbba-4c76-b9ae-5fafbb9f6358 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:32.577224 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e3d2f74b-fbba-4c76-b9ae-5fafbb9f6358 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:32.607211 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e3d2f74b-fbba-4c76-b9ae-5fafbb9f6358 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045916 Aug 10 12:53:32.607758 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 893/1770] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:32 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:53:33.619401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0fee3049-ecea-4d0a-9709-543bf0f80c40 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:33.621719 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0fee3049-ecea-4d0a-9709-543bf0f80c40 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:33.628212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0fee3049-ecea-4d0a-9709-543bf0f80c40 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:33.628693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0fee3049-ecea-4d0a-9709-543bf0f80c40 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:33.629128 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0fee3049-ecea-4d0a-9709-543bf0f80c40 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:33.629819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0fee3049-ecea-4d0a-9709-543bf0f80c40 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:33.630265 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0fee3049-ecea-4d0a-9709-543bf0f80c40 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:33.631279 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0fee3049-ecea-4d0a-9709-543bf0f80c40 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:33.661061 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0fee3049-ecea-4d0a-9709-543bf0f80c40 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045747 Aug 10 12:53:33.661629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 878/1771] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:33 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:34.673593 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2a5bc5c9-68e2-496e-ac7e-e5c9aef6b12e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:34.675757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2a5bc5c9-68e2-496e-ac7e-e5c9aef6b12e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:34.682856 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a5bc5c9-68e2-496e-ac7e-e5c9aef6b12e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:34.683406 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a5bc5c9-68e2-496e-ac7e-e5c9aef6b12e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:34.683848 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a5bc5c9-68e2-496e-ac7e-e5c9aef6b12e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:34.684550 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a5bc5c9-68e2-496e-ac7e-e5c9aef6b12e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:34.685000 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a5bc5c9-68e2-496e-ac7e-e5c9aef6b12e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:34.685423 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a5bc5c9-68e2-496e-ac7e-e5c9aef6b12e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:34.714338 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2a5bc5c9-68e2-496e-ac7e-e5c9aef6b12e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045824 Aug 10 12:53:34.714898 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 894/1772] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:34 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:35.726860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-71e3081f-2669-4822-90f5-d8cc1e501ae7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:35.730596 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-71e3081f-2669-4822-90f5-d8cc1e501ae7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:35.737008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71e3081f-2669-4822-90f5-d8cc1e501ae7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:35.737487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71e3081f-2669-4822-90f5-d8cc1e501ae7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:35.738011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71e3081f-2669-4822-90f5-d8cc1e501ae7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:35.738700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71e3081f-2669-4822-90f5-d8cc1e501ae7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:35.739030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71e3081f-2669-4822-90f5-d8cc1e501ae7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:35.739472 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71e3081f-2669-4822-90f5-d8cc1e501ae7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:35.742562 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=94 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:53:35.768925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-71e3081f-2669-4822-90f5-d8cc1e501ae7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046880 Aug 10 12:53:35.769472 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 879/1773] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:35 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:36.781937 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ebe2d900-2161-4b67-bed9-63b5cfbc0bf1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:36.784096 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ebe2d900-2161-4b67-bed9-63b5cfbc0bf1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:36.791533 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebe2d900-2161-4b67-bed9-63b5cfbc0bf1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:36.792014 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebe2d900-2161-4b67-bed9-63b5cfbc0bf1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:36.792447 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebe2d900-2161-4b67-bed9-63b5cfbc0bf1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:36.793143 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebe2d900-2161-4b67-bed9-63b5cfbc0bf1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:36.793590 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebe2d900-2161-4b67-bed9-63b5cfbc0bf1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:36.794011 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebe2d900-2161-4b67-bed9-63b5cfbc0bf1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:36.824260 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ebe2d900-2161-4b67-bed9-63b5cfbc0bf1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046979 Aug 10 12:53:36.824841 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 895/1774] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:36 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:37.837068 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d6d1fcc3-b102-4535-beaf-211e12a0d33f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:37.839267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d6d1fcc3-b102-4535-beaf-211e12a0d33f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:37.841816 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=32 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:53:37.846808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6d1fcc3-b102-4535-beaf-211e12a0d33f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:37.847324 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6d1fcc3-b102-4535-beaf-211e12a0d33f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:37.847762 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6d1fcc3-b102-4535-beaf-211e12a0d33f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:37.848457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6d1fcc3-b102-4535-beaf-211e12a0d33f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:37.848906 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6d1fcc3-b102-4535-beaf-211e12a0d33f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:37.849899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6d1fcc3-b102-4535-beaf-211e12a0d33f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:37.880986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d6d1fcc3-b102-4535-beaf-211e12a0d33f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048499 Aug 10 12:53:37.881534 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 880/1775] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:37 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:38.892572 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-52c8921f-af12-4aed-ac24-97b4a89c79cb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:38.895388 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-52c8921f-af12-4aed-ac24-97b4a89c79cb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:38.903718 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-52c8921f-af12-4aed-ac24-97b4a89c79cb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:38.904218 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-52c8921f-af12-4aed-ac24-97b4a89c79cb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:38.904657 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-52c8921f-af12-4aed-ac24-97b4a89c79cb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:38.905365 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-52c8921f-af12-4aed-ac24-97b4a89c79cb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:38.905821 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-52c8921f-af12-4aed-ac24-97b4a89c79cb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:38.906402 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-52c8921f-af12-4aed-ac24-97b4a89c79cb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:38.909478 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=96 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:53:38.945167 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-52c8921f-af12-4aed-ac24-97b4a89c79cb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056636 Aug 10 12:53:38.945767 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 896/1776] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:38 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:39.957545 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8619f1e3-c63f-4f1a-9cdf-200abc7942d5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:39.961417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8619f1e3-c63f-4f1a-9cdf-200abc7942d5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:39.967495 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8619f1e3-c63f-4f1a-9cdf-200abc7942d5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:39.967968 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8619f1e3-c63f-4f1a-9cdf-200abc7942d5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:39.968396 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8619f1e3-c63f-4f1a-9cdf-200abc7942d5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:39.969077 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8619f1e3-c63f-4f1a-9cdf-200abc7942d5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:39.969557 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8619f1e3-c63f-4f1a-9cdf-200abc7942d5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:39.969971 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8619f1e3-c63f-4f1a-9cdf-200abc7942d5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:39.999617 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8619f1e3-c63f-4f1a-9cdf-200abc7942d5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045871 Aug 10 12:53:40.000166 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 881/1777] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:39 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:41.012733 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-978d68bc-7df7-4e75-a2b1-0e282f1a51bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:41.014907 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-978d68bc-7df7-4e75-a2b1-0e282f1a51bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:41.022257 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-978d68bc-7df7-4e75-a2b1-0e282f1a51bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:41.022739 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-978d68bc-7df7-4e75-a2b1-0e282f1a51bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:41.023185 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-978d68bc-7df7-4e75-a2b1-0e282f1a51bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:41.023884 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-978d68bc-7df7-4e75-a2b1-0e282f1a51bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:41.024334 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-978d68bc-7df7-4e75-a2b1-0e282f1a51bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:41.024768 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-978d68bc-7df7-4e75-a2b1-0e282f1a51bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:41.055195 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-978d68bc-7df7-4e75-a2b1-0e282f1a51bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046824 Aug 10 12:53:41.055754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 897/1778] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:41 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:42.066972 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-12f61951-0f48-4a5c-ae2d-fe78ae3c0b56 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:42.069196 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-12f61951-0f48-4a5c-ae2d-fe78ae3c0b56 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:42.075629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12f61951-0f48-4a5c-ae2d-fe78ae3c0b56 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:42.076051 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12f61951-0f48-4a5c-ae2d-fe78ae3c0b56 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:42.076477 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12f61951-0f48-4a5c-ae2d-fe78ae3c0b56 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:42.077160 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12f61951-0f48-4a5c-ae2d-fe78ae3c0b56 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:42.077605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12f61951-0f48-4a5c-ae2d-fe78ae3c0b56 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:42.078028 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12f61951-0f48-4a5c-ae2d-fe78ae3c0b56 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:42.108372 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-12f61951-0f48-4a5c-ae2d-fe78ae3c0b56 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045259 Aug 10 12:53:42.108911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 882/1779] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:42 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:43.120333 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-566181b0-ac70-42ed-b2b7-22f5ebf8f05b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:43.122460 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-566181b0-ac70-42ed-b2b7-22f5ebf8f05b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:43.129421 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-566181b0-ac70-42ed-b2b7-22f5ebf8f05b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:43.130147 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-566181b0-ac70-42ed-b2b7-22f5ebf8f05b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:43.131405 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-566181b0-ac70-42ed-b2b7-22f5ebf8f05b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:43.132212 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-566181b0-ac70-42ed-b2b7-22f5ebf8f05b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:43.132672 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-566181b0-ac70-42ed-b2b7-22f5ebf8f05b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:43.133101 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-566181b0-ac70-42ed-b2b7-22f5ebf8f05b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:43.162944 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-566181b0-ac70-42ed-b2b7-22f5ebf8f05b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046455 Aug 10 12:53:43.163529 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 898/1780] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:43 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:44.174863 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a4d0d8f4-43e1-476e-93ce-10e47885aa5c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:44.177158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a4d0d8f4-43e1-476e-93ce-10e47885aa5c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:44.184040 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4d0d8f4-43e1-476e-93ce-10e47885aa5c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:44.184523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4d0d8f4-43e1-476e-93ce-10e47885aa5c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:44.184957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4d0d8f4-43e1-476e-93ce-10e47885aa5c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:44.185655 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4d0d8f4-43e1-476e-93ce-10e47885aa5c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:44.186221 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4d0d8f4-43e1-476e-93ce-10e47885aa5c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:44.186515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4d0d8f4-43e1-476e-93ce-10e47885aa5c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:44.216142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a4d0d8f4-43e1-476e-93ce-10e47885aa5c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045178 Aug 10 12:53:44.216690 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 883/1781] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:44 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:45.229444 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-11010bee-e293-414b-b110-c09ace28c855 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:45.231745 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-11010bee-e293-414b-b110-c09ace28c855 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:45.234284 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=32 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:53:45.239211 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11010bee-e293-414b-b110-c09ace28c855 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:45.239754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11010bee-e293-414b-b110-c09ace28c855 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:45.240289 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11010bee-e293-414b-b110-c09ace28c855 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:45.240980 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11010bee-e293-414b-b110-c09ace28c855 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:45.241461 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11010bee-e293-414b-b110-c09ace28c855 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:45.241883 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-11010bee-e293-414b-b110-c09ace28c855 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:45.284318 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-11010bee-e293-414b-b110-c09ace28c855 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059829 Aug 10 12:53:45.284907 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 899/1782] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:45 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:46.297472 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-140d2d72-f998-4d1e-8c17-c6ad8cc88562 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:46.299781 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-140d2d72-f998-4d1e-8c17-c6ad8cc88562 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:46.306699 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-140d2d72-f998-4d1e-8c17-c6ad8cc88562 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:46.307204 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-140d2d72-f998-4d1e-8c17-c6ad8cc88562 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:46.307658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-140d2d72-f998-4d1e-8c17-c6ad8cc88562 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:46.308387 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-140d2d72-f998-4d1e-8c17-c6ad8cc88562 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:46.308847 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-140d2d72-f998-4d1e-8c17-c6ad8cc88562 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:46.309292 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-140d2d72-f998-4d1e-8c17-c6ad8cc88562 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:46.339691 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-140d2d72-f998-4d1e-8c17-c6ad8cc88562 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046120 Aug 10 12:53:46.340247 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 884/1783] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:46 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:47.353050 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2a73a85f-30af-43d0-a8de-dfde60c10b3a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:47.355529 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2a73a85f-30af-43d0-a8de-dfde60c10b3a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:47.362426 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a73a85f-30af-43d0-a8de-dfde60c10b3a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:47.362910 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a73a85f-30af-43d0-a8de-dfde60c10b3a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:47.363367 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a73a85f-30af-43d0-a8de-dfde60c10b3a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:47.364057 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a73a85f-30af-43d0-a8de-dfde60c10b3a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:47.364501 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a73a85f-30af-43d0-a8de-dfde60c10b3a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:47.365150 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a73a85f-30af-43d0-a8de-dfde60c10b3a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:47.394317 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2a73a85f-30af-43d0-a8de-dfde60c10b3a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046258 Aug 10 12:53:47.394863 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 900/1784] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:47 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:48.407248 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c32c1fdd-4195-481f-9a29-ff4497efe3cc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:48.409358 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c32c1fdd-4195-481f-9a29-ff4497efe3cc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:48.415377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c32c1fdd-4195-481f-9a29-ff4497efe3cc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:48.415949 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c32c1fdd-4195-481f-9a29-ff4497efe3cc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:48.416379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c32c1fdd-4195-481f-9a29-ff4497efe3cc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:48.417058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c32c1fdd-4195-481f-9a29-ff4497efe3cc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:48.417502 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c32c1fdd-4195-481f-9a29-ff4497efe3cc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:48.417920 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c32c1fdd-4195-481f-9a29-ff4497efe3cc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:48.447311 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c32c1fdd-4195-481f-9a29-ff4497efe3cc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044063 Aug 10 12:53:48.447853 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 885/1785] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:48 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:49.460044 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6b3c653e-2b19-4c55-be4e-da74edf8f257 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:49.462191 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6b3c653e-2b19-4c55-be4e-da74edf8f257 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:49.468497 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6b3c653e-2b19-4c55-be4e-da74edf8f257 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:49.469018 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6b3c653e-2b19-4c55-be4e-da74edf8f257 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:49.469458 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6b3c653e-2b19-4c55-be4e-da74edf8f257 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:49.470158 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6b3c653e-2b19-4c55-be4e-da74edf8f257 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:49.470610 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6b3c653e-2b19-4c55-be4e-da74edf8f257 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:49.471033 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6b3c653e-2b19-4c55-be4e-da74edf8f257 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:49.501175 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6b3c653e-2b19-4c55-be4e-da74edf8f257 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045734 Aug 10 12:53:49.501735 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 901/1786] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:49 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:50.513432 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f2aa119a-6920-4b03-852e-84618735750f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:50.515668 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f2aa119a-6920-4b03-852e-84618735750f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:50.522893 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2aa119a-6920-4b03-852e-84618735750f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:50.523402 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2aa119a-6920-4b03-852e-84618735750f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:50.523840 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2aa119a-6920-4b03-852e-84618735750f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:50.524543 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2aa119a-6920-4b03-852e-84618735750f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:50.525008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2aa119a-6920-4b03-852e-84618735750f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:50.525417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2aa119a-6920-4b03-852e-84618735750f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:50.569748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f2aa119a-6920-4b03-852e-84618735750f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060200 Aug 10 12:53:50.570316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 886/1787] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:50 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:51.589211 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7cee15d8-d4d0-452c-a513-d28bebcb4490 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:51.591460 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7cee15d8-d4d0-452c-a513-d28bebcb4490 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:51.597867 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7cee15d8-d4d0-452c-a513-d28bebcb4490 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:51.598350 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7cee15d8-d4d0-452c-a513-d28bebcb4490 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:51.598783 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7cee15d8-d4d0-452c-a513-d28bebcb4490 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:51.600010 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7cee15d8-d4d0-452c-a513-d28bebcb4490 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:51.600640 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7cee15d8-d4d0-452c-a513-d28bebcb4490 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:51.601089 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7cee15d8-d4d0-452c-a513-d28bebcb4490 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:51.631493 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7cee15d8-d4d0-452c-a513-d28bebcb4490 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046667 Aug 10 12:53:51.632051 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 902/1788] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:51 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:52.643442 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bc751f29-1db0-4d41-9448-36057a3d333b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:52.645574 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bc751f29-1db0-4d41-9448-36057a3d333b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:52.651786 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc751f29-1db0-4d41-9448-36057a3d333b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:52.652196 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc751f29-1db0-4d41-9448-36057a3d333b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:52.652629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc751f29-1db0-4d41-9448-36057a3d333b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:52.653324 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc751f29-1db0-4d41-9448-36057a3d333b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:52.653773 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc751f29-1db0-4d41-9448-36057a3d333b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:52.654194 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc751f29-1db0-4d41-9448-36057a3d333b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:52.684848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bc751f29-1db0-4d41-9448-36057a3d333b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045347 Aug 10 12:53:52.685405 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 887/1789] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:52 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:53.697699 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-49d6697e-a9f2-4c42-9eff-53bf48ce0465 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:53.699977 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-49d6697e-a9f2-4c42-9eff-53bf48ce0465 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:53.706102 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-49d6697e-a9f2-4c42-9eff-53bf48ce0465 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:53.706573 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-49d6697e-a9f2-4c42-9eff-53bf48ce0465 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:53.706998 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-49d6697e-a9f2-4c42-9eff-53bf48ce0465 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:53.707709 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-49d6697e-a9f2-4c42-9eff-53bf48ce0465 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:53.708152 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-49d6697e-a9f2-4c42-9eff-53bf48ce0465 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:53.709233 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-49d6697e-a9f2-4c42-9eff-53bf48ce0465 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:53.738228 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-49d6697e-a9f2-4c42-9eff-53bf48ce0465 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045420 Aug 10 12:53:53.738781 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 903/1790] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:53 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:54.749805 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a051e374-f0e5-4730-a0ea-747b06395645 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:54.751995 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a051e374-f0e5-4730-a0ea-747b06395645 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:54.758890 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a051e374-f0e5-4730-a0ea-747b06395645 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:54.759393 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a051e374-f0e5-4730-a0ea-747b06395645 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:54.759825 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a051e374-f0e5-4730-a0ea-747b06395645 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:54.760516 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a051e374-f0e5-4730-a0ea-747b06395645 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:54.760960 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a051e374-f0e5-4730-a0ea-747b06395645 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:54.761374 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a051e374-f0e5-4730-a0ea-747b06395645 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:54.790971 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a051e374-f0e5-4730-a0ea-747b06395645 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045101 Aug 10 12:53:54.792106 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 888/1791] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:54 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:55.803042 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3abb5c5f-6c62-4ce1-8094-a2334b02d39c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:55.805249 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3abb5c5f-6c62-4ce1-8094-a2334b02d39c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:55.812819 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3abb5c5f-6c62-4ce1-8094-a2334b02d39c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:55.813305 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3abb5c5f-6c62-4ce1-8094-a2334b02d39c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:55.813741 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3abb5c5f-6c62-4ce1-8094-a2334b02d39c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:55.814450 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3abb5c5f-6c62-4ce1-8094-a2334b02d39c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:55.814900 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3abb5c5f-6c62-4ce1-8094-a2334b02d39c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:55.815359 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3abb5c5f-6c62-4ce1-8094-a2334b02d39c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:55.849146 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3abb5c5f-6c62-4ce1-8094-a2334b02d39c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050161 Aug 10 12:53:55.849734 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 904/1792] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:55 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:56.861439 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a3c9783f-4f70-4a70-bea1-4f0c1fe9f94a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:56.863576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a3c9783f-4f70-4a70-bea1-4f0c1fe9f94a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:56.870589 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3c9783f-4f70-4a70-bea1-4f0c1fe9f94a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:56.871074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3c9783f-4f70-4a70-bea1-4f0c1fe9f94a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:56.871544 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3c9783f-4f70-4a70-bea1-4f0c1fe9f94a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:56.872239 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3c9783f-4f70-4a70-bea1-4f0c1fe9f94a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:56.872693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3c9783f-4f70-4a70-bea1-4f0c1fe9f94a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:56.873119 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3c9783f-4f70-4a70-bea1-4f0c1fe9f94a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:56.902261 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a3c9783f-4f70-4a70-bea1-4f0c1fe9f94a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044822 Aug 10 12:53:56.902827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 889/1793] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:56 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:53:57.914340 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-17a1479c-78fe-4355-bcb0-22cbc3f53ca6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:57.916546 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-17a1479c-78fe-4355-bcb0-22cbc3f53ca6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:57.922409 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17a1479c-78fe-4355-bcb0-22cbc3f53ca6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:57.922888 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17a1479c-78fe-4355-bcb0-22cbc3f53ca6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:57.923369 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17a1479c-78fe-4355-bcb0-22cbc3f53ca6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:57.924087 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17a1479c-78fe-4355-bcb0-22cbc3f53ca6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:57.924535 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17a1479c-78fe-4355-bcb0-22cbc3f53ca6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:57.924956 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17a1479c-78fe-4355-bcb0-22cbc3f53ca6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:57.954136 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-17a1479c-78fe-4355-bcb0-22cbc3f53ca6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044168 Aug 10 12:53:57.954687 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 905/1794] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:57 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:53:58.966309 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-805ef540-863a-40cc-9a72-9eed82396a87 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:53:58.968480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-805ef540-863a-40cc-9a72-9eed82396a87 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:53:58.974882 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-805ef540-863a-40cc-9a72-9eed82396a87 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:58.975388 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-805ef540-863a-40cc-9a72-9eed82396a87 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:58.975822 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-805ef540-863a-40cc-9a72-9eed82396a87 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:58.976500 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-805ef540-863a-40cc-9a72-9eed82396a87 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:53:58.976943 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-805ef540-863a-40cc-9a72-9eed82396a87 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:53:58.977358 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-805ef540-863a-40cc-9a72-9eed82396a87 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:53:59.006381 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-805ef540-863a-40cc-9a72-9eed82396a87 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043981 Aug 10 12:53:59.006927 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 890/1795] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:53:58 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:00.018551 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5b6872c1-adc3-44b3-8ce3-509e23451cdb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:00.020756 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5b6872c1-adc3-44b3-8ce3-509e23451cdb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:00.027362 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b6872c1-adc3-44b3-8ce3-509e23451cdb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:00.027847 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b6872c1-adc3-44b3-8ce3-509e23451cdb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:00.028284 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b6872c1-adc3-44b3-8ce3-509e23451cdb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:00.028982 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b6872c1-adc3-44b3-8ce3-509e23451cdb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:00.029465 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b6872c1-adc3-44b3-8ce3-509e23451cdb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:00.029891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b6872c1-adc3-44b3-8ce3-509e23451cdb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:00.058676 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5b6872c1-adc3-44b3-8ce3-509e23451cdb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044151 Aug 10 12:54:00.059251 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 906/1796] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:00 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:01.071075 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8d2887cf-d90d-46af-a019-0699ab9949f6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:01.073229 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8d2887cf-d90d-46af-a019-0699ab9949f6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:01.079553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d2887cf-d90d-46af-a019-0699ab9949f6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:01.080030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d2887cf-d90d-46af-a019-0699ab9949f6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:01.080463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d2887cf-d90d-46af-a019-0699ab9949f6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:01.081145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d2887cf-d90d-46af-a019-0699ab9949f6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:01.081594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d2887cf-d90d-46af-a019-0699ab9949f6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:01.082020 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d2887cf-d90d-46af-a019-0699ab9949f6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:01.111003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8d2887cf-d90d-46af-a019-0699ab9949f6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044142 Aug 10 12:54:01.111596 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 891/1797] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:01 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:02.124319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1706dbff-2713-406e-912f-bd013f9ca1c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:02.126367 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1706dbff-2713-406e-912f-bd013f9ca1c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:02.133465 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1706dbff-2713-406e-912f-bd013f9ca1c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:02.133946 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1706dbff-2713-406e-912f-bd013f9ca1c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:02.134381 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1706dbff-2713-406e-912f-bd013f9ca1c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:02.135067 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1706dbff-2713-406e-912f-bd013f9ca1c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:02.135550 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1706dbff-2713-406e-912f-bd013f9ca1c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:02.135970 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1706dbff-2713-406e-912f-bd013f9ca1c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:02.164663 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1706dbff-2713-406e-912f-bd013f9ca1c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044395 Aug 10 12:54:02.165213 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 907/1798] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:02 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:03.176895 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0c95535f-bc06-44a9-83ed-54504165939e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:03.179119 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0c95535f-bc06-44a9-83ed-54504165939e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:03.185526 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0c95535f-bc06-44a9-83ed-54504165939e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:03.186011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0c95535f-bc06-44a9-83ed-54504165939e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:03.186446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0c95535f-bc06-44a9-83ed-54504165939e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:03.187138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0c95535f-bc06-44a9-83ed-54504165939e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:03.187617 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0c95535f-bc06-44a9-83ed-54504165939e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:03.188042 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0c95535f-bc06-44a9-83ed-54504165939e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:03.217262 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0c95535f-bc06-44a9-83ed-54504165939e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044333 Aug 10 12:54:03.217739 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 892/1799] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:03 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:04.230070 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-240f8f72-b6b9-453a-8559-e8e87a68c58b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:04.232160 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-240f8f72-b6b9-453a-8559-e8e87a68c58b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:04.238572 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-240f8f72-b6b9-453a-8559-e8e87a68c58b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:04.239051 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-240f8f72-b6b9-453a-8559-e8e87a68c58b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:04.240129 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-240f8f72-b6b9-453a-8559-e8e87a68c58b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:04.240990 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-240f8f72-b6b9-453a-8559-e8e87a68c58b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:04.241445 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-240f8f72-b6b9-453a-8559-e8e87a68c58b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:04.241871 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-240f8f72-b6b9-453a-8559-e8e87a68c58b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:04.270163 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-240f8f72-b6b9-453a-8559-e8e87a68c58b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044366 Aug 10 12:54:04.270728 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 908/1800] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:04 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:05.282091 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f9f2b215-0984-4a90-a0b7-0bb7378ced94 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:05.284282 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f9f2b215-0984-4a90-a0b7-0bb7378ced94 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:05.290702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f9f2b215-0984-4a90-a0b7-0bb7378ced94 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:05.291228 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f9f2b215-0984-4a90-a0b7-0bb7378ced94 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:05.296799 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f9f2b215-0984-4a90-a0b7-0bb7378ced94 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:05.296799 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f9f2b215-0984-4a90-a0b7-0bb7378ced94 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:05.296799 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f9f2b215-0984-4a90-a0b7-0bb7378ced94 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:05.296799 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f9f2b215-0984-4a90-a0b7-0bb7378ced94 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:05.322482 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f9f2b215-0984-4a90-a0b7-0bb7378ced94 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044441 Aug 10 12:54:05.325485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 893/1801] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:05 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:06.334013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0efd865f-7885-42cf-b5cc-fe2b38b7ff88 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:06.336169 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0efd865f-7885-42cf-b5cc-fe2b38b7ff88 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:06.342422 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0efd865f-7885-42cf-b5cc-fe2b38b7ff88 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:06.342900 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0efd865f-7885-42cf-b5cc-fe2b38b7ff88 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:06.343365 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0efd865f-7885-42cf-b5cc-fe2b38b7ff88 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:06.344049 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0efd865f-7885-42cf-b5cc-fe2b38b7ff88 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:06.344492 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0efd865f-7885-42cf-b5cc-fe2b38b7ff88 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:06.344909 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0efd865f-7885-42cf-b5cc-fe2b38b7ff88 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:06.374211 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0efd865f-7885-42cf-b5cc-fe2b38b7ff88 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044271 Aug 10 12:54:06.374753 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 909/1802] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:06 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:07.386038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0ff5f1e4-27b3-47c2-89ce-0681474718b8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:07.388173 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0ff5f1e4-27b3-47c2-89ce-0681474718b8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:07.394406 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ff5f1e4-27b3-47c2-89ce-0681474718b8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:07.394877 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ff5f1e4-27b3-47c2-89ce-0681474718b8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:07.395344 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ff5f1e4-27b3-47c2-89ce-0681474718b8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:07.396567 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ff5f1e4-27b3-47c2-89ce-0681474718b8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:07.397009 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ff5f1e4-27b3-47c2-89ce-0681474718b8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:07.397424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ff5f1e4-27b3-47c2-89ce-0681474718b8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:07.425915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0ff5f1e4-27b3-47c2-89ce-0681474718b8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043833 Aug 10 12:54:07.426448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 894/1803] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:07 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:08.438864 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ee91914e-7475-4314-b39e-e2fde7c61d8a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:08.441050 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ee91914e-7475-4314-b39e-e2fde7c61d8a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:08.447973 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee91914e-7475-4314-b39e-e2fde7c61d8a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:08.448446 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee91914e-7475-4314-b39e-e2fde7c61d8a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:08.448872 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee91914e-7475-4314-b39e-e2fde7c61d8a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:08.449549 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee91914e-7475-4314-b39e-e2fde7c61d8a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:08.449994 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee91914e-7475-4314-b39e-e2fde7c61d8a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:08.450416 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee91914e-7475-4314-b39e-e2fde7c61d8a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:08.478213 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ee91914e-7475-4314-b39e-e2fde7c61d8a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043336 Aug 10 12:54:08.479023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 910/1804] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:08 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:09.490158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-509b1c89-2134-4323-bbb0-40461a52ebe0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:09.492350 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-509b1c89-2134-4323-bbb0-40461a52ebe0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:09.494677 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=30 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:54:09.499304 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-509b1c89-2134-4323-bbb0-40461a52ebe0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:09.499782 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-509b1c89-2134-4323-bbb0-40461a52ebe0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:09.500566 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-509b1c89-2134-4323-bbb0-40461a52ebe0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:09.500878 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-509b1c89-2134-4323-bbb0-40461a52ebe0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:09.501321 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-509b1c89-2134-4323-bbb0-40461a52ebe0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:09.501740 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-509b1c89-2134-4323-bbb0-40461a52ebe0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:09.504041 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=96 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:54:09.531627 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-509b1c89-2134-4323-bbb0-40461a52ebe0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045424 Aug 10 12:54:09.532111 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 895/1805] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:09 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:10.544463 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3b53c632-63aa-4c50-9cf9-267138c7087b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:10.546533 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3b53c632-63aa-4c50-9cf9-267138c7087b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:10.552891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3b53c632-63aa-4c50-9cf9-267138c7087b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:10.553374 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3b53c632-63aa-4c50-9cf9-267138c7087b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:10.553809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3b53c632-63aa-4c50-9cf9-267138c7087b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:10.554502 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3b53c632-63aa-4c50-9cf9-267138c7087b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:10.554955 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3b53c632-63aa-4c50-9cf9-267138c7087b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:10.555423 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3b53c632-63aa-4c50-9cf9-267138c7087b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:10.584681 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3b53c632-63aa-4c50-9cf9-267138c7087b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044681 Aug 10 12:54:10.585234 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 911/1806] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:10 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:11.596695 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a4e08854-7c28-4c2e-862d-3f8e0d90dfd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:11.599503 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a4e08854-7c28-4c2e-862d-3f8e0d90dfd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:11.606413 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4e08854-7c28-4c2e-862d-3f8e0d90dfd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:11.606883 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4e08854-7c28-4c2e-862d-3f8e0d90dfd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:11.607340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4e08854-7c28-4c2e-862d-3f8e0d90dfd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:11.608016 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4e08854-7c28-4c2e-862d-3f8e0d90dfd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:11.608460 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4e08854-7c28-4c2e-862d-3f8e0d90dfd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:11.608875 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4e08854-7c28-4c2e-862d-3f8e0d90dfd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:11.638460 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a4e08854-7c28-4c2e-862d-3f8e0d90dfd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046396 Aug 10 12:54:11.639000 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 896/1807] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:11 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:12.650035 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b9bfc2f3-9e24-4edc-9be3-db6ad72b3290 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:12.652137 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b9bfc2f3-9e24-4edc-9be3-db6ad72b3290 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:12.658658 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b9bfc2f3-9e24-4edc-9be3-db6ad72b3290 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:12.659141 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b9bfc2f3-9e24-4edc-9be3-db6ad72b3290 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:12.659606 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b9bfc2f3-9e24-4edc-9be3-db6ad72b3290 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:12.660297 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b9bfc2f3-9e24-4edc-9be3-db6ad72b3290 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:12.660753 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b9bfc2f3-9e24-4edc-9be3-db6ad72b3290 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:12.661692 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b9bfc2f3-9e24-4edc-9be3-db6ad72b3290 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:12.665224 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=96 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:54:12.690741 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b9bfc2f3-9e24-4edc-9be3-db6ad72b3290 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044752 Aug 10 12:54:12.691320 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 912/1808] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:12 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:13.703010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f8e9920c-9dd7-4646-b02a-ededfe31903b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:13.705096 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f8e9920c-9dd7-4646-b02a-ededfe31903b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:13.712014 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f8e9920c-9dd7-4646-b02a-ededfe31903b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:13.712500 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f8e9920c-9dd7-4646-b02a-ededfe31903b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:13.712950 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f8e9920c-9dd7-4646-b02a-ededfe31903b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:13.713670 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f8e9920c-9dd7-4646-b02a-ededfe31903b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:13.714124 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f8e9920c-9dd7-4646-b02a-ededfe31903b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:13.714550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f8e9920c-9dd7-4646-b02a-ededfe31903b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:13.743609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f8e9920c-9dd7-4646-b02a-ededfe31903b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044636 Aug 10 12:54:13.744164 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 897/1809] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:13 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:14.755921 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-36cb4c19-cb59-45ef-be79-a00fa2ca191e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:14.758065 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-36cb4c19-cb59-45ef-be79-a00fa2ca191e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:14.764686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-36cb4c19-cb59-45ef-be79-a00fa2ca191e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:14.765161 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-36cb4c19-cb59-45ef-be79-a00fa2ca191e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:14.765590 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-36cb4c19-cb59-45ef-be79-a00fa2ca191e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:14.766268 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-36cb4c19-cb59-45ef-be79-a00fa2ca191e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:14.766713 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-36cb4c19-cb59-45ef-be79-a00fa2ca191e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:14.767130 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-36cb4c19-cb59-45ef-be79-a00fa2ca191e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:14.794947 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-36cb4c19-cb59-45ef-be79-a00fa2ca191e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043054 Aug 10 12:54:14.795518 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 913/1810] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:14 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:15.807270 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e660b045-93ae-41d0-a4a5-11d4f9c1a3e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:15.809406 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e660b045-93ae-41d0-a4a5-11d4f9c1a3e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:15.815708 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e660b045-93ae-41d0-a4a5-11d4f9c1a3e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:15.816187 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e660b045-93ae-41d0-a4a5-11d4f9c1a3e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:15.816613 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e660b045-93ae-41d0-a4a5-11d4f9c1a3e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:15.817296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e660b045-93ae-41d0-a4a5-11d4f9c1a3e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:15.817738 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e660b045-93ae-41d0-a4a5-11d4f9c1a3e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:15.818153 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e660b045-93ae-41d0-a4a5-11d4f9c1a3e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:15.846846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e660b045-93ae-41d0-a4a5-11d4f9c1a3e3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043510 Aug 10 12:54:15.847432 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 898/1811] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:15 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:16.859300 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-163bb8fc-69c4-46da-bfff-8c9a011bcbda tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:16.861433 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-163bb8fc-69c4-46da-bfff-8c9a011bcbda tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:16.867875 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-163bb8fc-69c4-46da-bfff-8c9a011bcbda tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:16.868353 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-163bb8fc-69c4-46da-bfff-8c9a011bcbda tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:16.868787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-163bb8fc-69c4-46da-bfff-8c9a011bcbda tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:16.869473 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-163bb8fc-69c4-46da-bfff-8c9a011bcbda tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:16.869922 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-163bb8fc-69c4-46da-bfff-8c9a011bcbda tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:16.870343 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-163bb8fc-69c4-46da-bfff-8c9a011bcbda tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:16.899221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-163bb8fc-69c4-46da-bfff-8c9a011bcbda tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043895 Aug 10 12:54:16.899772 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 914/1812] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:16 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:17.911592 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0e2cc7bc-6a52-4bc4-9b16-3ec6186a7f98 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:17.913747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0e2cc7bc-6a52-4bc4-9b16-3ec6186a7f98 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:17.920122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e2cc7bc-6a52-4bc4-9b16-3ec6186a7f98 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:17.920605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e2cc7bc-6a52-4bc4-9b16-3ec6186a7f98 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:17.921041 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e2cc7bc-6a52-4bc4-9b16-3ec6186a7f98 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:17.921730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e2cc7bc-6a52-4bc4-9b16-3ec6186a7f98 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:17.922181 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e2cc7bc-6a52-4bc4-9b16-3ec6186a7f98 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:17.922605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e2cc7bc-6a52-4bc4-9b16-3ec6186a7f98 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:17.951689 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0e2cc7bc-6a52-4bc4-9b16-3ec6186a7f98 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044299 Aug 10 12:54:17.952249 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 899/1813] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:17 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:18.963816 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d7cd1c78-8610-4145-bcb4-a4baec69f756 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:18.965971 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d7cd1c78-8610-4145-bcb4-a4baec69f756 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:18.968294 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=32 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:54:18.972936 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7cd1c78-8610-4145-bcb4-a4baec69f756 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:18.973413 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7cd1c78-8610-4145-bcb4-a4baec69f756 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:18.973949 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7cd1c78-8610-4145-bcb4-a4baec69f756 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:18.980798 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7cd1c78-8610-4145-bcb4-a4baec69f756 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:18.980798 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7cd1c78-8610-4145-bcb4-a4baec69f756 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:18.980798 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7cd1c78-8610-4145-bcb4-a4baec69f756 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:19.006751 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d7cd1c78-8610-4145-bcb4-a4baec69f756 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046899 Aug 10 12:54:19.007349 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 915/1814] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:18 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:20.019105 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-dc556226-d988-4ff0-809d-c20141ebbbd0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:20.021900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-dc556226-d988-4ff0-809d-c20141ebbbd0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:20.027910 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dc556226-d988-4ff0-809d-c20141ebbbd0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:20.032479 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dc556226-d988-4ff0-809d-c20141ebbbd0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:20.032479 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dc556226-d988-4ff0-809d-c20141ebbbd0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:20.032479 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dc556226-d988-4ff0-809d-c20141ebbbd0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:20.032479 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dc556226-d988-4ff0-809d-c20141ebbbd0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:20.032870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dc556226-d988-4ff0-809d-c20141ebbbd0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:20.058821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-dc556226-d988-4ff0-809d-c20141ebbbd0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043768 Aug 10 12:54:20.064165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 900/1815] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:20 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:21.070879 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-abea4e65-8c12-4fab-9f61-52e1b2230dd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:21.073044 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-abea4e65-8c12-4fab-9f61-52e1b2230dd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:21.079449 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-abea4e65-8c12-4fab-9f61-52e1b2230dd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:21.079928 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-abea4e65-8c12-4fab-9f61-52e1b2230dd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:21.080360 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-abea4e65-8c12-4fab-9f61-52e1b2230dd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:21.081048 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-abea4e65-8c12-4fab-9f61-52e1b2230dd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:21.081497 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-abea4e65-8c12-4fab-9f61-52e1b2230dd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:21.081919 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-abea4e65-8c12-4fab-9f61-52e1b2230dd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:21.111274 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-abea4e65-8c12-4fab-9f61-52e1b2230dd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044551 Aug 10 12:54:21.111821 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 916/1816] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:21 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:22.123350 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7a8c4679-57d2-4640-91dc-dda76856f07c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:22.125413 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7a8c4679-57d2-4640-91dc-dda76856f07c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:22.131982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a8c4679-57d2-4640-91dc-dda76856f07c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:22.132461 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a8c4679-57d2-4640-91dc-dda76856f07c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:22.132894 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a8c4679-57d2-4640-91dc-dda76856f07c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:22.133578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a8c4679-57d2-4640-91dc-dda76856f07c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:22.134031 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a8c4679-57d2-4640-91dc-dda76856f07c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:22.134452 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a8c4679-57d2-4640-91dc-dda76856f07c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:22.163449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7a8c4679-57d2-4640-91dc-dda76856f07c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044107 Aug 10 12:54:22.163990 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 901/1817] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:22 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:23.174700 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9e103a96-5ab0-4765-a35a-3e70aa8dc01f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:23.176869 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9e103a96-5ab0-4765-a35a-3e70aa8dc01f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:23.183597 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e103a96-5ab0-4765-a35a-3e70aa8dc01f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:23.184072 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e103a96-5ab0-4765-a35a-3e70aa8dc01f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:23.184503 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e103a96-5ab0-4765-a35a-3e70aa8dc01f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:23.185186 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e103a96-5ab0-4765-a35a-3e70aa8dc01f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:23.185637 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e103a96-5ab0-4765-a35a-3e70aa8dc01f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:23.186059 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e103a96-5ab0-4765-a35a-3e70aa8dc01f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:23.214640 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9e103a96-5ab0-4765-a35a-3e70aa8dc01f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043929 Aug 10 12:54:23.215197 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 917/1818] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:23 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:24.227412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3c8b3f47-36f2-4bcf-b06c-c20180dc2047 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:24.229858 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3c8b3f47-36f2-4bcf-b06c-c20180dc2047 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:24.235852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c8b3f47-36f2-4bcf-b06c-c20180dc2047 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:24.236327 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c8b3f47-36f2-4bcf-b06c-c20180dc2047 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:24.236757 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c8b3f47-36f2-4bcf-b06c-c20180dc2047 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:24.237434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c8b3f47-36f2-4bcf-b06c-c20180dc2047 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:24.237876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c8b3f47-36f2-4bcf-b06c-c20180dc2047 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:24.238292 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c8b3f47-36f2-4bcf-b06c-c20180dc2047 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:24.267419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3c8b3f47-36f2-4bcf-b06c-c20180dc2047 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044592 Aug 10 12:54:24.267966 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 902/1819] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:24 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:25.279853 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d791d095-c47d-4754-bd0c-18f183491c3f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:25.281994 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d791d095-c47d-4754-bd0c-18f183491c3f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:25.289413 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d791d095-c47d-4754-bd0c-18f183491c3f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:25.289895 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d791d095-c47d-4754-bd0c-18f183491c3f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:25.290329 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d791d095-c47d-4754-bd0c-18f183491c3f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:25.291082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d791d095-c47d-4754-bd0c-18f183491c3f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:25.291560 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d791d095-c47d-4754-bd0c-18f183491c3f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:25.291982 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d791d095-c47d-4754-bd0c-18f183491c3f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:25.321083 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d791d095-c47d-4754-bd0c-18f183491c3f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045164 Aug 10 12:54:25.321634 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 918/1820] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:25 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:26.333255 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8c23f6c0-6f95-4457-8ab5-8b3c6e7e2b73 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:26.335410 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8c23f6c0-6f95-4457-8ab5-8b3c6e7e2b73 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:26.341852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c23f6c0-6f95-4457-8ab5-8b3c6e7e2b73 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:26.342325 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c23f6c0-6f95-4457-8ab5-8b3c6e7e2b73 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:26.342747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c23f6c0-6f95-4457-8ab5-8b3c6e7e2b73 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:26.343466 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c23f6c0-6f95-4457-8ab5-8b3c6e7e2b73 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:26.343914 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c23f6c0-6f95-4457-8ab5-8b3c6e7e2b73 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:26.344354 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c23f6c0-6f95-4457-8ab5-8b3c6e7e2b73 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:26.373836 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8c23f6c0-6f95-4457-8ab5-8b3c6e7e2b73 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044554 Aug 10 12:54:26.374379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 903/1821] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:26 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:27.386668 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0ddc58e8-360d-464f-adbb-e595ffa64e90 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:27.388843 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0ddc58e8-360d-464f-adbb-e595ffa64e90 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:27.394794 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ddc58e8-360d-464f-adbb-e595ffa64e90 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:27.395310 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ddc58e8-360d-464f-adbb-e595ffa64e90 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:27.395746 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ddc58e8-360d-464f-adbb-e595ffa64e90 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:27.396435 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ddc58e8-360d-464f-adbb-e595ffa64e90 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:27.396888 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ddc58e8-360d-464f-adbb-e595ffa64e90 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:27.398036 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ddc58e8-360d-464f-adbb-e595ffa64e90 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:27.425672 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0ddc58e8-360d-464f-adbb-e595ffa64e90 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043682 Aug 10 12:54:27.426223 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 919/1822] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:27 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:28.437212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-dd929dd5-118e-4427-9184-d80e572886c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:28.439445 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-dd929dd5-118e-4427-9184-d80e572886c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:28.445878 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd929dd5-118e-4427-9184-d80e572886c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:28.446363 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd929dd5-118e-4427-9184-d80e572886c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:28.446801 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd929dd5-118e-4427-9184-d80e572886c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:28.447530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd929dd5-118e-4427-9184-d80e572886c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:28.447986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd929dd5-118e-4427-9184-d80e572886c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:28.448411 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd929dd5-118e-4427-9184-d80e572886c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:28.477530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-dd929dd5-118e-4427-9184-d80e572886c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044341 Aug 10 12:54:28.478071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 904/1823] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:28 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:29.489931 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-82e70278-2d51-4f84-8e1f-40bb79dba4b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:29.492289 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-82e70278-2d51-4f84-8e1f-40bb79dba4b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:29.498641 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82e70278-2d51-4f84-8e1f-40bb79dba4b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:29.499116 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82e70278-2d51-4f84-8e1f-40bb79dba4b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:29.499577 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82e70278-2d51-4f84-8e1f-40bb79dba4b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:29.500260 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82e70278-2d51-4f84-8e1f-40bb79dba4b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:29.500711 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82e70278-2d51-4f84-8e1f-40bb79dba4b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:29.501131 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82e70278-2d51-4f84-8e1f-40bb79dba4b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:29.530520 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-82e70278-2d51-4f84-8e1f-40bb79dba4b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044517 Aug 10 12:54:29.531000 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 920/1824] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:29 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:30.543045 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-76ec83ee-a1b4-407c-a409-e0bd9256b1cc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:30.545213 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-76ec83ee-a1b4-407c-a409-e0bd9256b1cc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:30.551650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76ec83ee-a1b4-407c-a409-e0bd9256b1cc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:30.552135 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76ec83ee-a1b4-407c-a409-e0bd9256b1cc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:30.552570 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76ec83ee-a1b4-407c-a409-e0bd9256b1cc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:30.553259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76ec83ee-a1b4-407c-a409-e0bd9256b1cc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:30.554342 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76ec83ee-a1b4-407c-a409-e0bd9256b1cc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:30.554793 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76ec83ee-a1b4-407c-a409-e0bd9256b1cc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:30.582831 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-76ec83ee-a1b4-407c-a409-e0bd9256b1cc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043695 Aug 10 12:54:30.583415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 905/1825] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:30 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:31.597083 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e86a0c6f-c9eb-4f94-87ab-03d0f6e3ef3a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:31.599280 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e86a0c6f-c9eb-4f94-87ab-03d0f6e3ef3a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:31.606100 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e86a0c6f-c9eb-4f94-87ab-03d0f6e3ef3a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:31.606588 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e86a0c6f-c9eb-4f94-87ab-03d0f6e3ef3a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:31.607028 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e86a0c6f-c9eb-4f94-87ab-03d0f6e3ef3a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:31.607771 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e86a0c6f-c9eb-4f94-87ab-03d0f6e3ef3a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:31.608268 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e86a0c6f-c9eb-4f94-87ab-03d0f6e3ef3a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:31.608715 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e86a0c6f-c9eb-4f94-87ab-03d0f6e3ef3a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:31.637951 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e86a0c6f-c9eb-4f94-87ab-03d0f6e3ef3a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044869 Aug 10 12:54:31.638518 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 921/1826] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:31 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:32.651267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d942ac7d-69b7-4fec-9640-3d082d810e65 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:32.653378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d942ac7d-69b7-4fec-9640-3d082d810e65 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:32.659675 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d942ac7d-69b7-4fec-9640-3d082d810e65 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:32.660149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d942ac7d-69b7-4fec-9640-3d082d810e65 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:32.660582 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d942ac7d-69b7-4fec-9640-3d082d810e65 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:32.661260 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d942ac7d-69b7-4fec-9640-3d082d810e65 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:32.661704 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d942ac7d-69b7-4fec-9640-3d082d810e65 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:32.662122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d942ac7d-69b7-4fec-9640-3d082d810e65 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:32.690564 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d942ac7d-69b7-4fec-9640-3d082d810e65 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044461 Aug 10 12:54:32.691099 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 906/1827] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:32 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:33.703562 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-98f55520-c280-42cf-9b30-2ea5e8f301c6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:33.705753 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-98f55520-c280-42cf-9b30-2ea5e8f301c6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:33.712244 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-98f55520-c280-42cf-9b30-2ea5e8f301c6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:33.712716 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-98f55520-c280-42cf-9b30-2ea5e8f301c6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:33.713143 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-98f55520-c280-42cf-9b30-2ea5e8f301c6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:33.713815 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-98f55520-c280-42cf-9b30-2ea5e8f301c6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:33.714257 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-98f55520-c280-42cf-9b30-2ea5e8f301c6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:33.714675 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-98f55520-c280-42cf-9b30-2ea5e8f301c6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:33.743320 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-98f55520-c280-42cf-9b30-2ea5e8f301c6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043746 Aug 10 12:54:33.743860 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 922/1828] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:33 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:34.755679 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-02d3557b-99ce-4845-aeb3-982d17dee388 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:34.758520 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-02d3557b-99ce-4845-aeb3-982d17dee388 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:34.764876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-02d3557b-99ce-4845-aeb3-982d17dee388 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:34.765362 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-02d3557b-99ce-4845-aeb3-982d17dee388 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:34.765797 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-02d3557b-99ce-4845-aeb3-982d17dee388 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:34.766487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-02d3557b-99ce-4845-aeb3-982d17dee388 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:34.766939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-02d3557b-99ce-4845-aeb3-982d17dee388 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:34.767399 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-02d3557b-99ce-4845-aeb3-982d17dee388 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:34.796062 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-02d3557b-99ce-4845-aeb3-982d17dee388 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044366 Aug 10 12:54:34.796614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 907/1829] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:34 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:35.808980 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-19d75e69-ff0e-490b-a287-a7eacb9d2acc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:35.811434 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-19d75e69-ff0e-490b-a287-a7eacb9d2acc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:35.817752 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19d75e69-ff0e-490b-a287-a7eacb9d2acc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:35.818230 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19d75e69-ff0e-490b-a287-a7eacb9d2acc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:35.818659 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19d75e69-ff0e-490b-a287-a7eacb9d2acc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:35.819446 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19d75e69-ff0e-490b-a287-a7eacb9d2acc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:35.819897 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19d75e69-ff0e-490b-a287-a7eacb9d2acc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:35.820318 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19d75e69-ff0e-490b-a287-a7eacb9d2acc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:35.848069 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-19d75e69-ff0e-490b-a287-a7eacb9d2acc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043076 Aug 10 12:54:35.848621 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 923/1830] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:35 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:36.861666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-04f917aa-304e-44c3-a3da-5a31dbe4294f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:36.863843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-04f917aa-304e-44c3-a3da-5a31dbe4294f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:36.870272 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04f917aa-304e-44c3-a3da-5a31dbe4294f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:36.870744 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04f917aa-304e-44c3-a3da-5a31dbe4294f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:36.871191 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04f917aa-304e-44c3-a3da-5a31dbe4294f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:36.871874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04f917aa-304e-44c3-a3da-5a31dbe4294f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:36.872318 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04f917aa-304e-44c3-a3da-5a31dbe4294f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:36.872734 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04f917aa-304e-44c3-a3da-5a31dbe4294f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:36.901043 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-04f917aa-304e-44c3-a3da-5a31dbe4294f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043360 Aug 10 12:54:36.901578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 908/1831] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:36 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:37.913237 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ce396b90-16e2-44d6-b35e-0c23b72962a5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:37.915397 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ce396b90-16e2-44d6-b35e-0c23b72962a5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:37.921751 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce396b90-16e2-44d6-b35e-0c23b72962a5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:37.922232 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce396b90-16e2-44d6-b35e-0c23b72962a5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:37.922662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce396b90-16e2-44d6-b35e-0c23b72962a5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:37.923377 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce396b90-16e2-44d6-b35e-0c23b72962a5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:37.923826 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce396b90-16e2-44d6-b35e-0c23b72962a5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:37.924243 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce396b90-16e2-44d6-b35e-0c23b72962a5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:37.953341 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ce396b90-16e2-44d6-b35e-0c23b72962a5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044116 Aug 10 12:54:37.953888 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 924/1832] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:37 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:38.965654 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-60f739d3-9e36-4eea-9ae3-368d44dfd845 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:38.967817 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-60f739d3-9e36-4eea-9ae3-368d44dfd845 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:38.974098 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60f739d3-9e36-4eea-9ae3-368d44dfd845 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:38.974573 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60f739d3-9e36-4eea-9ae3-368d44dfd845 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:38.975002 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60f739d3-9e36-4eea-9ae3-368d44dfd845 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:38.976521 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60f739d3-9e36-4eea-9ae3-368d44dfd845 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:38.976969 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60f739d3-9e36-4eea-9ae3-368d44dfd845 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:38.977391 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60f739d3-9e36-4eea-9ae3-368d44dfd845 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:39.005638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-60f739d3-9e36-4eea-9ae3-368d44dfd845 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043898 Aug 10 12:54:39.006177 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 909/1833] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:38 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:54:40.017760 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-63fedec9-73f4-4ef6-913c-42e60be66037 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:40.019955 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-63fedec9-73f4-4ef6-913c-42e60be66037 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:40.027027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63fedec9-73f4-4ef6-913c-42e60be66037 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:40.027550 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63fedec9-73f4-4ef6-913c-42e60be66037 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:40.027988 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63fedec9-73f4-4ef6-913c-42e60be66037 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:40.028694 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63fedec9-73f4-4ef6-913c-42e60be66037 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:40.029142 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63fedec9-73f4-4ef6-913c-42e60be66037 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:40.029567 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63fedec9-73f4-4ef6-913c-42e60be66037 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:40.060015 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-63fedec9-73f4-4ef6-913c-42e60be66037 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046033 Aug 10 12:54:40.060588 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 925/1834] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:40 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:41.072720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-db850ccf-6e25-47ca-b1f4-93ad7cf4c775 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:41.074892 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-db850ccf-6e25-47ca-b1f4-93ad7cf4c775 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:41.081444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-db850ccf-6e25-47ca-b1f4-93ad7cf4c775 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:41.081916 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-db850ccf-6e25-47ca-b1f4-93ad7cf4c775 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:41.082353 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-db850ccf-6e25-47ca-b1f4-93ad7cf4c775 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:41.083030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-db850ccf-6e25-47ca-b1f4-93ad7cf4c775 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:41.083503 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-db850ccf-6e25-47ca-b1f4-93ad7cf4c775 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:41.083923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-db850ccf-6e25-47ca-b1f4-93ad7cf4c775 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:41.113215 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-db850ccf-6e25-47ca-b1f4-93ad7cf4c775 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044931 Aug 10 12:54:41.113693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 910/1835] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:41 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:42.125265 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1848be2d-7815-4811-9cf3-3a17d4d6c83b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:42.127438 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1848be2d-7815-4811-9cf3-3a17d4d6c83b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:42.133881 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1848be2d-7815-4811-9cf3-3a17d4d6c83b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:42.134363 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1848be2d-7815-4811-9cf3-3a17d4d6c83b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:42.134798 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1848be2d-7815-4811-9cf3-3a17d4d6c83b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:42.135590 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1848be2d-7815-4811-9cf3-3a17d4d6c83b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:42.136045 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1848be2d-7815-4811-9cf3-3a17d4d6c83b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:42.136496 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1848be2d-7815-4811-9cf3-3a17d4d6c83b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:42.165704 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1848be2d-7815-4811-9cf3-3a17d4d6c83b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044419 Aug 10 12:54:42.166255 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 926/1836] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:42 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:43.177879 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ee9991ef-c311-423d-bc06-06a5662d0ed5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:43.180725 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ee9991ef-c311-423d-bc06-06a5662d0ed5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:43.183010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=32 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:54:43.187695 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ee9991ef-c311-423d-bc06-06a5662d0ed5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:43.188180 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ee9991ef-c311-423d-bc06-06a5662d0ed5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:43.188616 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ee9991ef-c311-423d-bc06-06a5662d0ed5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:43.189305 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ee9991ef-c311-423d-bc06-06a5662d0ed5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:43.189758 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ee9991ef-c311-423d-bc06-06a5662d0ed5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:43.190185 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ee9991ef-c311-423d-bc06-06a5662d0ed5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:43.207008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=96 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:54:43.218901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ee9991ef-c311-423d-bc06-06a5662d0ed5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044940 Aug 10 12:54:43.219495 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 911/1837] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:43 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:44.231703 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fd267908-011f-4617-824f-ec584339d07f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:44.233846 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fd267908-011f-4617-824f-ec584339d07f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:44.240295 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fd267908-011f-4617-824f-ec584339d07f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:44.240828 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fd267908-011f-4617-824f-ec584339d07f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:44.241453 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fd267908-011f-4617-824f-ec584339d07f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:44.242151 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fd267908-011f-4617-824f-ec584339d07f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:44.242615 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fd267908-011f-4617-824f-ec584339d07f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:44.243033 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fd267908-011f-4617-824f-ec584339d07f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:44.272897 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fd267908-011f-4617-824f-ec584339d07f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044826 Aug 10 12:54:44.273552 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 927/1838] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:44 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:54:45.284613 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-82a1f9ca-0405-45f7-93e5-1b468ec02108 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:45.286792 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-82a1f9ca-0405-45f7-93e5-1b468ec02108 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:45.294609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-82a1f9ca-0405-45f7-93e5-1b468ec02108 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:45.295095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-82a1f9ca-0405-45f7-93e5-1b468ec02108 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:45.295557 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-82a1f9ca-0405-45f7-93e5-1b468ec02108 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:45.296251 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-82a1f9ca-0405-45f7-93e5-1b468ec02108 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:45.296707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-82a1f9ca-0405-45f7-93e5-1b468ec02108 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:45.297176 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-82a1f9ca-0405-45f7-93e5-1b468ec02108 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:45.326516 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-82a1f9ca-0405-45f7-93e5-1b468ec02108 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045893 Aug 10 12:54:45.327080 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 912/1839] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:45 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:46.339560 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8a914584-a520-4efa-a6e4-c58b39072df5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:46.341730 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8a914584-a520-4efa-a6e4-c58b39072df5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:46.348082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a914584-a520-4efa-a6e4-c58b39072df5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:46.348568 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a914584-a520-4efa-a6e4-c58b39072df5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:46.349003 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a914584-a520-4efa-a6e4-c58b39072df5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:46.349689 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a914584-a520-4efa-a6e4-c58b39072df5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:46.350160 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a914584-a520-4efa-a6e4-c58b39072df5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:46.350590 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a914584-a520-4efa-a6e4-c58b39072df5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:46.353062 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=96 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:54:46.380419 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8a914584-a520-4efa-a6e4-c58b39072df5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045574 Aug 10 12:54:46.380978 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 928/1840] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:46 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:47.393340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5776aa06-eebe-4ade-9bc8-f34649e0f9d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:47.395516 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5776aa06-eebe-4ade-9bc8-f34649e0f9d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:47.401976 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5776aa06-eebe-4ade-9bc8-f34649e0f9d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:47.402459 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5776aa06-eebe-4ade-9bc8-f34649e0f9d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:47.402897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5776aa06-eebe-4ade-9bc8-f34649e0f9d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:47.403612 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5776aa06-eebe-4ade-9bc8-f34649e0f9d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:47.404066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5776aa06-eebe-4ade-9bc8-f34649e0f9d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:47.404496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5776aa06-eebe-4ade-9bc8-f34649e0f9d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:47.434948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5776aa06-eebe-4ade-9bc8-f34649e0f9d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045571 Aug 10 12:54:47.435552 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 913/1841] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:47 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:48.447518 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8ed18a31-5a0e-48d7-af35-acf050df12dd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:48.449680 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8ed18a31-5a0e-48d7-af35-acf050df12dd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:48.456197 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8ed18a31-5a0e-48d7-af35-acf050df12dd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:48.456679 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8ed18a31-5a0e-48d7-af35-acf050df12dd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:48.457116 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8ed18a31-5a0e-48d7-af35-acf050df12dd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:48.457797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8ed18a31-5a0e-48d7-af35-acf050df12dd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:48.458249 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8ed18a31-5a0e-48d7-af35-acf050df12dd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:48.458670 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8ed18a31-5a0e-48d7-af35-acf050df12dd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:48.487893 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8ed18a31-5a0e-48d7-af35-acf050df12dd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044710 Aug 10 12:54:48.488431 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 929/1842] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:48 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:49.500046 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-688ab945-7299-4a49-9f84-4aa66c1ef527 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:49.502169 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-688ab945-7299-4a49-9f84-4aa66c1ef527 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:49.508273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-688ab945-7299-4a49-9f84-4aa66c1ef527 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:49.508746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-688ab945-7299-4a49-9f84-4aa66c1ef527 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:49.509174 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-688ab945-7299-4a49-9f84-4aa66c1ef527 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:49.509847 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-688ab945-7299-4a49-9f84-4aa66c1ef527 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:49.510290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-688ab945-7299-4a49-9f84-4aa66c1ef527 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:49.510706 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-688ab945-7299-4a49-9f84-4aa66c1ef527 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:49.539683 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-688ab945-7299-4a49-9f84-4aa66c1ef527 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043478 Aug 10 12:54:49.540147 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 914/1843] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:49 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:50.551685 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-dcb1e14c-8af5-40a9-9159-2ae91c6ed4b2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:50.553850 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-dcb1e14c-8af5-40a9-9159-2ae91c6ed4b2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:50.557080 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=30 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:54:50.561774 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dcb1e14c-8af5-40a9-9159-2ae91c6ed4b2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:50.562253 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dcb1e14c-8af5-40a9-9159-2ae91c6ed4b2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:50.564419 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dcb1e14c-8af5-40a9-9159-2ae91c6ed4b2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:50.564419 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dcb1e14c-8af5-40a9-9159-2ae91c6ed4b2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:50.564419 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dcb1e14c-8af5-40a9-9159-2ae91c6ed4b2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:50.564419 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dcb1e14c-8af5-40a9-9159-2ae91c6ed4b2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:50.594417 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-dcb1e14c-8af5-40a9-9159-2ae91c6ed4b2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046607 Aug 10 12:54:50.594988 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 930/1844] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:50 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:51.607411 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-22da3e61-d4da-48c4-94cd-597ae32907d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:51.609533 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-22da3e61-d4da-48c4-94cd-597ae32907d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:51.615974 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-22da3e61-d4da-48c4-94cd-597ae32907d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:51.616453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-22da3e61-d4da-48c4-94cd-597ae32907d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:51.616889 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-22da3e61-d4da-48c4-94cd-597ae32907d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:51.617751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-22da3e61-d4da-48c4-94cd-597ae32907d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:51.618209 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-22da3e61-d4da-48c4-94cd-597ae32907d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:51.618633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-22da3e61-d4da-48c4-94cd-597ae32907d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:51.647409 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-22da3e61-d4da-48c4-94cd-597ae32907d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044165 Aug 10 12:54:51.647957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 915/1845] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:51 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:52.660189 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e80b5179-a761-41cf-ab26-e4bdb7416fd1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:52.662363 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e80b5179-a761-41cf-ab26-e4bdb7416fd1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:52.668776 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e80b5179-a761-41cf-ab26-e4bdb7416fd1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:52.669253 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e80b5179-a761-41cf-ab26-e4bdb7416fd1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:52.669687 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e80b5179-a761-41cf-ab26-e4bdb7416fd1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:52.670396 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e80b5179-a761-41cf-ab26-e4bdb7416fd1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:52.670819 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e80b5179-a761-41cf-ab26-e4bdb7416fd1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:52.671269 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e80b5179-a761-41cf-ab26-e4bdb7416fd1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:52.699798 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e80b5179-a761-41cf-ab26-e4bdb7416fd1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043530 Aug 10 12:54:52.700336 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 931/1846] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:52 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:53.712637 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-22e9d527-b51f-421a-9756-0334447bd1b1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:53.714778 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-22e9d527-b51f-421a-9756-0334447bd1b1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:53.721086 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-22e9d527-b51f-421a-9756-0334447bd1b1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:53.721558 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-22e9d527-b51f-421a-9756-0334447bd1b1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:53.721984 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-22e9d527-b51f-421a-9756-0334447bd1b1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:53.722666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-22e9d527-b51f-421a-9756-0334447bd1b1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:53.723238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-22e9d527-b51f-421a-9756-0334447bd1b1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:53.723658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-22e9d527-b51f-421a-9756-0334447bd1b1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:53.752191 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-22e9d527-b51f-421a-9756-0334447bd1b1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043807 Aug 10 12:54:53.752725 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 916/1847] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:53 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:54.764511 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2d84a56a-1bae-426f-96bb-58adbc06a647 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:54.766733 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2d84a56a-1bae-426f-96bb-58adbc06a647 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:54.773228 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2d84a56a-1bae-426f-96bb-58adbc06a647 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:54.773943 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2d84a56a-1bae-426f-96bb-58adbc06a647 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:54.774391 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2d84a56a-1bae-426f-96bb-58adbc06a647 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:54.775085 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2d84a56a-1bae-426f-96bb-58adbc06a647 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:54.775568 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2d84a56a-1bae-426f-96bb-58adbc06a647 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:54.775999 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2d84a56a-1bae-426f-96bb-58adbc06a647 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:54.805471 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2d84a56a-1bae-426f-96bb-58adbc06a647 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044374 Aug 10 12:54:54.806033 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 932/1848] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:54 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:55.817706 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d1fa7b15-25a0-4050-bb0c-4877560d8cea tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:55.819864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d1fa7b15-25a0-4050-bb0c-4877560d8cea tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:55.826296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d1fa7b15-25a0-4050-bb0c-4877560d8cea tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:55.826775 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d1fa7b15-25a0-4050-bb0c-4877560d8cea tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:55.827235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d1fa7b15-25a0-4050-bb0c-4877560d8cea tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:55.827933 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d1fa7b15-25a0-4050-bb0c-4877560d8cea tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:55.828384 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d1fa7b15-25a0-4050-bb0c-4877560d8cea tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:55.828871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d1fa7b15-25a0-4050-bb0c-4877560d8cea tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:55.858434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d1fa7b15-25a0-4050-bb0c-4877560d8cea tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044659 Aug 10 12:54:55.858983 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 917/1849] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:55 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:56.870583 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f41c9d5f-0024-457f-b28d-baf0df5c92e1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:56.872772 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f41c9d5f-0024-457f-b28d-baf0df5c92e1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:56.878829 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f41c9d5f-0024-457f-b28d-baf0df5c92e1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:56.879348 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f41c9d5f-0024-457f-b28d-baf0df5c92e1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:56.879786 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f41c9d5f-0024-457f-b28d-baf0df5c92e1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:56.880473 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f41c9d5f-0024-457f-b28d-baf0df5c92e1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:56.880927 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f41c9d5f-0024-457f-b28d-baf0df5c92e1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:56.881350 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f41c9d5f-0024-457f-b28d-baf0df5c92e1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:56.910497 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f41c9d5f-0024-457f-b28d-baf0df5c92e1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043885 Aug 10 12:54:56.911039 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 933/1850] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:56 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:57.923167 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5783e4f4-b4bb-485f-b1c0-54c8d64efa49 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:57.925373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5783e4f4-b4bb-485f-b1c0-54c8d64efa49 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:57.932691 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5783e4f4-b4bb-485f-b1c0-54c8d64efa49 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:57.933171 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5783e4f4-b4bb-485f-b1c0-54c8d64efa49 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:57.933608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5783e4f4-b4bb-485f-b1c0-54c8d64efa49 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:57.934303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5783e4f4-b4bb-485f-b1c0-54c8d64efa49 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:57.934758 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5783e4f4-b4bb-485f-b1c0-54c8d64efa49 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:57.935184 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5783e4f4-b4bb-485f-b1c0-54c8d64efa49 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:57.965537 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5783e4f4-b4bb-485f-b1c0-54c8d64efa49 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046262 Aug 10 12:54:57.966108 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 918/1851] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:57 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:54:58.979739 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f67075ee-67a9-4f68-b72b-a288896ea6ab tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:54:58.981797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f67075ee-67a9-4f68-b72b-a288896ea6ab tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:54:58.988207 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f67075ee-67a9-4f68-b72b-a288896ea6ab tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:58.988691 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f67075ee-67a9-4f68-b72b-a288896ea6ab tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:58.989121 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f67075ee-67a9-4f68-b72b-a288896ea6ab tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:58.989801 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f67075ee-67a9-4f68-b72b-a288896ea6ab tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:54:58.990251 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f67075ee-67a9-4f68-b72b-a288896ea6ab tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:54:58.990673 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f67075ee-67a9-4f68-b72b-a288896ea6ab tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:54:59.019774 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f67075ee-67a9-4f68-b72b-a288896ea6ab tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044515 Aug 10 12:54:59.020324 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 934/1852] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:54:58 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:00.032589 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-30fea7bb-7a6f-4262-97cf-a6646e9c18d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:00.034748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-30fea7bb-7a6f-4262-97cf-a6646e9c18d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:00.041321 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-30fea7bb-7a6f-4262-97cf-a6646e9c18d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:00.041801 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-30fea7bb-7a6f-4262-97cf-a6646e9c18d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:00.042239 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-30fea7bb-7a6f-4262-97cf-a6646e9c18d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:00.042933 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-30fea7bb-7a6f-4262-97cf-a6646e9c18d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:00.043420 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-30fea7bb-7a6f-4262-97cf-a6646e9c18d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:00.043847 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-30fea7bb-7a6f-4262-97cf-a6646e9c18d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:00.072632 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-30fea7bb-7a6f-4262-97cf-a6646e9c18d1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044070 Aug 10 12:55:00.073179 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 919/1853] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:00 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:01.084913 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-16e3910c-bddb-425d-a53c-16ebf9fe7b89 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:01.087600 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-16e3910c-bddb-425d-a53c-16ebf9fe7b89 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:01.093947 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-16e3910c-bddb-425d-a53c-16ebf9fe7b89 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:01.094426 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-16e3910c-bddb-425d-a53c-16ebf9fe7b89 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:01.094863 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-16e3910c-bddb-425d-a53c-16ebf9fe7b89 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:01.095587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-16e3910c-bddb-425d-a53c-16ebf9fe7b89 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:01.096045 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-16e3910c-bddb-425d-a53c-16ebf9fe7b89 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:01.096467 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-16e3910c-bddb-425d-a53c-16ebf9fe7b89 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:01.126030 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-16e3910c-bddb-425d-a53c-16ebf9fe7b89 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045179 Aug 10 12:55:01.126581 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 935/1854] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:01 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:02.138106 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ff46ebcb-fce8-4fde-a89b-51b0d10efe75 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:02.140409 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ff46ebcb-fce8-4fde-a89b-51b0d10efe75 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:02.146893 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff46ebcb-fce8-4fde-a89b-51b0d10efe75 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:02.147440 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff46ebcb-fce8-4fde-a89b-51b0d10efe75 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:02.147878 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff46ebcb-fce8-4fde-a89b-51b0d10efe75 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:02.148568 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff46ebcb-fce8-4fde-a89b-51b0d10efe75 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:02.149021 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff46ebcb-fce8-4fde-a89b-51b0d10efe75 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:02.149448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff46ebcb-fce8-4fde-a89b-51b0d10efe75 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:02.178136 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ff46ebcb-fce8-4fde-a89b-51b0d10efe75 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044001 Aug 10 12:55:02.178686 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 920/1855] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:02 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:03.191015 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-34526f51-9a47-47d2-9328-f5c8990c20de tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:03.193114 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-34526f51-9a47-47d2-9328-f5c8990c20de tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:03.200141 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34526f51-9a47-47d2-9328-f5c8990c20de tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:03.200623 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34526f51-9a47-47d2-9328-f5c8990c20de tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:03.201091 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34526f51-9a47-47d2-9328-f5c8990c20de tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:03.201752 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34526f51-9a47-47d2-9328-f5c8990c20de tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:03.202201 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34526f51-9a47-47d2-9328-f5c8990c20de tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:03.202623 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34526f51-9a47-47d2-9328-f5c8990c20de tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:03.231836 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-34526f51-9a47-47d2-9328-f5c8990c20de tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044863 Aug 10 12:55:03.232387 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 936/1856] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:03 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:04.244440 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-852c6bc4-020e-4cab-9845-29644ead9a3e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:04.246474 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-852c6bc4-020e-4cab-9845-29644ead9a3e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:04.252835 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-852c6bc4-020e-4cab-9845-29644ead9a3e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:04.253314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-852c6bc4-020e-4cab-9845-29644ead9a3e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:04.253747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-852c6bc4-020e-4cab-9845-29644ead9a3e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:04.254432 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-852c6bc4-020e-4cab-9845-29644ead9a3e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:04.254880 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-852c6bc4-020e-4cab-9845-29644ead9a3e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:04.255332 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-852c6bc4-020e-4cab-9845-29644ead9a3e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:04.284640 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-852c6bc4-020e-4cab-9845-29644ead9a3e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044564 Aug 10 12:55:04.285195 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 921/1857] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:04 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:05.297432 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d09650a6-dff2-4867-aede-ed8768f769fa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:05.299627 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d09650a6-dff2-4867-aede-ed8768f769fa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:05.306850 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d09650a6-dff2-4867-aede-ed8768f769fa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:05.307367 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d09650a6-dff2-4867-aede-ed8768f769fa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:05.307803 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d09650a6-dff2-4867-aede-ed8768f769fa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:05.308492 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d09650a6-dff2-4867-aede-ed8768f769fa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:05.308942 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d09650a6-dff2-4867-aede-ed8768f769fa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:05.314600 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d09650a6-dff2-4867-aede-ed8768f769fa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:05.337349 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d09650a6-dff2-4867-aede-ed8768f769fa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044104 Aug 10 12:55:05.337900 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 937/1858] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:05 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:06.349646 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1cb7ebe4-d1e1-4ef8-af86-c28cf9754841 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:06.351798 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1cb7ebe4-d1e1-4ef8-af86-c28cf9754841 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:06.359101 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cb7ebe4-d1e1-4ef8-af86-c28cf9754841 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:06.359685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cb7ebe4-d1e1-4ef8-af86-c28cf9754841 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:06.360117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cb7ebe4-d1e1-4ef8-af86-c28cf9754841 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:06.360804 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cb7ebe4-d1e1-4ef8-af86-c28cf9754841 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:06.361257 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cb7ebe4-d1e1-4ef8-af86-c28cf9754841 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:06.361682 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cb7ebe4-d1e1-4ef8-af86-c28cf9754841 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:06.389967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1cb7ebe4-d1e1-4ef8-af86-c28cf9754841 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044313 Aug 10 12:55:06.390509 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 922/1859] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:06 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:07.402722 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2b84203f-9939-4f09-9cd3-d9610a601275 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:07.404892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2b84203f-9939-4f09-9cd3-d9610a601275 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:07.411306 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b84203f-9939-4f09-9cd3-d9610a601275 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:07.411787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b84203f-9939-4f09-9cd3-d9610a601275 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:07.412223 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b84203f-9939-4f09-9cd3-d9610a601275 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:07.412911 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b84203f-9939-4f09-9cd3-d9610a601275 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:07.413360 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b84203f-9939-4f09-9cd3-d9610a601275 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:07.413780 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b84203f-9939-4f09-9cd3-d9610a601275 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:07.441593 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2b84203f-9939-4f09-9cd3-d9610a601275 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043508 Aug 10 12:55:07.442140 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 938/1860] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:07 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:08.453924 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f16cf0fe-766d-4c07-87a7-8f66bb21dc91 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:08.456044 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f16cf0fe-766d-4c07-87a7-8f66bb21dc91 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:08.462889 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f16cf0fe-766d-4c07-87a7-8f66bb21dc91 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:08.463390 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f16cf0fe-766d-4c07-87a7-8f66bb21dc91 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:08.463817 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f16cf0fe-766d-4c07-87a7-8f66bb21dc91 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:08.464496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f16cf0fe-766d-4c07-87a7-8f66bb21dc91 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:08.464942 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f16cf0fe-766d-4c07-87a7-8f66bb21dc91 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:08.465358 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f16cf0fe-766d-4c07-87a7-8f66bb21dc91 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:08.493959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f16cf0fe-766d-4c07-87a7-8f66bb21dc91 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043952 Aug 10 12:55:08.494501 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 923/1861] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:08 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:09.506146 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a0f5f9da-6ec1-43fa-a4ec-ce61882d7461 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:09.508386 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a0f5f9da-6ec1-43fa-a4ec-ce61882d7461 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:09.514757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a0f5f9da-6ec1-43fa-a4ec-ce61882d7461 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:09.515265 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a0f5f9da-6ec1-43fa-a4ec-ce61882d7461 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:09.515697 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a0f5f9da-6ec1-43fa-a4ec-ce61882d7461 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:09.516379 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a0f5f9da-6ec1-43fa-a4ec-ce61882d7461 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:09.516827 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a0f5f9da-6ec1-43fa-a4ec-ce61882d7461 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:09.517248 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a0f5f9da-6ec1-43fa-a4ec-ce61882d7461 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:09.546806 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a0f5f9da-6ec1-43fa-a4ec-ce61882d7461 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044615 Aug 10 12:55:09.547388 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 939/1862] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:09 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:10.558631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-aa957dcd-e630-4f38-8d74-ab12566808e2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:10.560770 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-aa957dcd-e630-4f38-8d74-ab12566808e2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:10.567021 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa957dcd-e630-4f38-8d74-ab12566808e2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:10.567520 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa957dcd-e630-4f38-8d74-ab12566808e2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:10.567949 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa957dcd-e630-4f38-8d74-ab12566808e2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:10.568649 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa957dcd-e630-4f38-8d74-ab12566808e2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:10.569090 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa957dcd-e630-4f38-8d74-ab12566808e2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:10.569506 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa957dcd-e630-4f38-8d74-ab12566808e2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:10.597332 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-aa957dcd-e630-4f38-8d74-ab12566808e2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043302 Aug 10 12:55:10.597872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 924/1863] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:10 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:11.609592 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2c42fe73-4bb9-40af-9c60-ff609973db8c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:11.611756 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2c42fe73-4bb9-40af-9c60-ff609973db8c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:11.618137 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c42fe73-4bb9-40af-9c60-ff609973db8c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:11.618703 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c42fe73-4bb9-40af-9c60-ff609973db8c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:11.619142 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c42fe73-4bb9-40af-9c60-ff609973db8c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:11.619871 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c42fe73-4bb9-40af-9c60-ff609973db8c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:11.620327 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c42fe73-4bb9-40af-9c60-ff609973db8c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:11.620756 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c42fe73-4bb9-40af-9c60-ff609973db8c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:11.648929 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2c42fe73-4bb9-40af-9c60-ff609973db8c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043385 Aug 10 12:55:11.650015 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 940/1864] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:11 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:12.661724 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b3687957-96d2-400e-b524-4cd227183fef tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:12.663877 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b3687957-96d2-400e-b524-4cd227183fef tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:12.671053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b3687957-96d2-400e-b524-4cd227183fef tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:12.671563 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b3687957-96d2-400e-b524-4cd227183fef tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:12.671992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b3687957-96d2-400e-b524-4cd227183fef tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:12.672673 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b3687957-96d2-400e-b524-4cd227183fef tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:12.673146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b3687957-96d2-400e-b524-4cd227183fef tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:12.673560 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b3687957-96d2-400e-b524-4cd227183fef tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:12.702888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b3687957-96d2-400e-b524-4cd227183fef tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045086 Aug 10 12:55:12.703470 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 925/1865] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:12 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:13.715684 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-19c5b8df-75f8-47b1-acd1-94d937874214 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:13.717852 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-19c5b8df-75f8-47b1-acd1-94d937874214 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:13.724208 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19c5b8df-75f8-47b1-acd1-94d937874214 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:13.724686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19c5b8df-75f8-47b1-acd1-94d937874214 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:13.725121 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19c5b8df-75f8-47b1-acd1-94d937874214 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:13.725802 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19c5b8df-75f8-47b1-acd1-94d937874214 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:13.726251 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19c5b8df-75f8-47b1-acd1-94d937874214 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:13.726671 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19c5b8df-75f8-47b1-acd1-94d937874214 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:13.755635 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-19c5b8df-75f8-47b1-acd1-94d937874214 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044434 Aug 10 12:55:13.756184 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 941/1866] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:13 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:14.768313 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-52b8e549-7544-4461-8628-751efb28a9d9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:14.770497 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-52b8e549-7544-4461-8628-751efb28a9d9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:14.777286 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-52b8e549-7544-4461-8628-751efb28a9d9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:14.777768 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-52b8e549-7544-4461-8628-751efb28a9d9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:14.778203 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-52b8e549-7544-4461-8628-751efb28a9d9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:14.778892 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-52b8e549-7544-4461-8628-751efb28a9d9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:14.779381 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-52b8e549-7544-4461-8628-751efb28a9d9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:14.779803 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-52b8e549-7544-4461-8628-751efb28a9d9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:14.808852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-52b8e549-7544-4461-8628-751efb28a9d9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044466 Aug 10 12:55:14.809397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 926/1867] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:14 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:15.510076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:55:15.510575 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Wed Aug 10 12:55:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 12:55:15.822044 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9275514d-b09b-4a0d-a41e-8789442030f8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:15.824129 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9275514d-b09b-4a0d-a41e-8789442030f8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:15.830489 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9275514d-b09b-4a0d-a41e-8789442030f8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:15.830963 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9275514d-b09b-4a0d-a41e-8789442030f8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:15.831418 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9275514d-b09b-4a0d-a41e-8789442030f8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:15.832095 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9275514d-b09b-4a0d-a41e-8789442030f8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:15.832538 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9275514d-b09b-4a0d-a41e-8789442030f8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:15.832952 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9275514d-b09b-4a0d-a41e-8789442030f8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:15.862068 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9275514d-b09b-4a0d-a41e-8789442030f8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044436 Aug 10 12:55:15.862609 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 942/1868] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:15 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:16.219038 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:55:16.219257 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Wed Aug 10 12:55:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 12:55:16.875034 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7ce9d1a4-cd1e-4d64-9dfe-5cb45bebbb73 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:16.877170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7ce9d1a4-cd1e-4d64-9dfe-5cb45bebbb73 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:16.879419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=32 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:55:16.884792 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7ce9d1a4-cd1e-4d64-9dfe-5cb45bebbb73 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:16.891604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7ce9d1a4-cd1e-4d64-9dfe-5cb45bebbb73 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:16.891604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7ce9d1a4-cd1e-4d64-9dfe-5cb45bebbb73 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:16.891604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7ce9d1a4-cd1e-4d64-9dfe-5cb45bebbb73 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:16.891604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7ce9d1a4-cd1e-4d64-9dfe-5cb45bebbb73 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:16.892087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7ce9d1a4-cd1e-4d64-9dfe-5cb45bebbb73 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:16.892087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=96 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:55:16.916146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7ce9d1a4-cd1e-4d64-9dfe-5cb45bebbb73 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045050 Aug 10 12:55:16.916685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 927/1869] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:16 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:17.928370 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d534367f-06f2-4212-ad67-54c31d3f81c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:17.930508 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d534367f-06f2-4212-ad67-54c31d3f81c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:17.937512 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d534367f-06f2-4212-ad67-54c31d3f81c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:17.937998 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d534367f-06f2-4212-ad67-54c31d3f81c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:17.938432 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d534367f-06f2-4212-ad67-54c31d3f81c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:17.939123 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d534367f-06f2-4212-ad67-54c31d3f81c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:17.939621 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d534367f-06f2-4212-ad67-54c31d3f81c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:17.940027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d534367f-06f2-4212-ad67-54c31d3f81c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:17.968349 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d534367f-06f2-4212-ad67-54c31d3f81c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043953 Aug 10 12:55:17.968909 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 943/1870] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:17 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:18.981070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9e93cb26-0a6f-4f30-882e-6088852dd306 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:18.983207 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9e93cb26-0a6f-4f30-882e-6088852dd306 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:18.989255 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e93cb26-0a6f-4f30-882e-6088852dd306 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:18.989733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e93cb26-0a6f-4f30-882e-6088852dd306 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:18.990166 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e93cb26-0a6f-4f30-882e-6088852dd306 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:18.990853 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e93cb26-0a6f-4f30-882e-6088852dd306 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:18.991334 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e93cb26-0a6f-4f30-882e-6088852dd306 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:18.991758 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e93cb26-0a6f-4f30-882e-6088852dd306 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:19.020840 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9e93cb26-0a6f-4f30-882e-6088852dd306 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044327 Aug 10 12:55:19.021391 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 928/1871] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:18 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:20.033339 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-abe423a8-af00-42e7-9a7f-12e7f3f9fc7e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:20.035495 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-abe423a8-af00-42e7-9a7f-12e7f3f9fc7e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:20.041940 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-abe423a8-af00-42e7-9a7f-12e7f3f9fc7e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:20.042415 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-abe423a8-af00-42e7-9a7f-12e7f3f9fc7e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:20.042846 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-abe423a8-af00-42e7-9a7f-12e7f3f9fc7e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:20.043610 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-abe423a8-af00-42e7-9a7f-12e7f3f9fc7e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:20.044060 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-abe423a8-af00-42e7-9a7f-12e7f3f9fc7e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:20.044487 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-abe423a8-af00-42e7-9a7f-12e7f3f9fc7e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:20.048864 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=96 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:55:20.073804 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-abe423a8-af00-42e7-9a7f-12e7f3f9fc7e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044517 Aug 10 12:55:20.074364 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 944/1872] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:20 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:21.086061 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7df56e5e-6c4e-4a26-b351-00f514f9e0f4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:21.088851 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7df56e5e-6c4e-4a26-b351-00f514f9e0f4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:21.095203 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7df56e5e-6c4e-4a26-b351-00f514f9e0f4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:21.095699 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7df56e5e-6c4e-4a26-b351-00f514f9e0f4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:21.096144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7df56e5e-6c4e-4a26-b351-00f514f9e0f4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:21.096831 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7df56e5e-6c4e-4a26-b351-00f514f9e0f4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:21.097282 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7df56e5e-6c4e-4a26-b351-00f514f9e0f4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:21.097706 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7df56e5e-6c4e-4a26-b351-00f514f9e0f4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:21.126425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7df56e5e-6c4e-4a26-b351-00f514f9e0f4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044349 Aug 10 12:55:21.127003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 929/1873] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:21 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:22.139522 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6eac7adc-e12b-4576-8ecd-63844621e2a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:22.141655 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6eac7adc-e12b-4576-8ecd-63844621e2a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:22.143935 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=30 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:55:22.148735 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6eac7adc-e12b-4576-8ecd-63844621e2a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:22.149216 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6eac7adc-e12b-4576-8ecd-63844621e2a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:22.149650 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6eac7adc-e12b-4576-8ecd-63844621e2a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:22.150398 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6eac7adc-e12b-4576-8ecd-63844621e2a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:22.150826 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6eac7adc-e12b-4576-8ecd-63844621e2a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:22.151279 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6eac7adc-e12b-4576-8ecd-63844621e2a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:22.179563 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6eac7adc-e12b-4576-8ecd-63844621e2a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045108 Aug 10 12:55:22.180111 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 945/1874] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:22 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:23.192367 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ce48fa3a-be16-4750-9d00-73068735f20a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:23.194545 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ce48fa3a-be16-4750-9d00-73068735f20a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:23.201149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce48fa3a-be16-4750-9d00-73068735f20a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:23.201628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce48fa3a-be16-4750-9d00-73068735f20a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:23.202066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce48fa3a-be16-4750-9d00-73068735f20a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:23.202753 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce48fa3a-be16-4750-9d00-73068735f20a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:23.203227 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce48fa3a-be16-4750-9d00-73068735f20a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:23.203649 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce48fa3a-be16-4750-9d00-73068735f20a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:23.232626 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ce48fa3a-be16-4750-9d00-73068735f20a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044181 Aug 10 12:55:23.233168 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 930/1875] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:23 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:24.246173 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-aac967a1-16db-448c-8f37-99b3331fdbd0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:24.248370 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-aac967a1-16db-448c-8f37-99b3331fdbd0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:24.254755 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aac967a1-16db-448c-8f37-99b3331fdbd0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:24.255261 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aac967a1-16db-448c-8f37-99b3331fdbd0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:24.255698 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aac967a1-16db-448c-8f37-99b3331fdbd0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:24.256393 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aac967a1-16db-448c-8f37-99b3331fdbd0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:24.256843 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aac967a1-16db-448c-8f37-99b3331fdbd0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:24.257265 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aac967a1-16db-448c-8f37-99b3331fdbd0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:24.286618 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-aac967a1-16db-448c-8f37-99b3331fdbd0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045791 Aug 10 12:55:24.287187 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 946/1876] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:24 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:25.298458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4916846c-ea55-4cd2-88fc-765764f39920 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:25.300838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4916846c-ea55-4cd2-88fc-765764f39920 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:25.307704 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4916846c-ea55-4cd2-88fc-765764f39920 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:25.308181 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4916846c-ea55-4cd2-88fc-765764f39920 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:25.308615 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4916846c-ea55-4cd2-88fc-765764f39920 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:25.309299 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4916846c-ea55-4cd2-88fc-765764f39920 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:25.309751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4916846c-ea55-4cd2-88fc-765764f39920 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:25.310174 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4916846c-ea55-4cd2-88fc-765764f39920 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:25.338469 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4916846c-ea55-4cd2-88fc-765764f39920 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044033 Aug 10 12:55:25.339018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 931/1877] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:25 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:26.350554 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8703d640-d059-4461-ac3d-da3c543cc00b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:26.352700 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8703d640-d059-4461-ac3d-da3c543cc00b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:26.359933 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8703d640-d059-4461-ac3d-da3c543cc00b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:26.360399 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8703d640-d059-4461-ac3d-da3c543cc00b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:26.360836 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8703d640-d059-4461-ac3d-da3c543cc00b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:26.361519 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8703d640-d059-4461-ac3d-da3c543cc00b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:26.361968 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8703d640-d059-4461-ac3d-da3c543cc00b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:26.362418 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8703d640-d059-4461-ac3d-da3c543cc00b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:26.392699 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8703d640-d059-4461-ac3d-da3c543cc00b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046063 Aug 10 12:55:26.393247 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 947/1878] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:26 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:27.404543 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a0a65bb5-7632-4a0f-8df4-15f13e66742d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:27.406747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a0a65bb5-7632-4a0f-8df4-15f13e66742d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:27.413077 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a0a65bb5-7632-4a0f-8df4-15f13e66742d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:27.413554 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a0a65bb5-7632-4a0f-8df4-15f13e66742d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:27.413989 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a0a65bb5-7632-4a0f-8df4-15f13e66742d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:27.414672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a0a65bb5-7632-4a0f-8df4-15f13e66742d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:27.415124 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a0a65bb5-7632-4a0f-8df4-15f13e66742d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:27.415570 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a0a65bb5-7632-4a0f-8df4-15f13e66742d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:27.444038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a0a65bb5-7632-4a0f-8df4-15f13e66742d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043997 Aug 10 12:55:27.444579 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 932/1879] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:27 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:28.456488 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d500c1f4-3513-4ca3-9f8c-e82a90b053f7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:28.458532 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d500c1f4-3513-4ca3-9f8c-e82a90b053f7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:28.464533 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d500c1f4-3513-4ca3-9f8c-e82a90b053f7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:28.465057 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d500c1f4-3513-4ca3-9f8c-e82a90b053f7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:28.465490 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d500c1f4-3513-4ca3-9f8c-e82a90b053f7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:28.466176 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d500c1f4-3513-4ca3-9f8c-e82a90b053f7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:28.466624 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d500c1f4-3513-4ca3-9f8c-e82a90b053f7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:28.467047 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d500c1f4-3513-4ca3-9f8c-e82a90b053f7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:28.496377 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d500c1f4-3513-4ca3-9f8c-e82a90b053f7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043998 Aug 10 12:55:28.496945 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 948/1880] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:28 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:29.508520 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3c9662c1-971f-463f-aaa8-64ebb173a726 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:29.511342 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3c9662c1-971f-463f-aaa8-64ebb173a726 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:29.517692 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c9662c1-971f-463f-aaa8-64ebb173a726 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:29.518170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c9662c1-971f-463f-aaa8-64ebb173a726 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:29.518605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c9662c1-971f-463f-aaa8-64ebb173a726 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:29.519325 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c9662c1-971f-463f-aaa8-64ebb173a726 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:29.519779 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c9662c1-971f-463f-aaa8-64ebb173a726 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:29.520207 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c9662c1-971f-463f-aaa8-64ebb173a726 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:29.548535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3c9662c1-971f-463f-aaa8-64ebb173a726 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043904 Aug 10 12:55:29.549015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 933/1881] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:29 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:30.560639 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fb90ec4a-3216-4196-8ee4-48017187f461 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:30.562797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fb90ec4a-3216-4196-8ee4-48017187f461 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:30.569121 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fb90ec4a-3216-4196-8ee4-48017187f461 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:30.570652 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fb90ec4a-3216-4196-8ee4-48017187f461 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:30.570652 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fb90ec4a-3216-4196-8ee4-48017187f461 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:30.570652 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fb90ec4a-3216-4196-8ee4-48017187f461 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:30.571105 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fb90ec4a-3216-4196-8ee4-48017187f461 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:30.571547 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fb90ec4a-3216-4196-8ee4-48017187f461 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:30.600897 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fb90ec4a-3216-4196-8ee4-48017187f461 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044189 Aug 10 12:55:30.601442 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 949/1882] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:30 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:31.613506 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-eea11db5-be9a-4384-9d6f-e29a3c016910 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:31.615698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-eea11db5-be9a-4384-9d6f-e29a3c016910 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:31.622835 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eea11db5-be9a-4384-9d6f-e29a3c016910 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:31.623355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eea11db5-be9a-4384-9d6f-e29a3c016910 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:31.623796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eea11db5-be9a-4384-9d6f-e29a3c016910 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:31.624496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eea11db5-be9a-4384-9d6f-e29a3c016910 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:31.624952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eea11db5-be9a-4384-9d6f-e29a3c016910 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:31.625379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eea11db5-be9a-4384-9d6f-e29a3c016910 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:31.653702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-eea11db5-be9a-4384-9d6f-e29a3c016910 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044158 Aug 10 12:55:31.654262 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 934/1883] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:31 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:32.665919 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9e3b52ee-d99c-4993-a9ca-f31a62b93d6b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:32.668173 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9e3b52ee-d99c-4993-a9ca-f31a62b93d6b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:32.674434 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e3b52ee-d99c-4993-a9ca-f31a62b93d6b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:32.674911 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e3b52ee-d99c-4993-a9ca-f31a62b93d6b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:32.675388 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e3b52ee-d99c-4993-a9ca-f31a62b93d6b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:32.676066 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e3b52ee-d99c-4993-a9ca-f31a62b93d6b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:32.676506 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e3b52ee-d99c-4993-a9ca-f31a62b93d6b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:32.676922 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e3b52ee-d99c-4993-a9ca-f31a62b93d6b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:32.706656 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9e3b52ee-d99c-4993-a9ca-f31a62b93d6b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044703 Aug 10 12:55:32.707223 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 950/1884] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:32 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:33.718980 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d0eb4a3b-0a75-4ce0-ad9a-9eb07906ece1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:33.721131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d0eb4a3b-0a75-4ce0-ad9a-9eb07906ece1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:33.727601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0eb4a3b-0a75-4ce0-ad9a-9eb07906ece1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:33.728119 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0eb4a3b-0a75-4ce0-ad9a-9eb07906ece1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:33.728842 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0eb4a3b-0a75-4ce0-ad9a-9eb07906ece1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:33.729639 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0eb4a3b-0a75-4ce0-ad9a-9eb07906ece1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:33.730091 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0eb4a3b-0a75-4ce0-ad9a-9eb07906ece1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:33.730532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0eb4a3b-0a75-4ce0-ad9a-9eb07906ece1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:33.758869 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d0eb4a3b-0a75-4ce0-ad9a-9eb07906ece1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043937 Aug 10 12:55:33.760045 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 935/1885] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:33 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:34.772024 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-860d379e-292a-4b8d-84d1-aa7e90dd0415 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:34.774136 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-860d379e-292a-4b8d-84d1-aa7e90dd0415 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:34.780981 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-860d379e-292a-4b8d-84d1-aa7e90dd0415 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:34.781457 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-860d379e-292a-4b8d-84d1-aa7e90dd0415 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:34.781882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-860d379e-292a-4b8d-84d1-aa7e90dd0415 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:34.782563 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-860d379e-292a-4b8d-84d1-aa7e90dd0415 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:34.783034 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-860d379e-292a-4b8d-84d1-aa7e90dd0415 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:34.783481 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-860d379e-292a-4b8d-84d1-aa7e90dd0415 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:34.812160 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-860d379e-292a-4b8d-84d1-aa7e90dd0415 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044096 Aug 10 12:55:34.812701 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 951/1886] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:34 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:35.824380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9fd0771a-92bf-4d9a-a27b-ac220db0e0e6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:35.826491 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9fd0771a-92bf-4d9a-a27b-ac220db0e0e6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:35.836382 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9fd0771a-92bf-4d9a-a27b-ac220db0e0e6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:35.837263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9fd0771a-92bf-4d9a-a27b-ac220db0e0e6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:35.837970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9fd0771a-92bf-4d9a-a27b-ac220db0e0e6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:35.838936 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9fd0771a-92bf-4d9a-a27b-ac220db0e0e6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:35.839422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9fd0771a-92bf-4d9a-a27b-ac220db0e0e6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:35.839847 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9fd0771a-92bf-4d9a-a27b-ac220db0e0e6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:35.868276 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9fd0771a-92bf-4d9a-a27b-ac220db0e0e6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047995 Aug 10 12:55:35.869488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 936/1887] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:35 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:36.881283 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-705c0039-2597-46ae-a987-c2f8d5eec33a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:36.883372 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-705c0039-2597-46ae-a987-c2f8d5eec33a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:36.891080 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-705c0039-2597-46ae-a987-c2f8d5eec33a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:36.891591 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-705c0039-2597-46ae-a987-c2f8d5eec33a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:36.892023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-705c0039-2597-46ae-a987-c2f8d5eec33a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:36.892714 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-705c0039-2597-46ae-a987-c2f8d5eec33a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:36.893172 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-705c0039-2597-46ae-a987-c2f8d5eec33a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:36.893594 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-705c0039-2597-46ae-a987-c2f8d5eec33a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:36.922440 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-705c0039-2597-46ae-a987-c2f8d5eec33a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045183 Aug 10 12:55:36.922991 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 952/1888] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:36 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:37.935332 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7575e0fc-d8eb-4c34-b761-b9cd040c334f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:37.937446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7575e0fc-d8eb-4c34-b761-b9cd040c334f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:37.943867 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7575e0fc-d8eb-4c34-b761-b9cd040c334f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:37.944348 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7575e0fc-d8eb-4c34-b761-b9cd040c334f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:37.944796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7575e0fc-d8eb-4c34-b761-b9cd040c334f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:37.945468 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7575e0fc-d8eb-4c34-b761-b9cd040c334f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:37.945923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7575e0fc-d8eb-4c34-b761-b9cd040c334f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:37.946343 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7575e0fc-d8eb-4c34-b761-b9cd040c334f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:37.976576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7575e0fc-d8eb-4c34-b761-b9cd040c334f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045869 Aug 10 12:55:37.977121 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 937/1889] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:37 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:38.988997 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d31bf611-c602-4d22-925b-8e3f13f6663f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:38.991118 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d31bf611-c602-4d22-925b-8e3f13f6663f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:38.998038 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d31bf611-c602-4d22-925b-8e3f13f6663f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:38.998514 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d31bf611-c602-4d22-925b-8e3f13f6663f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:38.998959 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d31bf611-c602-4d22-925b-8e3f13f6663f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:38.999663 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d31bf611-c602-4d22-925b-8e3f13f6663f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:39.000116 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d31bf611-c602-4d22-925b-8e3f13f6663f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:39.000538 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d31bf611-c602-4d22-925b-8e3f13f6663f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:39.028739 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d31bf611-c602-4d22-925b-8e3f13f6663f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043643 Aug 10 12:55:39.029301 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 953/1890] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:38 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:40.040040 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1b3b60b4-b64c-433b-8707-7e6b00647897 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:40.042488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1b3b60b4-b64c-433b-8707-7e6b00647897 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:40.048956 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1b3b60b4-b64c-433b-8707-7e6b00647897 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:40.049433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1b3b60b4-b64c-433b-8707-7e6b00647897 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:40.049868 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1b3b60b4-b64c-433b-8707-7e6b00647897 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:40.050557 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1b3b60b4-b64c-433b-8707-7e6b00647897 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:40.051009 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1b3b60b4-b64c-433b-8707-7e6b00647897 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:40.051466 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1b3b60b4-b64c-433b-8707-7e6b00647897 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:40.081337 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1b3b60b4-b64c-433b-8707-7e6b00647897 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045236 Aug 10 12:55:40.081890 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 938/1891] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:40 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:41.094427 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ecb8a5f7-4b51-42b9-9cd2-1d9bd128c6b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:41.096528 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ecb8a5f7-4b51-42b9-9cd2-1d9bd128c6b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:41.102842 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ecb8a5f7-4b51-42b9-9cd2-1d9bd128c6b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:41.103652 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ecb8a5f7-4b51-42b9-9cd2-1d9bd128c6b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:41.104069 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ecb8a5f7-4b51-42b9-9cd2-1d9bd128c6b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:41.104754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ecb8a5f7-4b51-42b9-9cd2-1d9bd128c6b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:41.105205 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ecb8a5f7-4b51-42b9-9cd2-1d9bd128c6b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:41.105625 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ecb8a5f7-4b51-42b9-9cd2-1d9bd128c6b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:41.133682 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ecb8a5f7-4b51-42b9-9cd2-1d9bd128c6b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043453 Aug 10 12:55:41.134800 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 954/1892] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:41 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:42.146606 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c976a041-f384-47b1-a44f-2c1af7fe994a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:42.148777 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c976a041-f384-47b1-a44f-2c1af7fe994a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:42.155845 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c976a041-f384-47b1-a44f-2c1af7fe994a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:42.156326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c976a041-f384-47b1-a44f-2c1af7fe994a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:42.156761 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c976a041-f384-47b1-a44f-2c1af7fe994a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:42.157447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c976a041-f384-47b1-a44f-2c1af7fe994a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:42.157892 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c976a041-f384-47b1-a44f-2c1af7fe994a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:42.158314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c976a041-f384-47b1-a44f-2c1af7fe994a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:42.186851 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c976a041-f384-47b1-a44f-2c1af7fe994a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044208 Aug 10 12:55:42.187356 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 939/1893] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:42 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:43.201692 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9d68f71d-435c-43d5-94e0-256068307acd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:43.205430 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9d68f71d-435c-43d5-94e0-256068307acd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:43.216141 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d68f71d-435c-43d5-94e0-256068307acd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:43.216615 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d68f71d-435c-43d5-94e0-256068307acd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:43.217046 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d68f71d-435c-43d5-94e0-256068307acd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:43.217729 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d68f71d-435c-43d5-94e0-256068307acd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:43.218172 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d68f71d-435c-43d5-94e0-256068307acd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:43.218590 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d68f71d-435c-43d5-94e0-256068307acd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:43.250321 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9d68f71d-435c-43d5-94e0-256068307acd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055221 Aug 10 12:55:43.250865 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 955/1894] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:43 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:44.262432 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-491a2c9c-e795-45a2-a81a-3dc810949a67 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:44.264602 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-491a2c9c-e795-45a2-a81a-3dc810949a67 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:44.271153 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-491a2c9c-e795-45a2-a81a-3dc810949a67 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:44.271674 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-491a2c9c-e795-45a2-a81a-3dc810949a67 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:44.272113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-491a2c9c-e795-45a2-a81a-3dc810949a67 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:44.272802 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-491a2c9c-e795-45a2-a81a-3dc810949a67 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:44.273255 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-491a2c9c-e795-45a2-a81a-3dc810949a67 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:44.273678 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-491a2c9c-e795-45a2-a81a-3dc810949a67 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:44.303188 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-491a2c9c-e795-45a2-a81a-3dc810949a67 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045297 Aug 10 12:55:44.303757 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 940/1895] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:44 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:55:45.315501 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-51934355-1629-4fe8-ba57-d637aac7e24c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:45.317735 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-51934355-1629-4fe8-ba57-d637aac7e24c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:45.324106 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51934355-1629-4fe8-ba57-d637aac7e24c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:45.324591 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51934355-1629-4fe8-ba57-d637aac7e24c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:45.325022 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51934355-1629-4fe8-ba57-d637aac7e24c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:45.325713 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51934355-1629-4fe8-ba57-d637aac7e24c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:45.326162 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51934355-1629-4fe8-ba57-d637aac7e24c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:45.326586 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51934355-1629-4fe8-ba57-d637aac7e24c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:45.356185 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-51934355-1629-4fe8-ba57-d637aac7e24c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044739 Aug 10 12:55:45.356735 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 956/1896] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:45 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:46.368475 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-11b773d9-ee2c-4278-96a0-525ba87fb6a4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:46.371514 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-11b773d9-ee2c-4278-96a0-525ba87fb6a4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:46.377816 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11b773d9-ee2c-4278-96a0-525ba87fb6a4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:46.378295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11b773d9-ee2c-4278-96a0-525ba87fb6a4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:46.378729 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11b773d9-ee2c-4278-96a0-525ba87fb6a4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:46.379433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11b773d9-ee2c-4278-96a0-525ba87fb6a4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:46.379887 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11b773d9-ee2c-4278-96a0-525ba87fb6a4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:46.380310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11b773d9-ee2c-4278-96a0-525ba87fb6a4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:46.409648 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-11b773d9-ee2c-4278-96a0-525ba87fb6a4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045164 Aug 10 12:55:46.410204 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 941/1897] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:46 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:47.422229 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-12ad998b-d3cf-468d-a576-0ea5d2c157d8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:47.424380 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-12ad998b-d3cf-468d-a576-0ea5d2c157d8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:47.430711 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-12ad998b-d3cf-468d-a576-0ea5d2c157d8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:47.432202 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-12ad998b-d3cf-468d-a576-0ea5d2c157d8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:47.432647 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-12ad998b-d3cf-468d-a576-0ea5d2c157d8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:47.433329 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-12ad998b-d3cf-468d-a576-0ea5d2c157d8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:47.433774 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-12ad998b-d3cf-468d-a576-0ea5d2c157d8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:47.434190 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-12ad998b-d3cf-468d-a576-0ea5d2c157d8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:47.463323 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-12ad998b-d3cf-468d-a576-0ea5d2c157d8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044952 Aug 10 12:55:47.463879 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 957/1898] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:47 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:48.475537 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-755205a0-18fe-4eb7-863d-9b91a4688d98 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:48.477720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-755205a0-18fe-4eb7-863d-9b91a4688d98 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:48.480499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=30 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:55:48.485176 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-755205a0-18fe-4eb7-863d-9b91a4688d98 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:48.485649 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-755205a0-18fe-4eb7-863d-9b91a4688d98 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:48.486082 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-755205a0-18fe-4eb7-863d-9b91a4688d98 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:48.486771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-755205a0-18fe-4eb7-863d-9b91a4688d98 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:48.487243 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-755205a0-18fe-4eb7-863d-9b91a4688d98 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:48.487668 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-755205a0-18fe-4eb7-863d-9b91a4688d98 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:48.516212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-755205a0-18fe-4eb7-863d-9b91a4688d98 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044628 Aug 10 12:55:48.516782 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 942/1899] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:48 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:49.528875 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-859a3703-eb24-46ea-be6b-19bcf0f24f5f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:49.531711 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-859a3703-eb24-46ea-be6b-19bcf0f24f5f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:49.538049 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-859a3703-eb24-46ea-be6b-19bcf0f24f5f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:49.538522 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-859a3703-eb24-46ea-be6b-19bcf0f24f5f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:49.538949 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-859a3703-eb24-46ea-be6b-19bcf0f24f5f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:49.539676 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-859a3703-eb24-46ea-be6b-19bcf0f24f5f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:49.540121 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-859a3703-eb24-46ea-be6b-19bcf0f24f5f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:49.540726 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-859a3703-eb24-46ea-be6b-19bcf0f24f5f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:49.569127 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-859a3703-eb24-46ea-be6b-19bcf0f24f5f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044505 Aug 10 12:55:49.569670 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 958/1900] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:49 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:50.581512 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-52ccc408-4d6f-4f0a-b434-be57887ca307 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:50.583685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-52ccc408-4d6f-4f0a-b434-be57887ca307 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:50.590827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-52ccc408-4d6f-4f0a-b434-be57887ca307 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:50.591335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-52ccc408-4d6f-4f0a-b434-be57887ca307 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:50.591769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-52ccc408-4d6f-4f0a-b434-be57887ca307 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:50.592449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-52ccc408-4d6f-4f0a-b434-be57887ca307 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:50.592893 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-52ccc408-4d6f-4f0a-b434-be57887ca307 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:50.593308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-52ccc408-4d6f-4f0a-b434-be57887ca307 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:50.595628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=96 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:55:50.622723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-52ccc408-4d6f-4f0a-b434-be57887ca307 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045563 Aug 10 12:55:50.628812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 943/1901] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:50 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:51.636019 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5bc34733-2d68-4475-8a5f-a2a0229a40fe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:51.638057 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5bc34733-2d68-4475-8a5f-a2a0229a40fe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:51.644421 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5bc34733-2d68-4475-8a5f-a2a0229a40fe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:51.644895 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5bc34733-2d68-4475-8a5f-a2a0229a40fe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:51.645326 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5bc34733-2d68-4475-8a5f-a2a0229a40fe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:51.646004 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5bc34733-2d68-4475-8a5f-a2a0229a40fe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:51.646452 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5bc34733-2d68-4475-8a5f-a2a0229a40fe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:51.646893 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5bc34733-2d68-4475-8a5f-a2a0229a40fe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:51.675806 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5bc34733-2d68-4475-8a5f-a2a0229a40fe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044416 Aug 10 12:55:51.676371 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 959/1902] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:51 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:52.687765 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4e933aa2-663c-497b-a256-8b1b38af57f3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:52.689875 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4e933aa2-663c-497b-a256-8b1b38af57f3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:52.696171 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e933aa2-663c-497b-a256-8b1b38af57f3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:52.697174 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e933aa2-663c-497b-a256-8b1b38af57f3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:52.697794 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e933aa2-663c-497b-a256-8b1b38af57f3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:52.698477 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e933aa2-663c-497b-a256-8b1b38af57f3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:52.698925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e933aa2-663c-497b-a256-8b1b38af57f3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:52.699382 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e933aa2-663c-497b-a256-8b1b38af57f3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:52.727485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4e933aa2-663c-497b-a256-8b1b38af57f3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044000 Aug 10 12:55:52.728031 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 944/1903] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:52 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:53.740294 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-91deba9a-235e-4704-81ed-9a2b525b3997 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:53.742355 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-91deba9a-235e-4704-81ed-9a2b525b3997 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:53.749698 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-91deba9a-235e-4704-81ed-9a2b525b3997 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:53.750179 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-91deba9a-235e-4704-81ed-9a2b525b3997 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:53.750614 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-91deba9a-235e-4704-81ed-9a2b525b3997 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:53.751379 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-91deba9a-235e-4704-81ed-9a2b525b3997 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:53.751830 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-91deba9a-235e-4704-81ed-9a2b525b3997 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:53.752252 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-91deba9a-235e-4704-81ed-9a2b525b3997 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:53.755796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=96 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:55:53.782346 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-91deba9a-235e-4704-81ed-9a2b525b3997 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046067 Aug 10 12:55:53.782900 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 960/1904] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:53 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:54.794065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-853fde61-97cc-4b7f-89d3-ba9b83226570 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:54.796157 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-853fde61-97cc-4b7f-89d3-ba9b83226570 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:54.802546 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-853fde61-97cc-4b7f-89d3-ba9b83226570 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:54.803032 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-853fde61-97cc-4b7f-89d3-ba9b83226570 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:54.803512 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-853fde61-97cc-4b7f-89d3-ba9b83226570 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:54.804209 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-853fde61-97cc-4b7f-89d3-ba9b83226570 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:54.804661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-853fde61-97cc-4b7f-89d3-ba9b83226570 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:54.805086 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-853fde61-97cc-4b7f-89d3-ba9b83226570 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:54.834534 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-853fde61-97cc-4b7f-89d3-ba9b83226570 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044543 Aug 10 12:55:54.835074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 945/1905] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:54 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:55.847262 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-219d193c-4e69-43c3-9cd7-0bdffd5a0a84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:55.849338 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-219d193c-4e69-43c3-9cd7-0bdffd5a0a84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:55.851643 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=32 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:55:55.857803 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-219d193c-4e69-43c3-9cd7-0bdffd5a0a84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:55.858290 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-219d193c-4e69-43c3-9cd7-0bdffd5a0a84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:55.858729 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-219d193c-4e69-43c3-9cd7-0bdffd5a0a84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:55.859460 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-219d193c-4e69-43c3-9cd7-0bdffd5a0a84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:55.859916 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-219d193c-4e69-43c3-9cd7-0bdffd5a0a84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:55.860342 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-219d193c-4e69-43c3-9cd7-0bdffd5a0a84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:55.890064 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-219d193c-4e69-43c3-9cd7-0bdffd5a0a84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047057 Aug 10 12:55:55.890616 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 961/1906] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:55 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:56.902441 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-33f86d82-4b75-413f-b723-33ea1c30231b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:56.904550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-33f86d82-4b75-413f-b723-33ea1c30231b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:56.910973 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-33f86d82-4b75-413f-b723-33ea1c30231b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:56.911495 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-33f86d82-4b75-413f-b723-33ea1c30231b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:56.911932 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-33f86d82-4b75-413f-b723-33ea1c30231b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:56.912616 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-33f86d82-4b75-413f-b723-33ea1c30231b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:56.913069 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-33f86d82-4b75-413f-b723-33ea1c30231b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:56.913494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-33f86d82-4b75-413f-b723-33ea1c30231b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:56.942496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-33f86d82-4b75-413f-b723-33ea1c30231b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044107 Aug 10 12:55:56.943045 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 946/1907] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:56 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:57.954910 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ccf82049-db27-4d10-a0e6-1e5e8169d27c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:57.957058 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ccf82049-db27-4d10-a0e6-1e5e8169d27c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:57.964058 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ccf82049-db27-4d10-a0e6-1e5e8169d27c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:57.964533 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ccf82049-db27-4d10-a0e6-1e5e8169d27c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:57.964963 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ccf82049-db27-4d10-a0e6-1e5e8169d27c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:57.965639 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ccf82049-db27-4d10-a0e6-1e5e8169d27c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:57.966082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ccf82049-db27-4d10-a0e6-1e5e8169d27c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:57.966499 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ccf82049-db27-4d10-a0e6-1e5e8169d27c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:58.004570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ccf82049-db27-4d10-a0e6-1e5e8169d27c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053755 Aug 10 12:55:58.005123 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 962/1908] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:57 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:55:59.016778 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e263172d-631c-4036-9e00-2017583e38af tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:55:59.018926 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e263172d-631c-4036-9e00-2017583e38af tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:55:59.025948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e263172d-631c-4036-9e00-2017583e38af tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:59.026416 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e263172d-631c-4036-9e00-2017583e38af tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:59.026853 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e263172d-631c-4036-9e00-2017583e38af tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:59.027578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e263172d-631c-4036-9e00-2017583e38af tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:55:59.028039 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e263172d-631c-4036-9e00-2017583e38af tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:55:59.028463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e263172d-631c-4036-9e00-2017583e38af tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:55:59.056549 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e263172d-631c-4036-9e00-2017583e38af tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043721 Aug 10 12:55:59.057085 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 947/1909] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:55:59 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:00.069351 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-51024a52-2a0e-42c2-b3d7-b741bc7b6d5d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:00.071518 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-51024a52-2a0e-42c2-b3d7-b741bc7b6d5d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:00.078545 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51024a52-2a0e-42c2-b3d7-b741bc7b6d5d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:00.079021 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51024a52-2a0e-42c2-b3d7-b741bc7b6d5d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:00.079500 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51024a52-2a0e-42c2-b3d7-b741bc7b6d5d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:00.080186 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51024a52-2a0e-42c2-b3d7-b741bc7b6d5d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:00.080633 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51024a52-2a0e-42c2-b3d7-b741bc7b6d5d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:00.081060 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51024a52-2a0e-42c2-b3d7-b741bc7b6d5d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:00.109414 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-51024a52-2a0e-42c2-b3d7-b741bc7b6d5d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044072 Aug 10 12:56:00.109964 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 963/1910] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:00 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:01.121898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b602503f-17cf-44a0-bf36-55d2ccf5c083 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:01.124001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b602503f-17cf-44a0-bf36-55d2ccf5c083 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:01.130546 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b602503f-17cf-44a0-bf36-55d2ccf5c083 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:01.131033 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b602503f-17cf-44a0-bf36-55d2ccf5c083 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:01.131504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b602503f-17cf-44a0-bf36-55d2ccf5c083 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:01.132240 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b602503f-17cf-44a0-bf36-55d2ccf5c083 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:01.132685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b602503f-17cf-44a0-bf36-55d2ccf5c083 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:01.133108 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b602503f-17cf-44a0-bf36-55d2ccf5c083 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:01.163118 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b602503f-17cf-44a0-bf36-55d2ccf5c083 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045315 Aug 10 12:56:01.163697 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 948/1911] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:01 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:02.175647 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2b02172d-a5b1-4b7d-9285-212f792dc72e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:02.177739 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2b02172d-a5b1-4b7d-9285-212f792dc72e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:02.184574 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b02172d-a5b1-4b7d-9285-212f792dc72e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:02.185047 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b02172d-a5b1-4b7d-9285-212f792dc72e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:02.185477 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b02172d-a5b1-4b7d-9285-212f792dc72e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:02.186151 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b02172d-a5b1-4b7d-9285-212f792dc72e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:02.186594 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b02172d-a5b1-4b7d-9285-212f792dc72e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:02.187010 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2b02172d-a5b1-4b7d-9285-212f792dc72e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:02.215899 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2b02172d-a5b1-4b7d-9285-212f792dc72e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044373 Aug 10 12:56:02.216461 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 964/1912] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:02 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:03.229165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-09cd90f7-0e9f-4a98-895f-9ea19ccf85c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:03.231239 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-09cd90f7-0e9f-4a98-895f-9ea19ccf85c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:03.237489 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-09cd90f7-0e9f-4a98-895f-9ea19ccf85c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:03.237957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-09cd90f7-0e9f-4a98-895f-9ea19ccf85c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:03.238391 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-09cd90f7-0e9f-4a98-895f-9ea19ccf85c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:03.239067 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-09cd90f7-0e9f-4a98-895f-9ea19ccf85c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:03.239537 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-09cd90f7-0e9f-4a98-895f-9ea19ccf85c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:03.239956 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-09cd90f7-0e9f-4a98-895f-9ea19ccf85c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:03.270841 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-09cd90f7-0e9f-4a98-895f-9ea19ccf85c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046377 Aug 10 12:56:03.271431 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 949/1913] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:03 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:04.284419 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-799a56de-f8bd-47fc-a9d6-61156da2db81 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:04.286536 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-799a56de-f8bd-47fc-a9d6-61156da2db81 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:04.293393 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-799a56de-f8bd-47fc-a9d6-61156da2db81 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:04.293865 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-799a56de-f8bd-47fc-a9d6-61156da2db81 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:04.294300 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-799a56de-f8bd-47fc-a9d6-61156da2db81 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:04.294978 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-799a56de-f8bd-47fc-a9d6-61156da2db81 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:04.295454 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-799a56de-f8bd-47fc-a9d6-61156da2db81 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:04.295872 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-799a56de-f8bd-47fc-a9d6-61156da2db81 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:04.323858 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-799a56de-f8bd-47fc-a9d6-61156da2db81 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043514 Aug 10 12:56:04.324408 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 965/1914] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:04 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:05.336170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-87c54bbe-8975-4232-801a-ccccc9584c08 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:05.338303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-87c54bbe-8975-4232-801a-ccccc9584c08 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:05.344702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-87c54bbe-8975-4232-801a-ccccc9584c08 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:05.345180 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-87c54bbe-8975-4232-801a-ccccc9584c08 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:05.345615 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-87c54bbe-8975-4232-801a-ccccc9584c08 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:05.346300 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-87c54bbe-8975-4232-801a-ccccc9584c08 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:05.346751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-87c54bbe-8975-4232-801a-ccccc9584c08 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:05.347194 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-87c54bbe-8975-4232-801a-ccccc9584c08 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:05.376119 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-87c54bbe-8975-4232-801a-ccccc9584c08 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043953 Aug 10 12:56:05.376662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 950/1915] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:05 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:06.388922 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bfb87e18-1509-412e-af9d-0c303781430f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:06.391162 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bfb87e18-1509-412e-af9d-0c303781430f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:06.397889 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bfb87e18-1509-412e-af9d-0c303781430f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:06.398361 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bfb87e18-1509-412e-af9d-0c303781430f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:06.398791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bfb87e18-1509-412e-af9d-0c303781430f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:06.399498 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bfb87e18-1509-412e-af9d-0c303781430f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:06.400586 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bfb87e18-1509-412e-af9d-0c303781430f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:06.401183 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bfb87e18-1509-412e-af9d-0c303781430f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:06.429295 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bfb87e18-1509-412e-af9d-0c303781430f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044839 Aug 10 12:56:06.429786 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 966/1916] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:06 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:07.440959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6467bdf8-83cb-40db-8967-ab09f32e03b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:07.443121 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6467bdf8-83cb-40db-8967-ab09f32e03b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:07.450384 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6467bdf8-83cb-40db-8967-ab09f32e03b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:07.450879 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6467bdf8-83cb-40db-8967-ab09f32e03b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:07.451375 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6467bdf8-83cb-40db-8967-ab09f32e03b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:07.452086 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6467bdf8-83cb-40db-8967-ab09f32e03b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:07.452539 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6467bdf8-83cb-40db-8967-ab09f32e03b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:07.452967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6467bdf8-83cb-40db-8967-ab09f32e03b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:07.490982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6467bdf8-83cb-40db-8967-ab09f32e03b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053623 Aug 10 12:56:07.491766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 951/1917] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:07 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:08.504573 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5c8ebf04-1458-4554-89cc-ebaf3bdaa469 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:08.506668 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5c8ebf04-1458-4554-89cc-ebaf3bdaa469 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:08.513625 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c8ebf04-1458-4554-89cc-ebaf3bdaa469 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:08.514104 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c8ebf04-1458-4554-89cc-ebaf3bdaa469 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:08.514536 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c8ebf04-1458-4554-89cc-ebaf3bdaa469 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:08.515242 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c8ebf04-1458-4554-89cc-ebaf3bdaa469 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:08.515692 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c8ebf04-1458-4554-89cc-ebaf3bdaa469 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:08.516114 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c8ebf04-1458-4554-89cc-ebaf3bdaa469 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:08.544545 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5c8ebf04-1458-4554-89cc-ebaf3bdaa469 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044032 Aug 10 12:56:08.545091 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 967/1918] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:08 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:09.557526 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a67862c4-45f7-4707-b33e-50720abf42e8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:09.559689 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a67862c4-45f7-4707-b33e-50720abf42e8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:09.565955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a67862c4-45f7-4707-b33e-50720abf42e8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:09.566426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a67862c4-45f7-4707-b33e-50720abf42e8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:09.566859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a67862c4-45f7-4707-b33e-50720abf42e8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:09.567568 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a67862c4-45f7-4707-b33e-50720abf42e8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:09.568014 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a67862c4-45f7-4707-b33e-50720abf42e8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:09.568431 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a67862c4-45f7-4707-b33e-50720abf42e8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:09.596856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a67862c4-45f7-4707-b33e-50720abf42e8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044057 Aug 10 12:56:09.597406 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 952/1919] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:09 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:10.608576 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7eb8b242-fd1c-4309-b822-10a85c17bd2a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:10.610696 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7eb8b242-fd1c-4309-b822-10a85c17bd2a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:10.617227 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7eb8b242-fd1c-4309-b822-10a85c17bd2a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:10.617701 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7eb8b242-fd1c-4309-b822-10a85c17bd2a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:10.618127 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7eb8b242-fd1c-4309-b822-10a85c17bd2a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:10.619453 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7eb8b242-fd1c-4309-b822-10a85c17bd2a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:10.619899 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7eb8b242-fd1c-4309-b822-10a85c17bd2a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:10.620321 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7eb8b242-fd1c-4309-b822-10a85c17bd2a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:10.649373 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7eb8b242-fd1c-4309-b822-10a85c17bd2a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044705 Aug 10 12:56:10.650040 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 968/1920] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:10 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:56:11.661672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e5a4aa25-92eb-4967-bafd-aec0f780e391 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:11.663859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e5a4aa25-92eb-4967-bafd-aec0f780e391 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:11.670874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e5a4aa25-92eb-4967-bafd-aec0f780e391 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:11.671394 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e5a4aa25-92eb-4967-bafd-aec0f780e391 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:11.671834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e5a4aa25-92eb-4967-bafd-aec0f780e391 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:11.672528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e5a4aa25-92eb-4967-bafd-aec0f780e391 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:11.672982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e5a4aa25-92eb-4967-bafd-aec0f780e391 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:11.673410 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e5a4aa25-92eb-4967-bafd-aec0f780e391 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:11.702473 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e5a4aa25-92eb-4967-bafd-aec0f780e391 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044743 Aug 10 12:56:11.702949 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 953/1921] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:11 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:12.715018 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-071d7ae1-b3bb-4203-b886-4842a988475f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:12.717245 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-071d7ae1-b3bb-4203-b886-4842a988475f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:12.723606 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-071d7ae1-b3bb-4203-b886-4842a988475f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:12.724084 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-071d7ae1-b3bb-4203-b886-4842a988475f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:12.724509 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-071d7ae1-b3bb-4203-b886-4842a988475f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:12.725213 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-071d7ae1-b3bb-4203-b886-4842a988475f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:12.725657 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-071d7ae1-b3bb-4203-b886-4842a988475f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:12.726073 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-071d7ae1-b3bb-4203-b886-4842a988475f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:12.754800 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-071d7ae1-b3bb-4203-b886-4842a988475f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044261 Aug 10 12:56:12.755364 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 969/1922] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:12 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:13.767005 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-08f9ff50-9ee9-40fd-8a6b-74c1a335fa92 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:13.769194 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-08f9ff50-9ee9-40fd-8a6b-74c1a335fa92 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:13.775726 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08f9ff50-9ee9-40fd-8a6b-74c1a335fa92 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:13.776206 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08f9ff50-9ee9-40fd-8a6b-74c1a335fa92 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:13.776643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08f9ff50-9ee9-40fd-8a6b-74c1a335fa92 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:13.777326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08f9ff50-9ee9-40fd-8a6b-74c1a335fa92 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:13.777773 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08f9ff50-9ee9-40fd-8a6b-74c1a335fa92 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:13.778213 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08f9ff50-9ee9-40fd-8a6b-74c1a335fa92 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:13.807956 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-08f9ff50-9ee9-40fd-8a6b-74c1a335fa92 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044878 Aug 10 12:56:13.808512 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 954/1923] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:13 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:56:14.819971 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ccc41c2b-bcc6-480c-8d33-8f7a8ee7a3c5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:14.822318 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ccc41c2b-bcc6-480c-8d33-8f7a8ee7a3c5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:14.828604 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ccc41c2b-bcc6-480c-8d33-8f7a8ee7a3c5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:14.829073 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ccc41c2b-bcc6-480c-8d33-8f7a8ee7a3c5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:14.829499 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ccc41c2b-bcc6-480c-8d33-8f7a8ee7a3c5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:14.830176 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ccc41c2b-bcc6-480c-8d33-8f7a8ee7a3c5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:14.830621 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ccc41c2b-bcc6-480c-8d33-8f7a8ee7a3c5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:14.831037 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ccc41c2b-bcc6-480c-8d33-8f7a8ee7a3c5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:14.861410 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ccc41c2b-bcc6-480c-8d33-8f7a8ee7a3c5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045367 Aug 10 12:56:14.861977 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 970/1924] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:14 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:15.873758 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6001b0fd-62c7-4852-960b-526daca2ef21 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:15.875824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6001b0fd-62c7-4852-960b-526daca2ef21 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:15.882107 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6001b0fd-62c7-4852-960b-526daca2ef21 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:15.882580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6001b0fd-62c7-4852-960b-526daca2ef21 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:15.883011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6001b0fd-62c7-4852-960b-526daca2ef21 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:15.883720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6001b0fd-62c7-4852-960b-526daca2ef21 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:15.884165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6001b0fd-62c7-4852-960b-526daca2ef21 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:15.884579 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6001b0fd-62c7-4852-960b-526daca2ef21 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:15.912859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6001b0fd-62c7-4852-960b-526daca2ef21 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043201 Aug 10 12:56:15.913400 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 955/1925] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:15 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:16.925198 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-20527886-a507-4b9b-b086-87b07f6d623b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:16.927355 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-20527886-a507-4b9b-b086-87b07f6d623b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:16.933821 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20527886-a507-4b9b-b086-87b07f6d623b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:16.934300 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20527886-a507-4b9b-b086-87b07f6d623b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:16.934734 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20527886-a507-4b9b-b086-87b07f6d623b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:16.935451 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20527886-a507-4b9b-b086-87b07f6d623b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:16.935905 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20527886-a507-4b9b-b086-87b07f6d623b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:16.936324 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20527886-a507-4b9b-b086-87b07f6d623b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:16.966345 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-20527886-a507-4b9b-b086-87b07f6d623b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045160 Aug 10 12:56:16.966905 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 971/1926] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:16 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:17.978436 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a3ba4a26-80c4-4a3e-969d-80fe90c2380c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:17.980700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a3ba4a26-80c4-4a3e-969d-80fe90c2380c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:17.987017 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3ba4a26-80c4-4a3e-969d-80fe90c2380c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:17.987535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3ba4a26-80c4-4a3e-969d-80fe90c2380c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:17.987970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3ba4a26-80c4-4a3e-969d-80fe90c2380c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:17.988652 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3ba4a26-80c4-4a3e-969d-80fe90c2380c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:17.989102 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3ba4a26-80c4-4a3e-969d-80fe90c2380c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:17.989523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a3ba4a26-80c4-4a3e-969d-80fe90c2380c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:18.018629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a3ba4a26-80c4-4a3e-969d-80fe90c2380c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044441 Aug 10 12:56:18.019203 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 956/1927] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:17 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:19.031160 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-45537a1c-fbe4-4109-a53c-9edaca5321c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:19.033314 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-45537a1c-fbe4-4109-a53c-9edaca5321c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:19.040167 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-45537a1c-fbe4-4109-a53c-9edaca5321c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:19.040642 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-45537a1c-fbe4-4109-a53c-9edaca5321c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:19.041069 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-45537a1c-fbe4-4109-a53c-9edaca5321c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:19.041825 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-45537a1c-fbe4-4109-a53c-9edaca5321c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:19.042226 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-45537a1c-fbe4-4109-a53c-9edaca5321c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:19.042642 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-45537a1c-fbe4-4109-a53c-9edaca5321c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:19.071718 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-45537a1c-fbe4-4109-a53c-9edaca5321c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044478 Aug 10 12:56:19.072266 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 972/1928] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:19 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:20.084915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9add99ad-2389-4c13-8693-cb954adc36fa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:20.087333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9add99ad-2389-4c13-8693-cb954adc36fa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:20.094067 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9add99ad-2389-4c13-8693-cb954adc36fa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:20.094547 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9add99ad-2389-4c13-8693-cb954adc36fa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:20.094979 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9add99ad-2389-4c13-8693-cb954adc36fa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:20.095778 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9add99ad-2389-4c13-8693-cb954adc36fa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:20.096244 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9add99ad-2389-4c13-8693-cb954adc36fa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:20.096658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9add99ad-2389-4c13-8693-cb954adc36fa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:20.126171 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9add99ad-2389-4c13-8693-cb954adc36fa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045240 Aug 10 12:56:20.126723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 957/1929] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:20 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:21.139191 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4b322097-7a58-482b-900e-561cea6e73ec tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:21.141445 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4b322097-7a58-482b-900e-561cea6e73ec tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:21.147930 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b322097-7a58-482b-900e-561cea6e73ec tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:21.148444 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b322097-7a58-482b-900e-561cea6e73ec tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:21.148848 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b322097-7a58-482b-900e-561cea6e73ec tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:21.149590 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b322097-7a58-482b-900e-561cea6e73ec tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:21.150044 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b322097-7a58-482b-900e-561cea6e73ec tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:21.150470 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b322097-7a58-482b-900e-561cea6e73ec tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:21.180628 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4b322097-7a58-482b-900e-561cea6e73ec tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046030 Aug 10 12:56:21.181189 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 973/1930] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:21 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:22.193151 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3645ba09-3c9c-4956-9a3d-5fe2728cbcf5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:22.195165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3645ba09-3c9c-4956-9a3d-5fe2728cbcf5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:22.197451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=32 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:56:22.202931 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3645ba09-3c9c-4956-9a3d-5fe2728cbcf5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:22.203438 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3645ba09-3c9c-4956-9a3d-5fe2728cbcf5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:22.203871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3645ba09-3c9c-4956-9a3d-5fe2728cbcf5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:22.204546 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3645ba09-3c9c-4956-9a3d-5fe2728cbcf5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:22.204989 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3645ba09-3c9c-4956-9a3d-5fe2728cbcf5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:22.205403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3645ba09-3c9c-4956-9a3d-5fe2728cbcf5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:22.235538 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3645ba09-3c9c-4956-9a3d-5fe2728cbcf5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046363 Aug 10 12:56:22.236095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 958/1931] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:22 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:23.247438 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-261a0c84-b300-42d1-a10b-48e351533fc6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:23.249513 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-261a0c84-b300-42d1-a10b-48e351533fc6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:23.255922 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-261a0c84-b300-42d1-a10b-48e351533fc6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:23.256410 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-261a0c84-b300-42d1-a10b-48e351533fc6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:23.256851 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-261a0c84-b300-42d1-a10b-48e351533fc6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:23.257543 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-261a0c84-b300-42d1-a10b-48e351533fc6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:23.258000 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-261a0c84-b300-42d1-a10b-48e351533fc6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:23.258424 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-261a0c84-b300-42d1-a10b-48e351533fc6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:23.287722 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-261a0c84-b300-42d1-a10b-48e351533fc6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044377 Aug 10 12:56:23.288286 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 974/1932] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:23 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:24.300789 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4703a931-9086-4dc0-97cb-6a88479d5709 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:24.302902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4703a931-9086-4dc0-97cb-6a88479d5709 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:24.309218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4703a931-9086-4dc0-97cb-6a88479d5709 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:24.309690 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4703a931-9086-4dc0-97cb-6a88479d5709 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:24.310125 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4703a931-9086-4dc0-97cb-6a88479d5709 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:24.310798 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4703a931-9086-4dc0-97cb-6a88479d5709 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:24.311267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4703a931-9086-4dc0-97cb-6a88479d5709 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:24.311688 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4703a931-9086-4dc0-97cb-6a88479d5709 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:24.315114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=96 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:56:24.340347 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4703a931-9086-4dc0-97cb-6a88479d5709 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043800 Aug 10 12:56:24.340934 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 959/1933] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:24 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:25.352496 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4fafab73-1556-41e5-9e51-ff9da9859661 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:25.354883 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4fafab73-1556-41e5-9e51-ff9da9859661 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:25.361213 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4fafab73-1556-41e5-9e51-ff9da9859661 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:25.361694 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4fafab73-1556-41e5-9e51-ff9da9859661 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:25.362128 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4fafab73-1556-41e5-9e51-ff9da9859661 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:25.362815 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4fafab73-1556-41e5-9e51-ff9da9859661 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:25.363299 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4fafab73-1556-41e5-9e51-ff9da9859661 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:25.363722 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4fafab73-1556-41e5-9e51-ff9da9859661 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:25.367307 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=90 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:56:25.393448 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4fafab73-1556-41e5-9e51-ff9da9859661 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044979 Aug 10 12:56:25.394000 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 975/1934] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:25 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:26.406085 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b15542c8-8e97-4748-9aaa-17345e1aff84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:26.408252 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b15542c8-8e97-4748-9aaa-17345e1aff84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:26.414680 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b15542c8-8e97-4748-9aaa-17345e1aff84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:26.415156 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b15542c8-8e97-4748-9aaa-17345e1aff84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:26.415606 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b15542c8-8e97-4748-9aaa-17345e1aff84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:26.416840 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b15542c8-8e97-4748-9aaa-17345e1aff84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:26.417405 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b15542c8-8e97-4748-9aaa-17345e1aff84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:26.417832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b15542c8-8e97-4748-9aaa-17345e1aff84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:26.447079 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b15542c8-8e97-4748-9aaa-17345e1aff84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045419 Aug 10 12:56:26.447647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 960/1935] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:26 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:27.459401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5023862f-63c6-4f78-abd3-9972f75f3249 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:27.461502 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5023862f-63c6-4f78-abd3-9972f75f3249 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:27.468576 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5023862f-63c6-4f78-abd3-9972f75f3249 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:27.469056 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5023862f-63c6-4f78-abd3-9972f75f3249 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:27.469490 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5023862f-63c6-4f78-abd3-9972f75f3249 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:27.470175 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5023862f-63c6-4f78-abd3-9972f75f3249 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:27.470629 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5023862f-63c6-4f78-abd3-9972f75f3249 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:27.471050 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5023862f-63c6-4f78-abd3-9972f75f3249 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:27.499389 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5023862f-63c6-4f78-abd3-9972f75f3249 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044174 Aug 10 12:56:27.499931 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 976/1936] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:27 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:28.512338 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-633ba9d6-3139-4b69-976b-edb28d6c5604 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:28.514463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-633ba9d6-3139-4b69-976b-edb28d6c5604 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:28.520988 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-633ba9d6-3139-4b69-976b-edb28d6c5604 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:28.521273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-633ba9d6-3139-4b69-976b-edb28d6c5604 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:28.521710 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-633ba9d6-3139-4b69-976b-edb28d6c5604 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:28.522423 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-633ba9d6-3139-4b69-976b-edb28d6c5604 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:28.522880 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-633ba9d6-3139-4b69-976b-edb28d6c5604 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:28.523352 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-633ba9d6-3139-4b69-976b-edb28d6c5604 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:28.551611 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-633ba9d6-3139-4b69-976b-edb28d6c5604 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043989 Aug 10 12:56:28.552159 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 961/1937] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:28 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:29.564623 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-266e784d-2590-4ad5-8715-158409e73c40 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:29.566761 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-266e784d-2590-4ad5-8715-158409e73c40 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:29.569153 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=32 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:56:29.573964 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-266e784d-2590-4ad5-8715-158409e73c40 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:29.574440 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-266e784d-2590-4ad5-8715-158409e73c40 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:29.574869 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-266e784d-2590-4ad5-8715-158409e73c40 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:29.575579 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-266e784d-2590-4ad5-8715-158409e73c40 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:29.576029 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-266e784d-2590-4ad5-8715-158409e73c40 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:29.581126 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-266e784d-2590-4ad5-8715-158409e73c40 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:29.606276 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-266e784d-2590-4ad5-8715-158409e73c40 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045631 Aug 10 12:56:29.606833 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 977/1938] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:29 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:30.617952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-995c5a96-9a15-4971-a240-c55c9ce56719 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:30.620338 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-995c5a96-9a15-4971-a240-c55c9ce56719 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:30.626698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-995c5a96-9a15-4971-a240-c55c9ce56719 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:30.627204 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-995c5a96-9a15-4971-a240-c55c9ce56719 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:30.627636 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-995c5a96-9a15-4971-a240-c55c9ce56719 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:30.629582 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-995c5a96-9a15-4971-a240-c55c9ce56719 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:30.629582 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-995c5a96-9a15-4971-a240-c55c9ce56719 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:30.629582 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-995c5a96-9a15-4971-a240-c55c9ce56719 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:30.657905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-995c5a96-9a15-4971-a240-c55c9ce56719 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043944 Aug 10 12:56:30.658457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 962/1939] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:30 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:31.670447 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0ee9ca6f-8a7a-40da-b529-12318085f300 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:31.672683 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0ee9ca6f-8a7a-40da-b529-12318085f300 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:31.678995 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ee9ca6f-8a7a-40da-b529-12318085f300 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:31.679510 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ee9ca6f-8a7a-40da-b529-12318085f300 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:31.679945 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ee9ca6f-8a7a-40da-b529-12318085f300 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:31.680632 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ee9ca6f-8a7a-40da-b529-12318085f300 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:31.681207 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ee9ca6f-8a7a-40da-b529-12318085f300 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:31.681635 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ee9ca6f-8a7a-40da-b529-12318085f300 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:31.710662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0ee9ca6f-8a7a-40da-b529-12318085f300 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044657 Aug 10 12:56:31.711230 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 978/1940] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:31 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:32.722911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-88556e53-e42e-4d4d-aadd-62db5da21b7c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:32.725066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-88556e53-e42e-4d4d-aadd-62db5da21b7c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:32.732430 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-88556e53-e42e-4d4d-aadd-62db5da21b7c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:32.732910 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-88556e53-e42e-4d4d-aadd-62db5da21b7c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:32.733350 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-88556e53-e42e-4d4d-aadd-62db5da21b7c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:32.734029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-88556e53-e42e-4d4d-aadd-62db5da21b7c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:32.734479 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-88556e53-e42e-4d4d-aadd-62db5da21b7c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:32.734900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-88556e53-e42e-4d4d-aadd-62db5da21b7c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:32.763392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-88556e53-e42e-4d4d-aadd-62db5da21b7c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044346 Aug 10 12:56:32.763941 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 963/1941] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:32 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:33.775439 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a7aa0dfa-d8ec-4fc3-86fc-6464dda407b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:33.777721 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a7aa0dfa-d8ec-4fc3-86fc-6464dda407b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:33.784109 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a7aa0dfa-d8ec-4fc3-86fc-6464dda407b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:33.784551 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a7aa0dfa-d8ec-4fc3-86fc-6464dda407b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:33.784985 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a7aa0dfa-d8ec-4fc3-86fc-6464dda407b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:33.785667 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a7aa0dfa-d8ec-4fc3-86fc-6464dda407b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:33.786110 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a7aa0dfa-d8ec-4fc3-86fc-6464dda407b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:33.786525 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a7aa0dfa-d8ec-4fc3-86fc-6464dda407b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:33.816309 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a7aa0dfa-d8ec-4fc3-86fc-6464dda407b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044803 Aug 10 12:56:33.816863 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 979/1942] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:33 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:34.828156 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5d3933ad-f383-48b7-8c9d-2fa4b68d64fe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:34.830298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5d3933ad-f383-48b7-8c9d-2fa4b68d64fe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:34.836977 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d3933ad-f383-48b7-8c9d-2fa4b68d64fe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:34.837466 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d3933ad-f383-48b7-8c9d-2fa4b68d64fe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:34.837899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d3933ad-f383-48b7-8c9d-2fa4b68d64fe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:34.839490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d3933ad-f383-48b7-8c9d-2fa4b68d64fe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:34.839952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d3933ad-f383-48b7-8c9d-2fa4b68d64fe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:34.840538 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d3933ad-f383-48b7-8c9d-2fa4b68d64fe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:34.846871 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:56:34.847381 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Wed Aug 10 12:56:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 12:56:34.869992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5d3933ad-f383-48b7-8c9d-2fa4b68d64fe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045763 Aug 10 12:56:34.870570 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 964/1943] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:34 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:56:35.881811 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7495ed54-b01b-4dc0-afeb-fd65aab9dc7e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:35.883928 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7495ed54-b01b-4dc0-afeb-fd65aab9dc7e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:35.890817 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7495ed54-b01b-4dc0-afeb-fd65aab9dc7e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:35.891336 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7495ed54-b01b-4dc0-afeb-fd65aab9dc7e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:35.891788 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7495ed54-b01b-4dc0-afeb-fd65aab9dc7e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:35.892469 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7495ed54-b01b-4dc0-afeb-fd65aab9dc7e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:35.892911 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7495ed54-b01b-4dc0-afeb-fd65aab9dc7e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:35.893326 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7495ed54-b01b-4dc0-afeb-fd65aab9dc7e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:35.921467 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7495ed54-b01b-4dc0-afeb-fd65aab9dc7e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043602 Aug 10 12:56:35.922006 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 980/1944] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:35 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:36.934200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-27d56ae3-d729-4555-9477-2497e055f946 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:36.936430 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-27d56ae3-d729-4555-9477-2497e055f946 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:36.942736 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27d56ae3-d729-4555-9477-2497e055f946 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:36.943244 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27d56ae3-d729-4555-9477-2497e055f946 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:36.943679 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27d56ae3-d729-4555-9477-2497e055f946 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:36.944362 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27d56ae3-d729-4555-9477-2497e055f946 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:36.944814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27d56ae3-d729-4555-9477-2497e055f946 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:36.945237 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27d56ae3-d729-4555-9477-2497e055f946 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:36.974583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-27d56ae3-d729-4555-9477-2497e055f946 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045002 Aug 10 12:56:36.975128 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 965/1945] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:36 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:37.987102 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f3949a7a-d1bb-4d8a-9e7e-246500be7b41 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:37.989276 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f3949a7a-d1bb-4d8a-9e7e-246500be7b41 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:37.995743 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f3949a7a-d1bb-4d8a-9e7e-246500be7b41 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:37.996157 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f3949a7a-d1bb-4d8a-9e7e-246500be7b41 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:37.996584 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f3949a7a-d1bb-4d8a-9e7e-246500be7b41 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:37.997261 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f3949a7a-d1bb-4d8a-9e7e-246500be7b41 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:37.997705 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f3949a7a-d1bb-4d8a-9e7e-246500be7b41 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:37.998121 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f3949a7a-d1bb-4d8a-9e7e-246500be7b41 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:38.026802 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f3949a7a-d1bb-4d8a-9e7e-246500be7b41 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043641 Aug 10 12:56:38.027365 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 981/1946] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:37 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:38.508298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:56:38.508771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Wed Aug 10 12:56:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 12:56:39.038639 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-dd2fac5c-9ea2-414d-a5a1-997b4b20d909 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:39.041015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-dd2fac5c-9ea2-414d-a5a1-997b4b20d909 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:39.048048 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd2fac5c-9ea2-414d-a5a1-997b4b20d909 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:39.048526 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd2fac5c-9ea2-414d-a5a1-997b4b20d909 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:39.049025 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd2fac5c-9ea2-414d-a5a1-997b4b20d909 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:39.049748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd2fac5c-9ea2-414d-a5a1-997b4b20d909 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:39.050197 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd2fac5c-9ea2-414d-a5a1-997b4b20d909 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:39.050753 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd2fac5c-9ea2-414d-a5a1-997b4b20d909 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:39.080536 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-dd2fac5c-9ea2-414d-a5a1-997b4b20d909 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045748 Aug 10 12:56:39.081088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 966/1947] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:39 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:40.092976 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1158af2d-035a-47f2-a2e9-ecba0b9d8bad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:40.095100 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1158af2d-035a-47f2-a2e9-ecba0b9d8bad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:40.101510 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1158af2d-035a-47f2-a2e9-ecba0b9d8bad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:40.101991 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1158af2d-035a-47f2-a2e9-ecba0b9d8bad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:40.102427 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1158af2d-035a-47f2-a2e9-ecba0b9d8bad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:40.103114 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1158af2d-035a-47f2-a2e9-ecba0b9d8bad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:40.104531 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1158af2d-035a-47f2-a2e9-ecba0b9d8bad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:40.104962 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1158af2d-035a-47f2-a2e9-ecba0b9d8bad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:40.134464 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1158af2d-035a-47f2-a2e9-ecba0b9d8bad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045665 Aug 10 12:56:40.135124 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 982/1948] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:40 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:41.146937 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6d2a6215-ad3c-425c-b172-0d91e6dc1fde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:41.149283 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6d2a6215-ad3c-425c-b172-0d91e6dc1fde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:41.157066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6d2a6215-ad3c-425c-b172-0d91e6dc1fde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:41.157807 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6d2a6215-ad3c-425c-b172-0d91e6dc1fde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:41.158980 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6d2a6215-ad3c-425c-b172-0d91e6dc1fde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:41.158980 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6d2a6215-ad3c-425c-b172-0d91e6dc1fde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:41.159428 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6d2a6215-ad3c-425c-b172-0d91e6dc1fde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:41.159856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6d2a6215-ad3c-425c-b172-0d91e6dc1fde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:41.190200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6d2a6215-ad3c-425c-b172-0d91e6dc1fde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047449 Aug 10 12:56:41.190767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 967/1949] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:41 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:41.468643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:56:41.468909 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Wed Aug 10 12:56:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 12:56:42.414027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9c998e23-219f-4c45-8999-ca804a39b9b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:42.416294 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9c998e23-219f-4c45-8999-ca804a39b9b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:42.422219 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9c998e23-219f-4c45-8999-ca804a39b9b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:42.422701 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9c998e23-219f-4c45-8999-ca804a39b9b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:42.423139 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9c998e23-219f-4c45-8999-ca804a39b9b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:42.423853 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9c998e23-219f-4c45-8999-ca804a39b9b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:42.424309 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9c998e23-219f-4c45-8999-ca804a39b9b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:42.424733 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9c998e23-219f-4c45-8999-ca804a39b9b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:42.453569 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9c998e23-219f-4c45-8999-ca804a39b9b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.254435 Aug 10 12:56:42.454114 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 983/1950] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:42 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:43.464828 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-11e6478d-5270-47d8-8617-f996d285b00a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:43.466986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-11e6478d-5270-47d8-8617-f996d285b00a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:43.473323 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11e6478d-5270-47d8-8617-f996d285b00a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:43.473801 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11e6478d-5270-47d8-8617-f996d285b00a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:43.474232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11e6478d-5270-47d8-8617-f996d285b00a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:43.474915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11e6478d-5270-47d8-8617-f996d285b00a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:43.475398 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11e6478d-5270-47d8-8617-f996d285b00a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:43.475827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11e6478d-5270-47d8-8617-f996d285b00a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:43.504854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-11e6478d-5270-47d8-8617-f996d285b00a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044062 Aug 10 12:56:43.505385 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 968/1951] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:43 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:44.517012 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-23aaadd5-243b-4c6b-9e10-38202daac766 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:44.519156 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-23aaadd5-243b-4c6b-9e10-38202daac766 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:44.525528 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23aaadd5-243b-4c6b-9e10-38202daac766 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:44.526524 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23aaadd5-243b-4c6b-9e10-38202daac766 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:44.526951 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23aaadd5-243b-4c6b-9e10-38202daac766 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:44.527666 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23aaadd5-243b-4c6b-9e10-38202daac766 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:44.528117 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23aaadd5-243b-4c6b-9e10-38202daac766 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:44.528539 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23aaadd5-243b-4c6b-9e10-38202daac766 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:44.556595 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-23aaadd5-243b-4c6b-9e10-38202daac766 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043502 Aug 10 12:56:44.557112 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 984/1952] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:44 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:45.568758 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a0c248e4-92a2-49cb-8b41-c2e2a92546d4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:45.570855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a0c248e4-92a2-49cb-8b41-c2e2a92546d4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:45.577694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a0c248e4-92a2-49cb-8b41-c2e2a92546d4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:45.578169 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a0c248e4-92a2-49cb-8b41-c2e2a92546d4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:45.578596 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a0c248e4-92a2-49cb-8b41-c2e2a92546d4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:45.579302 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a0c248e4-92a2-49cb-8b41-c2e2a92546d4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:45.579747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a0c248e4-92a2-49cb-8b41-c2e2a92546d4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:45.580162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a0c248e4-92a2-49cb-8b41-c2e2a92546d4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:45.608314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a0c248e4-92a2-49cb-8b41-c2e2a92546d4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043534 Aug 10 12:56:45.608860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 969/1953] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:45 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:46.620589 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8c0cf6c5-48d1-4e19-b41c-aa5f90520dbb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:46.622934 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8c0cf6c5-48d1-4e19-b41c-aa5f90520dbb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:46.629348 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8c0cf6c5-48d1-4e19-b41c-aa5f90520dbb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:46.629833 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8c0cf6c5-48d1-4e19-b41c-aa5f90520dbb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:46.630268 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8c0cf6c5-48d1-4e19-b41c-aa5f90520dbb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:46.630961 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8c0cf6c5-48d1-4e19-b41c-aa5f90520dbb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:46.631482 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8c0cf6c5-48d1-4e19-b41c-aa5f90520dbb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:46.631908 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8c0cf6c5-48d1-4e19-b41c-aa5f90520dbb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:46.660677 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8c0cf6c5-48d1-4e19-b41c-aa5f90520dbb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044114 Aug 10 12:56:46.661228 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 985/1954] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:46 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:47.673048 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4ebb69fa-932d-485f-aaaf-87b917ce2d80 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:47.675160 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4ebb69fa-932d-485f-aaaf-87b917ce2d80 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:47.682413 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ebb69fa-932d-485f-aaaf-87b917ce2d80 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:47.682955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ebb69fa-932d-485f-aaaf-87b917ce2d80 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:47.683440 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ebb69fa-932d-485f-aaaf-87b917ce2d80 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:47.684131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ebb69fa-932d-485f-aaaf-87b917ce2d80 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:47.684580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ebb69fa-932d-485f-aaaf-87b917ce2d80 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:47.685001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ebb69fa-932d-485f-aaaf-87b917ce2d80 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:47.715705 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4ebb69fa-932d-485f-aaaf-87b917ce2d80 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046572 Aug 10 12:56:47.716248 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 970/1955] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:47 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:48.728038 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-56817207-5440-4799-b41c-fe8bd2777ed0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:48.730700 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-56817207-5440-4799-b41c-fe8bd2777ed0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:48.737311 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56817207-5440-4799-b41c-fe8bd2777ed0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:48.737790 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56817207-5440-4799-b41c-fe8bd2777ed0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:48.738249 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56817207-5440-4799-b41c-fe8bd2777ed0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:48.738943 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56817207-5440-4799-b41c-fe8bd2777ed0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:48.739541 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56817207-5440-4799-b41c-fe8bd2777ed0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:48.739965 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56817207-5440-4799-b41c-fe8bd2777ed0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:48.770306 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-56817207-5440-4799-b41c-fe8bd2777ed0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047032 Aug 10 12:56:48.770863 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 986/1956] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:48 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:56:49.782661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9e3b1950-4f25-4312-b499-935f14e4c892 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:49.784782 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9e3b1950-4f25-4312-b499-935f14e4c892 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:49.790771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e3b1950-4f25-4312-b499-935f14e4c892 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:49.791280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e3b1950-4f25-4312-b499-935f14e4c892 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:49.792268 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e3b1950-4f25-4312-b499-935f14e4c892 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:49.792948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e3b1950-4f25-4312-b499-935f14e4c892 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:49.793395 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e3b1950-4f25-4312-b499-935f14e4c892 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:49.793812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e3b1950-4f25-4312-b499-935f14e4c892 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:49.822278 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9e3b1950-4f25-4312-b499-935f14e4c892 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043478 Aug 10 12:56:49.822748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 971/1957] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:49 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:50.833925 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-912d4b07-a3f5-4840-81bc-92ca4d8de956 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:50.836078 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-912d4b07-a3f5-4840-81bc-92ca4d8de956 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:50.842720 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-912d4b07-a3f5-4840-81bc-92ca4d8de956 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:50.843231 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-912d4b07-a3f5-4840-81bc-92ca4d8de956 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:50.843670 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-912d4b07-a3f5-4840-81bc-92ca4d8de956 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:50.844357 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-912d4b07-a3f5-4840-81bc-92ca4d8de956 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:50.844807 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-912d4b07-a3f5-4840-81bc-92ca4d8de956 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:50.845231 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-912d4b07-a3f5-4840-81bc-92ca4d8de956 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:50.874485 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-912d4b07-a3f5-4840-81bc-92ca4d8de956 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044451 Aug 10 12:56:50.875242 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 987/1958] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:50 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:51.887155 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1e6cf30d-048e-431c-9dd8-463aa257c29c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:51.889295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1e6cf30d-048e-431c-9dd8-463aa257c29c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:51.895609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1e6cf30d-048e-431c-9dd8-463aa257c29c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:51.896089 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1e6cf30d-048e-431c-9dd8-463aa257c29c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:51.896527 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1e6cf30d-048e-431c-9dd8-463aa257c29c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:51.897213 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1e6cf30d-048e-431c-9dd8-463aa257c29c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:51.897665 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1e6cf30d-048e-431c-9dd8-463aa257c29c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:51.898090 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1e6cf30d-048e-431c-9dd8-463aa257c29c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:51.927379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1e6cf30d-048e-431c-9dd8-463aa257c29c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044992 Aug 10 12:56:51.927914 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 972/1959] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:51 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:52.939800 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-49c31624-82c7-4033-aac3-dc75ef1d7ec1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:52.942004 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-49c31624-82c7-4033-aac3-dc75ef1d7ec1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:52.948929 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-49c31624-82c7-4033-aac3-dc75ef1d7ec1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:52.949413 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-49c31624-82c7-4033-aac3-dc75ef1d7ec1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:52.949844 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-49c31624-82c7-4033-aac3-dc75ef1d7ec1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:52.950532 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-49c31624-82c7-4033-aac3-dc75ef1d7ec1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:52.950980 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-49c31624-82c7-4033-aac3-dc75ef1d7ec1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:52.951435 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-49c31624-82c7-4033-aac3-dc75ef1d7ec1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:52.980462 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-49c31624-82c7-4033-aac3-dc75ef1d7ec1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044594 Aug 10 12:56:52.981008 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 988/1960] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:52 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:53.992476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0abefd54-5482-4f91-8f45-903ced820f19 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:53.994593 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0abefd54-5482-4f91-8f45-903ced820f19 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:54.001379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0abefd54-5482-4f91-8f45-903ced820f19 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:54.001852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0abefd54-5482-4f91-8f45-903ced820f19 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:54.002280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0abefd54-5482-4f91-8f45-903ced820f19 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:54.002962 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0abefd54-5482-4f91-8f45-903ced820f19 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:54.003435 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0abefd54-5482-4f91-8f45-903ced820f19 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:54.003857 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0abefd54-5482-4f91-8f45-903ced820f19 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:54.031935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0abefd54-5482-4f91-8f45-903ced820f19 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043371 Aug 10 12:56:54.032472 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 973/1961] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:53 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:54.397518 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:56:54.397710 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Wed Aug 10 12:56:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 12:56:55.043984 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-613c6600-0434-4aca-a417-0b47c18dce81 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:55.046190 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-613c6600-0434-4aca-a417-0b47c18dce81 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:55.052589 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-613c6600-0434-4aca-a417-0b47c18dce81 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:55.053087 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-613c6600-0434-4aca-a417-0b47c18dce81 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:55.053522 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-613c6600-0434-4aca-a417-0b47c18dce81 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:55.054214 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-613c6600-0434-4aca-a417-0b47c18dce81 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:55.054665 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-613c6600-0434-4aca-a417-0b47c18dce81 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:55.055091 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-613c6600-0434-4aca-a417-0b47c18dce81 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:55.084057 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-613c6600-0434-4aca-a417-0b47c18dce81 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043974 Aug 10 12:56:55.084612 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 989/1962] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:55 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:56.096233 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-675812a4-36e4-4183-940a-e2d4426bfbde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:56.098532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-675812a4-36e4-4183-940a-e2d4426bfbde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:56.100811 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=32 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:56:56.106548 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-675812a4-36e4-4183-940a-e2d4426bfbde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:56.107029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-675812a4-36e4-4183-940a-e2d4426bfbde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:56.107512 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-675812a4-36e4-4183-940a-e2d4426bfbde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:56.108199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-675812a4-36e4-4183-940a-e2d4426bfbde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:56.108647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-675812a4-36e4-4183-940a-e2d4426bfbde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:56.109068 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-675812a4-36e4-4183-940a-e2d4426bfbde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:56.138530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-675812a4-36e4-4183-940a-e2d4426bfbde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046291 Aug 10 12:56:56.139073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 974/1963] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:56 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:57.150555 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1c118255-808d-488f-95c1-a45ee1c1324b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:57.152907 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1c118255-808d-488f-95c1-a45ee1c1324b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:57.158987 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c118255-808d-488f-95c1-a45ee1c1324b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:57.159503 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c118255-808d-488f-95c1-a45ee1c1324b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:57.159940 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c118255-808d-488f-95c1-a45ee1c1324b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:57.160630 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c118255-808d-488f-95c1-a45ee1c1324b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:57.161082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c118255-808d-488f-95c1-a45ee1c1324b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:57.161503 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c118255-808d-488f-95c1-a45ee1c1324b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:57.190690 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1c118255-808d-488f-95c1-a45ee1c1324b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044020 Aug 10 12:56:57.191167 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 990/1964] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:57 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:58.203675 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3168cc33-26fb-4195-96a8-33b176214ec5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:58.205811 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3168cc33-26fb-4195-96a8-33b176214ec5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:58.212205 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3168cc33-26fb-4195-96a8-33b176214ec5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:58.212676 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3168cc33-26fb-4195-96a8-33b176214ec5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:58.213102 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3168cc33-26fb-4195-96a8-33b176214ec5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:58.214500 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3168cc33-26fb-4195-96a8-33b176214ec5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:58.215045 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3168cc33-26fb-4195-96a8-33b176214ec5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:58.215496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3168cc33-26fb-4195-96a8-33b176214ec5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:58.217784 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=96 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:56:58.245348 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3168cc33-26fb-4195-96a8-33b176214ec5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045585 Aug 10 12:56:58.245885 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 975/1965] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:58 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:56:59.257632 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-238d13c1-569e-441d-8a7a-574f83c652a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:56:59.259831 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-238d13c1-569e-441d-8a7a-574f83c652a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:56:59.266698 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-238d13c1-569e-441d-8a7a-574f83c652a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:59.267195 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-238d13c1-569e-441d-8a7a-574f83c652a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:59.267649 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-238d13c1-569e-441d-8a7a-574f83c652a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:59.268346 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-238d13c1-569e-441d-8a7a-574f83c652a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:56:59.268831 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-238d13c1-569e-441d-8a7a-574f83c652a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:56:59.269251 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-238d13c1-569e-441d-8a7a-574f83c652a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:56:59.271585 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=96 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:56:59.300119 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-238d13c1-569e-441d-8a7a-574f83c652a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046499 Aug 10 12:56:59.300679 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 991/1966] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:56:59 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:57:00.312869 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-863f10e9-fa75-4d0c-8cbe-95869ab68235 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:00.314984 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-863f10e9-fa75-4d0c-8cbe-95869ab68235 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:00.322035 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-863f10e9-fa75-4d0c-8cbe-95869ab68235 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:00.322592 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-863f10e9-fa75-4d0c-8cbe-95869ab68235 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:00.323154 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-863f10e9-fa75-4d0c-8cbe-95869ab68235 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:00.323908 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-863f10e9-fa75-4d0c-8cbe-95869ab68235 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:00.324362 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-863f10e9-fa75-4d0c-8cbe-95869ab68235 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:00.324791 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-863f10e9-fa75-4d0c-8cbe-95869ab68235 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:00.352747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-863f10e9-fa75-4d0c-8cbe-95869ab68235 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043859 Aug 10 12:57:00.353558 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 976/1967] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:57:00 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:57:01.365586 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6e391fdd-23ad-4e02-903c-f79efcfe4f9f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:01.367750 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6e391fdd-23ad-4e02-903c-f79efcfe4f9f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:01.371111 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=30 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:57:01.375945 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6e391fdd-23ad-4e02-903c-f79efcfe4f9f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:01.376425 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6e391fdd-23ad-4e02-903c-f79efcfe4f9f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:01.376862 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6e391fdd-23ad-4e02-903c-f79efcfe4f9f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:01.377546 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6e391fdd-23ad-4e02-903c-f79efcfe4f9f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:01.378003 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6e391fdd-23ad-4e02-903c-f79efcfe4f9f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:01.378423 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6e391fdd-23ad-4e02-903c-f79efcfe4f9f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:01.406806 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6e391fdd-23ad-4e02-903c-f79efcfe4f9f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045115 Aug 10 12:57:01.407395 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 992/1968] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:57:01 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:57:02.419207 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-caedf5c4-1702-4ab9-b88d-0d37028408e0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:02.421326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-caedf5c4-1702-4ab9-b88d-0d37028408e0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:02.427730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-caedf5c4-1702-4ab9-b88d-0d37028408e0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:02.428337 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-caedf5c4-1702-4ab9-b88d-0d37028408e0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:02.428773 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-caedf5c4-1702-4ab9-b88d-0d37028408e0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:02.429543 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-caedf5c4-1702-4ab9-b88d-0d37028408e0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:02.430026 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-caedf5c4-1702-4ab9-b88d-0d37028408e0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:02.430412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-caedf5c4-1702-4ab9-b88d-0d37028408e0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:02.459865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-caedf5c4-1702-4ab9-b88d-0d37028408e0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045042 Aug 10 12:57:02.460421 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 977/1969] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:57:02 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:57:03.472765 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-607bbc31-5d7a-46b3-89d2-7ffc8db6639e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:03.474939 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-607bbc31-5d7a-46b3-89d2-7ffc8db6639e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:03.481505 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-607bbc31-5d7a-46b3-89d2-7ffc8db6639e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:03.481981 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-607bbc31-5d7a-46b3-89d2-7ffc8db6639e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:03.482425 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-607bbc31-5d7a-46b3-89d2-7ffc8db6639e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:03.483112 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-607bbc31-5d7a-46b3-89d2-7ffc8db6639e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:03.483612 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-607bbc31-5d7a-46b3-89d2-7ffc8db6639e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:03.484027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-607bbc31-5d7a-46b3-89d2-7ffc8db6639e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:03.513602 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-607bbc31-5d7a-46b3-89d2-7ffc8db6639e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045181 Aug 10 12:57:03.514163 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 993/1970] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:57:03 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:57:04.525739 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5b842845-65ef-4b43-bcc5-1f485f8ed9c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:04.527962 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5b842845-65ef-4b43-bcc5-1f485f8ed9c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:04.534275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5b842845-65ef-4b43-bcc5-1f485f8ed9c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:04.534757 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5b842845-65ef-4b43-bcc5-1f485f8ed9c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:04.535214 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5b842845-65ef-4b43-bcc5-1f485f8ed9c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:04.535905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5b842845-65ef-4b43-bcc5-1f485f8ed9c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:04.536355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5b842845-65ef-4b43-bcc5-1f485f8ed9c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:04.536777 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5b842845-65ef-4b43-bcc5-1f485f8ed9c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:04.566028 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5b842845-65ef-4b43-bcc5-1f485f8ed9c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044127 Aug 10 12:57:04.566574 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 978/1971] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:57:04 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:57:05.577892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-46d079dd-f07c-4652-b9fb-e40f3d0936bc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:05.580094 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-46d079dd-f07c-4652-b9fb-e40f3d0936bc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:05.586452 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46d079dd-f07c-4652-b9fb-e40f3d0936bc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:05.586929 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46d079dd-f07c-4652-b9fb-e40f3d0936bc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:05.587404 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46d079dd-f07c-4652-b9fb-e40f3d0936bc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:05.588087 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46d079dd-f07c-4652-b9fb-e40f3d0936bc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:05.588565 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46d079dd-f07c-4652-b9fb-e40f3d0936bc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:05.589042 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46d079dd-f07c-4652-b9fb-e40f3d0936bc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:05.617700 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-46d079dd-f07c-4652-b9fb-e40f3d0936bc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043657 Aug 10 12:57:05.618250 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 994/1972] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:57:05 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:57:06.630381 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-80b27b9b-d925-40cc-9126-a464897c66ed tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:06.632582 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-80b27b9b-d925-40cc-9126-a464897c66ed tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:06.639664 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80b27b9b-d925-40cc-9126-a464897c66ed tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:06.640175 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80b27b9b-d925-40cc-9126-a464897c66ed tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:06.640636 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80b27b9b-d925-40cc-9126-a464897c66ed tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:06.641326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80b27b9b-d925-40cc-9126-a464897c66ed tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:06.641773 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80b27b9b-d925-40cc-9126-a464897c66ed tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:06.642196 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80b27b9b-d925-40cc-9126-a464897c66ed tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:06.670225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-80b27b9b-d925-40cc-9126-a464897c66ed tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044175 Aug 10 12:57:06.670776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 979/1973] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:57:06 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:57:07.681809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bf70ea6e-1748-432e-a17e-a66a354f5a65 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:07.683960 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bf70ea6e-1748-432e-a17e-a66a354f5a65 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:07.690225 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf70ea6e-1748-432e-a17e-a66a354f5a65 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:07.690736 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf70ea6e-1748-432e-a17e-a66a354f5a65 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:07.691195 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf70ea6e-1748-432e-a17e-a66a354f5a65 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:07.691890 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf70ea6e-1748-432e-a17e-a66a354f5a65 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:07.692340 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf70ea6e-1748-432e-a17e-a66a354f5a65 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:07.692762 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf70ea6e-1748-432e-a17e-a66a354f5a65 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:07.722285 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bf70ea6e-1748-432e-a17e-a66a354f5a65 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044352 Aug 10 12:57:07.722825 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 995/1974] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:57:07 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:57:08.735119 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-aa46183c-e09a-40ea-a092-3d7a2b005e1b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:08.737288 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-aa46183c-e09a-40ea-a092-3d7a2b005e1b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:08.743540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa46183c-e09a-40ea-a092-3d7a2b005e1b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:08.744029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa46183c-e09a-40ea-a092-3d7a2b005e1b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:08.744626 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa46183c-e09a-40ea-a092-3d7a2b005e1b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:08.746495 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa46183c-e09a-40ea-a092-3d7a2b005e1b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:08.746943 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa46183c-e09a-40ea-a092-3d7a2b005e1b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:08.747394 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa46183c-e09a-40ea-a092-3d7a2b005e1b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:08.775760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-aa46183c-e09a-40ea-a092-3d7a2b005e1b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044515 Aug 10 12:57:08.777320 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 980/1975] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:57:08 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 12:57:09.788922 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-acb7c876-699b-4ce3-9e80-1f08cdda5469 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:09.791090 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-acb7c876-699b-4ce3-9e80-1f08cdda5469 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:09.797554 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-acb7c876-699b-4ce3-9e80-1f08cdda5469 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:09.798037 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-acb7c876-699b-4ce3-9e80-1f08cdda5469 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:09.798474 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-acb7c876-699b-4ce3-9e80-1f08cdda5469 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:09.799167 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-acb7c876-699b-4ce3-9e80-1f08cdda5469 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:09.799647 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-acb7c876-699b-4ce3-9e80-1f08cdda5469 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:09.800070 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-acb7c876-699b-4ce3-9e80-1f08cdda5469 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:09.829041 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-acb7c876-699b-4ce3-9e80-1f08cdda5469 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043984 Aug 10 12:57:09.829590 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 996/1976] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:57:09 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:57:10.841421 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b357a8a2-5268-46ad-acda-73ec7da86f63 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:10.843628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b357a8a2-5268-46ad-acda-73ec7da86f63 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:10.850121 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b357a8a2-5268-46ad-acda-73ec7da86f63 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:10.850612 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b357a8a2-5268-46ad-acda-73ec7da86f63 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:10.851052 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b357a8a2-5268-46ad-acda-73ec7da86f63 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:10.851786 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b357a8a2-5268-46ad-acda-73ec7da86f63 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:10.852240 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b357a8a2-5268-46ad-acda-73ec7da86f63 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:10.852666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b357a8a2-5268-46ad-acda-73ec7da86f63 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:10.883643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b357a8a2-5268-46ad-acda-73ec7da86f63 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046314 Aug 10 12:57:10.884402 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 981/1977] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:57:10 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:57:11.896822 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0838a122-7cc3-4325-a399-d38631843708 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:11.898638 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0838a122-7cc3-4325-a399-d38631843708 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:11.905239 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0838a122-7cc3-4325-a399-d38631843708 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:11.905725 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0838a122-7cc3-4325-a399-d38631843708 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:11.906164 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0838a122-7cc3-4325-a399-d38631843708 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:11.906874 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0838a122-7cc3-4325-a399-d38631843708 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:11.907379 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0838a122-7cc3-4325-a399-d38631843708 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:11.907806 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0838a122-7cc3-4325-a399-d38631843708 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:11.936951 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0838a122-7cc3-4325-a399-d38631843708 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044623 Aug 10 12:57:11.937512 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 997/1978] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:57:11 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:57:12.950362 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-01b53c8b-1b3d-4edf-aa25-f0092e1af940 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:12.952531 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-01b53c8b-1b3d-4edf-aa25-f0092e1af940 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:12.958871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01b53c8b-1b3d-4edf-aa25-f0092e1af940 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:12.959373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01b53c8b-1b3d-4edf-aa25-f0092e1af940 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:12.959806 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01b53c8b-1b3d-4edf-aa25-f0092e1af940 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:12.960492 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01b53c8b-1b3d-4edf-aa25-f0092e1af940 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:12.960967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01b53c8b-1b3d-4edf-aa25-f0092e1af940 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:12.961384 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01b53c8b-1b3d-4edf-aa25-f0092e1af940 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:12.990373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-01b53c8b-1b3d-4edf-aa25-f0092e1af940 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045213 Aug 10 12:57:12.990911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 982/1979] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:57:12 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:57:14.014277 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-cb2aca3e-ce0c-4ffa-b5de-dc19a1b4e6c2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:14.016600 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-cb2aca3e-ce0c-4ffa-b5de-dc19a1b4e6c2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:14.023223 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cb2aca3e-ce0c-4ffa-b5de-dc19a1b4e6c2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:14.023704 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cb2aca3e-ce0c-4ffa-b5de-dc19a1b4e6c2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:14.024131 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cb2aca3e-ce0c-4ffa-b5de-dc19a1b4e6c2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:14.024814 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cb2aca3e-ce0c-4ffa-b5de-dc19a1b4e6c2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:14.025257 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cb2aca3e-ce0c-4ffa-b5de-dc19a1b4e6c2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:14.025672 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cb2aca3e-ce0c-4ffa-b5de-dc19a1b4e6c2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:14.054302 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-cb2aca3e-ce0c-4ffa-b5de-dc19a1b4e6c2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044777 Aug 10 12:57:14.054844 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 998/1980] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 12:57:14 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 12:57:15.068013 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3c176807-a501-403f-866c-fa698cc78886 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 12:57:15.070152 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3c176807-a501-403f-866c-fa698cc78886 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:15.076852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c176807-a501-403f-866c-fa698cc78886 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:15.077331 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c176807-a501-403f-866c-fa698cc78886 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:15.077764 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c176807-a501-403f-866c-fa698cc78886 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:15.078486 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c176807-a501-403f-866c-fa698cc78886 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:15.078934 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c176807-a501-403f-866c-fa698cc78886 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:15.079394 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c176807-a501-403f-866c-fa698cc78886 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:15.164563 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3c176807-a501-403f-866c-fa698cc78886 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "POST /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/action" status: 200 len: 75968 microversion: 2.1 time: 0.100281 Aug 10 12:57:15.165217 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 983/1981] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 10 12:57:15 2022] POST /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25/action => generated 75968 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 12:57:16.935660 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-24d1156f-59f7-4b2e-beb0-79dfaeb6c421 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:16.936198 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-24d1156f-59f7-4b2e-beb0-79dfaeb6c421 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:16.942722 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24d1156f-59f7-4b2e-beb0-79dfaeb6c421 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:16.943231 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24d1156f-59f7-4b2e-beb0-79dfaeb6c421 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:16.943666 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24d1156f-59f7-4b2e-beb0-79dfaeb6c421 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:16.944355 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24d1156f-59f7-4b2e-beb0-79dfaeb6c421 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:16.944805 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24d1156f-59f7-4b2e-beb0-79dfaeb6c421 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:16.945224 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24d1156f-59f7-4b2e-beb0-79dfaeb6c421 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:16.971553 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-24d1156f-59f7-4b2e-beb0-79dfaeb6c421 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Going to try to terminate instance {{(pid=124642) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:57:17.189374 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-24d1156f-59f7-4b2e-beb0-79dfaeb6c421 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 204 len: 0 microversion: 2.1 time: 0.257351 Aug 10 12:57:17.190208 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 999/1982] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 12:57:16 2022] DELETE /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 12:57:17.204305 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-853eab55-5d0f-4f4d-b2cf-9cc681286788 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:17.204997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-853eab55-5d0f-4f4d-b2cf-9cc681286788 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:17.212033 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-853eab55-5d0f-4f4d-b2cf-9cc681286788 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:17.212798 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-853eab55-5d0f-4f4d-b2cf-9cc681286788 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:17.212902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-853eab55-5d0f-4f4d-b2cf-9cc681286788 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:17.213575 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-853eab55-5d0f-4f4d-b2cf-9cc681286788 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:17.214022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-853eab55-5d0f-4f4d-b2cf-9cc681286788 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:17.214438 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-853eab55-5d0f-4f4d-b2cf-9cc681286788 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:17.401941 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-853eab55-5d0f-4f4d-b2cf-9cc681286788 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:17.410659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-853eab55-5d0f-4f4d-b2cf-9cc681286788 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.211932 Aug 10 12:57:17.411241 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 984/1983] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:17 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:18.432245 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b1d6429d-c9ce-4e3d-90d1-4f02fcb7c379 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:18.432979 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b1d6429d-c9ce-4e3d-90d1-4f02fcb7c379 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:18.439369 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1d6429d-c9ce-4e3d-90d1-4f02fcb7c379 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:18.439849 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1d6429d-c9ce-4e3d-90d1-4f02fcb7c379 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:18.440282 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1d6429d-c9ce-4e3d-90d1-4f02fcb7c379 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:18.440967 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1d6429d-c9ce-4e3d-90d1-4f02fcb7c379 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:18.441415 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1d6429d-c9ce-4e3d-90d1-4f02fcb7c379 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:18.441833 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1d6429d-c9ce-4e3d-90d1-4f02fcb7c379 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:18.619848 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b1d6429d-c9ce-4e3d-90d1-4f02fcb7c379 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:18.628432 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b1d6429d-c9ce-4e3d-90d1-4f02fcb7c379 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.200372 Aug 10 12:57:18.629006 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1000/1984] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:18 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:19.649877 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4888ad73-a73d-4387-9e20-42cc3e2be951 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:19.650487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4888ad73-a73d-4387-9e20-42cc3e2be951 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:19.657770 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4888ad73-a73d-4387-9e20-42cc3e2be951 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:19.658256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4888ad73-a73d-4387-9e20-42cc3e2be951 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:19.658684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4888ad73-a73d-4387-9e20-42cc3e2be951 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:19.659412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4888ad73-a73d-4387-9e20-42cc3e2be951 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:19.659849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4888ad73-a73d-4387-9e20-42cc3e2be951 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:19.660268 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4888ad73-a73d-4387-9e20-42cc3e2be951 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:19.788513 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4888ad73-a73d-4387-9e20-42cc3e2be951 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:19.796486 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4888ad73-a73d-4387-9e20-42cc3e2be951 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.150547 Aug 10 12:57:19.797049 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 985/1985] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:19 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:20.818088 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4279ac5a-220d-416f-a003-508d9f610f38 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:20.818635 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4279ac5a-220d-416f-a003-508d9f610f38 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:20.825176 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4279ac5a-220d-416f-a003-508d9f610f38 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:20.825647 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4279ac5a-220d-416f-a003-508d9f610f38 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:20.826079 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4279ac5a-220d-416f-a003-508d9f610f38 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:20.826766 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4279ac5a-220d-416f-a003-508d9f610f38 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:20.827236 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4279ac5a-220d-416f-a003-508d9f610f38 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:20.827660 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4279ac5a-220d-416f-a003-508d9f610f38 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:20.958512 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4279ac5a-220d-416f-a003-508d9f610f38 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:20.967336 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4279ac5a-220d-416f-a003-508d9f610f38 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.153107 Aug 10 12:57:20.967908 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1001/1986] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:20 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:21.989384 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ab833eda-a639-4f6a-9f22-0d4291db1d6e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:21.989992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ab833eda-a639-4f6a-9f22-0d4291db1d6e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:21.996829 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ab833eda-a639-4f6a-9f22-0d4291db1d6e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:21.997324 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ab833eda-a639-4f6a-9f22-0d4291db1d6e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:21.997755 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ab833eda-a639-4f6a-9f22-0d4291db1d6e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:21.998433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ab833eda-a639-4f6a-9f22-0d4291db1d6e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:21.999022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ab833eda-a639-4f6a-9f22-0d4291db1d6e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:21.999480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ab833eda-a639-4f6a-9f22-0d4291db1d6e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:22.125944 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ab833eda-a639-4f6a-9f22-0d4291db1d6e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:22.133787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ab833eda-a639-4f6a-9f22-0d4291db1d6e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.148225 Aug 10 12:57:22.134335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 986/1987] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:21 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:23.157083 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-faabf9a3-488e-4d58-823e-23dd2914462a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:23.157687 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-faabf9a3-488e-4d58-823e-23dd2914462a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:23.164158 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-faabf9a3-488e-4d58-823e-23dd2914462a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:23.164633 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-faabf9a3-488e-4d58-823e-23dd2914462a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:23.165063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-faabf9a3-488e-4d58-823e-23dd2914462a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:23.165754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-faabf9a3-488e-4d58-823e-23dd2914462a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:23.166192 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-faabf9a3-488e-4d58-823e-23dd2914462a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:23.166613 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-faabf9a3-488e-4d58-823e-23dd2914462a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:23.297237 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-faabf9a3-488e-4d58-823e-23dd2914462a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:23.305203 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-faabf9a3-488e-4d58-823e-23dd2914462a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.152758 Aug 10 12:57:23.305768 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1002/1988] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:23 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:24.325888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5e9515ee-9e65-4c6d-8425-abecad54bdd5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:24.326521 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5e9515ee-9e65-4c6d-8425-abecad54bdd5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:24.332915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e9515ee-9e65-4c6d-8425-abecad54bdd5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:24.333395 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e9515ee-9e65-4c6d-8425-abecad54bdd5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:24.333828 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e9515ee-9e65-4c6d-8425-abecad54bdd5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:24.334515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e9515ee-9e65-4c6d-8425-abecad54bdd5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:24.334960 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e9515ee-9e65-4c6d-8425-abecad54bdd5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:24.335402 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e9515ee-9e65-4c6d-8425-abecad54bdd5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:24.465843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5e9515ee-9e65-4c6d-8425-abecad54bdd5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:24.473826 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5e9515ee-9e65-4c6d-8425-abecad54bdd5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.151841 Aug 10 12:57:24.474376 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 987/1989] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:24 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:25.495677 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-68aa4e29-9e1f-4c94-90e9-a4dfa960247a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:25.496820 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-68aa4e29-9e1f-4c94-90e9-a4dfa960247a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:25.503141 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-68aa4e29-9e1f-4c94-90e9-a4dfa960247a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:25.503647 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-68aa4e29-9e1f-4c94-90e9-a4dfa960247a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:25.504079 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-68aa4e29-9e1f-4c94-90e9-a4dfa960247a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:25.504765 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-68aa4e29-9e1f-4c94-90e9-a4dfa960247a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:25.505232 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-68aa4e29-9e1f-4c94-90e9-a4dfa960247a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:25.505654 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-68aa4e29-9e1f-4c94-90e9-a4dfa960247a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:25.639406 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-68aa4e29-9e1f-4c94-90e9-a4dfa960247a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:25.647267 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-68aa4e29-9e1f-4c94-90e9-a4dfa960247a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.155416 Aug 10 12:57:25.647833 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1003/1990] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:25 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:26.670084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-670f53fa-f703-4f3e-a021-3d9f2efb2eb0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:26.670712 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-670f53fa-f703-4f3e-a021-3d9f2efb2eb0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:26.673122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=28 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:57:26.678186 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-670f53fa-f703-4f3e-a021-3d9f2efb2eb0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:26.678713 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-670f53fa-f703-4f3e-a021-3d9f2efb2eb0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:26.684701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-670f53fa-f703-4f3e-a021-3d9f2efb2eb0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:26.684701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-670f53fa-f703-4f3e-a021-3d9f2efb2eb0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:26.684701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-670f53fa-f703-4f3e-a021-3d9f2efb2eb0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:26.684701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-670f53fa-f703-4f3e-a021-3d9f2efb2eb0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:26.811204 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-670f53fa-f703-4f3e-a021-3d9f2efb2eb0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:26.818936 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-670f53fa-f703-4f3e-a021-3d9f2efb2eb0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.153845 Aug 10 12:57:26.819525 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 988/1991] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:26 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:27.840053 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4b8ed922-6b11-4f98-8f8b-5f18f647998c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:27.841225 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4b8ed922-6b11-4f98-8f8b-5f18f647998c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:27.847275 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b8ed922-6b11-4f98-8f8b-5f18f647998c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:27.847911 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b8ed922-6b11-4f98-8f8b-5f18f647998c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:27.848355 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b8ed922-6b11-4f98-8f8b-5f18f647998c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:27.849044 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b8ed922-6b11-4f98-8f8b-5f18f647998c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:27.849501 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b8ed922-6b11-4f98-8f8b-5f18f647998c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:27.849932 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b8ed922-6b11-4f98-8f8b-5f18f647998c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:27.992272 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4b8ed922-6b11-4f98-8f8b-5f18f647998c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:28.000362 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4b8ed922-6b11-4f98-8f8b-5f18f647998c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.164431 Aug 10 12:57:28.000927 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1004/1992] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:27 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:29.021658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-53365fcf-35c0-4619-8763-b6ef1a92f68c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:29.022265 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-53365fcf-35c0-4619-8763-b6ef1a92f68c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:29.028992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53365fcf-35c0-4619-8763-b6ef1a92f68c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:29.029468 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53365fcf-35c0-4619-8763-b6ef1a92f68c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:29.029898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53365fcf-35c0-4619-8763-b6ef1a92f68c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:29.030576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53365fcf-35c0-4619-8763-b6ef1a92f68c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:29.031021 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53365fcf-35c0-4619-8763-b6ef1a92f68c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:29.031476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53365fcf-35c0-4619-8763-b6ef1a92f68c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:29.158733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-53365fcf-35c0-4619-8763-b6ef1a92f68c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:29.166626 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-53365fcf-35c0-4619-8763-b6ef1a92f68c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.148776 Aug 10 12:57:29.167212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 989/1993] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:29 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:30.187197 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-09679f9c-4982-4042-b96b-114e18e11ac6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:30.187801 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-09679f9c-4982-4042-b96b-114e18e11ac6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:30.194073 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09679f9c-4982-4042-b96b-114e18e11ac6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:30.194544 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09679f9c-4982-4042-b96b-114e18e11ac6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:30.194976 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09679f9c-4982-4042-b96b-114e18e11ac6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:30.195679 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09679f9c-4982-4042-b96b-114e18e11ac6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:30.196126 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09679f9c-4982-4042-b96b-114e18e11ac6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:30.196541 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09679f9c-4982-4042-b96b-114e18e11ac6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:30.325861 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-09679f9c-4982-4042-b96b-114e18e11ac6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:30.334415 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-09679f9c-4982-4042-b96b-114e18e11ac6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.151467 Aug 10 12:57:30.334996 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1005/1994] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:30 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:31.357664 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4c87ae0a-67ad-40a1-93a0-57d59ea8a3e8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:31.358200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4c87ae0a-67ad-40a1-93a0-57d59ea8a3e8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:31.364665 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4c87ae0a-67ad-40a1-93a0-57d59ea8a3e8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:31.365141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4c87ae0a-67ad-40a1-93a0-57d59ea8a3e8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:31.365571 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4c87ae0a-67ad-40a1-93a0-57d59ea8a3e8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:31.366255 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4c87ae0a-67ad-40a1-93a0-57d59ea8a3e8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:31.366702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4c87ae0a-67ad-40a1-93a0-57d59ea8a3e8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:31.367120 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4c87ae0a-67ad-40a1-93a0-57d59ea8a3e8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:31.369684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=88 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:57:31.498120 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4c87ae0a-67ad-40a1-93a0-57d59ea8a3e8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:31.505963 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4c87ae0a-67ad-40a1-93a0-57d59ea8a3e8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.153205 Aug 10 12:57:31.506525 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 990/1995] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:31 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:32.527015 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8a8b99ed-6bda-4c82-bd7c-4f7f10fd746e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:32.527661 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8a8b99ed-6bda-4c82-bd7c-4f7f10fd746e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:32.534154 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a8b99ed-6bda-4c82-bd7c-4f7f10fd746e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:32.534633 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a8b99ed-6bda-4c82-bd7c-4f7f10fd746e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:32.535069 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a8b99ed-6bda-4c82-bd7c-4f7f10fd746e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:32.535797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a8b99ed-6bda-4c82-bd7c-4f7f10fd746e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:32.536252 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a8b99ed-6bda-4c82-bd7c-4f7f10fd746e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:32.536680 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a8b99ed-6bda-4c82-bd7c-4f7f10fd746e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:32.540649 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:57:32.667544 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-8a8b99ed-6bda-4c82-bd7c-4f7f10fd746e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:32.675357 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8a8b99ed-6bda-4c82-bd7c-4f7f10fd746e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.152198 Aug 10 12:57:32.675926 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1006/1996] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:32 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:33.696220 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-51944f4c-854e-4ba5-8896-953d59701bb3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:33.696830 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-51944f4c-854e-4ba5-8896-953d59701bb3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:33.703224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-51944f4c-854e-4ba5-8896-953d59701bb3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:33.703707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-51944f4c-854e-4ba5-8896-953d59701bb3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:33.704135 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-51944f4c-854e-4ba5-8896-953d59701bb3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:33.704820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-51944f4c-854e-4ba5-8896-953d59701bb3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:33.705272 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-51944f4c-854e-4ba5-8896-953d59701bb3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:33.705701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-51944f4c-854e-4ba5-8896-953d59701bb3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:33.833716 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-51944f4c-854e-4ba5-8896-953d59701bb3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:33.842013 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-51944f4c-854e-4ba5-8896-953d59701bb3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.149732 Aug 10 12:57:33.842567 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 991/1997] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:33 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:34.862870 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d75a3a2b-8377-464f-b4df-bfdd2ee647d2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:34.863509 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d75a3a2b-8377-464f-b4df-bfdd2ee647d2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:34.865883 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:57:34.870532 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d75a3a2b-8377-464f-b4df-bfdd2ee647d2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:34.871008 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d75a3a2b-8377-464f-b4df-bfdd2ee647d2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:34.871466 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d75a3a2b-8377-464f-b4df-bfdd2ee647d2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:34.872163 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d75a3a2b-8377-464f-b4df-bfdd2ee647d2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:34.872613 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d75a3a2b-8377-464f-b4df-bfdd2ee647d2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:34.873031 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d75a3a2b-8377-464f-b4df-bfdd2ee647d2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:35.002549 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d75a3a2b-8377-464f-b4df-bfdd2ee647d2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:35.010549 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d75a3a2b-8377-464f-b4df-bfdd2ee647d2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.151528 Aug 10 12:57:35.011119 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1007/1998] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:34 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:36.032647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-90b9ad88-1a88-4770-a502-b475377de227 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:36.033876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-90b9ad88-1a88-4770-a502-b475377de227 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:36.040589 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90b9ad88-1a88-4770-a502-b475377de227 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:36.041070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90b9ad88-1a88-4770-a502-b475377de227 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:36.041501 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90b9ad88-1a88-4770-a502-b475377de227 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:36.042195 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90b9ad88-1a88-4770-a502-b475377de227 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:36.042640 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90b9ad88-1a88-4770-a502-b475377de227 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:36.043059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90b9ad88-1a88-4770-a502-b475377de227 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:36.170565 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-90b9ad88-1a88-4770-a502-b475377de227 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:36.178625 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-90b9ad88-1a88-4770-a502-b475377de227 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.150194 Aug 10 12:57:36.179197 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 992/1999] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:36 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:36.192618 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6c050e91-afec-4ad8-9c31-13abdc76bf59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:36.193113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6c050e91-afec-4ad8-9c31-13abdc76bf59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:36.199429 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6c050e91-afec-4ad8-9c31-13abdc76bf59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:36.199912 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6c050e91-afec-4ad8-9c31-13abdc76bf59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:36.200508 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6c050e91-afec-4ad8-9c31-13abdc76bf59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:36.201376 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6c050e91-afec-4ad8-9c31-13abdc76bf59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:36.201833 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6c050e91-afec-4ad8-9c31-13abdc76bf59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:36.202261 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6c050e91-afec-4ad8-9c31-13abdc76bf59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:36.228725 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6c050e91-afec-4ad8-9c31-13abdc76bf59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Going to try to terminate instance {{(pid=124642) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:57:36.514499 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6c050e91-afec-4ad8-9c31-13abdc76bf59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "DELETE /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 204 len: 0 microversion: 2.20 time: 0.325427 Aug 10 12:57:36.515091 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1008/2000] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 10 12:57:36 2022] DELETE /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 12:57:36.523276 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9a180e1a-660b-4ef4-b76a-43b958d0258a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:36.523888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9a180e1a-660b-4ef4-b76a-43b958d0258a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:36.530870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a180e1a-660b-4ef4-b76a-43b958d0258a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:36.531387 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a180e1a-660b-4ef4-b76a-43b958d0258a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:36.531838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a180e1a-660b-4ef4-b76a-43b958d0258a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:36.532546 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a180e1a-660b-4ef4-b76a-43b958d0258a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:36.532990 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a180e1a-660b-4ef4-b76a-43b958d0258a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:36.533405 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a180e1a-660b-4ef4-b76a-43b958d0258a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:36.668535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9a180e1a-660b-4ef4-b76a-43b958d0258a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:36.677189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9a180e1a-660b-4ef4-b76a-43b958d0258a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:36.678720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9a180e1a-660b-4ef4-b76a-43b958d0258a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:36.679915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9a180e1a-660b-4ef4-b76a-43b958d0258a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.160594 Aug 10 12:57:36.680474 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 993/2001] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:57:36 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:57:37.200669 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a75b5908-ee80-4e80-8900-432abd8b02a7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:37.201368 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a75b5908-ee80-4e80-8900-432abd8b02a7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:37.207672 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a75b5908-ee80-4e80-8900-432abd8b02a7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:37.208148 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a75b5908-ee80-4e80-8900-432abd8b02a7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:37.208580 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a75b5908-ee80-4e80-8900-432abd8b02a7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:37.209263 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a75b5908-ee80-4e80-8900-432abd8b02a7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:37.209712 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a75b5908-ee80-4e80-8900-432abd8b02a7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:37.210130 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a75b5908-ee80-4e80-8900-432abd8b02a7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:37.338410 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a75b5908-ee80-4e80-8900-432abd8b02a7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:37.346945 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a75b5908-ee80-4e80-8900-432abd8b02a7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.150575 Aug 10 12:57:37.347554 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1009/2002] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:37 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:37.704489 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5fb38e18-ee6b-4147-9909-04718e2a90c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:37.705030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5fb38e18-ee6b-4147-9909-04718e2a90c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:37.711326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5fb38e18-ee6b-4147-9909-04718e2a90c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:37.711799 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5fb38e18-ee6b-4147-9909-04718e2a90c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:37.712254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5fb38e18-ee6b-4147-9909-04718e2a90c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:37.712932 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5fb38e18-ee6b-4147-9909-04718e2a90c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:37.713374 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5fb38e18-ee6b-4147-9909-04718e2a90c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:37.713791 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5fb38e18-ee6b-4147-9909-04718e2a90c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:37.844466 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5fb38e18-ee6b-4147-9909-04718e2a90c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:37.852699 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5fb38e18-ee6b-4147-9909-04718e2a90c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:37.854458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5fb38e18-ee6b-4147-9909-04718e2a90c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:37.855635 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5fb38e18-ee6b-4147-9909-04718e2a90c2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.155805 Aug 10 12:57:37.856183 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 994/2003] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:57:37 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:57:38.372972 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-98af052e-db55-4da9-8004-b1ebf5c607b3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:38.373586 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-98af052e-db55-4da9-8004-b1ebf5c607b3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:38.379975 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-98af052e-db55-4da9-8004-b1ebf5c607b3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:38.380454 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-98af052e-db55-4da9-8004-b1ebf5c607b3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:38.380886 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-98af052e-db55-4da9-8004-b1ebf5c607b3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:38.381575 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-98af052e-db55-4da9-8004-b1ebf5c607b3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:38.382023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-98af052e-db55-4da9-8004-b1ebf5c607b3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:38.382449 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-98af052e-db55-4da9-8004-b1ebf5c607b3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:38.515910 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-98af052e-db55-4da9-8004-b1ebf5c607b3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:38.523994 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-98af052e-db55-4da9-8004-b1ebf5c607b3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.158187 Aug 10 12:57:38.524556 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1010/2004] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:38 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:38.879449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b4bfabe5-274c-4bfb-a646-394118adb28b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:38.880053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b4bfabe5-274c-4bfb-a646-394118adb28b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:38.886336 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4bfabe5-274c-4bfb-a646-394118adb28b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:38.886812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4bfabe5-274c-4bfb-a646-394118adb28b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:38.887269 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4bfabe5-274c-4bfb-a646-394118adb28b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:38.888595 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4bfabe5-274c-4bfb-a646-394118adb28b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:38.889049 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4bfabe5-274c-4bfb-a646-394118adb28b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:38.889471 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4bfabe5-274c-4bfb-a646-394118adb28b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:39.023373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b4bfabe5-274c-4bfb-a646-394118adb28b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:39.032131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b4bfabe5-274c-4bfb-a646-394118adb28b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:39.033646 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b4bfabe5-274c-4bfb-a646-394118adb28b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:39.034789 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b4bfabe5-274c-4bfb-a646-394118adb28b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.159442 Aug 10 12:57:39.035379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 995/2005] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:57:38 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:57:39.546251 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f1f4dedd-e424-43c6-9c8f-91dcb8a28037 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:39.546931 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f1f4dedd-e424-43c6-9c8f-91dcb8a28037 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:39.553064 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f1f4dedd-e424-43c6-9c8f-91dcb8a28037 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:39.553682 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f1f4dedd-e424-43c6-9c8f-91dcb8a28037 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:39.554117 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f1f4dedd-e424-43c6-9c8f-91dcb8a28037 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:39.554944 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f1f4dedd-e424-43c6-9c8f-91dcb8a28037 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:39.555422 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f1f4dedd-e424-43c6-9c8f-91dcb8a28037 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:39.555936 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f1f4dedd-e424-43c6-9c8f-91dcb8a28037 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:39.689688 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f1f4dedd-e424-43c6-9c8f-91dcb8a28037 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:39.697582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f1f4dedd-e424-43c6-9c8f-91dcb8a28037 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.155829 Aug 10 12:57:39.698177 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1011/2006] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:39 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:40.057905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ca54b4aa-02dc-4c66-8e51-3f698fc542a9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:40.058505 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ca54b4aa-02dc-4c66-8e51-3f698fc542a9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:40.065719 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ca54b4aa-02dc-4c66-8e51-3f698fc542a9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:40.066191 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ca54b4aa-02dc-4c66-8e51-3f698fc542a9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:40.066615 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ca54b4aa-02dc-4c66-8e51-3f698fc542a9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:40.067328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ca54b4aa-02dc-4c66-8e51-3f698fc542a9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:40.067772 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ca54b4aa-02dc-4c66-8e51-3f698fc542a9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:40.068189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ca54b4aa-02dc-4c66-8e51-3f698fc542a9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:40.194088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ca54b4aa-02dc-4c66-8e51-3f698fc542a9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:40.202681 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ca54b4aa-02dc-4c66-8e51-3f698fc542a9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:40.204197 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ca54b4aa-02dc-4c66-8e51-3f698fc542a9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:40.205332 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ca54b4aa-02dc-4c66-8e51-3f698fc542a9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.151310 Aug 10 12:57:40.205878 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 996/2007] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:57:40 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:57:40.720596 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-72386fde-040d-4115-92b2-ee79eddb196e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:40.721208 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-72386fde-040d-4115-92b2-ee79eddb196e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:40.727601 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72386fde-040d-4115-92b2-ee79eddb196e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:40.728087 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72386fde-040d-4115-92b2-ee79eddb196e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:40.728785 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72386fde-040d-4115-92b2-ee79eddb196e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:40.729471 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72386fde-040d-4115-92b2-ee79eddb196e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:40.729920 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72386fde-040d-4115-92b2-ee79eddb196e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:40.730344 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72386fde-040d-4115-92b2-ee79eddb196e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:40.862511 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-72386fde-040d-4115-92b2-ee79eddb196e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:40.870380 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-72386fde-040d-4115-92b2-ee79eddb196e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.154395 Aug 10 12:57:40.870954 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1012/2008] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:40 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:41.229193 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-84ab5ec2-74b3-4802-bdc7-79ae30160aff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:41.229871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-84ab5ec2-74b3-4802-bdc7-79ae30160aff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:41.236021 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84ab5ec2-74b3-4802-bdc7-79ae30160aff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:41.236493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84ab5ec2-74b3-4802-bdc7-79ae30160aff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:41.236924 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84ab5ec2-74b3-4802-bdc7-79ae30160aff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:41.237600 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84ab5ec2-74b3-4802-bdc7-79ae30160aff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:41.238048 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84ab5ec2-74b3-4802-bdc7-79ae30160aff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:41.238464 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84ab5ec2-74b3-4802-bdc7-79ae30160aff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:41.430345 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-84ab5ec2-74b3-4802-bdc7-79ae30160aff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:41.439023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-84ab5ec2-74b3-4802-bdc7-79ae30160aff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:41.440659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-84ab5ec2-74b3-4802-bdc7-79ae30160aff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:41.441809 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-84ab5ec2-74b3-4802-bdc7-79ae30160aff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.216806 Aug 10 12:57:41.442360 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 997/2009] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:57:41 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:57:41.892295 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-72ab9025-cb58-4d42-8457-8d068664dcdd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:41.892900 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-72ab9025-cb58-4d42-8457-8d068664dcdd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:41.899332 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72ab9025-cb58-4d42-8457-8d068664dcdd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:41.899802 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72ab9025-cb58-4d42-8457-8d068664dcdd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:41.900224 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72ab9025-cb58-4d42-8457-8d068664dcdd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:41.900900 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72ab9025-cb58-4d42-8457-8d068664dcdd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:41.901343 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72ab9025-cb58-4d42-8457-8d068664dcdd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:41.901759 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72ab9025-cb58-4d42-8457-8d068664dcdd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:42.032194 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-72ab9025-cb58-4d42-8457-8d068664dcdd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:42.039987 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-72ab9025-cb58-4d42-8457-8d068664dcdd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.152122 Aug 10 12:57:42.040561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1013/2010] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:41 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:42.465454 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-34b39245-c0b5-4a57-a20f-345fa788ceb0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:42.466893 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-34b39245-c0b5-4a57-a20f-345fa788ceb0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:42.473253 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34b39245-c0b5-4a57-a20f-345fa788ceb0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:42.473732 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34b39245-c0b5-4a57-a20f-345fa788ceb0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:42.474165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34b39245-c0b5-4a57-a20f-345fa788ceb0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:42.474847 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34b39245-c0b5-4a57-a20f-345fa788ceb0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:42.475327 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34b39245-c0b5-4a57-a20f-345fa788ceb0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:42.475752 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34b39245-c0b5-4a57-a20f-345fa788ceb0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:42.600171 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-34b39245-c0b5-4a57-a20f-345fa788ceb0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:42.609139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-34b39245-c0b5-4a57-a20f-345fa788ceb0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:42.610691 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-34b39245-c0b5-4a57-a20f-345fa788ceb0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:42.611890 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-34b39245-c0b5-4a57-a20f-345fa788ceb0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.150286 Aug 10 12:57:42.612811 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 998/2011] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:57:42 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:57:43.061640 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2a687d04-e480-4a34-a434-bd5f75504088 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:43.062248 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2a687d04-e480-4a34-a434-bd5f75504088 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:43.068595 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a687d04-e480-4a34-a434-bd5f75504088 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:43.069093 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a687d04-e480-4a34-a434-bd5f75504088 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:43.069521 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a687d04-e480-4a34-a434-bd5f75504088 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:43.070203 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a687d04-e480-4a34-a434-bd5f75504088 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:43.070656 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a687d04-e480-4a34-a434-bd5f75504088 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:43.071075 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a687d04-e480-4a34-a434-bd5f75504088 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:43.203730 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2a687d04-e480-4a34-a434-bd5f75504088 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:43.211629 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2a687d04-e480-4a34-a434-bd5f75504088 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.154474 Aug 10 12:57:43.212174 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1014/2012] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:43 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:43.636127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-60a8ab84-d24c-4d3b-9695-3a04e94f59d6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:43.636675 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-60a8ab84-d24c-4d3b-9695-3a04e94f59d6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:43.643488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60a8ab84-d24c-4d3b-9695-3a04e94f59d6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:43.643967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60a8ab84-d24c-4d3b-9695-3a04e94f59d6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:43.644398 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60a8ab84-d24c-4d3b-9695-3a04e94f59d6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:43.645084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60a8ab84-d24c-4d3b-9695-3a04e94f59d6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:43.645528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60a8ab84-d24c-4d3b-9695-3a04e94f59d6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:43.645947 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60a8ab84-d24c-4d3b-9695-3a04e94f59d6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:43.772834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-60a8ab84-d24c-4d3b-9695-3a04e94f59d6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:43.782130 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-60a8ab84-d24c-4d3b-9695-3a04e94f59d6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:43.783682 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-60a8ab84-d24c-4d3b-9695-3a04e94f59d6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:43.784833 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-60a8ab84-d24c-4d3b-9695-3a04e94f59d6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.152730 Aug 10 12:57:43.785411 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 999/2013] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:57:43 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:57:44.234880 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-cc1f42f3-fb3c-421f-815a-9fb6a0b1421e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:44.235432 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-cc1f42f3-fb3c-421f-815a-9fb6a0b1421e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:44.241747 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc1f42f3-fb3c-421f-815a-9fb6a0b1421e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:44.242227 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc1f42f3-fb3c-421f-815a-9fb6a0b1421e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:44.242660 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc1f42f3-fb3c-421f-815a-9fb6a0b1421e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:44.243384 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc1f42f3-fb3c-421f-815a-9fb6a0b1421e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:44.243835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc1f42f3-fb3c-421f-815a-9fb6a0b1421e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:44.244259 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cc1f42f3-fb3c-421f-815a-9fb6a0b1421e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:44.373398 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-cc1f42f3-fb3c-421f-815a-9fb6a0b1421e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:44.381509 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-cc1f42f3-fb3c-421f-815a-9fb6a0b1421e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.151176 Aug 10 12:57:44.382085 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1015/2014] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:44 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:44.807369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-aa51a436-8ab4-4c6e-afbd-c629aa68b4e2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:44.807976 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-aa51a436-8ab4-4c6e-afbd-c629aa68b4e2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:44.814796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa51a436-8ab4-4c6e-afbd-c629aa68b4e2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:44.815313 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa51a436-8ab4-4c6e-afbd-c629aa68b4e2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:44.815750 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa51a436-8ab4-4c6e-afbd-c629aa68b4e2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:44.816450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa51a436-8ab4-4c6e-afbd-c629aa68b4e2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:44.816901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa51a436-8ab4-4c6e-afbd-c629aa68b4e2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:44.817328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa51a436-8ab4-4c6e-afbd-c629aa68b4e2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:44.953434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-aa51a436-8ab4-4c6e-afbd-c629aa68b4e2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:44.961607 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-aa51a436-8ab4-4c6e-afbd-c629aa68b4e2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:44.963101 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-aa51a436-8ab4-4c6e-afbd-c629aa68b4e2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:44.964258 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-aa51a436-8ab4-4c6e-afbd-c629aa68b4e2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.160821 Aug 10 12:57:44.964804 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1000/2015] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:57:44 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:57:45.402787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d1e99522-fc7f-44d6-909b-9389a3272027 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:45.403515 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d1e99522-fc7f-44d6-909b-9389a3272027 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:45.410090 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1e99522-fc7f-44d6-909b-9389a3272027 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:45.413824 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1e99522-fc7f-44d6-909b-9389a3272027 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:45.413824 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1e99522-fc7f-44d6-909b-9389a3272027 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:45.413824 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1e99522-fc7f-44d6-909b-9389a3272027 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:45.413824 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1e99522-fc7f-44d6-909b-9389a3272027 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:45.414228 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1e99522-fc7f-44d6-909b-9389a3272027 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:45.541112 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d1e99522-fc7f-44d6-909b-9389a3272027 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:45.549831 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d1e99522-fc7f-44d6-909b-9389a3272027 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.150902 Aug 10 12:57:45.550409 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1016/2016] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:45 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:45.987929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d4d3e752-15c9-4c04-acca-2fef4ae259a7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:45.988540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d4d3e752-15c9-4c04-acca-2fef4ae259a7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:45.994870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d4d3e752-15c9-4c04-acca-2fef4ae259a7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:45.995389 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d4d3e752-15c9-4c04-acca-2fef4ae259a7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:45.995825 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d4d3e752-15c9-4c04-acca-2fef4ae259a7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:45.996508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d4d3e752-15c9-4c04-acca-2fef4ae259a7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:45.996963 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d4d3e752-15c9-4c04-acca-2fef4ae259a7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:45.997388 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d4d3e752-15c9-4c04-acca-2fef4ae259a7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:46.125613 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d4d3e752-15c9-4c04-acca-2fef4ae259a7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:46.134007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d4d3e752-15c9-4c04-acca-2fef4ae259a7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:46.135531 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d4d3e752-15c9-4c04-acca-2fef4ae259a7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:46.136686 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d4d3e752-15c9-4c04-acca-2fef4ae259a7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.152633 Aug 10 12:57:46.137242 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1001/2017] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:57:45 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:57:46.571057 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-efaee41c-ef3d-42c7-ad0c-f381c198e01d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:46.571715 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-efaee41c-ef3d-42c7-ad0c-f381c198e01d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:46.578928 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-efaee41c-ef3d-42c7-ad0c-f381c198e01d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:46.579456 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-efaee41c-ef3d-42c7-ad0c-f381c198e01d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:46.579893 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-efaee41c-ef3d-42c7-ad0c-f381c198e01d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:46.580588 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-efaee41c-ef3d-42c7-ad0c-f381c198e01d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:46.581038 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-efaee41c-ef3d-42c7-ad0c-f381c198e01d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:46.581559 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-efaee41c-ef3d-42c7-ad0c-f381c198e01d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:46.712261 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-efaee41c-ef3d-42c7-ad0c-f381c198e01d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:46.718628 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-efaee41c-ef3d-42c7-ad0c-f381c198e01d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.151425 Aug 10 12:57:46.719223 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1017/2018] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:46 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:47.160147 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-25b9afd9-c1bc-44e7-8db7-1d9b3239b1be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:47.160670 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-25b9afd9-c1bc-44e7-8db7-1d9b3239b1be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:47.167025 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25b9afd9-c1bc-44e7-8db7-1d9b3239b1be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:47.167549 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25b9afd9-c1bc-44e7-8db7-1d9b3239b1be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:47.167984 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25b9afd9-c1bc-44e7-8db7-1d9b3239b1be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:47.168727 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25b9afd9-c1bc-44e7-8db7-1d9b3239b1be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:47.169267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25b9afd9-c1bc-44e7-8db7-1d9b3239b1be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:47.169694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25b9afd9-c1bc-44e7-8db7-1d9b3239b1be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:47.302644 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-25b9afd9-c1bc-44e7-8db7-1d9b3239b1be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:47.311577 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-25b9afd9-c1bc-44e7-8db7-1d9b3239b1be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:47.313052 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-25b9afd9-c1bc-44e7-8db7-1d9b3239b1be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:47.314187 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-25b9afd9-c1bc-44e7-8db7-1d9b3239b1be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.158086 Aug 10 12:57:47.314743 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1002/2019] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:57:47 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:57:47.740561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a398a419-0d3b-4918-ac65-3d2f79f861bd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:47.741171 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a398a419-0d3b-4918-ac65-3d2f79f861bd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:47.747459 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a398a419-0d3b-4918-ac65-3d2f79f861bd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:47.748105 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a398a419-0d3b-4918-ac65-3d2f79f861bd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:47.748532 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a398a419-0d3b-4918-ac65-3d2f79f861bd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:47.749217 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a398a419-0d3b-4918-ac65-3d2f79f861bd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:47.749660 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a398a419-0d3b-4918-ac65-3d2f79f861bd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:47.750075 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a398a419-0d3b-4918-ac65-3d2f79f861bd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:47.877722 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a398a419-0d3b-4918-ac65-3d2f79f861bd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:47.885582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a398a419-0d3b-4918-ac65-3d2f79f861bd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.148899 Aug 10 12:57:47.886148 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1018/2020] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:47 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:48.337586 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4f265a28-88d3-4cc0-9fc6-91d507b9190a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:48.338190 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4f265a28-88d3-4cc0-9fc6-91d507b9190a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:48.344500 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f265a28-88d3-4cc0-9fc6-91d507b9190a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:48.344972 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f265a28-88d3-4cc0-9fc6-91d507b9190a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:48.345396 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f265a28-88d3-4cc0-9fc6-91d507b9190a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:48.346069 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f265a28-88d3-4cc0-9fc6-91d507b9190a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:48.346513 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f265a28-88d3-4cc0-9fc6-91d507b9190a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:48.346926 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f265a28-88d3-4cc0-9fc6-91d507b9190a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:48.475435 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4f265a28-88d3-4cc0-9fc6-91d507b9190a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:48.484831 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4f265a28-88d3-4cc0-9fc6-91d507b9190a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:48.486345 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4f265a28-88d3-4cc0-9fc6-91d507b9190a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:48.487510 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4f265a28-88d3-4cc0-9fc6-91d507b9190a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.153770 Aug 10 12:57:48.488060 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1003/2021] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:57:48 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:57:48.907502 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-25d296c6-e35a-410e-b788-de815ad58412 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:48.908117 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-25d296c6-e35a-410e-b788-de815ad58412 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:48.914557 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-25d296c6-e35a-410e-b788-de815ad58412 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:48.915058 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-25d296c6-e35a-410e-b788-de815ad58412 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:48.915500 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-25d296c6-e35a-410e-b788-de815ad58412 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:48.916188 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-25d296c6-e35a-410e-b788-de815ad58412 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:48.916686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-25d296c6-e35a-410e-b788-de815ad58412 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:48.917061 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-25d296c6-e35a-410e-b788-de815ad58412 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:49.043375 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-25d296c6-e35a-410e-b788-de815ad58412 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:49.052318 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-25d296c6-e35a-410e-b788-de815ad58412 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.149257 Aug 10 12:57:49.053084 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1019/2022] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:48 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:49.511330 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-61c0efa9-0ba9-4659-bfee-5fc257770dc2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:49.511935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-61c0efa9-0ba9-4659-bfee-5fc257770dc2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:49.519373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61c0efa9-0ba9-4659-bfee-5fc257770dc2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:49.519850 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61c0efa9-0ba9-4659-bfee-5fc257770dc2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:49.520277 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61c0efa9-0ba9-4659-bfee-5fc257770dc2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:49.520954 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61c0efa9-0ba9-4659-bfee-5fc257770dc2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:49.521398 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61c0efa9-0ba9-4659-bfee-5fc257770dc2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:49.521814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-61c0efa9-0ba9-4659-bfee-5fc257770dc2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:49.648463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-61c0efa9-0ba9-4659-bfee-5fc257770dc2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:49.657559 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-61c0efa9-0ba9-4659-bfee-5fc257770dc2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:49.661249 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-61c0efa9-0ba9-4659-bfee-5fc257770dc2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:49.661249 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-61c0efa9-0ba9-4659-bfee-5fc257770dc2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.152886 Aug 10 12:57:49.661249 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1004/2023] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:57:49 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:57:50.073949 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4de840b6-6e99-49a5-bec9-247f5a43ba76 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:50.074649 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4de840b6-6e99-49a5-bec9-247f5a43ba76 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:50.081741 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4de840b6-6e99-49a5-bec9-247f5a43ba76 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:50.082229 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4de840b6-6e99-49a5-bec9-247f5a43ba76 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:50.082664 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4de840b6-6e99-49a5-bec9-247f5a43ba76 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:50.083396 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4de840b6-6e99-49a5-bec9-247f5a43ba76 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:50.083850 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4de840b6-6e99-49a5-bec9-247f5a43ba76 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:50.084278 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4de840b6-6e99-49a5-bec9-247f5a43ba76 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:50.217125 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4de840b6-6e99-49a5-bec9-247f5a43ba76 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:50.225091 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4de840b6-6e99-49a5-bec9-247f5a43ba76 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.155039 Aug 10 12:57:50.225600 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1020/2024] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:50 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:50.683489 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f5596e21-1a2e-43a6-abe7-9bd933a4b857 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:50.684101 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f5596e21-1a2e-43a6-abe7-9bd933a4b857 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:50.690561 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f5596e21-1a2e-43a6-abe7-9bd933a4b857 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:50.691039 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f5596e21-1a2e-43a6-abe7-9bd933a4b857 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:50.691517 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f5596e21-1a2e-43a6-abe7-9bd933a4b857 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:50.692206 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f5596e21-1a2e-43a6-abe7-9bd933a4b857 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:50.692660 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f5596e21-1a2e-43a6-abe7-9bd933a4b857 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:50.693087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f5596e21-1a2e-43a6-abe7-9bd933a4b857 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:50.821586 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f5596e21-1a2e-43a6-abe7-9bd933a4b857 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:50.830824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f5596e21-1a2e-43a6-abe7-9bd933a4b857 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:50.832369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f5596e21-1a2e-43a6-abe7-9bd933a4b857 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:50.833524 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f5596e21-1a2e-43a6-abe7-9bd933a4b857 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.154123 Aug 10 12:57:50.834083 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1005/2025] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:57:50 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:57:51.246256 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4485a973-c121-4b2a-920e-d939bfe77ef0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:51.246867 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4485a973-c121-4b2a-920e-d939bfe77ef0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:51.253241 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4485a973-c121-4b2a-920e-d939bfe77ef0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:51.253720 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4485a973-c121-4b2a-920e-d939bfe77ef0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:51.254152 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4485a973-c121-4b2a-920e-d939bfe77ef0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:51.254833 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4485a973-c121-4b2a-920e-d939bfe77ef0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:51.255380 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4485a973-c121-4b2a-920e-d939bfe77ef0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:51.255827 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4485a973-c121-4b2a-920e-d939bfe77ef0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:51.258486 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:57:51.387588 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4485a973-c121-4b2a-920e-d939bfe77ef0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:51.395869 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4485a973-c121-4b2a-920e-d939bfe77ef0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.153472 Aug 10 12:57:51.396440 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1021/2026] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:51 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:51.856583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-128f23f2-ee44-4fd6-ab5d-948e81eef2b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:51.858402 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-128f23f2-ee44-4fd6-ab5d-948e81eef2b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:51.864749 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-128f23f2-ee44-4fd6-ab5d-948e81eef2b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:51.865227 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-128f23f2-ee44-4fd6-ab5d-948e81eef2b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:51.865659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-128f23f2-ee44-4fd6-ab5d-948e81eef2b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:51.866339 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-128f23f2-ee44-4fd6-ab5d-948e81eef2b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:51.866785 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-128f23f2-ee44-4fd6-ab5d-948e81eef2b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:51.867224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-128f23f2-ee44-4fd6-ab5d-948e81eef2b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:51.995251 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-128f23f2-ee44-4fd6-ab5d-948e81eef2b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:51.997408 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:57:52.004161 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-128f23f2-ee44-4fd6-ab5d-948e81eef2b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:52.005657 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-128f23f2-ee44-4fd6-ab5d-948e81eef2b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:52.006808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-128f23f2-ee44-4fd6-ab5d-948e81eef2b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.154405 Aug 10 12:57:52.007401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1006/2027] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:57:51 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:57:52.416704 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-71a38eb3-3018-407b-91d9-3e6ae7435c4c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:52.417317 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-71a38eb3-3018-407b-91d9-3e6ae7435c4c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:52.423876 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-71a38eb3-3018-407b-91d9-3e6ae7435c4c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:52.424353 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-71a38eb3-3018-407b-91d9-3e6ae7435c4c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:52.424787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-71a38eb3-3018-407b-91d9-3e6ae7435c4c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:52.425470 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-71a38eb3-3018-407b-91d9-3e6ae7435c4c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:52.425922 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-71a38eb3-3018-407b-91d9-3e6ae7435c4c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:52.426340 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-71a38eb3-3018-407b-91d9-3e6ae7435c4c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:52.553159 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-71a38eb3-3018-407b-91d9-3e6ae7435c4c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:52.561646 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-71a38eb3-3018-407b-91d9-3e6ae7435c4c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.148778 Aug 10 12:57:52.562222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1022/2028] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:52 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:53.032551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b880c63a-c948-41aa-8af6-6ef262aa9214 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:53.033212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b880c63a-c948-41aa-8af6-6ef262aa9214 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:53.039730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b880c63a-c948-41aa-8af6-6ef262aa9214 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:53.040209 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b880c63a-c948-41aa-8af6-6ef262aa9214 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:53.040640 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b880c63a-c948-41aa-8af6-6ef262aa9214 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:53.041326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b880c63a-c948-41aa-8af6-6ef262aa9214 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:53.041778 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b880c63a-c948-41aa-8af6-6ef262aa9214 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:53.042198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b880c63a-c948-41aa-8af6-6ef262aa9214 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:53.172225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b880c63a-c948-41aa-8af6-6ef262aa9214 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:53.180409 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b880c63a-c948-41aa-8af6-6ef262aa9214 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:53.181903 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b880c63a-c948-41aa-8af6-6ef262aa9214 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:53.183050 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b880c63a-c948-41aa-8af6-6ef262aa9214 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.154878 Aug 10 12:57:53.183633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1007/2029] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:57:53 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:57:53.582571 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5945cce1-2647-4b4e-907e-126ed5b99b3b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:53.583205 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5945cce1-2647-4b4e-907e-126ed5b99b3b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:53.589525 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5945cce1-2647-4b4e-907e-126ed5b99b3b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:53.590009 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5945cce1-2647-4b4e-907e-126ed5b99b3b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:53.590438 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5945cce1-2647-4b4e-907e-126ed5b99b3b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:53.591121 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5945cce1-2647-4b4e-907e-126ed5b99b3b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:53.592329 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5945cce1-2647-4b4e-907e-126ed5b99b3b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:53.592814 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5945cce1-2647-4b4e-907e-126ed5b99b3b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:53.721750 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5945cce1-2647-4b4e-907e-126ed5b99b3b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:53.729979 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5945cce1-2647-4b4e-907e-126ed5b99b3b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.151220 Aug 10 12:57:53.730546 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1023/2030] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:53 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:54.206995 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-cd0758a7-f3a7-45cd-81aa-f64ddd3d031d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:54.207563 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-cd0758a7-f3a7-45cd-81aa-f64ddd3d031d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:54.213972 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd0758a7-f3a7-45cd-81aa-f64ddd3d031d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:54.214451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd0758a7-f3a7-45cd-81aa-f64ddd3d031d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:54.214884 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd0758a7-f3a7-45cd-81aa-f64ddd3d031d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:54.215632 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd0758a7-f3a7-45cd-81aa-f64ddd3d031d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:54.216082 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd0758a7-f3a7-45cd-81aa-f64ddd3d031d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:54.216537 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd0758a7-f3a7-45cd-81aa-f64ddd3d031d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:54.348198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-cd0758a7-f3a7-45cd-81aa-f64ddd3d031d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:54.374297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-cd0758a7-f3a7-45cd-81aa-f64ddd3d031d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:54.374297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-cd0758a7-f3a7-45cd-81aa-f64ddd3d031d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:54.374297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-cd0758a7-f3a7-45cd-81aa-f64ddd3d031d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.156826 Aug 10 12:57:54.374688 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1008/2031] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:57:54 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:57:54.752179 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a4a0299f-59cf-46c4-beaa-f9dafe29c245 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:54.752795 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a4a0299f-59cf-46c4-beaa-f9dafe29c245 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:54.759105 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a4a0299f-59cf-46c4-beaa-f9dafe29c245 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:54.759617 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a4a0299f-59cf-46c4-beaa-f9dafe29c245 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:54.760048 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a4a0299f-59cf-46c4-beaa-f9dafe29c245 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:54.760729 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a4a0299f-59cf-46c4-beaa-f9dafe29c245 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:54.761181 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a4a0299f-59cf-46c4-beaa-f9dafe29c245 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:54.761601 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a4a0299f-59cf-46c4-beaa-f9dafe29c245 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:54.888272 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a4a0299f-59cf-46c4-beaa-f9dafe29c245 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:54.896428 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a4a0299f-59cf-46c4-beaa-f9dafe29c245 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.148822 Aug 10 12:57:54.896997 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1024/2032] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:54 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:55.383639 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-043d7ad4-4f73-4094-ac9a-0764f5e01f2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:55.385767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-043d7ad4-4f73-4094-ac9a-0764f5e01f2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:55.392963 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-043d7ad4-4f73-4094-ac9a-0764f5e01f2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:55.393443 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-043d7ad4-4f73-4094-ac9a-0764f5e01f2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:55.393876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-043d7ad4-4f73-4094-ac9a-0764f5e01f2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:55.394568 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-043d7ad4-4f73-4094-ac9a-0764f5e01f2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:55.395019 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-043d7ad4-4f73-4094-ac9a-0764f5e01f2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:55.395685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-043d7ad4-4f73-4094-ac9a-0764f5e01f2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:55.530699 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-043d7ad4-4f73-4094-ac9a-0764f5e01f2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:55.539169 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-043d7ad4-4f73-4094-ac9a-0764f5e01f2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:55.540636 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-043d7ad4-4f73-4094-ac9a-0764f5e01f2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:55.541788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-043d7ad4-4f73-4094-ac9a-0764f5e01f2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.162434 Aug 10 12:57:55.542345 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1009/2033] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:57:55 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:57:55.917793 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a51c154a-f448-473c-8d67-c3920ad8f770 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:55.918401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a51c154a-f448-473c-8d67-c3920ad8f770 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:55.925120 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a51c154a-f448-473c-8d67-c3920ad8f770 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:55.925619 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a51c154a-f448-473c-8d67-c3920ad8f770 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:55.926048 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a51c154a-f448-473c-8d67-c3920ad8f770 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:55.926730 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a51c154a-f448-473c-8d67-c3920ad8f770 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:55.927194 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a51c154a-f448-473c-8d67-c3920ad8f770 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:55.927626 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a51c154a-f448-473c-8d67-c3920ad8f770 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:56.277794 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a51c154a-f448-473c-8d67-c3920ad8f770 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:56.286076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a51c154a-f448-473c-8d67-c3920ad8f770 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.372053 Aug 10 12:57:56.286655 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1025/2034] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:55 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:56.565575 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2dc00e11-2085-4969-81d7-9f36a79fc3b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:56.566219 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2dc00e11-2085-4969-81d7-9f36a79fc3b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:56.572562 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2dc00e11-2085-4969-81d7-9f36a79fc3b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:56.573033 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2dc00e11-2085-4969-81d7-9f36a79fc3b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:56.573463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2dc00e11-2085-4969-81d7-9f36a79fc3b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:56.574137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2dc00e11-2085-4969-81d7-9f36a79fc3b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:56.574580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2dc00e11-2085-4969-81d7-9f36a79fc3b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:56.574999 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2dc00e11-2085-4969-81d7-9f36a79fc3b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:56.703852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2dc00e11-2085-4969-81d7-9f36a79fc3b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:56.712246 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2dc00e11-2085-4969-81d7-9f36a79fc3b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:56.713740 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2dc00e11-2085-4969-81d7-9f36a79fc3b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:56.714886 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2dc00e11-2085-4969-81d7-9f36a79fc3b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.153204 Aug 10 12:57:56.715482 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1010/2035] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:57:56 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:57:57.308608 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3d77ee5f-90d3-411d-a36e-96d4efc00ef7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:57.309259 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3d77ee5f-90d3-411d-a36e-96d4efc00ef7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:57.315802 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d77ee5f-90d3-411d-a36e-96d4efc00ef7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:57.316283 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d77ee5f-90d3-411d-a36e-96d4efc00ef7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:57.316718 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d77ee5f-90d3-411d-a36e-96d4efc00ef7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:57.317408 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d77ee5f-90d3-411d-a36e-96d4efc00ef7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:57.317862 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d77ee5f-90d3-411d-a36e-96d4efc00ef7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:57.318287 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d77ee5f-90d3-411d-a36e-96d4efc00ef7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:57.445480 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3d77ee5f-90d3-411d-a36e-96d4efc00ef7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:57.454451 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3d77ee5f-90d3-411d-a36e-96d4efc00ef7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.149914 Aug 10 12:57:57.455030 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1026/2036] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:57 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:57.738915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4d6b029f-7597-48bc-94b8-e2d58272cf9e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:57.739491 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4d6b029f-7597-48bc-94b8-e2d58272cf9e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:57.741699 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=46 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:57:57.746247 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d6b029f-7597-48bc-94b8-e2d58272cf9e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:57.746718 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d6b029f-7597-48bc-94b8-e2d58272cf9e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:57.747144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d6b029f-7597-48bc-94b8-e2d58272cf9e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:57.748938 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d6b029f-7597-48bc-94b8-e2d58272cf9e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:57.749398 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d6b029f-7597-48bc-94b8-e2d58272cf9e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:57.749819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d6b029f-7597-48bc-94b8-e2d58272cf9e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:57.876013 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4d6b029f-7597-48bc-94b8-e2d58272cf9e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:57.884264 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4d6b029f-7597-48bc-94b8-e2d58272cf9e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:57.885751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4d6b029f-7597-48bc-94b8-e2d58272cf9e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:57.886905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4d6b029f-7597-48bc-94b8-e2d58272cf9e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.151932 Aug 10 12:57:57.887499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1011/2037] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:57:57 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:57:58.475441 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4d87fc86-53a0-4ab6-a1db-630b152716f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:58.475982 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4d87fc86-53a0-4ab6-a1db-630b152716f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:58.483401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d87fc86-53a0-4ab6-a1db-630b152716f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:58.483879 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d87fc86-53a0-4ab6-a1db-630b152716f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:58.484302 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d87fc86-53a0-4ab6-a1db-630b152716f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:58.485083 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d87fc86-53a0-4ab6-a1db-630b152716f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:58.485528 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d87fc86-53a0-4ab6-a1db-630b152716f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:58.485941 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d87fc86-53a0-4ab6-a1db-630b152716f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:58.627080 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4d87fc86-53a0-4ab6-a1db-630b152716f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:58.634989 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4d87fc86-53a0-4ab6-a1db-630b152716f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.163493 Aug 10 12:57:58.635582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1027/2038] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:58 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:57:58.910693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3ba29fda-741e-4428-a588-75e35889f07b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:58.911330 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3ba29fda-741e-4428-a588-75e35889f07b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:58.917752 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ba29fda-741e-4428-a588-75e35889f07b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:58.918233 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ba29fda-741e-4428-a588-75e35889f07b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:58.918663 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ba29fda-741e-4428-a588-75e35889f07b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:58.919386 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ba29fda-741e-4428-a588-75e35889f07b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:58.920475 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ba29fda-741e-4428-a588-75e35889f07b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:58.920903 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ba29fda-741e-4428-a588-75e35889f07b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:59.047445 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3ba29fda-741e-4428-a588-75e35889f07b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:59.055759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3ba29fda-741e-4428-a588-75e35889f07b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:59.057247 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3ba29fda-741e-4428-a588-75e35889f07b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:59.058381 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3ba29fda-741e-4428-a588-75e35889f07b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.151583 Aug 10 12:57:59.058930 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1012/2039] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:57:58 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:57:59.656199 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1d4b53db-67ca-4184-aa46-ea85be2aef47 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:57:59.656795 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1d4b53db-67ca-4184-aa46-ea85be2aef47 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:57:59.664448 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d4b53db-67ca-4184-aa46-ea85be2aef47 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:59.664924 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d4b53db-67ca-4184-aa46-ea85be2aef47 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:59.665351 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d4b53db-67ca-4184-aa46-ea85be2aef47 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:59.666041 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d4b53db-67ca-4184-aa46-ea85be2aef47 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:57:59.666634 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d4b53db-67ca-4184-aa46-ea85be2aef47 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:57:59.666885 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1d4b53db-67ca-4184-aa46-ea85be2aef47 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:57:59.796580 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-1d4b53db-67ca-4184-aa46-ea85be2aef47 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:57:59.804465 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1d4b53db-67ca-4184-aa46-ea85be2aef47 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.152207 Aug 10 12:57:59.805028 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1028/2040] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:57:59 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:00.081609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e1fccbe7-f0e0-4a61-b8ec-d7069fa29389 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:00.082211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e1fccbe7-f0e0-4a61-b8ec-d7069fa29389 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:00.088603 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e1fccbe7-f0e0-4a61-b8ec-d7069fa29389 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:00.089081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e1fccbe7-f0e0-4a61-b8ec-d7069fa29389 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:00.089510 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e1fccbe7-f0e0-4a61-b8ec-d7069fa29389 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:00.090197 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e1fccbe7-f0e0-4a61-b8ec-d7069fa29389 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:00.090647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e1fccbe7-f0e0-4a61-b8ec-d7069fa29389 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:00.091067 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e1fccbe7-f0e0-4a61-b8ec-d7069fa29389 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:00.220333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e1fccbe7-f0e0-4a61-b8ec-d7069fa29389 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:00.229010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e1fccbe7-f0e0-4a61-b8ec-d7069fa29389 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:00.230473 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e1fccbe7-f0e0-4a61-b8ec-d7069fa29389 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:00.231649 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e1fccbe7-f0e0-4a61-b8ec-d7069fa29389 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.153981 Aug 10 12:58:00.232874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1013/2041] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:00 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:00.825539 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-742983f0-2079-4f94-81ec-2b43317e6564 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:00.826580 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-742983f0-2079-4f94-81ec-2b43317e6564 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:00.832950 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-742983f0-2079-4f94-81ec-2b43317e6564 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:00.833434 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-742983f0-2079-4f94-81ec-2b43317e6564 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:00.833859 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-742983f0-2079-4f94-81ec-2b43317e6564 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:00.834544 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-742983f0-2079-4f94-81ec-2b43317e6564 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:00.835007 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-742983f0-2079-4f94-81ec-2b43317e6564 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:00.835455 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-742983f0-2079-4f94-81ec-2b43317e6564 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:00.964572 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-742983f0-2079-4f94-81ec-2b43317e6564 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:00.972543 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-742983f0-2079-4f94-81ec-2b43317e6564 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.150965 Aug 10 12:58:00.973104 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1029/2042] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:00 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:01.255290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8c3a0ac4-f083-49a6-a192-153eb648e4c4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:01.255899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8c3a0ac4-f083-49a6-a192-153eb648e4c4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:01.265698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c3a0ac4-f083-49a6-a192-153eb648e4c4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:01.266174 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c3a0ac4-f083-49a6-a192-153eb648e4c4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:01.266713 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c3a0ac4-f083-49a6-a192-153eb648e4c4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:01.267355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c3a0ac4-f083-49a6-a192-153eb648e4c4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:01.267795 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c3a0ac4-f083-49a6-a192-153eb648e4c4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:01.268209 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c3a0ac4-f083-49a6-a192-153eb648e4c4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:01.430415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8c3a0ac4-f083-49a6-a192-153eb648e4c4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:01.430415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8c3a0ac4-f083-49a6-a192-153eb648e4c4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:01.431000 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8c3a0ac4-f083-49a6-a192-153eb648e4c4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:01.431000 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8c3a0ac4-f083-49a6-a192-153eb648e4c4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.179763 Aug 10 12:58:01.431579 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1014/2043] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:01 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:01.993960 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-32c7097a-2d98-48db-8357-2133b578c3fa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:01.994574 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-32c7097a-2d98-48db-8357-2133b578c3fa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:02.002681 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-32c7097a-2d98-48db-8357-2133b578c3fa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:02.003168 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-32c7097a-2d98-48db-8357-2133b578c3fa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:02.003950 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-32c7097a-2d98-48db-8357-2133b578c3fa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:02.004937 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-32c7097a-2d98-48db-8357-2133b578c3fa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:02.005398 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-32c7097a-2d98-48db-8357-2133b578c3fa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:02.005827 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-32c7097a-2d98-48db-8357-2133b578c3fa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:02.142320 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-32c7097a-2d98-48db-8357-2133b578c3fa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:02.150238 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-32c7097a-2d98-48db-8357-2133b578c3fa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.160147 Aug 10 12:58:02.150836 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1030/2044] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:01 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:02.456112 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-184edfa1-12d1-48d1-97b3-b238fd1a5a4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:02.456674 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-184edfa1-12d1-48d1-97b3-b238fd1a5a4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:02.463526 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-184edfa1-12d1-48d1-97b3-b238fd1a5a4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:02.464018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-184edfa1-12d1-48d1-97b3-b238fd1a5a4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:02.464455 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-184edfa1-12d1-48d1-97b3-b238fd1a5a4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:02.465356 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-184edfa1-12d1-48d1-97b3-b238fd1a5a4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:02.465807 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-184edfa1-12d1-48d1-97b3-b238fd1a5a4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:02.467737 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-184edfa1-12d1-48d1-97b3-b238fd1a5a4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:02.606597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-184edfa1-12d1-48d1-97b3-b238fd1a5a4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:02.614963 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-184edfa1-12d1-48d1-97b3-b238fd1a5a4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:02.616486 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-184edfa1-12d1-48d1-97b3-b238fd1a5a4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:02.617630 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-184edfa1-12d1-48d1-97b3-b238fd1a5a4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.165406 Aug 10 12:58:02.618181 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1015/2045] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:02 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:03.172180 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2a7b63f8-562d-4bc2-9986-4c14a2a7b992 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:03.312341 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2a7b63f8-562d-4bc2-9986-4c14a2a7b992 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:03.312341 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a7b63f8-562d-4bc2-9986-4c14a2a7b992 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:03.312341 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a7b63f8-562d-4bc2-9986-4c14a2a7b992 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:03.312341 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a7b63f8-562d-4bc2-9986-4c14a2a7b992 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:03.313997 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a7b63f8-562d-4bc2-9986-4c14a2a7b992 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:03.313997 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a7b63f8-562d-4bc2-9986-4c14a2a7b992 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:03.313997 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2a7b63f8-562d-4bc2-9986-4c14a2a7b992 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:03.326153 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2a7b63f8-562d-4bc2-9986-4c14a2a7b992 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:03.334076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2a7b63f8-562d-4bc2-9986-4c14a2a7b992 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.166034 Aug 10 12:58:03.334645 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1031/2046] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:03 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:03.642443 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-99ce8131-a014-4b0b-8058-948421a95832 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:03.643076 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-99ce8131-a014-4b0b-8058-948421a95832 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:03.649532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99ce8131-a014-4b0b-8058-948421a95832 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:03.650012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99ce8131-a014-4b0b-8058-948421a95832 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:03.650442 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99ce8131-a014-4b0b-8058-948421a95832 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:03.651131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99ce8131-a014-4b0b-8058-948421a95832 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:03.651604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99ce8131-a014-4b0b-8058-948421a95832 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:03.652028 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99ce8131-a014-4b0b-8058-948421a95832 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:03.778210 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-99ce8131-a014-4b0b-8058-948421a95832 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:03.787056 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-99ce8131-a014-4b0b-8058-948421a95832 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:03.788624 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-99ce8131-a014-4b0b-8058-948421a95832 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:03.789773 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-99ce8131-a014-4b0b-8058-948421a95832 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.152075 Aug 10 12:58:03.790323 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1016/2047] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:03 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:04.355921 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b1ecc623-3b2f-47bc-9cf1-a2e042871413 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:04.356535 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b1ecc623-3b2f-47bc-9cf1-a2e042871413 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:04.363554 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1ecc623-3b2f-47bc-9cf1-a2e042871413 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:04.371607 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1ecc623-3b2f-47bc-9cf1-a2e042871413 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:04.371607 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1ecc623-3b2f-47bc-9cf1-a2e042871413 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:04.371607 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1ecc623-3b2f-47bc-9cf1-a2e042871413 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:04.371607 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1ecc623-3b2f-47bc-9cf1-a2e042871413 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:04.372015 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1ecc623-3b2f-47bc-9cf1-a2e042871413 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:04.495682 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b1ecc623-3b2f-47bc-9cf1-a2e042871413 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:04.504155 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b1ecc623-3b2f-47bc-9cf1-a2e042871413 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.152380 Aug 10 12:58:04.504725 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1032/2048] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:04 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:04.812162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0ff4a8c1-f7e3-4480-b050-f6cbe9794c3d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:04.812720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0ff4a8c1-f7e3-4480-b050-f6cbe9794c3d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:04.819057 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ff4a8c1-f7e3-4480-b050-f6cbe9794c3d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:04.819574 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ff4a8c1-f7e3-4480-b050-f6cbe9794c3d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:04.820012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ff4a8c1-f7e3-4480-b050-f6cbe9794c3d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:04.820704 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ff4a8c1-f7e3-4480-b050-f6cbe9794c3d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:04.821157 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ff4a8c1-f7e3-4480-b050-f6cbe9794c3d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:04.821582 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ff4a8c1-f7e3-4480-b050-f6cbe9794c3d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:04.956959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0ff4a8c1-f7e3-4480-b050-f6cbe9794c3d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:04.965390 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0ff4a8c1-f7e3-4480-b050-f6cbe9794c3d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:04.967483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0ff4a8c1-f7e3-4480-b050-f6cbe9794c3d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:04.968692 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0ff4a8c1-f7e3-4480-b050-f6cbe9794c3d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.160604 Aug 10 12:58:04.969243 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1017/2049] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:04 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:05.525272 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-58187aae-0f9c-4d43-b5fc-957e9fe73ac1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:05.525882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-58187aae-0f9c-4d43-b5fc-957e9fe73ac1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:05.528194 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:58:05.533259 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-58187aae-0f9c-4d43-b5fc-957e9fe73ac1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:05.533757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-58187aae-0f9c-4d43-b5fc-957e9fe73ac1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:05.534166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-58187aae-0f9c-4d43-b5fc-957e9fe73ac1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:05.534840 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-58187aae-0f9c-4d43-b5fc-957e9fe73ac1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:05.535321 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-58187aae-0f9c-4d43-b5fc-957e9fe73ac1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:05.540841 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-58187aae-0f9c-4d43-b5fc-957e9fe73ac1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:05.674201 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-58187aae-0f9c-4d43-b5fc-957e9fe73ac1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:05.682260 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-58187aae-0f9c-4d43-b5fc-957e9fe73ac1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.160665 Aug 10 12:58:05.682831 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1033/2050] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:05 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:05.993659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4ad1bfb2-687b-4412-b11e-dcd11a934540 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:05.994268 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4ad1bfb2-687b-4412-b11e-dcd11a934540 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:06.000685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ad1bfb2-687b-4412-b11e-dcd11a934540 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:06.001173 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ad1bfb2-687b-4412-b11e-dcd11a934540 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:06.001601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ad1bfb2-687b-4412-b11e-dcd11a934540 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:06.002296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ad1bfb2-687b-4412-b11e-dcd11a934540 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:06.002743 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ad1bfb2-687b-4412-b11e-dcd11a934540 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:06.003163 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ad1bfb2-687b-4412-b11e-dcd11a934540 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:06.130953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4ad1bfb2-687b-4412-b11e-dcd11a934540 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:06.139881 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4ad1bfb2-687b-4412-b11e-dcd11a934540 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:06.141386 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4ad1bfb2-687b-4412-b11e-dcd11a934540 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:06.142531 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4ad1bfb2-687b-4412-b11e-dcd11a934540 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.152700 Aug 10 12:58:06.143087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1018/2051] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:05 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:06.704303 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bc3f14c3-9ca7-44ac-b9de-22e5e991bcde tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:06.704923 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bc3f14c3-9ca7-44ac-b9de-22e5e991bcde tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:06.711420 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc3f14c3-9ca7-44ac-b9de-22e5e991bcde tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:06.711892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc3f14c3-9ca7-44ac-b9de-22e5e991bcde tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:06.712324 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc3f14c3-9ca7-44ac-b9de-22e5e991bcde tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:06.713010 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc3f14c3-9ca7-44ac-b9de-22e5e991bcde tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:06.713460 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc3f14c3-9ca7-44ac-b9de-22e5e991bcde tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:06.713879 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc3f14c3-9ca7-44ac-b9de-22e5e991bcde tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:06.848191 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-bc3f14c3-9ca7-44ac-b9de-22e5e991bcde tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:06.856271 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bc3f14c3-9ca7-44ac-b9de-22e5e991bcde tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.156458 Aug 10 12:58:06.856833 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1034/2052] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:06 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:07.165214 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6d38d805-d580-4416-9411-cb8b29bd8232 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:07.165735 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6d38d805-d580-4416-9411-cb8b29bd8232 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:07.173285 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6d38d805-d580-4416-9411-cb8b29bd8232 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:07.173758 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6d38d805-d580-4416-9411-cb8b29bd8232 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:07.174186 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6d38d805-d580-4416-9411-cb8b29bd8232 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:07.174866 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6d38d805-d580-4416-9411-cb8b29bd8232 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:07.175343 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6d38d805-d580-4416-9411-cb8b29bd8232 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:07.175763 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6d38d805-d580-4416-9411-cb8b29bd8232 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:07.309889 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6d38d805-d580-4416-9411-cb8b29bd8232 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:07.318263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6d38d805-d580-4416-9411-cb8b29bd8232 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:07.330380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6d38d805-d580-4416-9411-cb8b29bd8232 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:07.330380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6d38d805-d580-4416-9411-cb8b29bd8232 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.159681 Aug 10 12:58:07.330380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1019/2053] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:07 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:07.878011 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ad5b88bb-1a4c-453d-a49a-fd7ba45724f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:07.878723 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ad5b88bb-1a4c-453d-a49a-fd7ba45724f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:07.885136 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad5b88bb-1a4c-453d-a49a-fd7ba45724f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:07.889914 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad5b88bb-1a4c-453d-a49a-fd7ba45724f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:07.889914 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad5b88bb-1a4c-453d-a49a-fd7ba45724f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:07.889914 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad5b88bb-1a4c-453d-a49a-fd7ba45724f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:07.889914 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad5b88bb-1a4c-453d-a49a-fd7ba45724f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:07.890309 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad5b88bb-1a4c-453d-a49a-fd7ba45724f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:08.017263 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ad5b88bb-1a4c-453d-a49a-fd7ba45724f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:08.025113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ad5b88bb-1a4c-453d-a49a-fd7ba45724f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.151003 Aug 10 12:58:08.025677 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1035/2054] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:07 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:08.352216 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-68b89847-6580-41ed-bd51-1eb594e1f62c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:08.352830 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-68b89847-6580-41ed-bd51-1eb594e1f62c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:08.360105 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68b89847-6580-41ed-bd51-1eb594e1f62c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:08.360580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68b89847-6580-41ed-bd51-1eb594e1f62c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:08.361012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68b89847-6580-41ed-bd51-1eb594e1f62c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:08.361702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68b89847-6580-41ed-bd51-1eb594e1f62c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:08.362154 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68b89847-6580-41ed-bd51-1eb594e1f62c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:08.362577 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68b89847-6580-41ed-bd51-1eb594e1f62c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:08.493759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-68b89847-6580-41ed-bd51-1eb594e1f62c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:08.502413 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-68b89847-6580-41ed-bd51-1eb594e1f62c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:08.504142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-68b89847-6580-41ed-bd51-1eb594e1f62c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:08.505279 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-68b89847-6580-41ed-bd51-1eb594e1f62c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.156993 Aug 10 12:58:08.505838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1020/2055] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:08 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:09.045839 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-64178b62-eff7-4e35-a8b5-9a443aa651df tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:09.046506 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-64178b62-eff7-4e35-a8b5-9a443aa651df tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:09.052887 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-64178b62-eff7-4e35-a8b5-9a443aa651df tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:09.053362 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-64178b62-eff7-4e35-a8b5-9a443aa651df tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:09.053791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-64178b62-eff7-4e35-a8b5-9a443aa651df tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:09.054471 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-64178b62-eff7-4e35-a8b5-9a443aa651df tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:09.054919 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-64178b62-eff7-4e35-a8b5-9a443aa651df tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:09.055370 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-64178b62-eff7-4e35-a8b5-9a443aa651df tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:09.183257 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-64178b62-eff7-4e35-a8b5-9a443aa651df tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:09.191722 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-64178b62-eff7-4e35-a8b5-9a443aa651df tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.149740 Aug 10 12:58:09.192290 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1036/2056] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:09 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:09.528878 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ee1693f0-bd9a-4de3-8eb5-2499610e07b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:09.529789 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ee1693f0-bd9a-4de3-8eb5-2499610e07b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:09.535824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ee1693f0-bd9a-4de3-8eb5-2499610e07b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:09.536295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ee1693f0-bd9a-4de3-8eb5-2499610e07b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:09.536724 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ee1693f0-bd9a-4de3-8eb5-2499610e07b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:09.537407 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ee1693f0-bd9a-4de3-8eb5-2499610e07b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:09.537849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ee1693f0-bd9a-4de3-8eb5-2499610e07b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:09.538264 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ee1693f0-bd9a-4de3-8eb5-2499610e07b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:09.667929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ee1693f0-bd9a-4de3-8eb5-2499610e07b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:09.677150 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ee1693f0-bd9a-4de3-8eb5-2499610e07b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:09.678650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ee1693f0-bd9a-4de3-8eb5-2499610e07b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:09.679834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ee1693f0-bd9a-4de3-8eb5-2499610e07b4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.154922 Aug 10 12:58:09.680415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1021/2057] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:09 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:09.903308 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-dc811379-cd69-4043-afc8-2e7fb5af0e6a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:09.904332 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-dc811379-cd69-4043-afc8-2e7fb5af0e6a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:09.910180 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc811379-cd69-4043-afc8-2e7fb5af0e6a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:09.910661 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc811379-cd69-4043-afc8-2e7fb5af0e6a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:09.911092 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc811379-cd69-4043-afc8-2e7fb5af0e6a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:09.911802 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc811379-cd69-4043-afc8-2e7fb5af0e6a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:09.912252 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc811379-cd69-4043-afc8-2e7fb5af0e6a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:09.912739 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc811379-cd69-4043-afc8-2e7fb5af0e6a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:09.936991 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-dc811379-cd69-4043-afc8-2e7fb5af0e6a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Going to try to terminate instance {{(pid=124642) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:58:09.939611 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:58:10.147828 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-dc811379-cd69-4043-afc8-2e7fb5af0e6a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 204 len: 0 microversion: 2.1 time: 0.248074 Aug 10 12:58:10.148522 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1037/2058] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 12:58:09 2022] DELETE /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 12:58:10.157253 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-334d1a10-6c3a-475e-800b-1c955304d87b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:10.162011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-334d1a10-6c3a-475e-800b-1c955304d87b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:10.164100 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-334d1a10-6c3a-475e-800b-1c955304d87b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:10.164586 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-334d1a10-6c3a-475e-800b-1c955304d87b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:10.165033 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-334d1a10-6c3a-475e-800b-1c955304d87b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:10.165721 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-334d1a10-6c3a-475e-800b-1c955304d87b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:10.166169 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-334d1a10-6c3a-475e-800b-1c955304d87b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:10.166616 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-334d1a10-6c3a-475e-800b-1c955304d87b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:10.215819 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ee81b988-4b6b-4811-9271-13053f5c8f66 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:10.217186 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ee81b988-4b6b-4811-9271-13053f5c8f66 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:10.223653 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee81b988-4b6b-4811-9271-13053f5c8f66 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:10.238319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee81b988-4b6b-4811-9271-13053f5c8f66 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:10.238319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee81b988-4b6b-4811-9271-13053f5c8f66 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:10.238319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee81b988-4b6b-4811-9271-13053f5c8f66 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:10.238319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee81b988-4b6b-4811-9271-13053f5c8f66 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:10.239317 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee81b988-4b6b-4811-9271-13053f5c8f66 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:10.365180 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-334d1a10-6c3a-475e-800b-1c955304d87b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:10.374121 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-334d1a10-6c3a-475e-800b-1c955304d87b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.221216 Aug 10 12:58:10.374696 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1022/2059] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:10 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:10.406643 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ee81b988-4b6b-4811-9271-13053f5c8f66 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:10.408877 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ee81b988-4b6b-4811-9271-13053f5c8f66 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.198693 Aug 10 12:58:10.409453 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1038/2060] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:10 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:10.703822 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-46211377-0d53-4bec-9968-ceba51f4e3c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:10.704372 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-46211377-0d53-4bec-9968-ceba51f4e3c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:10.710696 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-46211377-0d53-4bec-9968-ceba51f4e3c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:10.711191 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-46211377-0d53-4bec-9968-ceba51f4e3c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:10.711749 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-46211377-0d53-4bec-9968-ceba51f4e3c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:10.712434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-46211377-0d53-4bec-9968-ceba51f4e3c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:10.712885 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-46211377-0d53-4bec-9968-ceba51f4e3c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:10.713304 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-46211377-0d53-4bec-9968-ceba51f4e3c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:10.728738 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:58:10.844209 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-46211377-0d53-4bec-9968-ceba51f4e3c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:10.852465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-46211377-0d53-4bec-9968-ceba51f4e3c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:10.854216 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-46211377-0d53-4bec-9968-ceba51f4e3c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:10.855388 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-46211377-0d53-4bec-9968-ceba51f4e3c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.155571 Aug 10 12:58:10.855952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1023/2061] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:10 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:11.395371 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c3077b8f-14ba-48e2-8741-30dc4f066790 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:11.395985 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c3077b8f-14ba-48e2-8741-30dc4f066790 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:11.402795 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3077b8f-14ba-48e2-8741-30dc4f066790 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:11.403408 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3077b8f-14ba-48e2-8741-30dc4f066790 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:11.403873 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3077b8f-14ba-48e2-8741-30dc4f066790 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:11.404562 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3077b8f-14ba-48e2-8741-30dc4f066790 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:11.405076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3077b8f-14ba-48e2-8741-30dc4f066790 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:11.405563 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3077b8f-14ba-48e2-8741-30dc4f066790 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:11.429936 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0986ba9a-06ac-42bd-913f-96cb38be6db0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:11.430554 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0986ba9a-06ac-42bd-913f-96cb38be6db0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:11.436927 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0986ba9a-06ac-42bd-913f-96cb38be6db0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:11.437405 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0986ba9a-06ac-42bd-913f-96cb38be6db0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:11.437844 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0986ba9a-06ac-42bd-913f-96cb38be6db0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:11.438539 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0986ba9a-06ac-42bd-913f-96cb38be6db0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:11.438991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0986ba9a-06ac-42bd-913f-96cb38be6db0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:11.439435 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0986ba9a-06ac-42bd-913f-96cb38be6db0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:11.588431 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c3077b8f-14ba-48e2-8741-30dc4f066790 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:11.596727 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c3077b8f-14ba-48e2-8741-30dc4f066790 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.205153 Aug 10 12:58:11.597297 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1039/2062] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:11 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:11.614556 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0986ba9a-06ac-42bd-913f-96cb38be6db0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:11.623356 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0986ba9a-06ac-42bd-913f-96cb38be6db0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.196645 Aug 10 12:58:11.623971 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1024/2063] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:11 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:11.880655 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-924d63f0-3c33-4516-9db5-9de6478bb945 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:11.881295 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-924d63f0-3c33-4516-9db5-9de6478bb945 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:11.887313 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-924d63f0-3c33-4516-9db5-9de6478bb945 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:11.897075 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-924d63f0-3c33-4516-9db5-9de6478bb945 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:11.897075 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-924d63f0-3c33-4516-9db5-9de6478bb945 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:11.897075 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-924d63f0-3c33-4516-9db5-9de6478bb945 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:11.897075 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-924d63f0-3c33-4516-9db5-9de6478bb945 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:11.897475 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-924d63f0-3c33-4516-9db5-9de6478bb945 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:12.026598 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-924d63f0-3c33-4516-9db5-9de6478bb945 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:12.035663 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-924d63f0-3c33-4516-9db5-9de6478bb945 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:12.037155 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-924d63f0-3c33-4516-9db5-9de6478bb945 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:12.038302 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-924d63f0-3c33-4516-9db5-9de6478bb945 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.162083 Aug 10 12:58:12.038858 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1040/2064] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:11 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:12.617914 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-49646ff2-7b0c-48f6-b2c5-a3cee2b80cc8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:12.618454 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-49646ff2-7b0c-48f6-b2c5-a3cee2b80cc8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:12.625294 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49646ff2-7b0c-48f6-b2c5-a3cee2b80cc8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:12.625772 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49646ff2-7b0c-48f6-b2c5-a3cee2b80cc8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:12.626232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49646ff2-7b0c-48f6-b2c5-a3cee2b80cc8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:12.626921 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49646ff2-7b0c-48f6-b2c5-a3cee2b80cc8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:12.627397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49646ff2-7b0c-48f6-b2c5-a3cee2b80cc8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:12.627822 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49646ff2-7b0c-48f6-b2c5-a3cee2b80cc8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:12.644872 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9173d45f-e3c6-422f-bd8a-ddf2ec567424 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:12.645524 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9173d45f-e3c6-422f-bd8a-ddf2ec567424 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:12.651791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9173d45f-e3c6-422f-bd8a-ddf2ec567424 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:12.652271 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9173d45f-e3c6-422f-bd8a-ddf2ec567424 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:12.652700 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9173d45f-e3c6-422f-bd8a-ddf2ec567424 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:12.653384 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9173d45f-e3c6-422f-bd8a-ddf2ec567424 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:12.653831 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9173d45f-e3c6-422f-bd8a-ddf2ec567424 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:12.654997 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9173d45f-e3c6-422f-bd8a-ddf2ec567424 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:12.823663 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-49646ff2-7b0c-48f6-b2c5-a3cee2b80cc8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:12.830897 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9173d45f-e3c6-422f-bd8a-ddf2ec567424 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:12.832108 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-49646ff2-7b0c-48f6-b2c5-a3cee2b80cc8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.218120 Aug 10 12:58:12.832877 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1025/2065] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:12 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:12.838894 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9173d45f-e3c6-422f-bd8a-ddf2ec567424 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.197833 Aug 10 12:58:12.839477 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1041/2066] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:12 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:13.062741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-05111c5e-2f31-464f-8d0a-aafb341e5e4d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:13.063391 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-05111c5e-2f31-464f-8d0a-aafb341e5e4d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:13.069290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-05111c5e-2f31-464f-8d0a-aafb341e5e4d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:13.069768 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-05111c5e-2f31-464f-8d0a-aafb341e5e4d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:13.070201 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-05111c5e-2f31-464f-8d0a-aafb341e5e4d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:13.070891 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-05111c5e-2f31-464f-8d0a-aafb341e5e4d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:13.071374 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-05111c5e-2f31-464f-8d0a-aafb341e5e4d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:13.071797 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-05111c5e-2f31-464f-8d0a-aafb341e5e4d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:13.201389 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-05111c5e-2f31-464f-8d0a-aafb341e5e4d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:13.209732 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-05111c5e-2f31-464f-8d0a-aafb341e5e4d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:13.211269 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-05111c5e-2f31-464f-8d0a-aafb341e5e4d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:13.212446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-05111c5e-2f31-464f-8d0a-aafb341e5e4d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.154240 Aug 10 12:58:13.213003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1026/2067] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:13 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:13.854167 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-892de82d-97e7-4a62-8805-e3cd4014642d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:13.854797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-892de82d-97e7-4a62-8805-e3cd4014642d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:13.861519 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-232923a6-1d39-4f96-8e5c-5b2e1a64a79f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:13.862131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-232923a6-1d39-4f96-8e5c-5b2e1a64a79f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:13.862351 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-892de82d-97e7-4a62-8805-e3cd4014642d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:13.862828 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-892de82d-97e7-4a62-8805-e3cd4014642d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:13.863286 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-892de82d-97e7-4a62-8805-e3cd4014642d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:13.863975 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-892de82d-97e7-4a62-8805-e3cd4014642d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:13.864420 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-892de82d-97e7-4a62-8805-e3cd4014642d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:13.864837 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-892de82d-97e7-4a62-8805-e3cd4014642d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:13.868470 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-232923a6-1d39-4f96-8e5c-5b2e1a64a79f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:13.869087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-232923a6-1d39-4f96-8e5c-5b2e1a64a79f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:13.869523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-232923a6-1d39-4f96-8e5c-5b2e1a64a79f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:13.870230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-232923a6-1d39-4f96-8e5c-5b2e1a64a79f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:13.870713 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-232923a6-1d39-4f96-8e5c-5b2e1a64a79f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:13.871140 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-232923a6-1d39-4f96-8e5c-5b2e1a64a79f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:14.056068 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-892de82d-97e7-4a62-8805-e3cd4014642d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:14.063805 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-232923a6-1d39-4f96-8e5c-5b2e1a64a79f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:14.064546 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-892de82d-97e7-4a62-8805-e3cd4014642d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.214422 Aug 10 12:58:14.065320 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1042/2068] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:13 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:14.072588 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-232923a6-1d39-4f96-8e5c-5b2e1a64a79f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.215647 Aug 10 12:58:14.073169 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1027/2069] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:13 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:14.235556 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-664cd0af-6f0d-4b06-bbda-06da367a710d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:14.236076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-664cd0af-6f0d-4b06-bbda-06da367a710d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:14.242053 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-664cd0af-6f0d-4b06-bbda-06da367a710d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:14.242531 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-664cd0af-6f0d-4b06-bbda-06da367a710d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:14.242965 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-664cd0af-6f0d-4b06-bbda-06da367a710d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:14.243671 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-664cd0af-6f0d-4b06-bbda-06da367a710d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:14.244123 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-664cd0af-6f0d-4b06-bbda-06da367a710d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:14.244546 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-664cd0af-6f0d-4b06-bbda-06da367a710d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:14.372162 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-664cd0af-6f0d-4b06-bbda-06da367a710d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:14.381049 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-664cd0af-6f0d-4b06-bbda-06da367a710d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:14.382548 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-664cd0af-6f0d-4b06-bbda-06da367a710d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:14.383745 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-664cd0af-6f0d-4b06-bbda-06da367a710d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.152257 Aug 10 12:58:14.384337 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1043/2070] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:14 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:15.093047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1885d695-c76b-41b6-ab14-24ba8f190b79 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:15.093660 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1885d695-c76b-41b6-ab14-24ba8f190b79 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:15.093851 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-640844bf-018f-445f-9922-e43cb338024d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:15.094495 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-640844bf-018f-445f-9922-e43cb338024d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:15.100357 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1885d695-c76b-41b6-ab14-24ba8f190b79 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:15.100846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1885d695-c76b-41b6-ab14-24ba8f190b79 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:15.101235 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-640844bf-018f-445f-9922-e43cb338024d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:15.101352 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1885d695-c76b-41b6-ab14-24ba8f190b79 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:15.101711 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-640844bf-018f-445f-9922-e43cb338024d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:15.101972 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1885d695-c76b-41b6-ab14-24ba8f190b79 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:15.102166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-640844bf-018f-445f-9922-e43cb338024d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:15.102434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1885d695-c76b-41b6-ab14-24ba8f190b79 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:15.102856 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-640844bf-018f-445f-9922-e43cb338024d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:15.102965 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1885d695-c76b-41b6-ab14-24ba8f190b79 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:15.103547 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-640844bf-018f-445f-9922-e43cb338024d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:15.103969 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-640844bf-018f-445f-9922-e43cb338024d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:15.301823 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1885d695-c76b-41b6-ab14-24ba8f190b79 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:15.305420 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-640844bf-018f-445f-9922-e43cb338024d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:15.312225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1885d695-c76b-41b6-ab14-24ba8f190b79 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.222970 Aug 10 12:58:15.312805 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1028/2071] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:15 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:15.313707 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-640844bf-018f-445f-9922-e43cb338024d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.223679 Aug 10 12:58:15.314438 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1044/2072] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:15 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:15.408931 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c176bdc4-b7d2-4137-bfce-83fd098809e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:15.409462 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c176bdc4-b7d2-4137-bfce-83fd098809e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:15.415343 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c176bdc4-b7d2-4137-bfce-83fd098809e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:15.415819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c176bdc4-b7d2-4137-bfce-83fd098809e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:15.416246 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c176bdc4-b7d2-4137-bfce-83fd098809e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:15.416931 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c176bdc4-b7d2-4137-bfce-83fd098809e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:15.417374 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c176bdc4-b7d2-4137-bfce-83fd098809e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:15.417789 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c176bdc4-b7d2-4137-bfce-83fd098809e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:15.550805 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c176bdc4-b7d2-4137-bfce-83fd098809e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:15.559085 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c176bdc4-b7d2-4137-bfce-83fd098809e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:15.560623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c176bdc4-b7d2-4137-bfce-83fd098809e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:15.561772 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c176bdc4-b7d2-4137-bfce-83fd098809e7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.157746 Aug 10 12:58:15.562332 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1029/2073] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:15 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:58:16.333754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6de90286-9116-4aa5-a72d-65d4049c87f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:16.334456 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6de90286-9116-4aa5-a72d-65d4049c87f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:16.339431 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2e979def-0f6d-4b20-a8e7-3334f93fa9b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:16.340051 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2e979def-0f6d-4b20-a8e7-3334f93fa9b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:16.340860 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6de90286-9116-4aa5-a72d-65d4049c87f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:16.341339 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6de90286-9116-4aa5-a72d-65d4049c87f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:16.341781 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6de90286-9116-4aa5-a72d-65d4049c87f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:16.342790 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6de90286-9116-4aa5-a72d-65d4049c87f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:16.343262 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6de90286-9116-4aa5-a72d-65d4049c87f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:16.343681 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6de90286-9116-4aa5-a72d-65d4049c87f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:16.346482 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e979def-0f6d-4b20-a8e7-3334f93fa9b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:16.346961 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e979def-0f6d-4b20-a8e7-3334f93fa9b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:16.347434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e979def-0f6d-4b20-a8e7-3334f93fa9b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:16.348129 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e979def-0f6d-4b20-a8e7-3334f93fa9b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:16.348580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e979def-0f6d-4b20-a8e7-3334f93fa9b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:16.349003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e979def-0f6d-4b20-a8e7-3334f93fa9b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:16.544307 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6de90286-9116-4aa5-a72d-65d4049c87f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:16.545110 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2e979def-0f6d-4b20-a8e7-3334f93fa9b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:16.549624 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6de90286-9116-4aa5-a72d-65d4049c87f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.219625 Aug 10 12:58:16.550389 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1045/2074] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:16 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:16.550691 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2e979def-0f6d-4b20-a8e7-3334f93fa9b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.215041 Aug 10 12:58:16.554632 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1030/2075] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:16 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:16.589635 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-86ba558f-11c8-42b9-96d8-1f05ea6c8fa9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:16.591027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-86ba558f-11c8-42b9-96d8-1f05ea6c8fa9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:16.598380 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86ba558f-11c8-42b9-96d8-1f05ea6c8fa9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:16.601085 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86ba558f-11c8-42b9-96d8-1f05ea6c8fa9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:16.601085 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86ba558f-11c8-42b9-96d8-1f05ea6c8fa9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:16.601085 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86ba558f-11c8-42b9-96d8-1f05ea6c8fa9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:16.601085 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86ba558f-11c8-42b9-96d8-1f05ea6c8fa9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:16.601437 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-86ba558f-11c8-42b9-96d8-1f05ea6c8fa9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:16.731874 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-86ba558f-11c8-42b9-96d8-1f05ea6c8fa9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:16.740266 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-86ba558f-11c8-42b9-96d8-1f05ea6c8fa9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:16.741745 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-86ba558f-11c8-42b9-96d8-1f05ea6c8fa9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:16.742892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-86ba558f-11c8-42b9-96d8-1f05ea6c8fa9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.161382 Aug 10 12:58:16.743484 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1046/2076] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:16 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:17.572414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bbdae55d-1a7c-4060-8ea9-556fa809cd14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:17.572953 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-74df28a5-5b7d-4f7a-b8ae-8e7747ffecbd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:17.573345 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bbdae55d-1a7c-4060-8ea9-556fa809cd14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:17.573470 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-74df28a5-5b7d-4f7a-b8ae-8e7747ffecbd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:17.580388 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bbdae55d-1a7c-4060-8ea9-556fa809cd14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:17.580574 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-74df28a5-5b7d-4f7a-b8ae-8e7747ffecbd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:17.580874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bbdae55d-1a7c-4060-8ea9-556fa809cd14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:17.581001 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-74df28a5-5b7d-4f7a-b8ae-8e7747ffecbd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:17.581311 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bbdae55d-1a7c-4060-8ea9-556fa809cd14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:17.581425 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-74df28a5-5b7d-4f7a-b8ae-8e7747ffecbd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:17.582026 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-74df28a5-5b7d-4f7a-b8ae-8e7747ffecbd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:17.582143 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bbdae55d-1a7c-4060-8ea9-556fa809cd14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:17.582476 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-74df28a5-5b7d-4f7a-b8ae-8e7747ffecbd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:17.582580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bbdae55d-1a7c-4060-8ea9-556fa809cd14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:17.582899 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-74df28a5-5b7d-4f7a-b8ae-8e7747ffecbd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:17.583001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bbdae55d-1a7c-4060-8ea9-556fa809cd14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:17.780537 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-bbdae55d-1a7c-4060-8ea9-556fa809cd14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:17.783821 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-74df28a5-5b7d-4f7a-b8ae-8e7747ffecbd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:17.788563 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bbdae55d-1a7c-4060-8ea9-556fa809cd14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.220016 Aug 10 12:58:17.789138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1031/2077] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:17 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:17.792165 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-74df28a5-5b7d-4f7a-b8ae-8e7747ffecbd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.223134 Aug 10 12:58:17.797341 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1047/2078] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:17 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:17.797497 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-60e524eb-61ff-4bdd-a483-0cf3d2bec713 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:17.797497 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-60e524eb-61ff-4bdd-a483-0cf3d2bec713 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:17.800521 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60e524eb-61ff-4bdd-a483-0cf3d2bec713 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:17.800998 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60e524eb-61ff-4bdd-a483-0cf3d2bec713 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:17.801424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60e524eb-61ff-4bdd-a483-0cf3d2bec713 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:17.802404 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60e524eb-61ff-4bdd-a483-0cf3d2bec713 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:17.802868 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60e524eb-61ff-4bdd-a483-0cf3d2bec713 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:17.803373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60e524eb-61ff-4bdd-a483-0cf3d2bec713 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:17.930441 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-60e524eb-61ff-4bdd-a483-0cf3d2bec713 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:17.939797 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-60e524eb-61ff-4bdd-a483-0cf3d2bec713 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:17.941357 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-60e524eb-61ff-4bdd-a483-0cf3d2bec713 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:17.942509 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-60e524eb-61ff-4bdd-a483-0cf3d2bec713 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.152469 Aug 10 12:58:17.943067 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1032/2079] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:17 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:18.810697 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-09685df3-1168-4d99-bb74-e4463f12f987 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:18.811335 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-09685df3-1168-4d99-bb74-e4463f12f987 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:18.814159 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1e612539-58fe-4335-a223-349c7aae23ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:18.814941 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1e612539-58fe-4335-a223-349c7aae23ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:18.817814 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09685df3-1168-4d99-bb74-e4463f12f987 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:18.818287 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09685df3-1168-4d99-bb74-e4463f12f987 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:18.818713 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09685df3-1168-4d99-bb74-e4463f12f987 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:18.819422 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09685df3-1168-4d99-bb74-e4463f12f987 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:18.819870 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09685df3-1168-4d99-bb74-e4463f12f987 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:18.820283 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09685df3-1168-4d99-bb74-e4463f12f987 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:18.821274 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1e612539-58fe-4335-a223-349c7aae23ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:18.821757 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1e612539-58fe-4335-a223-349c7aae23ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:18.822189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1e612539-58fe-4335-a223-349c7aae23ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:18.822881 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1e612539-58fe-4335-a223-349c7aae23ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:18.823364 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1e612539-58fe-4335-a223-349c7aae23ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:18.823777 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1e612539-58fe-4335-a223-349c7aae23ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:19.012024 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-09685df3-1168-4d99-bb74-e4463f12f987 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:19.019115 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1e612539-58fe-4335-a223-349c7aae23ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:19.019927 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-09685df3-1168-4d99-bb74-e4463f12f987 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.213940 Aug 10 12:58:19.020499 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1048/2080] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:18 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:19.024890 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a02cb98e-336e-4d5c-afbf-1ae00a1679b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:19.025486 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a02cb98e-336e-4d5c-afbf-1ae00a1679b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:19.031702 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a02cb98e-336e-4d5c-afbf-1ae00a1679b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:19.032166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a02cb98e-336e-4d5c-afbf-1ae00a1679b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:19.032614 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a02cb98e-336e-4d5c-afbf-1ae00a1679b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:19.032827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1e612539-58fe-4335-a223-349c7aae23ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.222740 Aug 10 12:58:19.033267 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a02cb98e-336e-4d5c-afbf-1ae00a1679b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:19.033585 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1033/2081] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:18 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:19.033717 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a02cb98e-336e-4d5c-afbf-1ae00a1679b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:19.034141 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a02cb98e-336e-4d5c-afbf-1ae00a1679b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:19.163039 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a02cb98e-336e-4d5c-afbf-1ae00a1679b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:19.171907 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a02cb98e-336e-4d5c-afbf-1ae00a1679b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:19.173400 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a02cb98e-336e-4d5c-afbf-1ae00a1679b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:19.174542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a02cb98e-336e-4d5c-afbf-1ae00a1679b9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.153133 Aug 10 12:58:19.175097 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1049/2082] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:19 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:20.046081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7946e7ac-119f-4aa2-b782-ce1c1cc77a85 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:20.046721 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7946e7ac-119f-4aa2-b782-ce1c1cc77a85 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:20.053186 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7946e7ac-119f-4aa2-b782-ce1c1cc77a85 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:20.060686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-08253e18-ce3c-4bc0-95f9-75f7ff1ea8bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:20.061176 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7946e7ac-119f-4aa2-b782-ce1c1cc77a85 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:20.061176 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7946e7ac-119f-4aa2-b782-ce1c1cc77a85 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:20.061380 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-08253e18-ce3c-4bc0-95f9-75f7ff1ea8bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:20.061488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7946e7ac-119f-4aa2-b782-ce1c1cc77a85 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:20.061488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7946e7ac-119f-4aa2-b782-ce1c1cc77a85 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:20.061488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7946e7ac-119f-4aa2-b782-ce1c1cc77a85 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:20.061755 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08253e18-ce3c-4bc0-95f9-75f7ff1ea8bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:20.061755 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08253e18-ce3c-4bc0-95f9-75f7ff1ea8bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:20.062109 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08253e18-ce3c-4bc0-95f9-75f7ff1ea8bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:20.062805 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08253e18-ce3c-4bc0-95f9-75f7ff1ea8bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:20.063280 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08253e18-ce3c-4bc0-95f9-75f7ff1ea8bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:20.063716 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08253e18-ce3c-4bc0-95f9-75f7ff1ea8bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:20.248442 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7946e7ac-119f-4aa2-b782-ce1c1cc77a85 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:20.252463 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-08253e18-ce3c-4bc0-95f9-75f7ff1ea8bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:20.256936 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7946e7ac-119f-4aa2-b782-ce1c1cc77a85 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.215225 Aug 10 12:58:20.257835 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1034/2083] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:20 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:20.262630 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-50fc14a3-e10c-45fa-851c-dc3bd1bfd6c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:20.263903 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-50fc14a3-e10c-45fa-851c-dc3bd1bfd6c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:20.266909 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-08253e18-ce3c-4bc0-95f9-75f7ff1ea8bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.217022 Aug 10 12:58:20.267815 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1050/2084] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:20 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:20.270373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50fc14a3-e10c-45fa-851c-dc3bd1bfd6c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:20.270862 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50fc14a3-e10c-45fa-851c-dc3bd1bfd6c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:20.271330 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50fc14a3-e10c-45fa-851c-dc3bd1bfd6c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:20.272031 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50fc14a3-e10c-45fa-851c-dc3bd1bfd6c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:20.272489 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50fc14a3-e10c-45fa-851c-dc3bd1bfd6c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:20.272911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50fc14a3-e10c-45fa-851c-dc3bd1bfd6c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:20.404270 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-50fc14a3-e10c-45fa-851c-dc3bd1bfd6c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:20.413029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-50fc14a3-e10c-45fa-851c-dc3bd1bfd6c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:20.422422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-50fc14a3-e10c-45fa-851c-dc3bd1bfd6c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:20.422422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-50fc14a3-e10c-45fa-851c-dc3bd1bfd6c0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.157083 Aug 10 12:58:20.422422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1035/2085] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:20 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:21.279878 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c45bc53c-87be-43e4-ac26-8901168e9ce9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:21.280511 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c45bc53c-87be-43e4-ac26-8901168e9ce9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:21.287012 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c45bc53c-87be-43e4-ac26-8901168e9ce9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:21.287524 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c45bc53c-87be-43e4-ac26-8901168e9ce9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:21.287951 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c45bc53c-87be-43e4-ac26-8901168e9ce9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:21.288628 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c45bc53c-87be-43e4-ac26-8901168e9ce9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:21.289070 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c45bc53c-87be-43e4-ac26-8901168e9ce9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:21.289195 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ef5f6931-8c79-4a72-93c5-fdad12d118ae tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:21.289593 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c45bc53c-87be-43e4-ac26-8901168e9ce9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:21.289763 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ef5f6931-8c79-4a72-93c5-fdad12d118ae tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:21.296903 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef5f6931-8c79-4a72-93c5-fdad12d118ae tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:21.297378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef5f6931-8c79-4a72-93c5-fdad12d118ae tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:21.297811 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef5f6931-8c79-4a72-93c5-fdad12d118ae tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:21.298504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef5f6931-8c79-4a72-93c5-fdad12d118ae tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:21.298982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef5f6931-8c79-4a72-93c5-fdad12d118ae tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:21.299440 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef5f6931-8c79-4a72-93c5-fdad12d118ae tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:21.478802 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c45bc53c-87be-43e4-ac26-8901168e9ce9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:21.496913 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ef5f6931-8c79-4a72-93c5-fdad12d118ae tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:21.500002 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c45bc53c-87be-43e4-ac26-8901168e9ce9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.224465 Aug 10 12:58:21.507274 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1051/2086] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:21 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:21.507274 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-655d4bfa-2f9a-428f-aa4b-2891342e3dbc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:21.507274 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-655d4bfa-2f9a-428f-aa4b-2891342e3dbc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:21.511563 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ef5f6931-8c79-4a72-93c5-fdad12d118ae tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.226172 Aug 10 12:58:21.512578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1036/2087] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:21 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:21.516907 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-655d4bfa-2f9a-428f-aa4b-2891342e3dbc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:21.517474 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-655d4bfa-2f9a-428f-aa4b-2891342e3dbc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:21.518024 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-655d4bfa-2f9a-428f-aa4b-2891342e3dbc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:21.518801 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-655d4bfa-2f9a-428f-aa4b-2891342e3dbc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:21.519271 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-655d4bfa-2f9a-428f-aa4b-2891342e3dbc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:21.519694 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-655d4bfa-2f9a-428f-aa4b-2891342e3dbc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:21.652647 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-655d4bfa-2f9a-428f-aa4b-2891342e3dbc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:21.655026 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:58:21.662192 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-655d4bfa-2f9a-428f-aa4b-2891342e3dbc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:21.666238 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-655d4bfa-2f9a-428f-aa4b-2891342e3dbc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:21.666238 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-655d4bfa-2f9a-428f-aa4b-2891342e3dbc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.163100 Aug 10 12:58:21.666238 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1052/2088] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:21 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:22.521733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b9c16afd-4945-44b1-8554-581ec3de2953 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:22.522367 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b9c16afd-4945-44b1-8554-581ec3de2953 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:22.528763 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b9c16afd-4945-44b1-8554-581ec3de2953 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:22.529961 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b9c16afd-4945-44b1-8554-581ec3de2953 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:22.530392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b9c16afd-4945-44b1-8554-581ec3de2953 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:22.531139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b9c16afd-4945-44b1-8554-581ec3de2953 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:22.531562 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b9c16afd-4945-44b1-8554-581ec3de2953 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:22.531980 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b9c16afd-4945-44b1-8554-581ec3de2953 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:22.534182 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e405fffc-baac-4981-a962-e50a6bcc1358 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:22.534795 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e405fffc-baac-4981-a962-e50a6bcc1358 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:22.541775 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e405fffc-baac-4981-a962-e50a6bcc1358 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:22.542314 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e405fffc-baac-4981-a962-e50a6bcc1358 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:22.542743 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e405fffc-baac-4981-a962-e50a6bcc1358 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:22.543445 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e405fffc-baac-4981-a962-e50a6bcc1358 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:22.544122 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e405fffc-baac-4981-a962-e50a6bcc1358 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:22.544965 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e405fffc-baac-4981-a962-e50a6bcc1358 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:22.733395 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b9c16afd-4945-44b1-8554-581ec3de2953 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:22.739991 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e405fffc-baac-4981-a962-e50a6bcc1358 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:22.741594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b9c16afd-4945-44b1-8554-581ec3de2953 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.223703 Aug 10 12:58:22.742198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1037/2089] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:22 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:22.746781 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f88f1231-0e36-450b-b3cc-0525fb03974c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:22.747407 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f88f1231-0e36-450b-b3cc-0525fb03974c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:22.748335 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e405fffc-baac-4981-a962-e50a6bcc1358 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.219182 Aug 10 12:58:22.749326 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1053/2090] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:22 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:22.753329 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f88f1231-0e36-450b-b3cc-0525fb03974c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:22.753800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f88f1231-0e36-450b-b3cc-0525fb03974c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:22.754228 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f88f1231-0e36-450b-b3cc-0525fb03974c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:22.754909 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f88f1231-0e36-450b-b3cc-0525fb03974c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:22.755387 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f88f1231-0e36-450b-b3cc-0525fb03974c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:22.755804 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f88f1231-0e36-450b-b3cc-0525fb03974c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:22.884491 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f88f1231-0e36-450b-b3cc-0525fb03974c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:22.893449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f88f1231-0e36-450b-b3cc-0525fb03974c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:22.894953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f88f1231-0e36-450b-b3cc-0525fb03974c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:22.896133 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f88f1231-0e36-450b-b3cc-0525fb03974c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.152998 Aug 10 12:58:22.896693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1038/2091] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:22 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:23.762679 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7c874396-620b-4d5b-814c-ee2719d1cee9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:23.763843 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7c874396-620b-4d5b-814c-ee2719d1cee9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:23.769512 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b2aa33e0-ea56-4917-b7a3-64270b15557e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:23.770127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b2aa33e0-ea56-4917-b7a3-64270b15557e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:23.770631 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c874396-620b-4d5b-814c-ee2719d1cee9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:23.771120 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c874396-620b-4d5b-814c-ee2719d1cee9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:23.771581 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c874396-620b-4d5b-814c-ee2719d1cee9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:23.772341 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c874396-620b-4d5b-814c-ee2719d1cee9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:23.772818 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c874396-620b-4d5b-814c-ee2719d1cee9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:23.773501 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c874396-620b-4d5b-814c-ee2719d1cee9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:23.776503 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2aa33e0-ea56-4917-b7a3-64270b15557e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:23.776985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2aa33e0-ea56-4917-b7a3-64270b15557e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:23.777449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2aa33e0-ea56-4917-b7a3-64270b15557e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:23.778124 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2aa33e0-ea56-4917-b7a3-64270b15557e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:23.778578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2aa33e0-ea56-4917-b7a3-64270b15557e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:23.779701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2aa33e0-ea56-4917-b7a3-64270b15557e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:23.972882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-7c874396-620b-4d5b-814c-ee2719d1cee9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:23.975938 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b2aa33e0-ea56-4917-b7a3-64270b15557e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:23.981535 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7c874396-620b-4d5b-814c-ee2719d1cee9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.222800 Aug 10 12:58:23.982122 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1054/2092] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:23 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:23.986665 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4341859b-822c-4925-a06f-c4ba82e737ef tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:23.987298 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4341859b-822c-4925-a06f-c4ba82e737ef tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:23.993137 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4341859b-822c-4925-a06f-c4ba82e737ef tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:23.993616 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4341859b-822c-4925-a06f-c4ba82e737ef tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:23.994248 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4341859b-822c-4925-a06f-c4ba82e737ef tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:23.995116 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4341859b-822c-4925-a06f-c4ba82e737ef tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:23.995914 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4341859b-822c-4925-a06f-c4ba82e737ef tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:23.996367 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4341859b-822c-4925-a06f-c4ba82e737ef tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:23.998435 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b2aa33e0-ea56-4917-b7a3-64270b15557e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.232745 Aug 10 12:58:24.002814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1039/2093] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:23 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:24.131644 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4341859b-822c-4925-a06f-c4ba82e737ef tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:24.140750 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4341859b-822c-4925-a06f-c4ba82e737ef tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:24.142252 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4341859b-822c-4925-a06f-c4ba82e737ef tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:24.143449 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4341859b-822c-4925-a06f-c4ba82e737ef tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.160386 Aug 10 12:58:24.144018 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1055/2094] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:23 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:25.002568 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a5c5c4ef-dab1-4517-a3e8-293c1e3c36cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:25.003151 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a5c5c4ef-dab1-4517-a3e8-293c1e3c36cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:25.009413 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5c5c4ef-dab1-4517-a3e8-293c1e3c36cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:25.009888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5c5c4ef-dab1-4517-a3e8-293c1e3c36cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:25.010315 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5c5c4ef-dab1-4517-a3e8-293c1e3c36cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:25.010992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5c5c4ef-dab1-4517-a3e8-293c1e3c36cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:25.011462 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5c5c4ef-dab1-4517-a3e8-293c1e3c36cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:25.011879 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5c5c4ef-dab1-4517-a3e8-293c1e3c36cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:25.015030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:58:25.023849 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4405ee93-1cc6-4522-9c06-964ffebed8b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:25.024493 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4405ee93-1cc6-4522-9c06-964ffebed8b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:25.030970 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4405ee93-1cc6-4522-9c06-964ffebed8b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:25.038145 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4405ee93-1cc6-4522-9c06-964ffebed8b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:25.038145 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4405ee93-1cc6-4522-9c06-964ffebed8b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:25.038145 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4405ee93-1cc6-4522-9c06-964ffebed8b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:25.038145 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4405ee93-1cc6-4522-9c06-964ffebed8b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:25.038763 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4405ee93-1cc6-4522-9c06-964ffebed8b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:25.200209 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a5c5c4ef-dab1-4517-a3e8-293c1e3c36cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:25.211322 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a5c5c4ef-dab1-4517-a3e8-293c1e3c36cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.212557 Aug 10 12:58:25.211904 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1040/2095] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:24 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:25.220449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7ab8d063-d93f-411d-9d12-17b730e79788 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:25.221135 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7ab8d063-d93f-411d-9d12-17b730e79788 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:25.225853 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4405ee93-1cc6-4522-9c06-964ffebed8b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:25.227065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7ab8d063-d93f-411d-9d12-17b730e79788 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:25.227585 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7ab8d063-d93f-411d-9d12-17b730e79788 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:25.228013 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7ab8d063-d93f-411d-9d12-17b730e79788 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:25.228967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7ab8d063-d93f-411d-9d12-17b730e79788 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:25.229413 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7ab8d063-d93f-411d-9d12-17b730e79788 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:25.229869 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7ab8d063-d93f-411d-9d12-17b730e79788 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:25.234631 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4405ee93-1cc6-4522-9c06-964ffebed8b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.214570 Aug 10 12:58:25.235371 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1056/2096] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:25 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:25.360231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7ab8d063-d93f-411d-9d12-17b730e79788 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:25.368534 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7ab8d063-d93f-411d-9d12-17b730e79788 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:25.370091 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7ab8d063-d93f-411d-9d12-17b730e79788 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:25.371252 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7ab8d063-d93f-411d-9d12-17b730e79788 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.158419 Aug 10 12:58:25.371810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1041/2097] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:25 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:26.233486 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fd71540c-6da1-4718-baa8-0d532bce4a5c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:26.234086 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fd71540c-6da1-4718-baa8-0d532bce4a5c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:26.240789 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fd71540c-6da1-4718-baa8-0d532bce4a5c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:26.241206 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fd71540c-6da1-4718-baa8-0d532bce4a5c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:26.241632 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fd71540c-6da1-4718-baa8-0d532bce4a5c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:26.242305 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fd71540c-6da1-4718-baa8-0d532bce4a5c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:26.242748 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fd71540c-6da1-4718-baa8-0d532bce4a5c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:26.243163 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fd71540c-6da1-4718-baa8-0d532bce4a5c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:26.257097 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4a2866b4-0e9e-494f-a45d-db21fa6e568f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:26.258415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4a2866b4-0e9e-494f-a45d-db21fa6e568f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:26.265522 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4a2866b4-0e9e-494f-a45d-db21fa6e568f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:26.266007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4a2866b4-0e9e-494f-a45d-db21fa6e568f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:26.266446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4a2866b4-0e9e-494f-a45d-db21fa6e568f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:26.267151 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4a2866b4-0e9e-494f-a45d-db21fa6e568f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:26.267631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4a2866b4-0e9e-494f-a45d-db21fa6e568f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:26.268057 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4a2866b4-0e9e-494f-a45d-db21fa6e568f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:26.440387 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fd71540c-6da1-4718-baa8-0d532bce4a5c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:26.444549 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4a2866b4-0e9e-494f-a45d-db21fa6e568f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:26.448431 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fd71540c-6da1-4718-baa8-0d532bce4a5c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.218881 Aug 10 12:58:26.449051 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1057/2098] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:26 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:26.453282 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4a2866b4-0e9e-494f-a45d-db21fa6e568f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.199992 Aug 10 12:58:26.453841 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1042/2099] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:26 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:26.454063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ab92cc76-2b64-4e79-a3e1-3e3c25e1df3e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:26.454902 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ab92cc76-2b64-4e79-a3e1-3e3c25e1df3e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:26.460671 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab92cc76-2b64-4e79-a3e1-3e3c25e1df3e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:26.461151 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab92cc76-2b64-4e79-a3e1-3e3c25e1df3e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:26.461581 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab92cc76-2b64-4e79-a3e1-3e3c25e1df3e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:26.462271 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab92cc76-2b64-4e79-a3e1-3e3c25e1df3e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:26.462722 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab92cc76-2b64-4e79-a3e1-3e3c25e1df3e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:26.463144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab92cc76-2b64-4e79-a3e1-3e3c25e1df3e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:26.587912 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ab92cc76-2b64-4e79-a3e1-3e3c25e1df3e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:26.596841 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ab92cc76-2b64-4e79-a3e1-3e3c25e1df3e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:26.598344 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ab92cc76-2b64-4e79-a3e1-3e3c25e1df3e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:26.599556 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ab92cc76-2b64-4e79-a3e1-3e3c25e1df3e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.149548 Aug 10 12:58:26.600127 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1058/2100] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:26 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:27.471085 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d0735ca2-22e9-404f-8652-51830672c1c7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:27.471739 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d0735ca2-22e9-404f-8652-51830672c1c7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:27.473618 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fb367051-6b04-44a1-9357-1657248e9f5a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:27.474231 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fb367051-6b04-44a1-9357-1657248e9f5a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:27.478732 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0735ca2-22e9-404f-8652-51830672c1c7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:27.479226 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0735ca2-22e9-404f-8652-51830672c1c7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:27.479657 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0735ca2-22e9-404f-8652-51830672c1c7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:27.480347 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0735ca2-22e9-404f-8652-51830672c1c7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:27.480451 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fb367051-6b04-44a1-9357-1657248e9f5a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:27.480793 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0735ca2-22e9-404f-8652-51830672c1c7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:27.480911 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fb367051-6b04-44a1-9357-1657248e9f5a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:27.481212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0735ca2-22e9-404f-8652-51830672c1c7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:27.481324 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fb367051-6b04-44a1-9357-1657248e9f5a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:27.482571 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fb367051-6b04-44a1-9357-1657248e9f5a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:27.483024 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fb367051-6b04-44a1-9357-1657248e9f5a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:27.483629 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fb367051-6b04-44a1-9357-1657248e9f5a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:27.673468 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fb367051-6b04-44a1-9357-1657248e9f5a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:27.680462 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d0735ca2-22e9-404f-8652-51830672c1c7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:27.681555 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fb367051-6b04-44a1-9357-1657248e9f5a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.211681 Aug 10 12:58:27.682137 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1059/2101] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:27 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:27.686637 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-71d19353-9350-4f4e-bc99-664caf8599d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:27.687279 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-71d19353-9350-4f4e-bc99-664caf8599d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:27.688702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d0735ca2-22e9-404f-8652-51830672c1c7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.222396 Aug 10 12:58:27.689443 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1043/2102] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:27 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:27.693006 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-71d19353-9350-4f4e-bc99-664caf8599d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:27.693593 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-71d19353-9350-4f4e-bc99-664caf8599d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:27.694142 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-71d19353-9350-4f4e-bc99-664caf8599d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:27.694931 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-71d19353-9350-4f4e-bc99-664caf8599d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:27.695513 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-71d19353-9350-4f4e-bc99-664caf8599d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:27.695936 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-71d19353-9350-4f4e-bc99-664caf8599d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:27.826738 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-71d19353-9350-4f4e-bc99-664caf8599d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:27.835312 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-71d19353-9350-4f4e-bc99-664caf8599d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:27.836823 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-71d19353-9350-4f4e-bc99-664caf8599d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:27.837989 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-71d19353-9350-4f4e-bc99-664caf8599d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.154938 Aug 10 12:58:27.838545 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1060/2103] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:27 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:28.703133 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-eb4c1c08-a435-4f05-a889-29e3a438b772 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:28.703746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-eb4c1c08-a435-4f05-a889-29e3a438b772 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:28.706041 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=66 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:58:28.709626 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-91cdb992-4e28-4950-86d8-633780b2750c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:28.710242 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-91cdb992-4e28-4950-86d8-633780b2750c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:28.710702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb4c1c08-a435-4f05-a889-29e3a438b772 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:28.711197 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb4c1c08-a435-4f05-a889-29e3a438b772 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:28.711654 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb4c1c08-a435-4f05-a889-29e3a438b772 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:28.712358 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb4c1c08-a435-4f05-a889-29e3a438b772 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:28.712809 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb4c1c08-a435-4f05-a889-29e3a438b772 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:28.713230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb4c1c08-a435-4f05-a889-29e3a438b772 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:28.717618 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-91cdb992-4e28-4950-86d8-633780b2750c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:28.718119 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-91cdb992-4e28-4950-86d8-633780b2750c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:28.727166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-91cdb992-4e28-4950-86d8-633780b2750c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:28.727166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-91cdb992-4e28-4950-86d8-633780b2750c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:28.727166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-91cdb992-4e28-4950-86d8-633780b2750c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:28.727166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-91cdb992-4e28-4950-86d8-633780b2750c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:28.902438 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-eb4c1c08-a435-4f05-a889-29e3a438b772 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:28.910069 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-91cdb992-4e28-4950-86d8-633780b2750c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:28.910819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-eb4c1c08-a435-4f05-a889-29e3a438b772 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.211611 Aug 10 12:58:28.911430 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1044/2104] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:28 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:28.915905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a161038a-7c7a-4a4d-9440-6d85968ab0b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:28.916507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a161038a-7c7a-4a4d-9440-6d85968ab0b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:28.918167 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-91cdb992-4e28-4950-86d8-633780b2750c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.212351 Aug 10 12:58:28.918735 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1061/2105] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:28 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:28.922853 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a161038a-7c7a-4a4d-9440-6d85968ab0b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:28.923364 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a161038a-7c7a-4a4d-9440-6d85968ab0b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:28.923796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a161038a-7c7a-4a4d-9440-6d85968ab0b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:28.924489 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a161038a-7c7a-4a4d-9440-6d85968ab0b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:28.924943 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a161038a-7c7a-4a4d-9440-6d85968ab0b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:28.925362 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a161038a-7c7a-4a4d-9440-6d85968ab0b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:29.280396 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a161038a-7c7a-4a4d-9440-6d85968ab0b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:29.288781 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a161038a-7c7a-4a4d-9440-6d85968ab0b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:29.290274 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a161038a-7c7a-4a4d-9440-6d85968ab0b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:29.291438 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a161038a-7c7a-4a4d-9440-6d85968ab0b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.379077 Aug 10 12:58:29.291986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1045/2106] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:28 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:29.932706 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-17bbf70c-3307-413a-9ef6-fa433090b1fc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:29.933358 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-17bbf70c-3307-413a-9ef6-fa433090b1fc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:29.940472 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17bbf70c-3307-413a-9ef6-fa433090b1fc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:29.940959 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17bbf70c-3307-413a-9ef6-fa433090b1fc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:29.941398 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17bbf70c-3307-413a-9ef6-fa433090b1fc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:29.953911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bd605265-3893-4d08-8017-5fabffa7791c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:29.954362 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17bbf70c-3307-413a-9ef6-fa433090b1fc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:29.954465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bd605265-3893-4d08-8017-5fabffa7791c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:29.954658 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17bbf70c-3307-413a-9ef6-fa433090b1fc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:29.954658 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17bbf70c-3307-413a-9ef6-fa433090b1fc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:29.954867 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd605265-3893-4d08-8017-5fabffa7791c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:29.954867 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd605265-3893-4d08-8017-5fabffa7791c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:29.954867 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd605265-3893-4d08-8017-5fabffa7791c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:29.954867 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd605265-3893-4d08-8017-5fabffa7791c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:29.955246 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd605265-3893-4d08-8017-5fabffa7791c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:29.955246 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd605265-3893-4d08-8017-5fabffa7791c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:30.135803 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-17bbf70c-3307-413a-9ef6-fa433090b1fc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:30.143020 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-bd605265-3893-4d08-8017-5fabffa7791c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:30.144311 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-17bbf70c-3307-413a-9ef6-fa433090b1fc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.215618 Aug 10 12:58:30.145151 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1062/2107] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:29 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:30.150939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bd605265-3893-4d08-8017-5fabffa7791c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.213399 Aug 10 12:58:30.151516 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1046/2108] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:29 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:30.315214 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-742b292c-5eee-4936-9236-cbfd928f0d5a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:30.315826 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-742b292c-5eee-4936-9236-cbfd928f0d5a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:30.321824 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-742b292c-5eee-4936-9236-cbfd928f0d5a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:30.322326 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-742b292c-5eee-4936-9236-cbfd928f0d5a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:30.322717 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-742b292c-5eee-4936-9236-cbfd928f0d5a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:30.323432 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-742b292c-5eee-4936-9236-cbfd928f0d5a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:30.323883 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-742b292c-5eee-4936-9236-cbfd928f0d5a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:30.324303 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-742b292c-5eee-4936-9236-cbfd928f0d5a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:30.452012 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-742b292c-5eee-4936-9236-cbfd928f0d5a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:30.460435 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-742b292c-5eee-4936-9236-cbfd928f0d5a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:30.464662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-742b292c-5eee-4936-9236-cbfd928f0d5a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:30.464662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-742b292c-5eee-4936-9236-cbfd928f0d5a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.152771 Aug 10 12:58:30.464662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1063/2109] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:30 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:58:31.165295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e34ca180-da88-44a4-9cb0-788d6c362763 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:31.165827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e34ca180-da88-44a4-9cb0-788d6c362763 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:31.171833 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8209dfb3-44bf-42bd-a282-4606c8825d5f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:31.172297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e34ca180-da88-44a4-9cb0-788d6c362763 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:31.172453 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8209dfb3-44bf-42bd-a282-4606c8825d5f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:31.172767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e34ca180-da88-44a4-9cb0-788d6c362763 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:31.173197 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e34ca180-da88-44a4-9cb0-788d6c362763 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:31.173929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e34ca180-da88-44a4-9cb0-788d6c362763 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:31.174482 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e34ca180-da88-44a4-9cb0-788d6c362763 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:31.174903 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e34ca180-da88-44a4-9cb0-788d6c362763 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:31.178805 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8209dfb3-44bf-42bd-a282-4606c8825d5f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:31.179313 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8209dfb3-44bf-42bd-a282-4606c8825d5f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:31.179756 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8209dfb3-44bf-42bd-a282-4606c8825d5f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:31.180451 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8209dfb3-44bf-42bd-a282-4606c8825d5f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:31.180904 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8209dfb3-44bf-42bd-a282-4606c8825d5f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:31.181334 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8209dfb3-44bf-42bd-a282-4606c8825d5f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:31.369283 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e34ca180-da88-44a4-9cb0-788d6c362763 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:31.376968 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-8209dfb3-44bf-42bd-a282-4606c8825d5f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:31.377974 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e34ca180-da88-44a4-9cb0-788d6c362763 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.216562 Aug 10 12:58:31.378734 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1047/2110] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:31 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:31.385427 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8209dfb3-44bf-42bd-a282-4606c8825d5f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.217371 Aug 10 12:58:31.386090 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1064/2111] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:31 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:31.486599 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7e658a03-6faf-4862-b786-1803dda45c19 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:31.487234 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7e658a03-6faf-4862-b786-1803dda45c19 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:31.493101 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7e658a03-6faf-4862-b786-1803dda45c19 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:31.493578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7e658a03-6faf-4862-b786-1803dda45c19 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:31.494010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7e658a03-6faf-4862-b786-1803dda45c19 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:31.494690 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7e658a03-6faf-4862-b786-1803dda45c19 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:31.495135 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7e658a03-6faf-4862-b786-1803dda45c19 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:31.495585 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7e658a03-6faf-4862-b786-1803dda45c19 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:31.630079 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7e658a03-6faf-4862-b786-1803dda45c19 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:31.638422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7e658a03-6faf-4862-b786-1803dda45c19 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:31.639942 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7e658a03-6faf-4862-b786-1803dda45c19 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:31.641083 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7e658a03-6faf-4862-b786-1803dda45c19 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.158347 Aug 10 12:58:31.641646 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1048/2112] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:31 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:32.399926 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ef6be9ae-e968-4f37-a332-c2f78d4ff820 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:32.400538 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ef6be9ae-e968-4f37-a332-c2f78d4ff820 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:32.407310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ac3c6b5b-3047-49f6-a705-75cec625cb23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:32.407768 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef6be9ae-e968-4f37-a332-c2f78d4ff820 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:32.407921 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ac3c6b5b-3047-49f6-a705-75cec625cb23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:32.408122 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef6be9ae-e968-4f37-a332-c2f78d4ff820 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:32.408554 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef6be9ae-e968-4f37-a332-c2f78d4ff820 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:32.409273 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef6be9ae-e968-4f37-a332-c2f78d4ff820 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:32.409724 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef6be9ae-e968-4f37-a332-c2f78d4ff820 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:32.410148 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef6be9ae-e968-4f37-a332-c2f78d4ff820 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:32.414090 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac3c6b5b-3047-49f6-a705-75cec625cb23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:32.414565 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac3c6b5b-3047-49f6-a705-75cec625cb23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:32.414994 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac3c6b5b-3047-49f6-a705-75cec625cb23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:32.415696 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac3c6b5b-3047-49f6-a705-75cec625cb23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:32.416139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac3c6b5b-3047-49f6-a705-75cec625cb23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:32.416556 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac3c6b5b-3047-49f6-a705-75cec625cb23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:32.604822 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ef6be9ae-e968-4f37-a332-c2f78d4ff820 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:32.613306 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ef6be9ae-e968-4f37-a332-c2f78d4ff820 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.217184 Aug 10 12:58:32.613885 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1065/2113] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:32 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:32.617777 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ac3c6b5b-3047-49f6-a705-75cec625cb23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:32.626977 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ac3c6b5b-3047-49f6-a705-75cec625cb23 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.224042 Aug 10 12:58:32.627679 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1049/2114] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:32 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:32.664466 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f5fb07b1-e42d-48ef-b935-66647fbe77ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:32.665199 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f5fb07b1-e42d-48ef-b935-66647fbe77ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:32.671488 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5fb07b1-e42d-48ef-b935-66647fbe77ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:32.671958 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5fb07b1-e42d-48ef-b935-66647fbe77ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:32.672408 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5fb07b1-e42d-48ef-b935-66647fbe77ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:32.673082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5fb07b1-e42d-48ef-b935-66647fbe77ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:32.673522 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5fb07b1-e42d-48ef-b935-66647fbe77ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:32.673948 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f5fb07b1-e42d-48ef-b935-66647fbe77ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:32.802856 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f5fb07b1-e42d-48ef-b935-66647fbe77ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:32.811676 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f5fb07b1-e42d-48ef-b935-66647fbe77ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:32.813167 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f5fb07b1-e42d-48ef-b935-66647fbe77ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:32.814319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f5fb07b1-e42d-48ef-b935-66647fbe77ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.153799 Aug 10 12:58:32.814875 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1066/2115] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:32 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:33.634880 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e6a01673-0828-4126-922c-3787ef6eda65 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:33.635573 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e6a01673-0828-4126-922c-3787ef6eda65 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:33.642193 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6a01673-0828-4126-922c-3787ef6eda65 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:33.642673 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6a01673-0828-4126-922c-3787ef6eda65 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:33.643100 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6a01673-0828-4126-922c-3787ef6eda65 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:33.644012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6a01673-0828-4126-922c-3787ef6eda65 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:33.644384 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6a01673-0828-4126-922c-3787ef6eda65 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:33.644814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6a01673-0828-4126-922c-3787ef6eda65 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:33.649577 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e1d33fa1-61ed-4fd2-878a-c6e5ce1a889f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:33.650398 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e1d33fa1-61ed-4fd2-878a-c6e5ce1a889f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:33.656817 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1d33fa1-61ed-4fd2-878a-c6e5ce1a889f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:33.660581 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1d33fa1-61ed-4fd2-878a-c6e5ce1a889f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:33.660581 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1d33fa1-61ed-4fd2-878a-c6e5ce1a889f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:33.660581 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1d33fa1-61ed-4fd2-878a-c6e5ce1a889f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:33.660581 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1d33fa1-61ed-4fd2-878a-c6e5ce1a889f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:33.661011 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1d33fa1-61ed-4fd2-878a-c6e5ce1a889f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:33.843936 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e6a01673-0828-4126-922c-3787ef6eda65 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:33.850782 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e1d33fa1-61ed-4fd2-878a-c6e5ce1a889f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:33.852038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e6a01673-0828-4126-922c-3787ef6eda65 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.221004 Aug 10 12:58:33.852649 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1050/2116] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:33 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:33.858100 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fb6a6382-f7ed-4a2f-ae6b-b4ce4560c413 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:33.858702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fb6a6382-f7ed-4a2f-ae6b-b4ce4560c413 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:33.862926 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e1d33fa1-61ed-4fd2-878a-c6e5ce1a889f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.217029 Aug 10 12:58:33.863534 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1067/2117] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:33 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:33.864279 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fb6a6382-f7ed-4a2f-ae6b-b4ce4560c413 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:33.864753 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fb6a6382-f7ed-4a2f-ae6b-b4ce4560c413 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:33.865375 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fb6a6382-f7ed-4a2f-ae6b-b4ce4560c413 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:33.866060 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fb6a6382-f7ed-4a2f-ae6b-b4ce4560c413 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:33.866678 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fb6a6382-f7ed-4a2f-ae6b-b4ce4560c413 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:33.867099 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fb6a6382-f7ed-4a2f-ae6b-b4ce4560c413 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:33.994995 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fb6a6382-f7ed-4a2f-ae6b-b4ce4560c413 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:34.003412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fb6a6382-f7ed-4a2f-ae6b-b4ce4560c413 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:34.004962 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fb6a6382-f7ed-4a2f-ae6b-b4ce4560c413 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:34.006050 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fb6a6382-f7ed-4a2f-ae6b-b4ce4560c413 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.152058 Aug 10 12:58:34.006608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1051/2118] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:33 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:34.874319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-aa9040f8-6f9f-4c02-a49d-bb6110a5388e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:34.874862 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-aa9040f8-6f9f-4c02-a49d-bb6110a5388e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:34.882843 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aa9040f8-6f9f-4c02-a49d-bb6110a5388e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:34.883361 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aa9040f8-6f9f-4c02-a49d-bb6110a5388e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:34.883807 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aa9040f8-6f9f-4c02-a49d-bb6110a5388e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:34.884503 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aa9040f8-6f9f-4c02-a49d-bb6110a5388e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:34.884917 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d281008e-5bb7-41b4-af46-49f108a1a1f7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:34.885410 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aa9040f8-6f9f-4c02-a49d-bb6110a5388e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:34.885410 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aa9040f8-6f9f-4c02-a49d-bb6110a5388e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:34.886458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d281008e-5bb7-41b4-af46-49f108a1a1f7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:34.892244 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d281008e-5bb7-41b4-af46-49f108a1a1f7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:34.892724 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d281008e-5bb7-41b4-af46-49f108a1a1f7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:34.893151 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d281008e-5bb7-41b4-af46-49f108a1a1f7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:34.893840 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d281008e-5bb7-41b4-af46-49f108a1a1f7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:34.894283 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d281008e-5bb7-41b4-af46-49f108a1a1f7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:34.894705 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d281008e-5bb7-41b4-af46-49f108a1a1f7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:35.083547 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-aa9040f8-6f9f-4c02-a49d-bb6110a5388e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:35.086964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d281008e-5bb7-41b4-af46-49f108a1a1f7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:35.092142 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-aa9040f8-6f9f-4c02-a49d-bb6110a5388e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.221709 Aug 10 12:58:35.092728 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1068/2119] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:34 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:35.096242 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d281008e-5bb7-41b4-af46-49f108a1a1f7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.215180 Aug 10 12:58:35.097015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1052/2120] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:34 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:35.097593 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6f2ec801-fdb9-4adf-9a57-db631e554ec6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:35.098196 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6f2ec801-fdb9-4adf-9a57-db631e554ec6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:35.104483 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f2ec801-fdb9-4adf-9a57-db631e554ec6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:35.105090 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f2ec801-fdb9-4adf-9a57-db631e554ec6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:35.105753 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f2ec801-fdb9-4adf-9a57-db631e554ec6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:35.106446 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f2ec801-fdb9-4adf-9a57-db631e554ec6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:35.107442 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f2ec801-fdb9-4adf-9a57-db631e554ec6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:35.107872 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f2ec801-fdb9-4adf-9a57-db631e554ec6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:35.122350 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:58:35.244092 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6f2ec801-fdb9-4adf-9a57-db631e554ec6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:35.254089 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6f2ec801-fdb9-4adf-9a57-db631e554ec6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:35.255738 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6f2ec801-fdb9-4adf-9a57-db631e554ec6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:35.256913 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6f2ec801-fdb9-4adf-9a57-db631e554ec6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.163191 Aug 10 12:58:35.257481 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1069/2121] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:35 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:35.518487 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:58:35.518690 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Wed Aug 10 12:58:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 12:58:36.113968 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-68eae58a-d5e9-479e-9a8d-35328418fe48 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:36.114581 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-68eae58a-d5e9-479e-9a8d-35328418fe48 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:36.117485 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0e5cbbd0-55c1-461f-94ec-a3ad4b07fc3a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:36.118111 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0e5cbbd0-55c1-461f-94ec-a3ad4b07fc3a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:36.120436 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:58:36.121120 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68eae58a-d5e9-479e-9a8d-35328418fe48 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:36.121609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68eae58a-d5e9-479e-9a8d-35328418fe48 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:36.122047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68eae58a-d5e9-479e-9a8d-35328418fe48 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:36.122742 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68eae58a-d5e9-479e-9a8d-35328418fe48 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:36.123868 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68eae58a-d5e9-479e-9a8d-35328418fe48 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:36.124292 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68eae58a-d5e9-479e-9a8d-35328418fe48 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:36.125957 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e5cbbd0-55c1-461f-94ec-a3ad4b07fc3a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:36.126432 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e5cbbd0-55c1-461f-94ec-a3ad4b07fc3a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:36.126860 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e5cbbd0-55c1-461f-94ec-a3ad4b07fc3a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:36.127569 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e5cbbd0-55c1-461f-94ec-a3ad4b07fc3a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:36.128012 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e5cbbd0-55c1-461f-94ec-a3ad4b07fc3a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:36.128426 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e5cbbd0-55c1-461f-94ec-a3ad4b07fc3a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:36.312714 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-68eae58a-d5e9-479e-9a8d-35328418fe48 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:36.320901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-68eae58a-d5e9-479e-9a8d-35328418fe48 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.210659 Aug 10 12:58:36.321294 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1053/2122] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:36 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:36.323563 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0e5cbbd0-55c1-461f-94ec-a3ad4b07fc3a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:36.325719 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4fe69c8e-e3cb-4b4f-9c37-3c88e92e1856 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:36.326358 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4fe69c8e-e3cb-4b4f-9c37-3c88e92e1856 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:36.331835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0e5cbbd0-55c1-461f-94ec-a3ad4b07fc3a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.218058 Aug 10 12:58:36.332070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4fe69c8e-e3cb-4b4f-9c37-3c88e92e1856 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:36.332561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1070/2123] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:36 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:36.332703 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4fe69c8e-e3cb-4b4f-9c37-3c88e92e1856 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:36.332901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4fe69c8e-e3cb-4b4f-9c37-3c88e92e1856 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:36.333657 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4fe69c8e-e3cb-4b4f-9c37-3c88e92e1856 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:36.334111 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4fe69c8e-e3cb-4b4f-9c37-3c88e92e1856 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:36.334535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4fe69c8e-e3cb-4b4f-9c37-3c88e92e1856 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:36.461183 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4fe69c8e-e3cb-4b4f-9c37-3c88e92e1856 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:36.470495 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4fe69c8e-e3cb-4b4f-9c37-3c88e92e1856 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:36.472038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4fe69c8e-e3cb-4b4f-9c37-3c88e92e1856 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:36.473187 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4fe69c8e-e3cb-4b4f-9c37-3c88e92e1856 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.150989 Aug 10 12:58:36.473745 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1054/2124] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:36 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:37.341744 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fa133667-8137-4b8c-bda3-adc6de4f2b1b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:37.342429 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fa133667-8137-4b8c-bda3-adc6de4f2b1b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:37.348766 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa133667-8137-4b8c-bda3-adc6de4f2b1b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:37.349239 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa133667-8137-4b8c-bda3-adc6de4f2b1b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:37.349676 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa133667-8137-4b8c-bda3-adc6de4f2b1b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:37.350373 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa133667-8137-4b8c-bda3-adc6de4f2b1b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:37.350841 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa133667-8137-4b8c-bda3-adc6de4f2b1b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:37.351282 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa133667-8137-4b8c-bda3-adc6de4f2b1b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:37.353979 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3167227f-18fc-437e-b670-dbdf9d16e519 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:37.354587 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3167227f-18fc-437e-b670-dbdf9d16e519 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:37.361514 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3167227f-18fc-437e-b670-dbdf9d16e519 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:37.361987 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3167227f-18fc-437e-b670-dbdf9d16e519 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:37.362415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3167227f-18fc-437e-b670-dbdf9d16e519 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:37.363094 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3167227f-18fc-437e-b670-dbdf9d16e519 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:37.363576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3167227f-18fc-437e-b670-dbdf9d16e519 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:37.363992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3167227f-18fc-437e-b670-dbdf9d16e519 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:37.549672 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fa133667-8137-4b8c-bda3-adc6de4f2b1b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:37.553762 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3167227f-18fc-437e-b670-dbdf9d16e519 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:37.557831 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fa133667-8137-4b8c-bda3-adc6de4f2b1b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.219921 Aug 10 12:58:37.558409 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1071/2125] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:37 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:37.562638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3167227f-18fc-437e-b670-dbdf9d16e519 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.212642 Aug 10 12:58:37.563360 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1055/2126] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:37 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:37.563653 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-50a85416-faf9-4508-9931-f2f775cb423a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:37.564398 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-50a85416-faf9-4508-9931-f2f775cb423a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:37.570212 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50a85416-faf9-4508-9931-f2f775cb423a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:37.570689 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50a85416-faf9-4508-9931-f2f775cb423a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:37.571125 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50a85416-faf9-4508-9931-f2f775cb423a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:37.571844 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50a85416-faf9-4508-9931-f2f775cb423a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:37.572298 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50a85416-faf9-4508-9931-f2f775cb423a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:37.572748 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-50a85416-faf9-4508-9931-f2f775cb423a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:37.699966 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-50a85416-faf9-4508-9931-f2f775cb423a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:37.708941 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-50a85416-faf9-4508-9931-f2f775cb423a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:37.710432 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-50a85416-faf9-4508-9931-f2f775cb423a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:37.711626 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-50a85416-faf9-4508-9931-f2f775cb423a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.152299 Aug 10 12:58:37.712187 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1072/2127] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:37 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:38.579423 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7e498332-c261-4daf-9d26-a9c3658a441c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:38.579975 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7e498332-c261-4daf-9d26-a9c3658a441c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:38.583754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3ef625f2-b042-4900-82a4-b4651fbc5b3e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:38.584404 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3ef625f2-b042-4900-82a4-b4651fbc5b3e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:38.586445 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7e498332-c261-4daf-9d26-a9c3658a441c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:38.586916 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7e498332-c261-4daf-9d26-a9c3658a441c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:38.587393 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7e498332-c261-4daf-9d26-a9c3658a441c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:38.588074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7e498332-c261-4daf-9d26-a9c3658a441c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:38.588554 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7e498332-c261-4daf-9d26-a9c3658a441c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:38.588972 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7e498332-c261-4daf-9d26-a9c3658a441c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:38.590836 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ef625f2-b042-4900-82a4-b4651fbc5b3e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:38.591349 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ef625f2-b042-4900-82a4-b4651fbc5b3e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:38.592346 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ef625f2-b042-4900-82a4-b4651fbc5b3e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:38.593038 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ef625f2-b042-4900-82a4-b4651fbc5b3e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:38.593491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ef625f2-b042-4900-82a4-b4651fbc5b3e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:38.593916 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ef625f2-b042-4900-82a4-b4651fbc5b3e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:38.786729 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7e498332-c261-4daf-9d26-a9c3658a441c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:38.790440 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:58:38.796027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3ef625f2-b042-4900-82a4-b4651fbc5b3e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:38.799440 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7e498332-c261-4daf-9d26-a9c3658a441c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.224101 Aug 10 12:58:38.800453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1056/2128] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:38 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:38.805833 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-765d934b-1641-4296-8faf-5220ef9ccad4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:38.806673 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-765d934b-1641-4296-8faf-5220ef9ccad4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:38.813128 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-765d934b-1641-4296-8faf-5220ef9ccad4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:38.813877 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-765d934b-1641-4296-8faf-5220ef9ccad4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:38.814517 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-765d934b-1641-4296-8faf-5220ef9ccad4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:38.815448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-765d934b-1641-4296-8faf-5220ef9ccad4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:38.816094 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-765d934b-1641-4296-8faf-5220ef9ccad4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:38.816732 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-765d934b-1641-4296-8faf-5220ef9ccad4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:38.817503 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3ef625f2-b042-4900-82a4-b4651fbc5b3e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.237603 Aug 10 12:58:38.818463 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1073/2129] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:38 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:38.963770 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-765d934b-1641-4296-8faf-5220ef9ccad4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:38.972701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-765d934b-1641-4296-8faf-5220ef9ccad4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:38.974217 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-765d934b-1641-4296-8faf-5220ef9ccad4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:38.975403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-765d934b-1641-4296-8faf-5220ef9ccad4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.173867 Aug 10 12:58:38.975973 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1057/2130] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:38 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:39.821780 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-713b6238-c4cf-4140-bee1-b675d37af435 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:39.822388 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-713b6238-c4cf-4140-bee1-b675d37af435 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:39.829350 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-713b6238-c4cf-4140-bee1-b675d37af435 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:39.829819 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-713b6238-c4cf-4140-bee1-b675d37af435 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:39.830242 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-713b6238-c4cf-4140-bee1-b675d37af435 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:39.830915 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-713b6238-c4cf-4140-bee1-b675d37af435 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:39.831390 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-713b6238-c4cf-4140-bee1-b675d37af435 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:39.831807 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-713b6238-c4cf-4140-bee1-b675d37af435 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:39.840750 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-cb062450-0903-481e-830c-f21182d50d4b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:39.841355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-cb062450-0903-481e-830c-f21182d50d4b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:39.848329 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb062450-0903-481e-830c-f21182d50d4b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:39.848808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb062450-0903-481e-830c-f21182d50d4b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:39.849233 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb062450-0903-481e-830c-f21182d50d4b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:39.849920 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb062450-0903-481e-830c-f21182d50d4b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:39.850363 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb062450-0903-481e-830c-f21182d50d4b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:39.850782 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb062450-0903-481e-830c-f21182d50d4b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:40.032560 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-713b6238-c4cf-4140-bee1-b675d37af435 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:40.047336 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-cb062450-0903-481e-830c-f21182d50d4b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:40.047524 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-713b6238-c4cf-4140-bee1-b675d37af435 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.222768 Aug 10 12:58:40.047524 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1074/2131] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:39 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:40.047524 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-28d47333-a02d-429d-8594-1736347f563c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:40.047524 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-28d47333-a02d-429d-8594-1736347f563c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:40.047861 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-cb062450-0903-481e-830c-f21182d50d4b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.210328 Aug 10 12:58:40.048897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1058/2132] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:39 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:40.053017 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-28d47333-a02d-429d-8594-1736347f563c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:40.053488 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-28d47333-a02d-429d-8594-1736347f563c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:40.053915 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-28d47333-a02d-429d-8594-1736347f563c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:40.054639 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-28d47333-a02d-429d-8594-1736347f563c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:40.055093 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-28d47333-a02d-429d-8594-1736347f563c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:40.055573 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-28d47333-a02d-429d-8594-1736347f563c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:40.186180 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-28d47333-a02d-429d-8594-1736347f563c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:40.194478 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-28d47333-a02d-429d-8594-1736347f563c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:40.196020 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-28d47333-a02d-429d-8594-1736347f563c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:40.197186 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-28d47333-a02d-429d-8594-1736347f563c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.154965 Aug 10 12:58:40.197748 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1075/2133] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:40 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:41.065549 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7ed1a5e7-837a-4828-b4d0-a3bc136ff34a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:41.066167 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7ed1a5e7-837a-4828-b4d0-a3bc136ff34a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:41.068683 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-47017277-6834-4707-b792-9724b2673a0f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:41.069303 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-47017277-6834-4707-b792-9724b2673a0f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:41.072819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7ed1a5e7-837a-4828-b4d0-a3bc136ff34a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:41.073298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7ed1a5e7-837a-4828-b4d0-a3bc136ff34a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:41.073727 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7ed1a5e7-837a-4828-b4d0-a3bc136ff34a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:41.074429 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7ed1a5e7-837a-4828-b4d0-a3bc136ff34a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:41.074895 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7ed1a5e7-837a-4828-b4d0-a3bc136ff34a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:41.075377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7ed1a5e7-837a-4828-b4d0-a3bc136ff34a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:41.075635 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-47017277-6834-4707-b792-9724b2673a0f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:41.077344 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-47017277-6834-4707-b792-9724b2673a0f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:41.077772 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-47017277-6834-4707-b792-9724b2673a0f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:41.078469 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-47017277-6834-4707-b792-9724b2673a0f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:41.078923 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-47017277-6834-4707-b792-9724b2673a0f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:41.079444 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-47017277-6834-4707-b792-9724b2673a0f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:41.275452 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7ed1a5e7-837a-4828-b4d0-a3bc136ff34a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:41.278608 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-47017277-6834-4707-b792-9724b2673a0f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:41.284836 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7ed1a5e7-837a-4828-b4d0-a3bc136ff34a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.223199 Aug 10 12:58:41.285418 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1059/2134] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:41 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:41.288245 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-47017277-6834-4707-b792-9724b2673a0f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.223525 Aug 10 12:58:41.289162 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1076/2135] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:41 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:41.289969 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a5b8b372-3aab-459e-bbcb-d6b1315bd979 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:41.290565 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a5b8b372-3aab-459e-bbcb-d6b1315bd979 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:41.296468 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5b8b372-3aab-459e-bbcb-d6b1315bd979 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:41.296953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5b8b372-3aab-459e-bbcb-d6b1315bd979 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:41.297390 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5b8b372-3aab-459e-bbcb-d6b1315bd979 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:41.298126 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5b8b372-3aab-459e-bbcb-d6b1315bd979 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:41.298586 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5b8b372-3aab-459e-bbcb-d6b1315bd979 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:41.299060 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5b8b372-3aab-459e-bbcb-d6b1315bd979 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:41.429431 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a5b8b372-3aab-459e-bbcb-d6b1315bd979 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:41.437722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a5b8b372-3aab-459e-bbcb-d6b1315bd979 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:41.439244 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a5b8b372-3aab-459e-bbcb-d6b1315bd979 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:41.440399 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a5b8b372-3aab-459e-bbcb-d6b1315bd979 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.154040 Aug 10 12:58:41.440964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1060/2136] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:41 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:42.305920 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ad8b83ad-03c4-4e7f-9d7d-e416ccfae294 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:42.306534 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ad8b83ad-03c4-4e7f-9d7d-e416ccfae294 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:42.309003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e47ec9ea-d9b0-4949-895b-daad28fed062 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:42.309612 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e47ec9ea-d9b0-4949-895b-daad28fed062 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:42.313297 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad8b83ad-03c4-4e7f-9d7d-e416ccfae294 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:42.313839 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad8b83ad-03c4-4e7f-9d7d-e416ccfae294 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:42.314270 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad8b83ad-03c4-4e7f-9d7d-e416ccfae294 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:42.314950 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad8b83ad-03c4-4e7f-9d7d-e416ccfae294 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:42.315416 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad8b83ad-03c4-4e7f-9d7d-e416ccfae294 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:42.315832 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad8b83ad-03c4-4e7f-9d7d-e416ccfae294 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:42.316034 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e47ec9ea-d9b0-4949-895b-daad28fed062 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:42.316503 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e47ec9ea-d9b0-4949-895b-daad28fed062 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:42.317019 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e47ec9ea-d9b0-4949-895b-daad28fed062 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:42.317697 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e47ec9ea-d9b0-4949-895b-daad28fed062 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:42.318171 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e47ec9ea-d9b0-4949-895b-daad28fed062 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:42.318584 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e47ec9ea-d9b0-4949-895b-daad28fed062 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:42.508783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e47ec9ea-d9b0-4949-895b-daad28fed062 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:42.512144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ad8b83ad-03c4-4e7f-9d7d-e416ccfae294 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:42.517681 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e47ec9ea-d9b0-4949-895b-daad28fed062 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.212473 Aug 10 12:58:42.518264 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1061/2137] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:42 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:42.520986 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ad8b83ad-03c4-4e7f-9d7d-e416ccfae294 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.218993 Aug 10 12:58:42.521634 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1077/2138] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:42 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:42.522666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6fe492f1-0bdf-4496-afa6-82f053af1a39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:42.523560 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6fe492f1-0bdf-4496-afa6-82f053af1a39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:42.529414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6fe492f1-0bdf-4496-afa6-82f053af1a39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:42.530651 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6fe492f1-0bdf-4496-afa6-82f053af1a39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:42.531158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6fe492f1-0bdf-4496-afa6-82f053af1a39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:42.532002 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6fe492f1-0bdf-4496-afa6-82f053af1a39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:42.532457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6fe492f1-0bdf-4496-afa6-82f053af1a39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:42.532889 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6fe492f1-0bdf-4496-afa6-82f053af1a39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:42.663968 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6fe492f1-0bdf-4496-afa6-82f053af1a39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:42.672566 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6fe492f1-0bdf-4496-afa6-82f053af1a39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:42.674060 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6fe492f1-0bdf-4496-afa6-82f053af1a39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:42.675446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6fe492f1-0bdf-4496-afa6-82f053af1a39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.156192 Aug 10 12:58:42.676019 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1062/2139] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:42 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:43.539473 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4cc3a480-cbdd-43dd-b737-5df6e94e0d40 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:43.540146 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4cc3a480-cbdd-43dd-b737-5df6e94e0d40 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:43.541849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-76711a21-f877-4384-a317-4e6d9a4db207 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:43.542542 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-76711a21-f877-4384-a317-4e6d9a4db207 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:43.548199 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4cc3a480-cbdd-43dd-b737-5df6e94e0d40 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:43.548685 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4cc3a480-cbdd-43dd-b737-5df6e94e0d40 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:43.549115 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4cc3a480-cbdd-43dd-b737-5df6e94e0d40 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:43.549811 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4cc3a480-cbdd-43dd-b737-5df6e94e0d40 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:43.550261 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4cc3a480-cbdd-43dd-b737-5df6e94e0d40 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:43.550679 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4cc3a480-cbdd-43dd-b737-5df6e94e0d40 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:43.550806 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76711a21-f877-4384-a317-4e6d9a4db207 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:43.551382 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76711a21-f877-4384-a317-4e6d9a4db207 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:43.551886 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76711a21-f877-4384-a317-4e6d9a4db207 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:43.552664 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76711a21-f877-4384-a317-4e6d9a4db207 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:43.553123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76711a21-f877-4384-a317-4e6d9a4db207 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:43.553551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76711a21-f877-4384-a317-4e6d9a4db207 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:43.854264 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4cc3a480-cbdd-43dd-b737-5df6e94e0d40 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:43.860658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-76711a21-f877-4384-a317-4e6d9a4db207 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:43.863423 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4cc3a480-cbdd-43dd-b737-5df6e94e0d40 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.327791 Aug 10 12:58:43.864565 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1078/2140] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:43 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:43.868643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-76711a21-f877-4384-a317-4e6d9a4db207 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.330775 Aug 10 12:58:43.880141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1063/2141] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:43 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:43.880705 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b3886e2b-587a-450f-820d-6243f7e2e910 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:43.881411 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b3886e2b-587a-450f-820d-6243f7e2e910 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:43.887336 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b3886e2b-587a-450f-820d-6243f7e2e910 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:43.887820 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b3886e2b-587a-450f-820d-6243f7e2e910 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:43.888251 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b3886e2b-587a-450f-820d-6243f7e2e910 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:43.888985 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b3886e2b-587a-450f-820d-6243f7e2e910 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:43.889435 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b3886e2b-587a-450f-820d-6243f7e2e910 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:43.889856 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b3886e2b-587a-450f-820d-6243f7e2e910 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:44.022296 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b3886e2b-587a-450f-820d-6243f7e2e910 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:44.031302 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b3886e2b-587a-450f-820d-6243f7e2e910 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:44.032813 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b3886e2b-587a-450f-820d-6243f7e2e910 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:44.033978 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b3886e2b-587a-450f-820d-6243f7e2e910 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.168285 Aug 10 12:58:44.034539 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1079/2142] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:43 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:44.884803 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3cd3c55b-df6c-486b-a122-d7bed058e4e5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:44.885393 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3cd3c55b-df6c-486b-a122-d7bed058e4e5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:44.889427 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-aa328311-01b5-4f55-8556-e7ebfb02086a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:44.890069 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-aa328311-01b5-4f55-8556-e7ebfb02086a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:44.892100 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3cd3c55b-df6c-486b-a122-d7bed058e4e5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:44.892582 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3cd3c55b-df6c-486b-a122-d7bed058e4e5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:44.893018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3cd3c55b-df6c-486b-a122-d7bed058e4e5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:44.893709 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3cd3c55b-df6c-486b-a122-d7bed058e4e5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:44.894165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3cd3c55b-df6c-486b-a122-d7bed058e4e5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:44.894605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3cd3c55b-df6c-486b-a122-d7bed058e4e5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:44.896314 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aa328311-01b5-4f55-8556-e7ebfb02086a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:44.896790 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aa328311-01b5-4f55-8556-e7ebfb02086a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:44.897242 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aa328311-01b5-4f55-8556-e7ebfb02086a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:44.897926 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aa328311-01b5-4f55-8556-e7ebfb02086a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:44.898369 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aa328311-01b5-4f55-8556-e7ebfb02086a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:44.898789 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aa328311-01b5-4f55-8556-e7ebfb02086a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:45.088167 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3cd3c55b-df6c-486b-a122-d7bed058e4e5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:45.091133 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-aa328311-01b5-4f55-8556-e7ebfb02086a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:45.096127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3cd3c55b-df6c-486b-a122-d7bed058e4e5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.215115 Aug 10 12:58:45.096777 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1064/2143] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:44 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:45.099539 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-aa328311-01b5-4f55-8556-e7ebfb02086a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.213896 Aug 10 12:58:45.100252 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1080/2144] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:44 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:45.101161 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-560adf44-2a67-4df6-81fc-e316f3151d14 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:45.101757 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-560adf44-2a67-4df6-81fc-e316f3151d14 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:45.108210 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-560adf44-2a67-4df6-81fc-e316f3151d14 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:45.108820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-560adf44-2a67-4df6-81fc-e316f3151d14 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:45.109067 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-560adf44-2a67-4df6-81fc-e316f3151d14 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:45.109748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-560adf44-2a67-4df6-81fc-e316f3151d14 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:45.110192 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-560adf44-2a67-4df6-81fc-e316f3151d14 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:45.110609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-560adf44-2a67-4df6-81fc-e316f3151d14 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:45.247094 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-560adf44-2a67-4df6-81fc-e316f3151d14 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:45.257158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-560adf44-2a67-4df6-81fc-e316f3151d14 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:45.257309 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-560adf44-2a67-4df6-81fc-e316f3151d14 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:45.258344 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-560adf44-2a67-4df6-81fc-e316f3151d14 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.160663 Aug 10 12:58:45.258936 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1065/2145] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:45 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:46.118288 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-41dbb062-adb9-4c8c-8628-92725ef6dd97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:46.118843 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-41dbb062-adb9-4c8c-8628-92725ef6dd97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:46.121255 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c59aa1b2-1f03-4f67-bb88-a64ae25bc1e9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:46.121868 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c59aa1b2-1f03-4f67-bb88-a64ae25bc1e9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:46.126093 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-41dbb062-adb9-4c8c-8628-92725ef6dd97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:46.126700 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-41dbb062-adb9-4c8c-8628-92725ef6dd97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:46.127138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-41dbb062-adb9-4c8c-8628-92725ef6dd97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:46.127867 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-41dbb062-adb9-4c8c-8628-92725ef6dd97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:46.128315 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-41dbb062-adb9-4c8c-8628-92725ef6dd97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:46.128688 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c59aa1b2-1f03-4f67-bb88-a64ae25bc1e9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:46.128808 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-41dbb062-adb9-4c8c-8628-92725ef6dd97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:46.129166 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c59aa1b2-1f03-4f67-bb88-a64ae25bc1e9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:46.129599 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c59aa1b2-1f03-4f67-bb88-a64ae25bc1e9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:46.130281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c59aa1b2-1f03-4f67-bb88-a64ae25bc1e9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:46.130732 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c59aa1b2-1f03-4f67-bb88-a64ae25bc1e9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:46.131157 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c59aa1b2-1f03-4f67-bb88-a64ae25bc1e9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:46.325039 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-41dbb062-adb9-4c8c-8628-92725ef6dd97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:46.332464 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c59aa1b2-1f03-4f67-bb88-a64ae25bc1e9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:46.333682 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-41dbb062-adb9-4c8c-8628-92725ef6dd97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.219456 Aug 10 12:58:46.334257 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1081/2146] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:46 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:46.338880 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b82a824a-7c94-48ef-b181-ad701b9baa02 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:46.339514 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b82a824a-7c94-48ef-b181-ad701b9baa02 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:46.340603 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c59aa1b2-1f03-4f67-bb88-a64ae25bc1e9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.223157 Aug 10 12:58:46.341326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1066/2147] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:46 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:46.345755 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b82a824a-7c94-48ef-b181-ad701b9baa02 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:46.346235 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b82a824a-7c94-48ef-b181-ad701b9baa02 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:46.346666 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b82a824a-7c94-48ef-b181-ad701b9baa02 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:46.347374 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b82a824a-7c94-48ef-b181-ad701b9baa02 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:46.347823 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b82a824a-7c94-48ef-b181-ad701b9baa02 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:46.348243 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b82a824a-7c94-48ef-b181-ad701b9baa02 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:46.474357 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b82a824a-7c94-48ef-b181-ad701b9baa02 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:46.483007 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b82a824a-7c94-48ef-b181-ad701b9baa02 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:46.484548 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b82a824a-7c94-48ef-b181-ad701b9baa02 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:46.485708 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b82a824a-7c94-48ef-b181-ad701b9baa02 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.150327 Aug 10 12:58:46.486272 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1082/2148] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:46 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:47.355887 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9babbc71-e45a-41e9-a8bc-733ba62102e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:47.356596 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9babbc71-e45a-41e9-a8bc-733ba62102e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:47.362564 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b031e374-95f6-4e3b-b266-1854e1269303 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:47.363167 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b031e374-95f6-4e3b-b266-1854e1269303 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:47.363739 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9babbc71-e45a-41e9-a8bc-733ba62102e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:47.364220 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9babbc71-e45a-41e9-a8bc-733ba62102e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:47.364654 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9babbc71-e45a-41e9-a8bc-733ba62102e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:47.365349 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9babbc71-e45a-41e9-a8bc-733ba62102e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:47.365801 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9babbc71-e45a-41e9-a8bc-733ba62102e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:47.366223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9babbc71-e45a-41e9-a8bc-733ba62102e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:47.369430 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b031e374-95f6-4e3b-b266-1854e1269303 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:47.369904 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b031e374-95f6-4e3b-b266-1854e1269303 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:47.370327 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b031e374-95f6-4e3b-b266-1854e1269303 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:47.371002 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b031e374-95f6-4e3b-b266-1854e1269303 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:47.371472 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b031e374-95f6-4e3b-b266-1854e1269303 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:47.371889 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b031e374-95f6-4e3b-b266-1854e1269303 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:47.564387 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9babbc71-e45a-41e9-a8bc-733ba62102e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:47.568345 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b031e374-95f6-4e3b-b266-1854e1269303 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:47.572483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9babbc71-e45a-41e9-a8bc-733ba62102e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.220703 Aug 10 12:58:47.573058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1067/2149] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:47 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:47.576363 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b031e374-95f6-4e3b-b266-1854e1269303 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.218257 Aug 10 12:58:47.576925 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1083/2150] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:47 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:47.578278 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-70528c70-778b-42b7-b033-89e0131563d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:47.578968 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-70528c70-778b-42b7-b033-89e0131563d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:47.584785 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-70528c70-778b-42b7-b033-89e0131563d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:47.585268 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-70528c70-778b-42b7-b033-89e0131563d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:47.585703 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-70528c70-778b-42b7-b033-89e0131563d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:47.586398 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-70528c70-778b-42b7-b033-89e0131563d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:47.586846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-70528c70-778b-42b7-b033-89e0131563d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:47.587299 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-70528c70-778b-42b7-b033-89e0131563d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:47.719523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-70528c70-778b-42b7-b033-89e0131563d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:47.728542 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-70528c70-778b-42b7-b033-89e0131563d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:47.730059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-70528c70-778b-42b7-b033-89e0131563d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:47.731234 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-70528c70-778b-42b7-b033-89e0131563d1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.157232 Aug 10 12:58:47.731791 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1068/2151] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:47 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:48.078650 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ed2ec360-0518-4668-87c9-350e9f20ff5f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:48.079153 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ed2ec360-0518-4668-87c9-350e9f20ff5f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:48.085200 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ed2ec360-0518-4668-87c9-350e9f20ff5f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:48.085685 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ed2ec360-0518-4668-87c9-350e9f20ff5f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:48.086122 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ed2ec360-0518-4668-87c9-350e9f20ff5f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:48.086825 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ed2ec360-0518-4668-87c9-350e9f20ff5f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:48.087302 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ed2ec360-0518-4668-87c9-350e9f20ff5f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:48.087728 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ed2ec360-0518-4668-87c9-350e9f20ff5f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:48.114306 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ed2ec360-0518-4668-87c9-350e9f20ff5f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Going to try to terminate instance {{(pid=124642) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 12:58:48.210571 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:58:48.325679 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ed2ec360-0518-4668-87c9-350e9f20ff5f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 204 len: 0 microversion: 2.1 time: 0.251078 Aug 10 12:58:48.326363 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1084/2152] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 12:58:48 2022] DELETE /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 12:58:48.334440 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ce057019-9fea-449e-bc2d-6fb072013b2d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:48.335051 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ce057019-9fea-449e-bc2d-6fb072013b2d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:48.340900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce057019-9fea-449e-bc2d-6fb072013b2d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:48.341381 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce057019-9fea-449e-bc2d-6fb072013b2d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:48.341816 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce057019-9fea-449e-bc2d-6fb072013b2d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:48.342505 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce057019-9fea-449e-bc2d-6fb072013b2d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:48.342960 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce057019-9fea-449e-bc2d-6fb072013b2d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:48.343408 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce057019-9fea-449e-bc2d-6fb072013b2d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:48.472495 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ce057019-9fea-449e-bc2d-6fb072013b2d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:48.480607 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ce057019-9fea-449e-bc2d-6fb072013b2d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.150107 Aug 10 12:58:48.481181 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1069/2153] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:48 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:48.596101 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-77caa3e6-9fa6-40df-b977-1129ce0d3d82 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:48.596801 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-77caa3e6-9fa6-40df-b977-1129ce0d3d82 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:48.598071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-33ce36be-484a-4e4c-8d8a-50fc540efa09 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:48.598678 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-33ce36be-484a-4e4c-8d8a-50fc540efa09 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:48.603698 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-77caa3e6-9fa6-40df-b977-1129ce0d3d82 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:48.604189 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-77caa3e6-9fa6-40df-b977-1129ce0d3d82 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:48.604622 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-77caa3e6-9fa6-40df-b977-1129ce0d3d82 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:48.604843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-33ce36be-484a-4e4c-8d8a-50fc540efa09 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:48.605314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-33ce36be-484a-4e4c-8d8a-50fc540efa09 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:48.605453 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-77caa3e6-9fa6-40df-b977-1129ce0d3d82 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:48.605743 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-33ce36be-484a-4e4c-8d8a-50fc540efa09 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:48.605855 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-77caa3e6-9fa6-40df-b977-1129ce0d3d82 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:48.606169 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-77caa3e6-9fa6-40df-b977-1129ce0d3d82 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:48.606423 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-33ce36be-484a-4e4c-8d8a-50fc540efa09 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:48.606867 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-33ce36be-484a-4e4c-8d8a-50fc540efa09 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:48.607304 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-33ce36be-484a-4e4c-8d8a-50fc540efa09 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:48.802992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-33ce36be-484a-4e4c-8d8a-50fc540efa09 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:48.806787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-77caa3e6-9fa6-40df-b977-1129ce0d3d82 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:48.811065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-33ce36be-484a-4e4c-8d8a-50fc540efa09 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.217336 Aug 10 12:58:48.811684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1070/2154] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:48 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:48.815415 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-77caa3e6-9fa6-40df-b977-1129ce0d3d82 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.224543 Aug 10 12:58:48.816266 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1085/2155] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:48 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:48.824582 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-422327b5-1511-44a6-bde0-bf0ab9b70c33 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:48.825196 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-422327b5-1511-44a6-bde0-bf0ab9b70c33 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:48.831948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-422327b5-1511-44a6-bde0-bf0ab9b70c33 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:48.832430 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-422327b5-1511-44a6-bde0-bf0ab9b70c33 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:48.832862 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-422327b5-1511-44a6-bde0-bf0ab9b70c33 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:48.833580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-422327b5-1511-44a6-bde0-bf0ab9b70c33 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:48.834029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-422327b5-1511-44a6-bde0-bf0ab9b70c33 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:48.834449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-422327b5-1511-44a6-bde0-bf0ab9b70c33 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:48.962585 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-422327b5-1511-44a6-bde0-bf0ab9b70c33 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:48.971526 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-422327b5-1511-44a6-bde0-bf0ab9b70c33 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:48.973090 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-422327b5-1511-44a6-bde0-bf0ab9b70c33 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:48.974198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-422327b5-1511-44a6-bde0-bf0ab9b70c33 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.161608 Aug 10 12:58:48.974788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1071/2156] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:48 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:49.501877 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-487136fd-c885-435d-aac9-054b7aacf8e0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:49.502523 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-487136fd-c885-435d-aac9-054b7aacf8e0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:49.508615 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-487136fd-c885-435d-aac9-054b7aacf8e0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:49.509119 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-487136fd-c885-435d-aac9-054b7aacf8e0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:49.509564 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-487136fd-c885-435d-aac9-054b7aacf8e0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:49.510256 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-487136fd-c885-435d-aac9-054b7aacf8e0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:49.510699 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-487136fd-c885-435d-aac9-054b7aacf8e0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:49.511116 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-487136fd-c885-435d-aac9-054b7aacf8e0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:49.640310 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-487136fd-c885-435d-aac9-054b7aacf8e0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:49.648464 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-487136fd-c885-435d-aac9-054b7aacf8e0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.151063 Aug 10 12:58:49.649040 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1086/2157] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:49 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:49.832447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-55c39a87-7f27-42ac-ada8-c8ead59012d5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:49.833058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-55c39a87-7f27-42ac-ada8-c8ead59012d5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:49.837529 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3c5191a5-f739-493a-95ba-1fa1203aaafc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:49.838147 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3c5191a5-f739-493a-95ba-1fa1203aaafc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:49.839634 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55c39a87-7f27-42ac-ada8-c8ead59012d5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:49.840055 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55c39a87-7f27-42ac-ada8-c8ead59012d5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:49.840478 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55c39a87-7f27-42ac-ada8-c8ead59012d5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:49.841163 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55c39a87-7f27-42ac-ada8-c8ead59012d5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:49.841605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55c39a87-7f27-42ac-ada8-c8ead59012d5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:49.842021 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55c39a87-7f27-42ac-ada8-c8ead59012d5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:49.844555 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3c5191a5-f739-493a-95ba-1fa1203aaafc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:49.845140 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3c5191a5-f739-493a-95ba-1fa1203aaafc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:49.845579 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3c5191a5-f739-493a-95ba-1fa1203aaafc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:49.846264 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3c5191a5-f739-493a-95ba-1fa1203aaafc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:49.846718 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3c5191a5-f739-493a-95ba-1fa1203aaafc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:49.847141 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3c5191a5-f739-493a-95ba-1fa1203aaafc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:50.037802 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-55c39a87-7f27-42ac-ada8-c8ead59012d5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:50.040763 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3c5191a5-f739-493a-95ba-1fa1203aaafc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:50.046240 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-55c39a87-7f27-42ac-ada8-c8ead59012d5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.217564 Aug 10 12:58:50.046822 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1072/2158] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:49 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:50.049709 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3c5191a5-f739-493a-95ba-1fa1203aaafc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.215921 Aug 10 12:58:50.050279 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1087/2159] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:49 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:50.060898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f6fe1869-1245-400b-8296-65209dd6f18c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:50.065131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f6fe1869-1245-400b-8296-65209dd6f18c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:50.067756 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6fe1869-1245-400b-8296-65209dd6f18c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:50.068238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6fe1869-1245-400b-8296-65209dd6f18c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:50.068678 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6fe1869-1245-400b-8296-65209dd6f18c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:50.069388 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6fe1869-1245-400b-8296-65209dd6f18c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:50.069840 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6fe1869-1245-400b-8296-65209dd6f18c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:50.070290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6fe1869-1245-400b-8296-65209dd6f18c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:50.085418 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:58:50.198251 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f6fe1869-1245-400b-8296-65209dd6f18c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:50.207243 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f6fe1869-1245-400b-8296-65209dd6f18c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:50.208758 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f6fe1869-1245-400b-8296-65209dd6f18c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:50.209910 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f6fe1869-1245-400b-8296-65209dd6f18c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.152843 Aug 10 12:58:50.210471 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1073/2160] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:50 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:50.669702 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0d62cad0-e734-42d4-a636-1c65e8df6314 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:50.670344 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0d62cad0-e734-42d4-a636-1c65e8df6314 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:50.677330 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0d62cad0-e734-42d4-a636-1c65e8df6314 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:50.677805 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0d62cad0-e734-42d4-a636-1c65e8df6314 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:50.678241 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0d62cad0-e734-42d4-a636-1c65e8df6314 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:50.678920 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0d62cad0-e734-42d4-a636-1c65e8df6314 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:50.679400 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0d62cad0-e734-42d4-a636-1c65e8df6314 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:50.679840 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0d62cad0-e734-42d4-a636-1c65e8df6314 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:50.810079 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0d62cad0-e734-42d4-a636-1c65e8df6314 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:50.818592 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0d62cad0-e734-42d4-a636-1c65e8df6314 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.152790 Aug 10 12:58:50.819167 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1088/2161] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:50 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:51.068258 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e938d349-c205-4bdf-856e-a0e5623297e9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:51.068838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e938d349-c205-4bdf-856e-a0e5623297e9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:51.071010 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1aeb8181-0d90-4d0c-8e8a-07bc443627ee tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:51.071653 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1aeb8181-0d90-4d0c-8e8a-07bc443627ee tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:51.075299 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e938d349-c205-4bdf-856e-a0e5623297e9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:51.075782 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e938d349-c205-4bdf-856e-a0e5623297e9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:51.076213 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e938d349-c205-4bdf-856e-a0e5623297e9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:51.076900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e938d349-c205-4bdf-856e-a0e5623297e9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:51.077355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e938d349-c205-4bdf-856e-a0e5623297e9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:51.077522 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1aeb8181-0d90-4d0c-8e8a-07bc443627ee tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:51.077773 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e938d349-c205-4bdf-856e-a0e5623297e9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:51.077986 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1aeb8181-0d90-4d0c-8e8a-07bc443627ee tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:51.078444 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1aeb8181-0d90-4d0c-8e8a-07bc443627ee tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:51.079147 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1aeb8181-0d90-4d0c-8e8a-07bc443627ee tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:51.079619 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1aeb8181-0d90-4d0c-8e8a-07bc443627ee tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:51.080077 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1aeb8181-0d90-4d0c-8e8a-07bc443627ee tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:51.496802 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-1aeb8181-0d90-4d0c-8e8a-07bc443627ee tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:51.497642 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e938d349-c205-4bdf-856e-a0e5623297e9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:51.506166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1aeb8181-0d90-4d0c-8e8a-07bc443627ee tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.437975 Aug 10 12:58:51.506476 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1089/2162] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:51 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:51.507068 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e938d349-c205-4bdf-856e-a0e5623297e9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.442721 Aug 10 12:58:51.511011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1074/2163] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:51 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:51.511205 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3df4ac20-7ab8-459a-9cf3-e14507e61cc9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:51.511689 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3df4ac20-7ab8-459a-9cf3-e14507e61cc9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:51.518043 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3df4ac20-7ab8-459a-9cf3-e14507e61cc9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:51.518520 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3df4ac20-7ab8-459a-9cf3-e14507e61cc9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:51.519093 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3df4ac20-7ab8-459a-9cf3-e14507e61cc9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:51.519670 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3df4ac20-7ab8-459a-9cf3-e14507e61cc9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:51.520117 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3df4ac20-7ab8-459a-9cf3-e14507e61cc9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:51.520536 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3df4ac20-7ab8-459a-9cf3-e14507e61cc9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:51.649044 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3df4ac20-7ab8-459a-9cf3-e14507e61cc9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:51.658078 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3df4ac20-7ab8-459a-9cf3-e14507e61cc9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:51.659543 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3df4ac20-7ab8-459a-9cf3-e14507e61cc9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:51.660698 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3df4ac20-7ab8-459a-9cf3-e14507e61cc9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.153259 Aug 10 12:58:51.661255 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1090/2164] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:51 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:51.839141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-91e25b4e-109a-4cab-8921-d0e16e4bf68f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:51.839777 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-91e25b4e-109a-4cab-8921-d0e16e4bf68f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:51.845688 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91e25b4e-109a-4cab-8921-d0e16e4bf68f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:51.846165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91e25b4e-109a-4cab-8921-d0e16e4bf68f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:51.846598 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91e25b4e-109a-4cab-8921-d0e16e4bf68f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:51.847319 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91e25b4e-109a-4cab-8921-d0e16e4bf68f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:51.847773 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91e25b4e-109a-4cab-8921-d0e16e4bf68f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:51.848193 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91e25b4e-109a-4cab-8921-d0e16e4bf68f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:51.973422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-91e25b4e-109a-4cab-8921-d0e16e4bf68f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:51.981443 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-91e25b4e-109a-4cab-8921-d0e16e4bf68f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.146117 Aug 10 12:58:51.981998 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1075/2165] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:51 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:52.528170 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-730bd371-b572-4e7a-b117-e6cc32fdc988 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:52.528979 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-730bd371-b572-4e7a-b117-e6cc32fdc988 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:52.529342 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-20d57df4-8831-46c8-b525-900e11bb1082 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:52.529953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-20d57df4-8831-46c8-b525-900e11bb1082 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:52.535553 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-730bd371-b572-4e7a-b117-e6cc32fdc988 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:52.535982 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-730bd371-b572-4e7a-b117-e6cc32fdc988 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:52.536415 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-730bd371-b572-4e7a-b117-e6cc32fdc988 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:52.536634 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-20d57df4-8831-46c8-b525-900e11bb1082 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:52.537108 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-730bd371-b572-4e7a-b117-e6cc32fdc988 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:52.537225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-20d57df4-8831-46c8-b525-900e11bb1082 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:52.537536 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-20d57df4-8831-46c8-b525-900e11bb1082 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:52.537651 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-730bd371-b572-4e7a-b117-e6cc32fdc988 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:52.537971 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-730bd371-b572-4e7a-b117-e6cc32fdc988 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:52.538220 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-20d57df4-8831-46c8-b525-900e11bb1082 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:52.538668 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-20d57df4-8831-46c8-b525-900e11bb1082 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:52.539085 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-20d57df4-8831-46c8-b525-900e11bb1082 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:52.735627 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-20d57df4-8831-46c8-b525-900e11bb1082 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:52.738973 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-730bd371-b572-4e7a-b117-e6cc32fdc988 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:52.743712 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-20d57df4-8831-46c8-b525-900e11bb1082 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.218112 Aug 10 12:58:52.744283 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1076/2166] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:52 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:52.748726 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-226994b7-0f26-491d-8e64-a37c3aeb43a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:52.749320 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-226994b7-0f26-491d-8e64-a37c3aeb43a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:52.754924 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-226994b7-0f26-491d-8e64-a37c3aeb43a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:52.755146 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-730bd371-b572-4e7a-b117-e6cc32fdc988 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.230820 Aug 10 12:58:52.755433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-226994b7-0f26-491d-8e64-a37c3aeb43a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:52.755848 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1091/2167] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:52 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:52.755981 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-226994b7-0f26-491d-8e64-a37c3aeb43a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:52.756865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-226994b7-0f26-491d-8e64-a37c3aeb43a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:52.757315 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-226994b7-0f26-491d-8e64-a37c3aeb43a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:52.757851 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-226994b7-0f26-491d-8e64-a37c3aeb43a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:52.887312 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-226994b7-0f26-491d-8e64-a37c3aeb43a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:52.896134 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-226994b7-0f26-491d-8e64-a37c3aeb43a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:52.897647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-226994b7-0f26-491d-8e64-a37c3aeb43a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:52.898782 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-226994b7-0f26-491d-8e64-a37c3aeb43a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.153600 Aug 10 12:58:52.899369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1077/2168] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:52 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:53.002455 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-63ac2c36-03e0-4f52-bfed-237f2eef8abd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:53.003060 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-63ac2c36-03e0-4f52-bfed-237f2eef8abd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:53.008888 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63ac2c36-03e0-4f52-bfed-237f2eef8abd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:53.009364 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63ac2c36-03e0-4f52-bfed-237f2eef8abd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:53.009813 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63ac2c36-03e0-4f52-bfed-237f2eef8abd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:53.010484 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63ac2c36-03e0-4f52-bfed-237f2eef8abd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:53.010927 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63ac2c36-03e0-4f52-bfed-237f2eef8abd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:53.011368 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63ac2c36-03e0-4f52-bfed-237f2eef8abd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:53.286762 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-63ac2c36-03e0-4f52-bfed-237f2eef8abd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:53.294587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-63ac2c36-03e0-4f52-bfed-237f2eef8abd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.296686 Aug 10 12:58:53.295149 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1092/2169] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:52 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:53.771382 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b566c0cb-427f-48a4-9755-6e62c3d31816 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:53.772010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b566c0cb-427f-48a4-9755-6e62c3d31816 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:53.776822 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5cba2bd6-7058-4369-a3e6-85e68b249ae5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:53.777434 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5cba2bd6-7058-4369-a3e6-85e68b249ae5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:53.778522 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b566c0cb-427f-48a4-9755-6e62c3d31816 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:53.779003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b566c0cb-427f-48a4-9755-6e62c3d31816 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:53.779466 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b566c0cb-427f-48a4-9755-6e62c3d31816 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:53.780166 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b566c0cb-427f-48a4-9755-6e62c3d31816 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:53.780611 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b566c0cb-427f-48a4-9755-6e62c3d31816 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:53.781036 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b566c0cb-427f-48a4-9755-6e62c3d31816 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:53.784978 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5cba2bd6-7058-4369-a3e6-85e68b249ae5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:53.789412 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5cba2bd6-7058-4369-a3e6-85e68b249ae5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:53.789412 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5cba2bd6-7058-4369-a3e6-85e68b249ae5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:53.789412 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5cba2bd6-7058-4369-a3e6-85e68b249ae5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:53.789412 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5cba2bd6-7058-4369-a3e6-85e68b249ae5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:53.789946 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5cba2bd6-7058-4369-a3e6-85e68b249ae5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:53.976564 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b566c0cb-427f-48a4-9755-6e62c3d31816 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:53.980061 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5cba2bd6-7058-4369-a3e6-85e68b249ae5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:53.985063 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b566c0cb-427f-48a4-9755-6e62c3d31816 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.217535 Aug 10 12:58:53.985741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1078/2170] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:53 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:53.988722 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5cba2bd6-7058-4369-a3e6-85e68b249ae5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.216091 Aug 10 12:58:53.989404 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1093/2171] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:53 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:53.990622 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3a3ca5fc-53c9-4304-86c7-a9e92aa257c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:53.991369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3a3ca5fc-53c9-4304-86c7-a9e92aa257c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:53.997168 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3a3ca5fc-53c9-4304-86c7-a9e92aa257c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:53.997748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3a3ca5fc-53c9-4304-86c7-a9e92aa257c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:53.998279 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3a3ca5fc-53c9-4304-86c7-a9e92aa257c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:54.000630 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3a3ca5fc-53c9-4304-86c7-a9e92aa257c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:54.001091 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3a3ca5fc-53c9-4304-86c7-a9e92aa257c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:54.001574 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3a3ca5fc-53c9-4304-86c7-a9e92aa257c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:54.132194 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3a3ca5fc-53c9-4304-86c7-a9e92aa257c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:54.140650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3a3ca5fc-53c9-4304-86c7-a9e92aa257c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:54.142765 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3a3ca5fc-53c9-4304-86c7-a9e92aa257c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:54.143942 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3a3ca5fc-53c9-4304-86c7-a9e92aa257c8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.157251 Aug 10 12:58:54.144506 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1079/2172] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:53 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:54.316686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b8be33a4-f082-44c3-8512-f5784c965fc7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:54.317293 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b8be33a4-f082-44c3-8512-f5784c965fc7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:54.323082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b8be33a4-f082-44c3-8512-f5784c965fc7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:54.323586 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b8be33a4-f082-44c3-8512-f5784c965fc7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:54.324017 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b8be33a4-f082-44c3-8512-f5784c965fc7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:54.324690 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b8be33a4-f082-44c3-8512-f5784c965fc7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:54.325135 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b8be33a4-f082-44c3-8512-f5784c965fc7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:54.325552 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b8be33a4-f082-44c3-8512-f5784c965fc7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:54.454716 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b8be33a4-f082-44c3-8512-f5784c965fc7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:54.462699 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b8be33a4-f082-44c3-8512-f5784c965fc7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.150770 Aug 10 12:58:54.463325 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1094/2173] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:54 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:55.009538 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fe92b83b-c53f-4256-aae2-8722958231ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:55.010176 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fe92b83b-c53f-4256-aae2-8722958231ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:55.016838 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe92b83b-c53f-4256-aae2-8722958231ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:55.017319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe92b83b-c53f-4256-aae2-8722958231ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:55.017757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe92b83b-c53f-4256-aae2-8722958231ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:55.018448 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe92b83b-c53f-4256-aae2-8722958231ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:55.018899 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe92b83b-c53f-4256-aae2-8722958231ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:55.019353 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe92b83b-c53f-4256-aae2-8722958231ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:55.121002 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-030bd47a-9aa4-403c-a211-8c9d54e1bfad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:55.121788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-030bd47a-9aa4-403c-a211-8c9d54e1bfad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:55.128250 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-030bd47a-9aa4-403c-a211-8c9d54e1bfad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:55.128732 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-030bd47a-9aa4-403c-a211-8c9d54e1bfad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:55.139948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-030bd47a-9aa4-403c-a211-8c9d54e1bfad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:55.139948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-030bd47a-9aa4-403c-a211-8c9d54e1bfad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:55.139948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-030bd47a-9aa4-403c-a211-8c9d54e1bfad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:55.139948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-030bd47a-9aa4-403c-a211-8c9d54e1bfad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:55.149201 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fe92b83b-c53f-4256-aae2-8722958231ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:55.157694 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fe92b83b-c53f-4256-aae2-8722958231ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.152014 Aug 10 12:58:55.158261 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1095/2174] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:55 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:58:55.168063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7c4d2276-ac77-414a-840e-acaf800d8d7c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:55.168848 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7c4d2276-ac77-414a-840e-acaf800d8d7c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:55.175843 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c4d2276-ac77-414a-840e-acaf800d8d7c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:55.176446 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c4d2276-ac77-414a-840e-acaf800d8d7c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:55.179940 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c4d2276-ac77-414a-840e-acaf800d8d7c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:55.179940 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c4d2276-ac77-414a-840e-acaf800d8d7c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:55.179940 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c4d2276-ac77-414a-840e-acaf800d8d7c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:55.179940 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c4d2276-ac77-414a-840e-acaf800d8d7c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:55.329876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-030bd47a-9aa4-403c-a211-8c9d54e1bfad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:55.337822 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-030bd47a-9aa4-403c-a211-8c9d54e1bfad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.335807 Aug 10 12:58:55.338403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1080/2175] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:55 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:55.352713 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-7c4d2276-ac77-414a-840e-acaf800d8d7c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:55.361434 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-7c4d2276-ac77-414a-840e-acaf800d8d7c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:55.362936 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-7c4d2276-ac77-414a-840e-acaf800d8d7c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:55.364128 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7c4d2276-ac77-414a-840e-acaf800d8d7c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.199997 Aug 10 12:58:55.364687 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1096/2176] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:55 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:55.483887 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ffb9a3a5-4a1a-41f5-9de9-5c2e9ba50017 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:55.484497 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ffb9a3a5-4a1a-41f5-9de9-5c2e9ba50017 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:55.490421 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ffb9a3a5-4a1a-41f5-9de9-5c2e9ba50017 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:55.490903 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ffb9a3a5-4a1a-41f5-9de9-5c2e9ba50017 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:55.491379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ffb9a3a5-4a1a-41f5-9de9-5c2e9ba50017 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:55.492066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ffb9a3a5-4a1a-41f5-9de9-5c2e9ba50017 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:55.492520 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ffb9a3a5-4a1a-41f5-9de9-5c2e9ba50017 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:55.492974 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ffb9a3a5-4a1a-41f5-9de9-5c2e9ba50017 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:55.650100 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ffb9a3a5-4a1a-41f5-9de9-5c2e9ba50017 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:55.660662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ffb9a3a5-4a1a-41f5-9de9-5c2e9ba50017 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.180269 Aug 10 12:58:55.661437 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1081/2177] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:55 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:56.178667 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9aa7a0e9-2e3f-40dd-b555-a99242a407b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:56.179308 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9aa7a0e9-2e3f-40dd-b555-a99242a407b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:56.185673 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9aa7a0e9-2e3f-40dd-b555-a99242a407b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:56.186155 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9aa7a0e9-2e3f-40dd-b555-a99242a407b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:56.186589 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9aa7a0e9-2e3f-40dd-b555-a99242a407b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:56.187296 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9aa7a0e9-2e3f-40dd-b555-a99242a407b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:56.187766 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9aa7a0e9-2e3f-40dd-b555-a99242a407b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:56.188283 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9aa7a0e9-2e3f-40dd-b555-a99242a407b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:56.314774 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9aa7a0e9-2e3f-40dd-b555-a99242a407b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:56.322809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9aa7a0e9-2e3f-40dd-b555-a99242a407b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.148030 Aug 10 12:58:56.323408 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1097/2178] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:56 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:56.359159 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9539543d-0631-4c99-b252-6816cc48a671 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:56.359989 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9539543d-0631-4c99-b252-6816cc48a671 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:56.366290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9539543d-0631-4c99-b252-6816cc48a671 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:56.366770 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9539543d-0631-4c99-b252-6816cc48a671 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:56.367230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9539543d-0631-4c99-b252-6816cc48a671 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:56.367916 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9539543d-0631-4c99-b252-6816cc48a671 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:56.368366 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9539543d-0631-4c99-b252-6816cc48a671 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:56.368784 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9539543d-0631-4c99-b252-6816cc48a671 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:56.386496 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a4173ac2-1dbc-47b9-a75e-f361305b3988 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:56.387216 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a4173ac2-1dbc-47b9-a75e-f361305b3988 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:56.393806 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a4173ac2-1dbc-47b9-a75e-f361305b3988 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:56.394292 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a4173ac2-1dbc-47b9-a75e-f361305b3988 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:56.394728 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a4173ac2-1dbc-47b9-a75e-f361305b3988 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:56.395455 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a4173ac2-1dbc-47b9-a75e-f361305b3988 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:56.395910 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a4173ac2-1dbc-47b9-a75e-f361305b3988 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:56.396336 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a4173ac2-1dbc-47b9-a75e-f361305b3988 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:56.566703 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9539543d-0631-4c99-b252-6816cc48a671 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:56.570573 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a4173ac2-1dbc-47b9-a75e-f361305b3988 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:56.574965 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9539543d-0631-4c99-b252-6816cc48a671 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.219618 Aug 10 12:58:56.575779 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1082/2179] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:56 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:56.580431 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a4173ac2-1dbc-47b9-a75e-f361305b3988 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:56.581957 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a4173ac2-1dbc-47b9-a75e-f361305b3988 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:56.583117 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a4173ac2-1dbc-47b9-a75e-f361305b3988 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.200429 Aug 10 12:58:56.583691 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1098/2180] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:56 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:58:56.683223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-70759731-1e34-40d0-b25f-36db450582bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:56.684896 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-70759731-1e34-40d0-b25f-36db450582bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:56.691886 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-70759731-1e34-40d0-b25f-36db450582bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:56.693632 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-70759731-1e34-40d0-b25f-36db450582bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:56.693632 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-70759731-1e34-40d0-b25f-36db450582bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:56.693632 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-70759731-1e34-40d0-b25f-36db450582bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:56.694007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-70759731-1e34-40d0-b25f-36db450582bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:56.694381 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-70759731-1e34-40d0-b25f-36db450582bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:56.827432 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-70759731-1e34-40d0-b25f-36db450582bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:56.837829 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-70759731-1e34-40d0-b25f-36db450582bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.158549 Aug 10 12:58:56.838622 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1083/2181] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:56 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:57.345291 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a0e5e67a-c001-4a68-a3ed-d1e57f6aa92c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:57.345896 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a0e5e67a-c001-4a68-a3ed-d1e57f6aa92c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:57.351813 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a0e5e67a-c001-4a68-a3ed-d1e57f6aa92c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:57.352289 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a0e5e67a-c001-4a68-a3ed-d1e57f6aa92c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:57.352719 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a0e5e67a-c001-4a68-a3ed-d1e57f6aa92c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:57.353660 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a0e5e67a-c001-4a68-a3ed-d1e57f6aa92c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:57.354108 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a0e5e67a-c001-4a68-a3ed-d1e57f6aa92c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:57.354523 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a0e5e67a-c001-4a68-a3ed-d1e57f6aa92c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:57.485640 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a0e5e67a-c001-4a68-a3ed-d1e57f6aa92c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:57.493525 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a0e5e67a-c001-4a68-a3ed-d1e57f6aa92c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.152710 Aug 10 12:58:57.494089 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1099/2182] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:57 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:57.597557 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-129fd407-7f78-436f-a4f8-72188e025470 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:57.598086 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-129fd407-7f78-436f-a4f8-72188e025470 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:57.604923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-129fd407-7f78-436f-a4f8-72188e025470 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:57.605409 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-129fd407-7f78-436f-a4f8-72188e025470 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:57.605843 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-94a09ce0-e0ad-4e59-8a59-131abfd475e8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:57.605986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-129fd407-7f78-436f-a4f8-72188e025470 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:57.606450 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-94a09ce0-e0ad-4e59-8a59-131abfd475e8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:57.606566 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-129fd407-7f78-436f-a4f8-72188e025470 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:57.606976 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-129fd407-7f78-436f-a4f8-72188e025470 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:57.607458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-129fd407-7f78-436f-a4f8-72188e025470 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:57.612701 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-94a09ce0-e0ad-4e59-8a59-131abfd475e8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:57.613182 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-94a09ce0-e0ad-4e59-8a59-131abfd475e8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:57.613615 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-94a09ce0-e0ad-4e59-8a59-131abfd475e8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:57.614301 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-94a09ce0-e0ad-4e59-8a59-131abfd475e8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:57.614750 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-94a09ce0-e0ad-4e59-8a59-131abfd475e8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:57.615192 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-94a09ce0-e0ad-4e59-8a59-131abfd475e8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:57.810047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-129fd407-7f78-436f-a4f8-72188e025470 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:57.814414 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-94a09ce0-e0ad-4e59-8a59-131abfd475e8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:57.819009 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-129fd407-7f78-436f-a4f8-72188e025470 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.226266 Aug 10 12:58:57.819615 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1084/2183] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:57 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:57.823227 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-94a09ce0-e0ad-4e59-8a59-131abfd475e8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:57.824808 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-94a09ce0-e0ad-4e59-8a59-131abfd475e8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:57.825953 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-94a09ce0-e0ad-4e59-8a59-131abfd475e8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.224210 Aug 10 12:58:57.826534 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1100/2184] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:57 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:58:57.857831 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d014ee68-4b02-45f2-8416-8dcaa99c6ef9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:57.858361 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d014ee68-4b02-45f2-8416-8dcaa99c6ef9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:57.864310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d014ee68-4b02-45f2-8416-8dcaa99c6ef9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:57.864787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d014ee68-4b02-45f2-8416-8dcaa99c6ef9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:57.865216 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d014ee68-4b02-45f2-8416-8dcaa99c6ef9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:57.865900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d014ee68-4b02-45f2-8416-8dcaa99c6ef9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:57.866354 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d014ee68-4b02-45f2-8416-8dcaa99c6ef9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:57.866781 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d014ee68-4b02-45f2-8416-8dcaa99c6ef9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:57.995321 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d014ee68-4b02-45f2-8416-8dcaa99c6ef9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:58.004140 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d014ee68-4b02-45f2-8416-8dcaa99c6ef9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.150361 Aug 10 12:58:58.004929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1085/2185] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:57 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:58.514277 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-003ab82d-53e8-4fd5-a448-c5614edc7815 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:58.514912 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-003ab82d-53e8-4fd5-a448-c5614edc7815 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:58.521247 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-003ab82d-53e8-4fd5-a448-c5614edc7815 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:58.521720 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-003ab82d-53e8-4fd5-a448-c5614edc7815 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:58.522148 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-003ab82d-53e8-4fd5-a448-c5614edc7815 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:58.522820 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-003ab82d-53e8-4fd5-a448-c5614edc7815 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:58.523287 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-003ab82d-53e8-4fd5-a448-c5614edc7815 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:58.523706 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-003ab82d-53e8-4fd5-a448-c5614edc7815 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:58.526275 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:58:58.650781 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-003ab82d-53e8-4fd5-a448-c5614edc7815 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:58.659347 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-003ab82d-53e8-4fd5-a448-c5614edc7815 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.148835 Aug 10 12:58:58.659895 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1101/2186] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:58 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:58.840660 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-666685c9-cc77-4d60-8cf7-b969cb7d5658 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:58.841294 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-666685c9-cc77-4d60-8cf7-b969cb7d5658 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:58.843612 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=84 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:58:58.848903 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-666685c9-cc77-4d60-8cf7-b969cb7d5658 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:58.849382 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-666685c9-cc77-4d60-8cf7-b969cb7d5658 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:58.849706 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3100fa29-f937-4c2b-8041-8fa41672a570 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:58.849849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-666685c9-cc77-4d60-8cf7-b969cb7d5658 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:58.850315 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3100fa29-f937-4c2b-8041-8fa41672a570 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:58.850556 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-666685c9-cc77-4d60-8cf7-b969cb7d5658 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:58.850946 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-666685c9-cc77-4d60-8cf7-b969cb7d5658 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:58.851391 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-666685c9-cc77-4d60-8cf7-b969cb7d5658 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:58.862770 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3100fa29-f937-4c2b-8041-8fa41672a570 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:58.862770 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3100fa29-f937-4c2b-8041-8fa41672a570 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:58.862770 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3100fa29-f937-4c2b-8041-8fa41672a570 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:58.862770 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3100fa29-f937-4c2b-8041-8fa41672a570 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:58.863237 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3100fa29-f937-4c2b-8041-8fa41672a570 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:58.863237 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3100fa29-f937-4c2b-8041-8fa41672a570 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:59.050568 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3100fa29-f937-4c2b-8041-8fa41672a570 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:59.054568 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-666685c9-cc77-4d60-8cf7-b969cb7d5658 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:59.059462 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3100fa29-f937-4c2b-8041-8fa41672a570 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:59.061056 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3100fa29-f937-4c2b-8041-8fa41672a570 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:59.062281 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3100fa29-f937-4c2b-8041-8fa41672a570 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.216450 Aug 10 12:58:59.062437 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-666685c9-cc77-4d60-8cf7-b969cb7d5658 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.225476 Aug 10 12:58:59.062917 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1086/2187] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:58 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:59.067268 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1102/2188] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:58:58 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:58:59.067424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b799a33a-1fb4-4a94-9cf2-ad2cbcf3c035 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:59.067926 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b799a33a-1fb4-4a94-9cf2-ad2cbcf3c035 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:59.073521 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b799a33a-1fb4-4a94-9cf2-ad2cbcf3c035 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:59.073992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b799a33a-1fb4-4a94-9cf2-ad2cbcf3c035 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:59.074423 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b799a33a-1fb4-4a94-9cf2-ad2cbcf3c035 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:59.075099 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b799a33a-1fb4-4a94-9cf2-ad2cbcf3c035 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:59.075567 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b799a33a-1fb4-4a94-9cf2-ad2cbcf3c035 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:59.075986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b799a33a-1fb4-4a94-9cf2-ad2cbcf3c035 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:59.205362 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b799a33a-1fb4-4a94-9cf2-ad2cbcf3c035 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:59.213167 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b799a33a-1fb4-4a94-9cf2-ad2cbcf3c035 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.149298 Aug 10 12:58:59.213728 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1087/2189] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:59 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:58:59.681014 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8542c2d8-a2f7-4a09-a743-463f83b6a9b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:58:59.681620 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8542c2d8-a2f7-4a09-a743-463f83b6a9b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:58:59.688647 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8542c2d8-a2f7-4a09-a743-463f83b6a9b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:59.689118 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8542c2d8-a2f7-4a09-a743-463f83b6a9b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:59.689538 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8542c2d8-a2f7-4a09-a743-463f83b6a9b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:59.690212 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8542c2d8-a2f7-4a09-a743-463f83b6a9b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:58:59.690654 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8542c2d8-a2f7-4a09-a743-463f83b6a9b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:58:59.691071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8542c2d8-a2f7-4a09-a743-463f83b6a9b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:58:59.817062 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-8542c2d8-a2f7-4a09-a743-463f83b6a9b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:58:59.824873 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8542c2d8-a2f7-4a09-a743-463f83b6a9b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.147687 Aug 10 12:58:59.825439 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1103/2190] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:58:59 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:00.083042 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8e4f57d7-d53d-4fbd-8181-2b42bea6b04e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:00.083698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8e4f57d7-d53d-4fbd-8181-2b42bea6b04e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:00.084848 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f07c6e66-90fc-47cd-a869-3f7f0837e781 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:00.085463 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f07c6e66-90fc-47cd-a869-3f7f0837e781 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:00.090089 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8e4f57d7-d53d-4fbd-8181-2b42bea6b04e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:00.090571 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8e4f57d7-d53d-4fbd-8181-2b42bea6b04e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:00.091010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8e4f57d7-d53d-4fbd-8181-2b42bea6b04e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:00.091347 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f07c6e66-90fc-47cd-a869-3f7f0837e781 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:00.091719 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8e4f57d7-d53d-4fbd-8181-2b42bea6b04e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:00.091845 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f07c6e66-90fc-47cd-a869-3f7f0837e781 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:00.092173 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8e4f57d7-d53d-4fbd-8181-2b42bea6b04e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:00.092308 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f07c6e66-90fc-47cd-a869-3f7f0837e781 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:00.092597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8e4f57d7-d53d-4fbd-8181-2b42bea6b04e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:00.092908 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f07c6e66-90fc-47cd-a869-3f7f0837e781 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:00.093357 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f07c6e66-90fc-47cd-a869-3f7f0837e781 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:00.093777 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f07c6e66-90fc-47cd-a869-3f7f0837e781 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:00.287062 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f07c6e66-90fc-47cd-a869-3f7f0837e781 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:00.291328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8e4f57d7-d53d-4fbd-8181-2b42bea6b04e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:00.295387 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f07c6e66-90fc-47cd-a869-3f7f0837e781 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:00.296873 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f07c6e66-90fc-47cd-a869-3f7f0837e781 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:00.298654 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f07c6e66-90fc-47cd-a869-3f7f0837e781 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.217668 Aug 10 12:59:00.299226 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1104/2191] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:00 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:00.300290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8e4f57d7-d53d-4fbd-8181-2b42bea6b04e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.221142 Aug 10 12:59:00.301021 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1088/2192] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:00 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:00.303564 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-57585756-edfe-46c2-bd7c-1ef100584452 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:00.304158 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-57585756-edfe-46c2-bd7c-1ef100584452 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:00.309759 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57585756-edfe-46c2-bd7c-1ef100584452 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:00.310229 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57585756-edfe-46c2-bd7c-1ef100584452 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:00.310657 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57585756-edfe-46c2-bd7c-1ef100584452 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:00.311358 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57585756-edfe-46c2-bd7c-1ef100584452 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:00.311969 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57585756-edfe-46c2-bd7c-1ef100584452 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:00.312392 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57585756-edfe-46c2-bd7c-1ef100584452 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:00.440850 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-57585756-edfe-46c2-bd7c-1ef100584452 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:00.448605 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-57585756-edfe-46c2-bd7c-1ef100584452 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.148454 Aug 10 12:59:00.449173 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1105/2193] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:00 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:00.845989 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-10deaee4-07cc-4e6e-9539-545ff81a1296 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:00.846505 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-10deaee4-07cc-4e6e-9539-545ff81a1296 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:00.852371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-10deaee4-07cc-4e6e-9539-545ff81a1296 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:00.852871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-10deaee4-07cc-4e6e-9539-545ff81a1296 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:00.853304 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-10deaee4-07cc-4e6e-9539-545ff81a1296 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:00.854246 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-10deaee4-07cc-4e6e-9539-545ff81a1296 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:00.854695 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-10deaee4-07cc-4e6e-9539-545ff81a1296 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:00.855259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-10deaee4-07cc-4e6e-9539-545ff81a1296 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:00.981994 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-10deaee4-07cc-4e6e-9539-545ff81a1296 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:00.990339 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-10deaee4-07cc-4e6e-9539-545ff81a1296 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.148394 Aug 10 12:59:00.990907 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1089/2194] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:00 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:01.321576 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a4c603b3-cbed-4d00-ba0f-aa994823cc25 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:01.322111 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4ef7cf54-38c9-46b7-b274-73317783ee38 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:01.322569 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4ef7cf54-38c9-46b7-b274-73317783ee38 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:01.322686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a4c603b3-cbed-4d00-ba0f-aa994823cc25 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:01.328660 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ef7cf54-38c9-46b7-b274-73317783ee38 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:01.328863 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a4c603b3-cbed-4d00-ba0f-aa994823cc25 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:01.329142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ef7cf54-38c9-46b7-b274-73317783ee38 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:01.329361 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a4c603b3-cbed-4d00-ba0f-aa994823cc25 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:01.329571 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ef7cf54-38c9-46b7-b274-73317783ee38 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:01.329797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a4c603b3-cbed-4d00-ba0f-aa994823cc25 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:01.330260 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ef7cf54-38c9-46b7-b274-73317783ee38 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:01.330545 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a4c603b3-cbed-4d00-ba0f-aa994823cc25 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:01.330715 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ef7cf54-38c9-46b7-b274-73317783ee38 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:01.331009 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a4c603b3-cbed-4d00-ba0f-aa994823cc25 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:01.331127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ef7cf54-38c9-46b7-b274-73317783ee38 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:01.331460 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a4c603b3-cbed-4d00-ba0f-aa994823cc25 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:01.333709 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:59:01.528981 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4ef7cf54-38c9-46b7-b274-73317783ee38 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:01.533325 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a4c603b3-cbed-4d00-ba0f-aa994823cc25 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:01.537783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4ef7cf54-38c9-46b7-b274-73317783ee38 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:01.539424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4ef7cf54-38c9-46b7-b274-73317783ee38 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:01.540683 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4ef7cf54-38c9-46b7-b274-73317783ee38 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.222976 Aug 10 12:59:01.541205 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a4c603b3-cbed-4d00-ba0f-aa994823cc25 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.223509 Aug 10 12:59:01.541335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1090/2195] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:01 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:01.548013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1106/2196] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:01 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:01.548155 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-16c04f07-2538-4dc5-9e45-1d5f0e4710f6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:01.548155 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-16c04f07-2538-4dc5-9e45-1d5f0e4710f6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:01.553190 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-16c04f07-2538-4dc5-9e45-1d5f0e4710f6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:01.553748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-16c04f07-2538-4dc5-9e45-1d5f0e4710f6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:01.554300 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-16c04f07-2538-4dc5-9e45-1d5f0e4710f6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:01.555058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-16c04f07-2538-4dc5-9e45-1d5f0e4710f6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:01.555602 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-16c04f07-2538-4dc5-9e45-1d5f0e4710f6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:01.556107 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-16c04f07-2538-4dc5-9e45-1d5f0e4710f6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:01.684521 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-16c04f07-2538-4dc5-9e45-1d5f0e4710f6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:01.692463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-16c04f07-2538-4dc5-9e45-1d5f0e4710f6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.150069 Aug 10 12:59:01.693041 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1091/2197] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:01 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:02.011507 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bf4835e2-a209-4e12-be0c-8c03a6fd8ab9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:02.012122 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bf4835e2-a209-4e12-be0c-8c03a6fd8ab9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:02.018255 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf4835e2-a209-4e12-be0c-8c03a6fd8ab9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:02.018737 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf4835e2-a209-4e12-be0c-8c03a6fd8ab9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:02.019190 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf4835e2-a209-4e12-be0c-8c03a6fd8ab9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:02.019911 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf4835e2-a209-4e12-be0c-8c03a6fd8ab9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:02.020365 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf4835e2-a209-4e12-be0c-8c03a6fd8ab9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:02.020809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf4835e2-a209-4e12-be0c-8c03a6fd8ab9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:02.167434 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-bf4835e2-a209-4e12-be0c-8c03a6fd8ab9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:02.175826 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bf4835e2-a209-4e12-be0c-8c03a6fd8ab9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.168228 Aug 10 12:59:02.176389 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1107/2198] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:02 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:02.562773 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-01e02741-92f7-4894-a564-eb60781b12cc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:02.563320 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-01e02741-92f7-4894-a564-eb60781b12cc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:02.564011 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b6efde3a-035f-4a96-9a96-69c2e7a3cf40 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:02.565034 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b6efde3a-035f-4a96-9a96-69c2e7a3cf40 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:02.569897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01e02741-92f7-4894-a564-eb60781b12cc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:02.570377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01e02741-92f7-4894-a564-eb60781b12cc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:02.570807 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01e02741-92f7-4894-a564-eb60781b12cc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:02.571080 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b6efde3a-035f-4a96-9a96-69c2e7a3cf40 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:02.571522 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01e02741-92f7-4894-a564-eb60781b12cc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:02.571647 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b6efde3a-035f-4a96-9a96-69c2e7a3cf40 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:02.571972 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01e02741-92f7-4894-a564-eb60781b12cc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:02.572079 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b6efde3a-035f-4a96-9a96-69c2e7a3cf40 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:02.572397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01e02741-92f7-4894-a564-eb60781b12cc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:02.572697 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b6efde3a-035f-4a96-9a96-69c2e7a3cf40 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:02.573159 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b6efde3a-035f-4a96-9a96-69c2e7a3cf40 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:02.573589 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b6efde3a-035f-4a96-9a96-69c2e7a3cf40 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:02.766219 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-01e02741-92f7-4894-a564-eb60781b12cc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:02.771014 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b6efde3a-035f-4a96-9a96-69c2e7a3cf40 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:02.774789 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-01e02741-92f7-4894-a564-eb60781b12cc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.215931 Aug 10 12:59:02.775397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1092/2199] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:02 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:02.779938 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9d8d270e-6f2f-408d-8c76-5688dd338ea6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:02.780245 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b6efde3a-035f-4a96-9a96-69c2e7a3cf40 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:02.780539 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9d8d270e-6f2f-408d-8c76-5688dd338ea6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:02.781780 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b6efde3a-035f-4a96-9a96-69c2e7a3cf40 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:02.783766 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b6efde3a-035f-4a96-9a96-69c2e7a3cf40 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.222895 Aug 10 12:59:02.784516 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1108/2200] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:02 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:02.786784 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d8d270e-6f2f-408d-8c76-5688dd338ea6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:02.787292 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d8d270e-6f2f-408d-8c76-5688dd338ea6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:02.787730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d8d270e-6f2f-408d-8c76-5688dd338ea6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:02.788608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d8d270e-6f2f-408d-8c76-5688dd338ea6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:02.789065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d8d270e-6f2f-408d-8c76-5688dd338ea6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:02.789493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9d8d270e-6f2f-408d-8c76-5688dd338ea6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:02.916099 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9d8d270e-6f2f-408d-8c76-5688dd338ea6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:02.924314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9d8d270e-6f2f-408d-8c76-5688dd338ea6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.147866 Aug 10 12:59:02.924891 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1093/2201] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:02 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:03.197441 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6d8b9856-2e13-4947-97d7-aa386caa79f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:03.198043 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6d8b9856-2e13-4947-97d7-aa386caa79f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:03.203922 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6d8b9856-2e13-4947-97d7-aa386caa79f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:03.204394 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6d8b9856-2e13-4947-97d7-aa386caa79f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:03.205463 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6d8b9856-2e13-4947-97d7-aa386caa79f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:03.206140 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6d8b9856-2e13-4947-97d7-aa386caa79f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:03.206585 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6d8b9856-2e13-4947-97d7-aa386caa79f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:03.207000 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6d8b9856-2e13-4947-97d7-aa386caa79f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:03.337174 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6d8b9856-2e13-4947-97d7-aa386caa79f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:03.345032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6d8b9856-2e13-4947-97d7-aa386caa79f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.151356 Aug 10 12:59:03.345760 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1109/2202] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:03 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:03.795751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1d407050-8d64-4895-ad4f-3f63d1f4a044 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:03.796389 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1d407050-8d64-4895-ad4f-3f63d1f4a044 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:03.806120 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d407050-8d64-4895-ad4f-3f63d1f4a044 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:03.806607 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d407050-8d64-4895-ad4f-3f63d1f4a044 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:03.807039 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d407050-8d64-4895-ad4f-3f63d1f4a044 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:03.807766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d407050-8d64-4895-ad4f-3f63d1f4a044 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:03.808230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d407050-8d64-4895-ad4f-3f63d1f4a044 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:03.808485 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-79bb0369-2fb4-40cc-a73f-3fef81d16256 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:03.808963 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d407050-8d64-4895-ad4f-3f63d1f4a044 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:03.809106 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-79bb0369-2fb4-40cc-a73f-3fef81d16256 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:03.816025 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-79bb0369-2fb4-40cc-a73f-3fef81d16256 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:03.816481 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-79bb0369-2fb4-40cc-a73f-3fef81d16256 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:03.816915 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-79bb0369-2fb4-40cc-a73f-3fef81d16256 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:03.817617 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-79bb0369-2fb4-40cc-a73f-3fef81d16256 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:03.818072 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-79bb0369-2fb4-40cc-a73f-3fef81d16256 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:03.818500 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-79bb0369-2fb4-40cc-a73f-3fef81d16256 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:04.028899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1d407050-8d64-4895-ad4f-3f63d1f4a044 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:04.038078 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1d407050-8d64-4895-ad4f-3f63d1f4a044 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.246132 Aug 10 12:59:04.038657 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1094/2203] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:03 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:04.044030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-93ad6e2f-5c80-43de-a812-853e64017afd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:04.044642 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-93ad6e2f-5c80-43de-a812-853e64017afd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:04.045558 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-79bb0369-2fb4-40cc-a73f-3fef81d16256 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:04.052902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93ad6e2f-5c80-43de-a812-853e64017afd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:04.053312 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93ad6e2f-5c80-43de-a812-853e64017afd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:04.053743 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93ad6e2f-5c80-43de-a812-853e64017afd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:04.054453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93ad6e2f-5c80-43de-a812-853e64017afd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:04.054888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93ad6e2f-5c80-43de-a812-853e64017afd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:04.055354 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93ad6e2f-5c80-43de-a812-853e64017afd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:04.056059 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-79bb0369-2fb4-40cc-a73f-3fef81d16256 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:04.057568 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-79bb0369-2fb4-40cc-a73f-3fef81d16256 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:04.058753 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-79bb0369-2fb4-40cc-a73f-3fef81d16256 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.255096 Aug 10 12:59:04.059343 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1110/2204] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:03 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:04.201422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-93ad6e2f-5c80-43de-a812-853e64017afd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:04.209952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-93ad6e2f-5c80-43de-a812-853e64017afd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.170341 Aug 10 12:59:04.210524 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1095/2205] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:04 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:04.366180 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e4951a2d-2edc-4f85-98de-b6d3582c0e6f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:04.366709 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e4951a2d-2edc-4f85-98de-b6d3582c0e6f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:04.372639 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4951a2d-2edc-4f85-98de-b6d3582c0e6f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:04.373118 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4951a2d-2edc-4f85-98de-b6d3582c0e6f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:04.373550 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4951a2d-2edc-4f85-98de-b6d3582c0e6f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:04.374235 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4951a2d-2edc-4f85-98de-b6d3582c0e6f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:04.374701 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4951a2d-2edc-4f85-98de-b6d3582c0e6f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:04.375104 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4951a2d-2edc-4f85-98de-b6d3582c0e6f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:04.503756 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e4951a2d-2edc-4f85-98de-b6d3582c0e6f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:04.511842 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e4951a2d-2edc-4f85-98de-b6d3582c0e6f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.149828 Aug 10 12:59:04.516529 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1111/2206] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:04 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:05.063029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2bc3087c-9ae2-4d4a-a22c-3a680402b6d0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:05.063678 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2bc3087c-9ae2-4d4a-a22c-3a680402b6d0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:05.070634 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2bc3087c-9ae2-4d4a-a22c-3a680402b6d0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:05.071114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2bc3087c-9ae2-4d4a-a22c-3a680402b6d0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:05.071578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2bc3087c-9ae2-4d4a-a22c-3a680402b6d0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:05.072269 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2bc3087c-9ae2-4d4a-a22c-3a680402b6d0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:05.072720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2bc3087c-9ae2-4d4a-a22c-3a680402b6d0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:05.073142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2bc3087c-9ae2-4d4a-a22c-3a680402b6d0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:05.083114 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-507e7161-1d9e-40dc-96d1-95be68cbda67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:05.083758 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-507e7161-1d9e-40dc-96d1-95be68cbda67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:05.090150 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-507e7161-1d9e-40dc-96d1-95be68cbda67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:05.090629 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-507e7161-1d9e-40dc-96d1-95be68cbda67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:05.091052 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-507e7161-1d9e-40dc-96d1-95be68cbda67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:05.091761 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-507e7161-1d9e-40dc-96d1-95be68cbda67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:05.092208 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-507e7161-1d9e-40dc-96d1-95be68cbda67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:05.092627 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-507e7161-1d9e-40dc-96d1-95be68cbda67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:05.286233 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2bc3087c-9ae2-4d4a-a22c-3a680402b6d0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:05.289969 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-507e7161-1d9e-40dc-96d1-95be68cbda67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:05.295161 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2bc3087c-9ae2-4d4a-a22c-3a680402b6d0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.235942 Aug 10 12:59:05.300459 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-507e7161-1d9e-40dc-96d1-95be68cbda67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:05.303684 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-507e7161-1d9e-40dc-96d1-95be68cbda67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:05.305561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-507e7161-1d9e-40dc-96d1-95be68cbda67 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.225841 Aug 10 12:59:05.305561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1112/2207] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:05 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:05.309304 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1096/2208] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:05 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:05.310316 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b53fa615-4fa9-40e2-8353-fcfc9b4264d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:05.310921 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b53fa615-4fa9-40e2-8353-fcfc9b4264d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:05.323355 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b53fa615-4fa9-40e2-8353-fcfc9b4264d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:05.323355 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b53fa615-4fa9-40e2-8353-fcfc9b4264d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:05.323355 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b53fa615-4fa9-40e2-8353-fcfc9b4264d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:05.323355 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b53fa615-4fa9-40e2-8353-fcfc9b4264d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:05.323795 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b53fa615-4fa9-40e2-8353-fcfc9b4264d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:05.323795 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b53fa615-4fa9-40e2-8353-fcfc9b4264d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:05.451592 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b53fa615-4fa9-40e2-8353-fcfc9b4264d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:05.460150 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b53fa615-4fa9-40e2-8353-fcfc9b4264d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.153554 Aug 10 12:59:05.460721 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1113/2209] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:05 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:05.533530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-591ee2d4-0d9a-4d04-b230-7ae6491f2e81 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:05.534146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-591ee2d4-0d9a-4d04-b230-7ae6491f2e81 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:05.540069 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-591ee2d4-0d9a-4d04-b230-7ae6491f2e81 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:05.540558 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-591ee2d4-0d9a-4d04-b230-7ae6491f2e81 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:05.541003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-591ee2d4-0d9a-4d04-b230-7ae6491f2e81 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:05.541721 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-591ee2d4-0d9a-4d04-b230-7ae6491f2e81 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:05.542176 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-591ee2d4-0d9a-4d04-b230-7ae6491f2e81 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:05.542602 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-591ee2d4-0d9a-4d04-b230-7ae6491f2e81 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:05.674744 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-591ee2d4-0d9a-4d04-b230-7ae6491f2e81 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:05.682613 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-591ee2d4-0d9a-4d04-b230-7ae6491f2e81 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.153119 Aug 10 12:59:05.683197 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1097/2210] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:05 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:06.331844 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-35253ca6-7f04-4290-8b01-9a5cd063a86b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:06.332622 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-35253ca6-7f04-4290-8b01-9a5cd063a86b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:06.334942 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fd738393-ba5b-4196-a0ba-6d15cc92bcfe tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:06.335378 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:59:06.335665 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fd738393-ba5b-4196-a0ba-6d15cc92bcfe tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:06.340932 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-35253ca6-7f04-4290-8b01-9a5cd063a86b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:06.341422 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-35253ca6-7f04-4290-8b01-9a5cd063a86b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:06.341857 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-35253ca6-7f04-4290-8b01-9a5cd063a86b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:06.342371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fd738393-ba5b-4196-a0ba-6d15cc92bcfe tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:06.342555 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-35253ca6-7f04-4290-8b01-9a5cd063a86b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:06.342845 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fd738393-ba5b-4196-a0ba-6d15cc92bcfe tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:06.343007 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-35253ca6-7f04-4290-8b01-9a5cd063a86b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:06.343306 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fd738393-ba5b-4196-a0ba-6d15cc92bcfe tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:06.343460 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-35253ca6-7f04-4290-8b01-9a5cd063a86b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:06.343988 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fd738393-ba5b-4196-a0ba-6d15cc92bcfe tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:06.344431 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fd738393-ba5b-4196-a0ba-6d15cc92bcfe tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:06.344859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fd738393-ba5b-4196-a0ba-6d15cc92bcfe tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:06.542431 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-35253ca6-7f04-4290-8b01-9a5cd063a86b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:06.550503 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-35253ca6-7f04-4290-8b01-9a5cd063a86b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.222451 Aug 10 12:59:06.551078 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1114/2211] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:06 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:06.553395 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fd738393-ba5b-4196-a0ba-6d15cc92bcfe tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:06.555530 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e5ffa16a-0fa6-404d-b7ec-3b67052f6833 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:06.556135 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e5ffa16a-0fa6-404d-b7ec-3b67052f6833 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:06.561808 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5ffa16a-0fa6-404d-b7ec-3b67052f6833 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:06.562042 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fd738393-ba5b-4196-a0ba-6d15cc92bcfe tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:06.562291 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5ffa16a-0fa6-404d-b7ec-3b67052f6833 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:06.562721 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5ffa16a-0fa6-404d-b7ec-3b67052f6833 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:06.563429 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5ffa16a-0fa6-404d-b7ec-3b67052f6833 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:06.563727 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fd738393-ba5b-4196-a0ba-6d15cc92bcfe tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:06.563987 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5ffa16a-0fa6-404d-b7ec-3b67052f6833 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:06.564411 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5ffa16a-0fa6-404d-b7ec-3b67052f6833 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:06.565046 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fd738393-ba5b-4196-a0ba-6d15cc92bcfe tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.235027 Aug 10 12:59:06.565604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1098/2212] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:06 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:06.694713 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e5ffa16a-0fa6-404d-b7ec-3b67052f6833 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:06.703312 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e5ffa16a-0fa6-404d-b7ec-3b67052f6833 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.151199 Aug 10 12:59:06.704063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1115/2213] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:06 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:06.705650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-44a1b466-13e9-4bfa-b9a5-c80f0f21db69 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:06.706082 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-44a1b466-13e9-4bfa-b9a5-c80f0f21db69 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:06.711975 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-44a1b466-13e9-4bfa-b9a5-c80f0f21db69 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:06.714986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-44a1b466-13e9-4bfa-b9a5-c80f0f21db69 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:06.714986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-44a1b466-13e9-4bfa-b9a5-c80f0f21db69 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:06.714986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-44a1b466-13e9-4bfa-b9a5-c80f0f21db69 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:06.714986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-44a1b466-13e9-4bfa-b9a5-c80f0f21db69 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:06.715540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-44a1b466-13e9-4bfa-b9a5-c80f0f21db69 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:06.842089 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-44a1b466-13e9-4bfa-b9a5-c80f0f21db69 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:06.849899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-44a1b466-13e9-4bfa-b9a5-c80f0f21db69 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.148973 Aug 10 12:59:06.850466 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1099/2214] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:06 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:07.571082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4eb329ad-e5e6-4637-bba4-6d4cf8fe3f6a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:07.571645 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4eb329ad-e5e6-4637-bba4-6d4cf8fe3f6a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:07.578080 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4eb329ad-e5e6-4637-bba4-6d4cf8fe3f6a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:07.578554 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4eb329ad-e5e6-4637-bba4-6d4cf8fe3f6a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:07.578978 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4eb329ad-e5e6-4637-bba4-6d4cf8fe3f6a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:07.579832 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4eb329ad-e5e6-4637-bba4-6d4cf8fe3f6a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:07.580456 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4eb329ad-e5e6-4637-bba4-6d4cf8fe3f6a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:07.580882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4eb329ad-e5e6-4637-bba4-6d4cf8fe3f6a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:07.588581 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-34d522ab-e37c-4a83-8883-446e7412c3ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:07.589192 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-34d522ab-e37c-4a83-8883-446e7412c3ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:07.596187 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34d522ab-e37c-4a83-8883-446e7412c3ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:07.596897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34d522ab-e37c-4a83-8883-446e7412c3ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:07.597338 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34d522ab-e37c-4a83-8883-446e7412c3ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:07.598053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34d522ab-e37c-4a83-8883-446e7412c3ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:07.598507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34d522ab-e37c-4a83-8883-446e7412c3ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:07.598929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34d522ab-e37c-4a83-8883-446e7412c3ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:07.775868 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4eb329ad-e5e6-4637-bba4-6d4cf8fe3f6a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:07.783205 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-34d522ab-e37c-4a83-8883-446e7412c3ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:07.784384 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4eb329ad-e5e6-4637-bba4-6d4cf8fe3f6a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.217190 Aug 10 12:59:07.785092 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1116/2215] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:07 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:07.789529 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-05d3ab14-bf36-4cee-995b-2bfc79e11060 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:07.790137 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-05d3ab14-bf36-4cee-995b-2bfc79e11060 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:07.791703 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-34d522ab-e37c-4a83-8883-446e7412c3ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:07.793198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-34d522ab-e37c-4a83-8883-446e7412c3ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:07.794436 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-34d522ab-e37c-4a83-8883-446e7412c3ad tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.209593 Aug 10 12:59:07.795052 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1100/2216] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:07 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:07.795910 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-05d3ab14-bf36-4cee-995b-2bfc79e11060 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:07.796403 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-05d3ab14-bf36-4cee-995b-2bfc79e11060 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:07.796838 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-05d3ab14-bf36-4cee-995b-2bfc79e11060 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:07.797659 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-05d3ab14-bf36-4cee-995b-2bfc79e11060 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:07.798144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-05d3ab14-bf36-4cee-995b-2bfc79e11060 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:07.799159 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-05d3ab14-bf36-4cee-995b-2bfc79e11060 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:07.871703 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-072e3391-e224-4e14-8d35-d74db8c3e4c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:07.872260 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-072e3391-e224-4e14-8d35-d74db8c3e4c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:07.878336 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-072e3391-e224-4e14-8d35-d74db8c3e4c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:07.878825 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-072e3391-e224-4e14-8d35-d74db8c3e4c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:07.879297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-072e3391-e224-4e14-8d35-d74db8c3e4c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:07.879999 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-072e3391-e224-4e14-8d35-d74db8c3e4c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:07.880452 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-072e3391-e224-4e14-8d35-d74db8c3e4c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:07.880894 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-072e3391-e224-4e14-8d35-d74db8c3e4c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:07.960553 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-05d3ab14-bf36-4cee-995b-2bfc79e11060 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:07.969819 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:59:07.969819 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-05d3ab14-bf36-4cee-995b-2bfc79e11060 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.183153 Aug 10 12:59:07.970986 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1117/2217] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:07 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:08.022077 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-072e3391-e224-4e14-8d35-d74db8c3e4c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:08.030039 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-072e3391-e224-4e14-8d35-d74db8c3e4c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.162294 Aug 10 12:59:08.030605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1101/2218] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:07 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:08.805650 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fa35dacd-b351-4b60-be4d-0e94be29dcf5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:08.806245 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fa35dacd-b351-4b60-be4d-0e94be29dcf5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:08.812725 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa35dacd-b351-4b60-be4d-0e94be29dcf5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:08.813201 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa35dacd-b351-4b60-be4d-0e94be29dcf5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:08.813632 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa35dacd-b351-4b60-be4d-0e94be29dcf5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:08.814972 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa35dacd-b351-4b60-be4d-0e94be29dcf5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:08.815434 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa35dacd-b351-4b60-be4d-0e94be29dcf5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:08.815855 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa35dacd-b351-4b60-be4d-0e94be29dcf5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:08.817918 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-555e9c81-5de8-480d-a89e-91577366f508 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:08.818655 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-555e9c81-5de8-480d-a89e-91577366f508 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:08.825067 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-555e9c81-5de8-480d-a89e-91577366f508 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:08.825668 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-555e9c81-5de8-480d-a89e-91577366f508 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:08.826106 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-555e9c81-5de8-480d-a89e-91577366f508 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:08.826799 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-555e9c81-5de8-480d-a89e-91577366f508 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:08.827321 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-555e9c81-5de8-480d-a89e-91577366f508 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:08.827725 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-555e9c81-5de8-480d-a89e-91577366f508 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:09.013812 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fa35dacd-b351-4b60-be4d-0e94be29dcf5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:09.019909 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-555e9c81-5de8-480d-a89e-91577366f508 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:09.022158 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fa35dacd-b351-4b60-be4d-0e94be29dcf5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.220667 Aug 10 12:59:09.022815 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1118/2219] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:08 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:09.028480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-555e9c81-5de8-480d-a89e-91577366f508 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:09.029662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bf02559a-9316-4dcc-8c49-468fe0401b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:09.029985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-555e9c81-5de8-480d-a89e-91577366f508 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:09.030280 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bf02559a-9316-4dcc-8c49-468fe0401b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:09.031396 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-555e9c81-5de8-480d-a89e-91577366f508 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.218035 Aug 10 12:59:09.032100 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1102/2220] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:08 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:09.036724 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf02559a-9316-4dcc-8c49-468fe0401b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:09.037198 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf02559a-9316-4dcc-8c49-468fe0401b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:09.037657 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf02559a-9316-4dcc-8c49-468fe0401b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:09.038353 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf02559a-9316-4dcc-8c49-468fe0401b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:09.038807 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf02559a-9316-4dcc-8c49-468fe0401b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:09.039254 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf02559a-9316-4dcc-8c49-468fe0401b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:09.052354 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4baf64f5-710e-4bf4-b50e-698f27a46c9e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:09.053050 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4baf64f5-710e-4bf4-b50e-698f27a46c9e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:09.059043 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4baf64f5-710e-4bf4-b50e-698f27a46c9e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:09.059537 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4baf64f5-710e-4bf4-b50e-698f27a46c9e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:09.060059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4baf64f5-710e-4bf4-b50e-698f27a46c9e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:09.060744 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4baf64f5-710e-4bf4-b50e-698f27a46c9e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:09.061193 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4baf64f5-710e-4bf4-b50e-698f27a46c9e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:09.061611 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4baf64f5-710e-4bf4-b50e-698f27a46c9e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:09.230994 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-bf02559a-9316-4dcc-8c49-468fe0401b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:09.240535 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bf02559a-9316-4dcc-8c49-468fe0401b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.214455 Aug 10 12:59:09.241016 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1119/2221] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:09 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:09.242870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4baf64f5-710e-4bf4-b50e-698f27a46c9e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:09.250864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4baf64f5-710e-4bf4-b50e-698f27a46c9e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.202907 Aug 10 12:59:09.251494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1103/2222] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:09 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:10.043216 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d4f02615-0406-4c33-a59a-2495d99e6ca4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:10.043839 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d4f02615-0406-4c33-a59a-2495d99e6ca4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:10.050384 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d4f02615-0406-4c33-a59a-2495d99e6ca4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:10.050871 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d4f02615-0406-4c33-a59a-2495d99e6ca4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:10.051362 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d4f02615-0406-4c33-a59a-2495d99e6ca4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:10.052066 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d4f02615-0406-4c33-a59a-2495d99e6ca4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:10.052528 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d4f02615-0406-4c33-a59a-2495d99e6ca4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:10.052958 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d4f02615-0406-4c33-a59a-2495d99e6ca4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:10.054913 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e64cc6e5-b126-4c7a-aac0-552a76f469be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:10.055734 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e64cc6e5-b126-4c7a-aac0-552a76f469be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:10.062030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e64cc6e5-b126-4c7a-aac0-552a76f469be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:10.062503 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e64cc6e5-b126-4c7a-aac0-552a76f469be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:10.062934 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e64cc6e5-b126-4c7a-aac0-552a76f469be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:10.063682 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e64cc6e5-b126-4c7a-aac0-552a76f469be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:10.064719 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e64cc6e5-b126-4c7a-aac0-552a76f469be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:10.065170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e64cc6e5-b126-4c7a-aac0-552a76f469be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:10.249048 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d4f02615-0406-4c33-a59a-2495d99e6ca4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:10.254401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e64cc6e5-b126-4c7a-aac0-552a76f469be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:10.258506 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d4f02615-0406-4c33-a59a-2495d99e6ca4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.219115 Aug 10 12:59:10.259098 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1120/2223] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:10 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:10.263791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d19476c7-f41a-473b-9601-c0a6290565f2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:10.264581 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d19476c7-f41a-473b-9601-c0a6290565f2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:10.268987 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e64cc6e5-b126-4c7a-aac0-552a76f469be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:10.270495 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e64cc6e5-b126-4c7a-aac0-552a76f469be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:10.271076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d19476c7-f41a-473b-9601-c0a6290565f2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:10.271594 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d19476c7-f41a-473b-9601-c0a6290565f2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:10.271829 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e64cc6e5-b126-4c7a-aac0-552a76f469be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.220642 Aug 10 12:59:10.272032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d19476c7-f41a-473b-9601-c0a6290565f2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:10.272721 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d19476c7-f41a-473b-9601-c0a6290565f2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:10.272841 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1104/2224] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:10 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:10.273176 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d19476c7-f41a-473b-9601-c0a6290565f2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:10.273601 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d19476c7-f41a-473b-9601-c0a6290565f2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:10.277662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e85fea12-8e67-44a7-856b-1166f006a38f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:10.278547 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e85fea12-8e67-44a7-856b-1166f006a38f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:10.285941 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e85fea12-8e67-44a7-856b-1166f006a38f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:10.286429 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e85fea12-8e67-44a7-856b-1166f006a38f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:10.286865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e85fea12-8e67-44a7-856b-1166f006a38f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:10.287585 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e85fea12-8e67-44a7-856b-1166f006a38f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:10.288043 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e85fea12-8e67-44a7-856b-1166f006a38f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:10.288465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e85fea12-8e67-44a7-856b-1166f006a38f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:10.470293 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d19476c7-f41a-473b-9601-c0a6290565f2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:10.474470 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e85fea12-8e67-44a7-856b-1166f006a38f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:10.478205 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d19476c7-f41a-473b-9601-c0a6290565f2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.217917 Aug 10 12:59:10.479045 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1121/2225] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:10 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:10.482747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e85fea12-8e67-44a7-856b-1166f006a38f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.209018 Aug 10 12:59:10.483473 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1105/2226] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:10 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:11.279217 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f543409a-f497-4a5c-9472-8c48c8e4697d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:11.279828 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f543409a-f497-4a5c-9472-8c48c8e4697d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:11.287040 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f543409a-f497-4a5c-9472-8c48c8e4697d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:11.287550 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f543409a-f497-4a5c-9472-8c48c8e4697d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:11.287983 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f543409a-f497-4a5c-9472-8c48c8e4697d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:11.288663 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f543409a-f497-4a5c-9472-8c48c8e4697d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:11.289106 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f543409a-f497-4a5c-9472-8c48c8e4697d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:11.289522 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f543409a-f497-4a5c-9472-8c48c8e4697d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:11.296882 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c143b6fb-51f0-436d-9eb8-35bb5461dd62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:11.297489 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c143b6fb-51f0-436d-9eb8-35bb5461dd62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:11.303641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c143b6fb-51f0-436d-9eb8-35bb5461dd62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:11.304122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c143b6fb-51f0-436d-9eb8-35bb5461dd62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:11.304551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c143b6fb-51f0-436d-9eb8-35bb5461dd62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:11.305230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c143b6fb-51f0-436d-9eb8-35bb5461dd62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:11.305690 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c143b6fb-51f0-436d-9eb8-35bb5461dd62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:11.306108 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c143b6fb-51f0-436d-9eb8-35bb5461dd62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:11.481622 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f543409a-f497-4a5c-9472-8c48c8e4697d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:11.489919 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f543409a-f497-4a5c-9472-8c48c8e4697d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.214491 Aug 10 12:59:11.490941 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1122/2227] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:11 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:11.493936 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c143b6fb-51f0-436d-9eb8-35bb5461dd62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:11.496119 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:59:11.501883 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0e724f87-2070-4793-b0b3-83a57cd2a972 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:11.507384 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0e724f87-2070-4793-b0b3-83a57cd2a972 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:11.507672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c143b6fb-51f0-436d-9eb8-35bb5461dd62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:11.507672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c143b6fb-51f0-436d-9eb8-35bb5461dd62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:11.507672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c143b6fb-51f0-436d-9eb8-35bb5461dd62 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.213254 Aug 10 12:59:11.508043 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1106/2228] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:11 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:11.509692 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e724f87-2070-4793-b0b3-83a57cd2a972 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:11.510439 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e724f87-2070-4793-b0b3-83a57cd2a972 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:11.511106 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e724f87-2070-4793-b0b3-83a57cd2a972 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:11.512252 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-905ff47f-bb05-445f-a55a-08884a2a78c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:11.512252 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-905ff47f-bb05-445f-a55a-08884a2a78c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:11.513220 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e724f87-2070-4793-b0b3-83a57cd2a972 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:11.513859 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e724f87-2070-4793-b0b3-83a57cd2a972 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:11.514453 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e724f87-2070-4793-b0b3-83a57cd2a972 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:11.518237 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-905ff47f-bb05-445f-a55a-08884a2a78c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:11.518718 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-905ff47f-bb05-445f-a55a-08884a2a78c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:11.519157 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-905ff47f-bb05-445f-a55a-08884a2a78c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:11.519875 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-905ff47f-bb05-445f-a55a-08884a2a78c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:11.520331 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-905ff47f-bb05-445f-a55a-08884a2a78c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:11.520761 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-905ff47f-bb05-445f-a55a-08884a2a78c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:11.710951 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0e724f87-2070-4793-b0b3-83a57cd2a972 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:11.714441 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-905ff47f-bb05-445f-a55a-08884a2a78c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:11.719013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0e724f87-2070-4793-b0b3-83a57cd2a972 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.221372 Aug 10 12:59:11.719621 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1123/2229] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:11 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:11.723143 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-905ff47f-bb05-445f-a55a-08884a2a78c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.215365 Aug 10 12:59:11.723737 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1107/2230] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:11 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:12.511869 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-06c0fe77-448c-4d26-a240-381759d8dd6b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:12.512474 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-06c0fe77-448c-4d26-a240-381759d8dd6b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:12.519293 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06c0fe77-448c-4d26-a240-381759d8dd6b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:12.519765 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06c0fe77-448c-4d26-a240-381759d8dd6b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:12.520207 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06c0fe77-448c-4d26-a240-381759d8dd6b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:12.520860 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06c0fe77-448c-4d26-a240-381759d8dd6b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:12.521306 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06c0fe77-448c-4d26-a240-381759d8dd6b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:12.521720 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06c0fe77-448c-4d26-a240-381759d8dd6b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:12.529855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-519a321d-76aa-400f-bff8-d1ca5da9bc88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:12.530397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-519a321d-76aa-400f-bff8-d1ca5da9bc88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:12.536915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-519a321d-76aa-400f-bff8-d1ca5da9bc88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:12.537393 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-519a321d-76aa-400f-bff8-d1ca5da9bc88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:12.537820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-519a321d-76aa-400f-bff8-d1ca5da9bc88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:12.538526 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-519a321d-76aa-400f-bff8-d1ca5da9bc88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:12.538950 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-519a321d-76aa-400f-bff8-d1ca5da9bc88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:12.539407 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-519a321d-76aa-400f-bff8-d1ca5da9bc88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:12.717000 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-06c0fe77-448c-4d26-a240-381759d8dd6b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:12.727486 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-06c0fe77-448c-4d26-a240-381759d8dd6b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.219413 Aug 10 12:59:12.728947 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1124/2231] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:12 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:12.730553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-519a321d-76aa-400f-bff8-d1ca5da9bc88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:12.740384 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-519a321d-76aa-400f-bff8-d1ca5da9bc88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:12.741922 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-519a321d-76aa-400f-bff8-d1ca5da9bc88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:12.743224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-519a321d-76aa-400f-bff8-d1ca5da9bc88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.217285 Aug 10 12:59:12.744059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1108/2232] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:12 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:12.747801 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0bfdb446-1b2e-4ca7-80ad-3a1c15f8293e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:12.748602 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0bfdb446-1b2e-4ca7-80ad-3a1c15f8293e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:12.748857 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ade2f7bd-7aba-4da2-ba19-acb6ea123117 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:12.749510 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ade2f7bd-7aba-4da2-ba19-acb6ea123117 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:12.756561 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ade2f7bd-7aba-4da2-ba19-acb6ea123117 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:12.757046 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ade2f7bd-7aba-4da2-ba19-acb6ea123117 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:12.757179 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0bfdb446-1b2e-4ca7-80ad-3a1c15f8293e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:12.757479 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ade2f7bd-7aba-4da2-ba19-acb6ea123117 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:12.757613 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0bfdb446-1b2e-4ca7-80ad-3a1c15f8293e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:12.757989 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0bfdb446-1b2e-4ca7-80ad-3a1c15f8293e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:12.758198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ade2f7bd-7aba-4da2-ba19-acb6ea123117 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:12.758598 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ade2f7bd-7aba-4da2-ba19-acb6ea123117 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:12.758799 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0bfdb446-1b2e-4ca7-80ad-3a1c15f8293e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:12.759010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ade2f7bd-7aba-4da2-ba19-acb6ea123117 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:12.759315 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0bfdb446-1b2e-4ca7-80ad-3a1c15f8293e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:12.759830 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0bfdb446-1b2e-4ca7-80ad-3a1c15f8293e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:13.161327 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0bfdb446-1b2e-4ca7-80ad-3a1c15f8293e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:13.169208 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0bfdb446-1b2e-4ca7-80ad-3a1c15f8293e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.427144 Aug 10 12:59:13.170060 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1125/2233] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:12 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:13.172615 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ade2f7bd-7aba-4da2-ba19-acb6ea123117 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:13.180726 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ade2f7bd-7aba-4da2-ba19-acb6ea123117 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.435274 Aug 10 12:59:13.181400 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1109/2234] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:12 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:13.763047 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fa88ce64-bf87-480a-8b41-6c7cd743b16e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:13.763758 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fa88ce64-bf87-480a-8b41-6c7cd743b16e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:13.767900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3294efb8-ef2a-4e9c-acf8-50f7026c9024 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:13.768522 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3294efb8-ef2a-4e9c-acf8-50f7026c9024 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:13.783585 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa88ce64-bf87-480a-8b41-6c7cd743b16e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:13.783585 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa88ce64-bf87-480a-8b41-6c7cd743b16e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:13.783585 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa88ce64-bf87-480a-8b41-6c7cd743b16e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:13.783585 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa88ce64-bf87-480a-8b41-6c7cd743b16e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:13.783915 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa88ce64-bf87-480a-8b41-6c7cd743b16e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:13.783915 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa88ce64-bf87-480a-8b41-6c7cd743b16e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:13.784072 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3294efb8-ef2a-4e9c-acf8-50f7026c9024 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:13.784072 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3294efb8-ef2a-4e9c-acf8-50f7026c9024 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:13.784072 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3294efb8-ef2a-4e9c-acf8-50f7026c9024 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:13.784072 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3294efb8-ef2a-4e9c-acf8-50f7026c9024 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:13.784395 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3294efb8-ef2a-4e9c-acf8-50f7026c9024 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:13.784395 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3294efb8-ef2a-4e9c-acf8-50f7026c9024 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:13.969294 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fa88ce64-bf87-480a-8b41-6c7cd743b16e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:13.972465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3294efb8-ef2a-4e9c-acf8-50f7026c9024 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:13.979736 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fa88ce64-bf87-480a-8b41-6c7cd743b16e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.220409 Aug 10 12:59:13.980250 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1126/2235] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:13 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:13.981003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3294efb8-ef2a-4e9c-acf8-50f7026c9024 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:13.982520 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3294efb8-ef2a-4e9c-acf8-50f7026c9024 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:13.983703 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3294efb8-ef2a-4e9c-acf8-50f7026c9024 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.220812 Aug 10 12:59:13.984266 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1110/2236] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:13 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:14.190310 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e12b3057-94bf-4dac-a283-51d6514e1fff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:14.190928 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e12b3057-94bf-4dac-a283-51d6514e1fff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:14.196869 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e12b3057-94bf-4dac-a283-51d6514e1fff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:14.197356 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e12b3057-94bf-4dac-a283-51d6514e1fff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:14.197798 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e12b3057-94bf-4dac-a283-51d6514e1fff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:14.198496 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e12b3057-94bf-4dac-a283-51d6514e1fff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:14.198952 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e12b3057-94bf-4dac-a283-51d6514e1fff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:14.199416 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e12b3057-94bf-4dac-a283-51d6514e1fff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:14.201811 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2e11a3dd-a8c9-4cf4-96ec-d63364bb6b34 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:14.202410 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2e11a3dd-a8c9-4cf4-96ec-d63364bb6b34 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:14.208342 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e11a3dd-a8c9-4cf4-96ec-d63364bb6b34 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:14.208814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e11a3dd-a8c9-4cf4-96ec-d63364bb6b34 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:14.209239 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e11a3dd-a8c9-4cf4-96ec-d63364bb6b34 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:14.209913 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e11a3dd-a8c9-4cf4-96ec-d63364bb6b34 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:14.210355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e11a3dd-a8c9-4cf4-96ec-d63364bb6b34 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:14.210770 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e11a3dd-a8c9-4cf4-96ec-d63364bb6b34 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:14.394818 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e12b3057-94bf-4dac-a283-51d6514e1fff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:14.398187 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2e11a3dd-a8c9-4cf4-96ec-d63364bb6b34 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:14.403057 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e12b3057-94bf-4dac-a283-51d6514e1fff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.217141 Aug 10 12:59:14.404421 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1127/2237] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:14 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:14.408511 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2e11a3dd-a8c9-4cf4-96ec-d63364bb6b34 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.208046 Aug 10 12:59:14.408511 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1111/2238] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:14 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:15.000946 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-48572309-4a4c-453f-9494-c63ac9bb1605 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:15.001715 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-48572309-4a4c-453f-9494-c63ac9bb1605 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:15.007473 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-df61db39-de98-45c2-bde7-436acbc9b851 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:15.008076 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-df61db39-de98-45c2-bde7-436acbc9b851 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:15.008217 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-48572309-4a4c-453f-9494-c63ac9bb1605 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:15.008648 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-48572309-4a4c-453f-9494-c63ac9bb1605 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:15.009077 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-48572309-4a4c-453f-9494-c63ac9bb1605 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:15.009767 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-48572309-4a4c-453f-9494-c63ac9bb1605 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:15.010213 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-48572309-4a4c-453f-9494-c63ac9bb1605 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:15.010634 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-48572309-4a4c-453f-9494-c63ac9bb1605 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:15.014268 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-df61db39-de98-45c2-bde7-436acbc9b851 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:15.014738 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-df61db39-de98-45c2-bde7-436acbc9b851 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:15.015163 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-df61db39-de98-45c2-bde7-436acbc9b851 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:15.015869 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-df61db39-de98-45c2-bde7-436acbc9b851 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:15.016313 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-df61db39-de98-45c2-bde7-436acbc9b851 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:15.016728 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-df61db39-de98-45c2-bde7-436acbc9b851 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:15.211830 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-48572309-4a4c-453f-9494-c63ac9bb1605 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:15.214641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-df61db39-de98-45c2-bde7-436acbc9b851 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:15.219797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-48572309-4a4c-453f-9494-c63ac9bb1605 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.222711 Aug 10 12:59:15.220471 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1128/2239] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:14 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:15.223245 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-df61db39-de98-45c2-bde7-436acbc9b851 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:15.224741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-df61db39-de98-45c2-bde7-436acbc9b851 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:15.225887 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-df61db39-de98-45c2-bde7-436acbc9b851 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.222378 Aug 10 12:59:15.226608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1112/2240] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:15 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:15.424927 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bed11cb5-6e5b-4671-9f18-78e4d9c84aee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:15.425463 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bed11cb5-6e5b-4671-9f18-78e4d9c84aee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:15.427392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-785fa180-67f5-4b1f-9467-da6d7c0896c0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:15.428041 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-785fa180-67f5-4b1f-9467-da6d7c0896c0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:15.431492 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bed11cb5-6e5b-4671-9f18-78e4d9c84aee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:15.431974 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bed11cb5-6e5b-4671-9f18-78e4d9c84aee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:15.432406 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bed11cb5-6e5b-4671-9f18-78e4d9c84aee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:15.433123 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bed11cb5-6e5b-4671-9f18-78e4d9c84aee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:15.433569 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bed11cb5-6e5b-4671-9f18-78e4d9c84aee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:15.433825 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-785fa180-67f5-4b1f-9467-da6d7c0896c0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:15.433982 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bed11cb5-6e5b-4671-9f18-78e4d9c84aee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:15.434302 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-785fa180-67f5-4b1f-9467-da6d7c0896c0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:15.434730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-785fa180-67f5-4b1f-9467-da6d7c0896c0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:15.435453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-785fa180-67f5-4b1f-9467-da6d7c0896c0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:15.435901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-785fa180-67f5-4b1f-9467-da6d7c0896c0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:15.436325 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-785fa180-67f5-4b1f-9467-da6d7c0896c0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:15.621411 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-bed11cb5-6e5b-4671-9f18-78e4d9c84aee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:15.629183 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-785fa180-67f5-4b1f-9467-da6d7c0896c0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:15.630387 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bed11cb5-6e5b-4671-9f18-78e4d9c84aee tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.209887 Aug 10 12:59:15.630970 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1129/2241] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:15 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:15.637412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-785fa180-67f5-4b1f-9467-da6d7c0896c0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.214545 Aug 10 12:59:15.638067 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1113/2242] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:15 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:16.240628 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f561a820-5b85-4686-a02e-4af67c4b2e66 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:16.241165 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f561a820-5b85-4686-a02e-4af67c4b2e66 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:16.247596 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f561a820-5b85-4686-a02e-4af67c4b2e66 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:16.248077 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f561a820-5b85-4686-a02e-4af67c4b2e66 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:16.248207 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-276c0d01-31ca-4295-90a8-7d3e2fb881a0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:16.248616 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f561a820-5b85-4686-a02e-4af67c4b2e66 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:16.248860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-276c0d01-31ca-4295-90a8-7d3e2fb881a0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:16.249188 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f561a820-5b85-4686-a02e-4af67c4b2e66 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:16.249615 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f561a820-5b85-4686-a02e-4af67c4b2e66 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:16.250033 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f561a820-5b85-4686-a02e-4af67c4b2e66 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:16.256414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-276c0d01-31ca-4295-90a8-7d3e2fb881a0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:16.256907 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-276c0d01-31ca-4295-90a8-7d3e2fb881a0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:16.257348 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-276c0d01-31ca-4295-90a8-7d3e2fb881a0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:16.258042 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-276c0d01-31ca-4295-90a8-7d3e2fb881a0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:16.258527 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-276c0d01-31ca-4295-90a8-7d3e2fb881a0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:16.258952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-276c0d01-31ca-4295-90a8-7d3e2fb881a0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:16.444639 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f561a820-5b85-4686-a02e-4af67c4b2e66 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:16.448720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-276c0d01-31ca-4295-90a8-7d3e2fb881a0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:16.452574 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f561a820-5b85-4686-a02e-4af67c4b2e66 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.215893 Aug 10 12:59:16.453152 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1130/2243] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:16 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:16.457837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-276c0d01-31ca-4295-90a8-7d3e2fb881a0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:16.459379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-276c0d01-31ca-4295-90a8-7d3e2fb881a0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:16.460535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-276c0d01-31ca-4295-90a8-7d3e2fb881a0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.216260 Aug 10 12:59:16.461094 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1114/2244] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:16 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:16.651385 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8b171fcd-9bf2-4351-874e-c4a876354561 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:16.652003 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8b171fcd-9bf2-4351-874e-c4a876354561 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:16.658626 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b171fcd-9bf2-4351-874e-c4a876354561 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:16.659139 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b171fcd-9bf2-4351-874e-c4a876354561 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:16.659358 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2f3b6c24-eeba-4fbb-bc31-9098461c3eb0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:16.659588 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b171fcd-9bf2-4351-874e-c4a876354561 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:16.660006 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2f3b6c24-eeba-4fbb-bc31-9098461c3eb0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:16.660290 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b171fcd-9bf2-4351-874e-c4a876354561 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:16.660742 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b171fcd-9bf2-4351-874e-c4a876354561 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:16.661170 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b171fcd-9bf2-4351-874e-c4a876354561 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:16.665831 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2f3b6c24-eeba-4fbb-bc31-9098461c3eb0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:16.669557 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2f3b6c24-eeba-4fbb-bc31-9098461c3eb0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:16.669557 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2f3b6c24-eeba-4fbb-bc31-9098461c3eb0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:16.669557 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2f3b6c24-eeba-4fbb-bc31-9098461c3eb0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:16.669557 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2f3b6c24-eeba-4fbb-bc31-9098461c3eb0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:16.669929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2f3b6c24-eeba-4fbb-bc31-9098461c3eb0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:16.858618 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2f3b6c24-eeba-4fbb-bc31-9098461c3eb0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:16.862544 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-8b171fcd-9bf2-4351-874e-c4a876354561 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:16.866795 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2f3b6c24-eeba-4fbb-bc31-9098461c3eb0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.212436 Aug 10 12:59:16.867389 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1115/2245] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:16 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:16.870773 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8b171fcd-9bf2-4351-874e-c4a876354561 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.223264 Aug 10 12:59:16.871372 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1131/2246] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:16 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:17.475710 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-84f09b20-12e1-45ee-8383-888707fca360 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:17.476323 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-84f09b20-12e1-45ee-8383-888707fca360 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:17.483015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84f09b20-12e1-45ee-8383-888707fca360 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:17.483532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84f09b20-12e1-45ee-8383-888707fca360 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:17.483968 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84f09b20-12e1-45ee-8383-888707fca360 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:17.484079 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3ba6e48e-b24e-485d-995c-c6f0b2527624 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:17.484644 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3ba6e48e-b24e-485d-995c-c6f0b2527624 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:17.484762 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84f09b20-12e1-45ee-8383-888707fca360 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:17.485096 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84f09b20-12e1-45ee-8383-888707fca360 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:17.485518 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84f09b20-12e1-45ee-8383-888707fca360 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:17.491797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ba6e48e-b24e-485d-995c-c6f0b2527624 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:17.492216 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ba6e48e-b24e-485d-995c-c6f0b2527624 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:17.492652 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ba6e48e-b24e-485d-995c-c6f0b2527624 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:17.493342 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ba6e48e-b24e-485d-995c-c6f0b2527624 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:17.493801 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ba6e48e-b24e-485d-995c-c6f0b2527624 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:17.494228 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ba6e48e-b24e-485d-995c-c6f0b2527624 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:17.682078 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-84f09b20-12e1-45ee-8383-888707fca360 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:17.685241 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3ba6e48e-b24e-485d-995c-c6f0b2527624 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:17.690234 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-84f09b20-12e1-45ee-8383-888707fca360 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.218338 Aug 10 12:59:17.690904 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1116/2247] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:17 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:17.694224 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3ba6e48e-b24e-485d-995c-c6f0b2527624 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:17.695762 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3ba6e48e-b24e-485d-995c-c6f0b2527624 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:17.696929 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3ba6e48e-b24e-485d-995c-c6f0b2527624 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.216814 Aug 10 12:59:17.697482 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1132/2248] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:17 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:17.889322 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3d630590-a35b-4e7a-8d41-e178c37110ed tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:17.889933 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3d630590-a35b-4e7a-8d41-e178c37110ed tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:17.892458 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bbe105f0-26db-4f26-bc1c-91bf5a851dae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:17.893434 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bbe105f0-26db-4f26-bc1c-91bf5a851dae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:17.896731 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3d630590-a35b-4e7a-8d41-e178c37110ed tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:17.897210 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3d630590-a35b-4e7a-8d41-e178c37110ed tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:17.897671 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3d630590-a35b-4e7a-8d41-e178c37110ed tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:17.898365 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3d630590-a35b-4e7a-8d41-e178c37110ed tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:17.898833 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3d630590-a35b-4e7a-8d41-e178c37110ed tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:17.899165 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bbe105f0-26db-4f26-bc1c-91bf5a851dae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:17.899323 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3d630590-a35b-4e7a-8d41-e178c37110ed tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:17.899668 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bbe105f0-26db-4f26-bc1c-91bf5a851dae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:17.900096 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bbe105f0-26db-4f26-bc1c-91bf5a851dae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:17.900778 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bbe105f0-26db-4f26-bc1c-91bf5a851dae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:17.901220 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bbe105f0-26db-4f26-bc1c-91bf5a851dae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:17.901635 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bbe105f0-26db-4f26-bc1c-91bf5a851dae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:18.098234 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3d630590-a35b-4e7a-8d41-e178c37110ed tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:18.101185 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-bbe105f0-26db-4f26-bc1c-91bf5a851dae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:18.106605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3d630590-a35b-4e7a-8d41-e178c37110ed tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.221386 Aug 10 12:59:18.107188 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1117/2249] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:17 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:18.109449 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bbe105f0-26db-4f26-bc1c-91bf5a851dae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.221316 Aug 10 12:59:18.110089 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1133/2250] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:17 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:18.711921 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a877975c-8663-4801-8e79-daf129e0f989 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:18.712484 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a877975c-8663-4801-8e79-daf129e0f989 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:18.718727 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a877975c-8663-4801-8e79-daf129e0f989 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:18.719241 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a877975c-8663-4801-8e79-daf129e0f989 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:18.719679 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a877975c-8663-4801-8e79-daf129e0f989 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:18.720470 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9d358f2f-c71f-45bb-b5fb-52aba31444eb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:18.721035 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a877975c-8663-4801-8e79-daf129e0f989 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:18.721160 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9d358f2f-c71f-45bb-b5fb-52aba31444eb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:18.721272 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a877975c-8663-4801-8e79-daf129e0f989 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:18.721560 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a877975c-8663-4801-8e79-daf129e0f989 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:18.727463 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d358f2f-c71f-45bb-b5fb-52aba31444eb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:18.727947 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d358f2f-c71f-45bb-b5fb-52aba31444eb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:18.728631 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d358f2f-c71f-45bb-b5fb-52aba31444eb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:18.729357 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d358f2f-c71f-45bb-b5fb-52aba31444eb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:18.729815 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d358f2f-c71f-45bb-b5fb-52aba31444eb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:18.730236 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d358f2f-c71f-45bb-b5fb-52aba31444eb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:18.745560 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:59:18.921784 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a877975c-8663-4801-8e79-daf129e0f989 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:18.925735 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9d358f2f-c71f-45bb-b5fb-52aba31444eb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:18.930603 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a877975c-8663-4801-8e79-daf129e0f989 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.222595 Aug 10 12:59:18.931238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1118/2251] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:18 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:18.934825 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9d358f2f-c71f-45bb-b5fb-52aba31444eb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:18.936361 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9d358f2f-c71f-45bb-b5fb-52aba31444eb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:18.937524 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9d358f2f-c71f-45bb-b5fb-52aba31444eb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.221191 Aug 10 12:59:18.938073 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1134/2252] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:18 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:19.128216 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ba991534-d4d3-4747-91fe-7f907ac04924 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:19.128839 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ba991534-d4d3-4747-91fe-7f907ac04924 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:19.131880 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-34d266fe-3c73-4628-97e7-d62657022d57 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:19.132547 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-34d266fe-3c73-4628-97e7-d62657022d57 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:19.134735 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ba991534-d4d3-4747-91fe-7f907ac04924 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:19.135239 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ba991534-d4d3-4747-91fe-7f907ac04924 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:19.135674 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ba991534-d4d3-4747-91fe-7f907ac04924 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:19.136357 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ba991534-d4d3-4747-91fe-7f907ac04924 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:19.136802 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ba991534-d4d3-4747-91fe-7f907ac04924 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:19.137222 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ba991534-d4d3-4747-91fe-7f907ac04924 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:19.138443 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34d266fe-3c73-4628-97e7-d62657022d57 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:19.138984 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34d266fe-3c73-4628-97e7-d62657022d57 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:19.139462 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34d266fe-3c73-4628-97e7-d62657022d57 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:19.140151 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34d266fe-3c73-4628-97e7-d62657022d57 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:19.140605 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34d266fe-3c73-4628-97e7-d62657022d57 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:19.141031 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34d266fe-3c73-4628-97e7-d62657022d57 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:19.332036 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ba991534-d4d3-4747-91fe-7f907ac04924 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:19.334098 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-34d266fe-3c73-4628-97e7-d62657022d57 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:19.339971 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ba991534-d4d3-4747-91fe-7f907ac04924 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.216379 Aug 10 12:59:19.340538 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1119/2253] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:19 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:19.341921 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-34d266fe-3c73-4628-97e7-d62657022d57 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.214246 Aug 10 12:59:19.342486 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1135/2254] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:19 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:19.952249 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-eeb786ca-4b53-450d-827d-e4d7c62c27d7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:19.952808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-eeb786ca-4b53-450d-827d-e4d7c62c27d7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:19.959915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eeb786ca-4b53-450d-827d-e4d7c62c27d7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:19.960392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eeb786ca-4b53-450d-827d-e4d7c62c27d7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:19.960828 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eeb786ca-4b53-450d-827d-e4d7c62c27d7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:19.961068 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-51ca48cd-b1e1-4a85-8b12-757e3c2ed7c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:19.961512 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eeb786ca-4b53-450d-827d-e4d7c62c27d7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:19.961683 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-51ca48cd-b1e1-4a85-8b12-757e3c2ed7c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:19.961951 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eeb786ca-4b53-450d-827d-e4d7c62c27d7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:19.962375 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eeb786ca-4b53-450d-827d-e4d7c62c27d7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:19.968002 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51ca48cd-b1e1-4a85-8b12-757e3c2ed7c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:19.968501 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51ca48cd-b1e1-4a85-8b12-757e3c2ed7c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:19.968931 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51ca48cd-b1e1-4a85-8b12-757e3c2ed7c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:19.969610 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51ca48cd-b1e1-4a85-8b12-757e3c2ed7c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:19.970059 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51ca48cd-b1e1-4a85-8b12-757e3c2ed7c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:19.971431 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51ca48cd-b1e1-4a85-8b12-757e3c2ed7c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:20.157347 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-eeb786ca-4b53-450d-827d-e4d7c62c27d7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:20.164736 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-51ca48cd-b1e1-4a85-8b12-757e3c2ed7c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:20.166286 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-eeb786ca-4b53-450d-827d-e4d7c62c27d7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.217965 Aug 10 12:59:20.167259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1120/2255] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:19 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:20.173237 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-51ca48cd-b1e1-4a85-8b12-757e3c2ed7c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:20.174966 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-51ca48cd-b1e1-4a85-8b12-757e3c2ed7c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:20.176217 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-51ca48cd-b1e1-4a85-8b12-757e3c2ed7c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.218970 Aug 10 12:59:20.176768 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1136/2256] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:19 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:59:20.363015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9ad093d2-9b82-402b-864d-1e0679b460b4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:20.363300 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-341057ca-3317-4eab-84e6-70d3939cc299 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:20.363637 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9ad093d2-9b82-402b-864d-1e0679b460b4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:20.363930 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-341057ca-3317-4eab-84e6-70d3939cc299 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:20.369783 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-341057ca-3317-4eab-84e6-70d3939cc299 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:20.369942 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ad093d2-9b82-402b-864d-1e0679b460b4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:20.370264 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-341057ca-3317-4eab-84e6-70d3939cc299 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:20.370385 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ad093d2-9b82-402b-864d-1e0679b460b4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:20.370700 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-341057ca-3317-4eab-84e6-70d3939cc299 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:20.370816 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ad093d2-9b82-402b-864d-1e0679b460b4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:20.371413 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-341057ca-3317-4eab-84e6-70d3939cc299 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:20.371540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ad093d2-9b82-402b-864d-1e0679b460b4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:20.371868 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-341057ca-3317-4eab-84e6-70d3939cc299 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:20.371995 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ad093d2-9b82-402b-864d-1e0679b460b4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:20.372292 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-341057ca-3317-4eab-84e6-70d3939cc299 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:20.372399 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ad093d2-9b82-402b-864d-1e0679b460b4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:20.564750 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9ad093d2-9b82-402b-864d-1e0679b460b4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:20.569854 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-341057ca-3317-4eab-84e6-70d3939cc299 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:20.572912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9ad093d2-9b82-402b-864d-1e0679b460b4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.213753 Aug 10 12:59:20.573730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1121/2257] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:20 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:20.577802 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-341057ca-3317-4eab-84e6-70d3939cc299 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.218489 Aug 10 12:59:20.580290 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1137/2258] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:20 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:21.187396 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3bdc0960-57ef-421c-802a-6ce1e7b86cfd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:21.188015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3bdc0960-57ef-421c-802a-6ce1e7b86cfd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:21.196418 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3bdc0960-57ef-421c-802a-6ce1e7b86cfd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:21.196902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3bdc0960-57ef-421c-802a-6ce1e7b86cfd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:21.197334 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3bdc0960-57ef-421c-802a-6ce1e7b86cfd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:21.198031 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3bdc0960-57ef-421c-802a-6ce1e7b86cfd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:21.198222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3c061953-e0da-4a89-95b7-b964e316246e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:21.198643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3bdc0960-57ef-421c-802a-6ce1e7b86cfd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:21.198872 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3c061953-e0da-4a89-95b7-b964e316246e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:21.198996 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3bdc0960-57ef-421c-802a-6ce1e7b86cfd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:21.205312 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3c061953-e0da-4a89-95b7-b964e316246e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:21.205791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3c061953-e0da-4a89-95b7-b964e316246e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:21.206230 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3c061953-e0da-4a89-95b7-b964e316246e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:21.206918 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3c061953-e0da-4a89-95b7-b964e316246e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:21.207402 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3c061953-e0da-4a89-95b7-b964e316246e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:21.207833 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3c061953-e0da-4a89-95b7-b964e316246e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:21.384590 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3bdc0960-57ef-421c-802a-6ce1e7b86cfd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:21.393050 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3bdc0960-57ef-421c-802a-6ce1e7b86cfd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.209455 Aug 10 12:59:21.393625 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1122/2259] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:21 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:21.395987 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3c061953-e0da-4a89-95b7-b964e316246e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:21.404551 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3c061953-e0da-4a89-95b7-b964e316246e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:21.406119 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3c061953-e0da-4a89-95b7-b964e316246e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:21.407412 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3c061953-e0da-4a89-95b7-b964e316246e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.212985 Aug 10 12:59:21.408519 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1138/2260] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:21 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:21.597242 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3b5a9ef3-5c98-4edc-a76e-da9e536664b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:21.597856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3b5a9ef3-5c98-4edc-a76e-da9e536664b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:21.600713 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-feeddf55-dbd3-47f5-b082-4a8b691081f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:21.601328 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-feeddf55-dbd3-47f5-b082-4a8b691081f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:21.604442 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3b5a9ef3-5c98-4edc-a76e-da9e536664b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:21.604699 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3b5a9ef3-5c98-4edc-a76e-da9e536664b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:21.605132 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3b5a9ef3-5c98-4edc-a76e-da9e536664b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:21.605817 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3b5a9ef3-5c98-4edc-a76e-da9e536664b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:21.606286 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3b5a9ef3-5c98-4edc-a76e-da9e536664b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:21.606695 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3b5a9ef3-5c98-4edc-a76e-da9e536664b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:21.607422 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-feeddf55-dbd3-47f5-b082-4a8b691081f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:21.607897 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-feeddf55-dbd3-47f5-b082-4a8b691081f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:21.608326 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-feeddf55-dbd3-47f5-b082-4a8b691081f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:21.609009 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-feeddf55-dbd3-47f5-b082-4a8b691081f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:21.609452 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-feeddf55-dbd3-47f5-b082-4a8b691081f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:21.609873 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-feeddf55-dbd3-47f5-b082-4a8b691081f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:21.621361 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:59:21.798002 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3b5a9ef3-5c98-4edc-a76e-da9e536664b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:21.805886 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-feeddf55-dbd3-47f5-b082-4a8b691081f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:21.808198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3b5a9ef3-5c98-4edc-a76e-da9e536664b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.216591 Aug 10 12:59:21.809100 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1123/2261] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:21 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:21.815254 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-feeddf55-dbd3-47f5-b082-4a8b691081f8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.218214 Aug 10 12:59:21.816191 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1139/2262] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:21 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:22.414238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3ed5430b-170d-40de-89d1-3a37c96481f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:22.414872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3ed5430b-170d-40de-89d1-3a37c96481f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:22.421216 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ed5430b-170d-40de-89d1-3a37c96481f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:22.421694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ed5430b-170d-40de-89d1-3a37c96481f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:22.422127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ed5430b-170d-40de-89d1-3a37c96481f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:22.422808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ed5430b-170d-40de-89d1-3a37c96481f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:22.423992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ed5430b-170d-40de-89d1-3a37c96481f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:22.424426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ed5430b-170d-40de-89d1-3a37c96481f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:22.430327 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5a4cf1b6-9b7f-43bd-9581-e8a3183842c5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:22.431024 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5a4cf1b6-9b7f-43bd-9581-e8a3183842c5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:22.437296 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a4cf1b6-9b7f-43bd-9581-e8a3183842c5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:22.437773 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a4cf1b6-9b7f-43bd-9581-e8a3183842c5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:22.438213 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a4cf1b6-9b7f-43bd-9581-e8a3183842c5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:22.439636 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a4cf1b6-9b7f-43bd-9581-e8a3183842c5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:22.440097 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a4cf1b6-9b7f-43bd-9581-e8a3183842c5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:22.440521 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5a4cf1b6-9b7f-43bd-9581-e8a3183842c5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:22.623493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3ed5430b-170d-40de-89d1-3a37c96481f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:22.626849 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5a4cf1b6-9b7f-43bd-9581-e8a3183842c5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:22.632081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3ed5430b-170d-40de-89d1-3a37c96481f6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.221744 Aug 10 12:59:22.632669 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1124/2263] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:22 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:22.635983 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5a4cf1b6-9b7f-43bd-9581-e8a3183842c5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:22.637495 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5a4cf1b6-9b7f-43bd-9581-e8a3183842c5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:22.638667 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5a4cf1b6-9b7f-43bd-9581-e8a3183842c5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.212239 Aug 10 12:59:22.639239 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1140/2264] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:22 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:22.830466 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-27964ca8-ae92-4c43-aaf9-d17e64fa483c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:22.831001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-27964ca8-ae92-4c43-aaf9-d17e64fa483c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:22.836374 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e7e43831-da12-46f8-aaa2-c61485e8b35c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:22.836937 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27964ca8-ae92-4c43-aaf9-d17e64fa483c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:22.837067 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e7e43831-da12-46f8-aaa2-c61485e8b35c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:22.837412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27964ca8-ae92-4c43-aaf9-d17e64fa483c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:22.837841 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27964ca8-ae92-4c43-aaf9-d17e64fa483c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:22.838523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27964ca8-ae92-4c43-aaf9-d17e64fa483c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:22.838965 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27964ca8-ae92-4c43-aaf9-d17e64fa483c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:22.839485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27964ca8-ae92-4c43-aaf9-d17e64fa483c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:22.842812 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e7e43831-da12-46f8-aaa2-c61485e8b35c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:22.843326 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e7e43831-da12-46f8-aaa2-c61485e8b35c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:22.843759 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e7e43831-da12-46f8-aaa2-c61485e8b35c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:22.844628 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e7e43831-da12-46f8-aaa2-c61485e8b35c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:22.845622 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e7e43831-da12-46f8-aaa2-c61485e8b35c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:22.846049 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e7e43831-da12-46f8-aaa2-c61485e8b35c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:23.037600 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e7e43831-da12-46f8-aaa2-c61485e8b35c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:23.041095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-27964ca8-ae92-4c43-aaf9-d17e64fa483c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:23.046174 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e7e43831-da12-46f8-aaa2-c61485e8b35c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.213453 Aug 10 12:59:23.047008 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1141/2265] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:22 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:23.051200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-27964ca8-ae92-4c43-aaf9-d17e64fa483c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.225177 Aug 10 12:59:23.055269 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1125/2266] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:22 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:23.653021 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-649d1bf9-e10b-4d45-bfaf-45548ba2f578 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:23.653616 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-649d1bf9-e10b-4d45-bfaf-45548ba2f578 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:23.660512 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-649d1bf9-e10b-4d45-bfaf-45548ba2f578 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:23.660992 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-649d1bf9-e10b-4d45-bfaf-45548ba2f578 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:23.661346 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c57e4c9c-e7d7-4f1d-8dd0-5bb4e95838b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:23.661769 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-649d1bf9-e10b-4d45-bfaf-45548ba2f578 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:23.661953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c57e4c9c-e7d7-4f1d-8dd0-5bb4e95838b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:23.662100 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-649d1bf9-e10b-4d45-bfaf-45548ba2f578 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:23.662550 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-649d1bf9-e10b-4d45-bfaf-45548ba2f578 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:23.662972 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-649d1bf9-e10b-4d45-bfaf-45548ba2f578 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:23.668263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c57e4c9c-e7d7-4f1d-8dd0-5bb4e95838b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:23.668741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c57e4c9c-e7d7-4f1d-8dd0-5bb4e95838b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:23.669170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c57e4c9c-e7d7-4f1d-8dd0-5bb4e95838b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:23.669855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c57e4c9c-e7d7-4f1d-8dd0-5bb4e95838b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:23.670302 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c57e4c9c-e7d7-4f1d-8dd0-5bb4e95838b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:23.670718 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c57e4c9c-e7d7-4f1d-8dd0-5bb4e95838b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:23.859280 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-649d1bf9-e10b-4d45-bfaf-45548ba2f578 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:23.862755 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c57e4c9c-e7d7-4f1d-8dd0-5bb4e95838b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:23.867959 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-649d1bf9-e10b-4d45-bfaf-45548ba2f578 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.218764 Aug 10 12:59:23.868701 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1142/2267] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:23 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:23.874464 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c57e4c9c-e7d7-4f1d-8dd0-5bb4e95838b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:23.876078 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c57e4c9c-e7d7-4f1d-8dd0-5bb4e95838b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:23.877754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c57e4c9c-e7d7-4f1d-8dd0-5bb4e95838b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.220547 Aug 10 12:59:23.878372 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1126/2268] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:23 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:24.073650 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3e007a29-4340-4244-8907-24a8d65c5647 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:24.073876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a8bb8106-7af4-409c-92de-1c9ae05ce4d9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:24.074265 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3e007a29-4340-4244-8907-24a8d65c5647 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:24.074393 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a8bb8106-7af4-409c-92de-1c9ae05ce4d9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:24.081082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e007a29-4340-4244-8907-24a8d65c5647 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:24.081247 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a8bb8106-7af4-409c-92de-1c9ae05ce4d9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:24.081562 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e007a29-4340-4244-8907-24a8d65c5647 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:24.081689 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a8bb8106-7af4-409c-92de-1c9ae05ce4d9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:24.081994 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e007a29-4340-4244-8907-24a8d65c5647 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:24.082120 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a8bb8106-7af4-409c-92de-1c9ae05ce4d9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:24.082688 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e007a29-4340-4244-8907-24a8d65c5647 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:24.082808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a8bb8106-7af4-409c-92de-1c9ae05ce4d9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:24.083128 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a8bb8106-7af4-409c-92de-1c9ae05ce4d9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:24.083272 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e007a29-4340-4244-8907-24a8d65c5647 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:24.083576 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e007a29-4340-4244-8907-24a8d65c5647 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:24.083684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a8bb8106-7af4-409c-92de-1c9ae05ce4d9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:24.271576 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3e007a29-4340-4244-8907-24a8d65c5647 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:24.278823 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a8bb8106-7af4-409c-92de-1c9ae05ce4d9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:24.280301 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3e007a29-4340-4244-8907-24a8d65c5647 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.210388 Aug 10 12:59:24.281331 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1143/2269] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:24 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:24.286908 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a8bb8106-7af4-409c-92de-1c9ae05ce4d9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.216999 Aug 10 12:59:24.287510 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1127/2270] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:24 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:24.889115 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-404d52c8-97f5-4342-91b8-98655b114604 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:24.889731 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-404d52c8-97f5-4342-91b8-98655b114604 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:24.896207 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-404d52c8-97f5-4342-91b8-98655b114604 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:24.896779 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-404d52c8-97f5-4342-91b8-98655b114604 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:24.897214 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-404d52c8-97f5-4342-91b8-98655b114604 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:24.897902 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-404d52c8-97f5-4342-91b8-98655b114604 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:24.898356 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-404d52c8-97f5-4342-91b8-98655b114604 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:24.898781 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-404d52c8-97f5-4342-91b8-98655b114604 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:24.901624 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-44c68edc-dabe-4e27-9124-8fc081e007db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:24.902353 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-44c68edc-dabe-4e27-9124-8fc081e007db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:24.909454 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-44c68edc-dabe-4e27-9124-8fc081e007db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:24.909932 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-44c68edc-dabe-4e27-9124-8fc081e007db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:24.910362 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-44c68edc-dabe-4e27-9124-8fc081e007db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:24.911044 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-44c68edc-dabe-4e27-9124-8fc081e007db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:24.911519 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-44c68edc-dabe-4e27-9124-8fc081e007db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:24.911938 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-44c68edc-dabe-4e27-9124-8fc081e007db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:25.099246 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-404d52c8-97f5-4342-91b8-98655b114604 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:25.106206 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-44c68edc-dabe-4e27-9124-8fc081e007db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:25.107522 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-404d52c8-97f5-4342-91b8-98655b114604 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.222287 Aug 10 12:59:25.108105 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1144/2271] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:24 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:25.115230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-44c68edc-dabe-4e27-9124-8fc081e007db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:25.116724 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-44c68edc-dabe-4e27-9124-8fc081e007db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:25.117868 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-44c68edc-dabe-4e27-9124-8fc081e007db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.220095 Aug 10 12:59:25.118421 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1128/2272] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:24 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:25.301834 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-68890eb4-e9da-4fbf-a46c-2b1f1e366e22 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:25.304329 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-68890eb4-e9da-4fbf-a46c-2b1f1e366e22 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:25.307963 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-91fd6660-13d3-4d6a-ab62-2a537a83e171 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:25.308599 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-91fd6660-13d3-4d6a-ab62-2a537a83e171 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:25.308726 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-68890eb4-e9da-4fbf-a46c-2b1f1e366e22 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:25.309169 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-68890eb4-e9da-4fbf-a46c-2b1f1e366e22 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:25.309605 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-68890eb4-e9da-4fbf-a46c-2b1f1e366e22 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:25.310344 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-68890eb4-e9da-4fbf-a46c-2b1f1e366e22 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:25.310827 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-68890eb4-e9da-4fbf-a46c-2b1f1e366e22 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:25.311279 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-68890eb4-e9da-4fbf-a46c-2b1f1e366e22 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:25.314977 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91fd6660-13d3-4d6a-ab62-2a537a83e171 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:25.315489 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91fd6660-13d3-4d6a-ab62-2a537a83e171 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:25.315921 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91fd6660-13d3-4d6a-ab62-2a537a83e171 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:25.316645 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91fd6660-13d3-4d6a-ab62-2a537a83e171 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:25.317052 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91fd6660-13d3-4d6a-ab62-2a537a83e171 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:25.317468 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91fd6660-13d3-4d6a-ab62-2a537a83e171 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:25.509283 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-68890eb4-e9da-4fbf-a46c-2b1f1e366e22 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:25.515792 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-91fd6660-13d3-4d6a-ab62-2a537a83e171 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:25.517462 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-68890eb4-e9da-4fbf-a46c-2b1f1e366e22 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.219407 Aug 10 12:59:25.518435 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1145/2273] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:25 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:25.524660 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-91fd6660-13d3-4d6a-ab62-2a537a83e171 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.220425 Aug 10 12:59:25.525413 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1129/2274] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:25 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:26.129249 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-59a8a640-007d-4856-b619-753b73f876f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:26.129861 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-59a8a640-007d-4856-b619-753b73f876f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:26.136332 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-59a8a640-007d-4856-b619-753b73f876f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:26.136806 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-59a8a640-007d-4856-b619-753b73f876f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:26.137231 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-59a8a640-007d-4856-b619-753b73f876f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:26.137911 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-59a8a640-007d-4856-b619-753b73f876f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:26.138356 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-59a8a640-007d-4856-b619-753b73f876f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:26.138776 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-59a8a640-007d-4856-b619-753b73f876f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:26.139674 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e25a07e7-dc87-4bcf-8faf-94c5cf1a101f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:26.140285 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e25a07e7-dc87-4bcf-8faf-94c5cf1a101f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:26.147031 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e25a07e7-dc87-4bcf-8faf-94c5cf1a101f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:26.147540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e25a07e7-dc87-4bcf-8faf-94c5cf1a101f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:26.147971 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e25a07e7-dc87-4bcf-8faf-94c5cf1a101f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:26.148658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e25a07e7-dc87-4bcf-8faf-94c5cf1a101f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:26.149108 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e25a07e7-dc87-4bcf-8faf-94c5cf1a101f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:26.149526 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e25a07e7-dc87-4bcf-8faf-94c5cf1a101f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:26.333397 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-59a8a640-007d-4856-b619-753b73f876f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:26.337036 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e25a07e7-dc87-4bcf-8faf-94c5cf1a101f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:26.341294 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-59a8a640-007d-4856-b619-753b73f876f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.215966 Aug 10 12:59:26.341867 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1146/2275] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:26 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:26.345458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e25a07e7-dc87-4bcf-8faf-94c5cf1a101f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:26.346942 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e25a07e7-dc87-4bcf-8faf-94c5cf1a101f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:26.348116 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e25a07e7-dc87-4bcf-8faf-94c5cf1a101f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.212291 Aug 10 12:59:26.348660 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1130/2276] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:26 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:26.537953 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7c4e8579-6a26-4755-b717-9afdc4ab8037 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:26.538518 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7c4e8579-6a26-4755-b717-9afdc4ab8037 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:26.544680 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c4e8579-6a26-4755-b717-9afdc4ab8037 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:26.545159 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c4e8579-6a26-4755-b717-9afdc4ab8037 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:26.545573 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-968b3b05-392a-4906-be81-bb252923727f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:26.545699 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c4e8579-6a26-4755-b717-9afdc4ab8037 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:26.546188 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-968b3b05-392a-4906-be81-bb252923727f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:26.546306 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c4e8579-6a26-4755-b717-9afdc4ab8037 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:26.546701 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c4e8579-6a26-4755-b717-9afdc4ab8037 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:26.547124 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c4e8579-6a26-4755-b717-9afdc4ab8037 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:26.552113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-968b3b05-392a-4906-be81-bb252923727f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:26.552598 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-968b3b05-392a-4906-be81-bb252923727f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:26.553036 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-968b3b05-392a-4906-be81-bb252923727f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:26.553724 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-968b3b05-392a-4906-be81-bb252923727f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:26.554174 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-968b3b05-392a-4906-be81-bb252923727f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:26.554625 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-968b3b05-392a-4906-be81-bb252923727f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:26.744136 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-7c4e8579-6a26-4755-b717-9afdc4ab8037 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:26.748088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-968b3b05-392a-4906-be81-bb252923727f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:26.753146 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7c4e8579-6a26-4755-b717-9afdc4ab8037 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.219032 Aug 10 12:59:26.753728 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1147/2277] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:26 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:26.757032 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-968b3b05-392a-4906-be81-bb252923727f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.215204 Aug 10 12:59:26.757588 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1131/2278] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:26 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:27.363086 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6b5a2007-b2e9-47d1-ad7f-e224dcc1b9ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:27.363731 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6b5a2007-b2e9-47d1-ad7f-e224dcc1b9ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:27.369677 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6b5a2007-b2e9-47d1-ad7f-e224dcc1b9ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:27.370162 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6b5a2007-b2e9-47d1-ad7f-e224dcc1b9ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:27.370598 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6b5a2007-b2e9-47d1-ad7f-e224dcc1b9ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:27.370850 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4182fdfa-020a-48e1-9d1f-89c165822b36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:27.371303 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6b5a2007-b2e9-47d1-ad7f-e224dcc1b9ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:27.371631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4182fdfa-020a-48e1-9d1f-89c165822b36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:27.371773 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6b5a2007-b2e9-47d1-ad7f-e224dcc1b9ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:27.372167 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6b5a2007-b2e9-47d1-ad7f-e224dcc1b9ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:27.378004 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4182fdfa-020a-48e1-9d1f-89c165822b36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:27.378474 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4182fdfa-020a-48e1-9d1f-89c165822b36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:27.378900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4182fdfa-020a-48e1-9d1f-89c165822b36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:27.379606 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4182fdfa-020a-48e1-9d1f-89c165822b36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:27.380050 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4182fdfa-020a-48e1-9d1f-89c165822b36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:27.380463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4182fdfa-020a-48e1-9d1f-89c165822b36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:27.564609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4182fdfa-020a-48e1-9d1f-89c165822b36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:27.571560 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6b5a2007-b2e9-47d1-ad7f-e224dcc1b9ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:27.573034 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4182fdfa-020a-48e1-9d1f-89c165822b36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:27.574544 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4182fdfa-020a-48e1-9d1f-89c165822b36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:27.575730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4182fdfa-020a-48e1-9d1f-89c165822b36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.208645 Aug 10 12:59:27.576296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1132/2279] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:27 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:27.580176 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6b5a2007-b2e9-47d1-ad7f-e224dcc1b9ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.221232 Aug 10 12:59:27.580801 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1148/2280] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:27 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:27.773138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-17992477-5ed4-4d42-a011-4442d8cc8f1a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:27.773743 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-17992477-5ed4-4d42-a011-4442d8cc8f1a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:27.778650 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f0855bcf-dd68-4bec-8100-997b97c4e2cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:27.779326 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f0855bcf-dd68-4bec-8100-997b97c4e2cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:27.779627 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-17992477-5ed4-4d42-a011-4442d8cc8f1a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:27.780103 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-17992477-5ed4-4d42-a011-4442d8cc8f1a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:27.780532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-17992477-5ed4-4d42-a011-4442d8cc8f1a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:27.781268 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-17992477-5ed4-4d42-a011-4442d8cc8f1a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:27.781655 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-17992477-5ed4-4d42-a011-4442d8cc8f1a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:27.782069 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-17992477-5ed4-4d42-a011-4442d8cc8f1a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:27.786040 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f0855bcf-dd68-4bec-8100-997b97c4e2cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:27.786594 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f0855bcf-dd68-4bec-8100-997b97c4e2cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:27.787027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f0855bcf-dd68-4bec-8100-997b97c4e2cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:27.787747 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f0855bcf-dd68-4bec-8100-997b97c4e2cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:27.788196 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f0855bcf-dd68-4bec-8100-997b97c4e2cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:27.788617 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f0855bcf-dd68-4bec-8100-997b97c4e2cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:28.193491 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-17992477-5ed4-4d42-a011-4442d8cc8f1a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:28.197521 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f0855bcf-dd68-4bec-8100-997b97c4e2cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:28.201409 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-17992477-5ed4-4d42-a011-4442d8cc8f1a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.432185 Aug 10 12:59:28.201982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1133/2281] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:27 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:28.205523 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f0855bcf-dd68-4bec-8100-997b97c4e2cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.430608 Aug 10 12:59:28.206091 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1149/2282] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:27 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:28.598970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8dcfa490-0fdb-4116-9b71-a87a5b8f49d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:28.599602 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8dcfa490-0fdb-4116-9b71-a87a5b8f49d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:28.602196 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c95acc2f-a737-40d5-a3b1-1fd1e28cb0b9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:28.602808 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c95acc2f-a737-40d5-a3b1-1fd1e28cb0b9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:28.606202 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8dcfa490-0fdb-4116-9b71-a87a5b8f49d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:28.606683 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8dcfa490-0fdb-4116-9b71-a87a5b8f49d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:28.607115 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8dcfa490-0fdb-4116-9b71-a87a5b8f49d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:28.607826 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8dcfa490-0fdb-4116-9b71-a87a5b8f49d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:28.608268 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8dcfa490-0fdb-4116-9b71-a87a5b8f49d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:28.608689 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8dcfa490-0fdb-4116-9b71-a87a5b8f49d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:28.609572 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c95acc2f-a737-40d5-a3b1-1fd1e28cb0b9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:28.610049 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c95acc2f-a737-40d5-a3b1-1fd1e28cb0b9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:28.610482 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c95acc2f-a737-40d5-a3b1-1fd1e28cb0b9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:28.611894 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c95acc2f-a737-40d5-a3b1-1fd1e28cb0b9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:28.612377 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c95acc2f-a737-40d5-a3b1-1fd1e28cb0b9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:28.612805 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c95acc2f-a737-40d5-a3b1-1fd1e28cb0b9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:28.798049 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8dcfa490-0fdb-4116-9b71-a87a5b8f49d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:28.805456 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c95acc2f-a737-40d5-a3b1-1fd1e28cb0b9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:28.807253 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8dcfa490-0fdb-4116-9b71-a87a5b8f49d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:28.808797 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8dcfa490-0fdb-4116-9b71-a87a5b8f49d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:28.809957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8dcfa490-0fdb-4116-9b71-a87a5b8f49d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.215422 Aug 10 12:59:28.810524 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1134/2283] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:28 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:59:28.813560 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c95acc2f-a737-40d5-a3b1-1fd1e28cb0b9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.215125 Aug 10 12:59:28.814395 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1150/2284] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:28 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:29.223234 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-08d07df5-0161-4066-adbd-c9859d77970d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:29.223923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-08d07df5-0161-4066-adbd-c9859d77970d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:29.225754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=98 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:59:29.226225 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-df505cd8-7acf-4b34-9a29-e49d89426283 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:29.226864 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-df505cd8-7acf-4b34-9a29-e49d89426283 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:29.230740 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08d07df5-0161-4066-adbd-c9859d77970d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:29.231246 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08d07df5-0161-4066-adbd-c9859d77970d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:29.231681 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08d07df5-0161-4066-adbd-c9859d77970d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:29.232400 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08d07df5-0161-4066-adbd-c9859d77970d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:29.232850 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08d07df5-0161-4066-adbd-c9859d77970d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:29.233050 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-df505cd8-7acf-4b34-9a29-e49d89426283 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:29.233264 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08d07df5-0161-4066-adbd-c9859d77970d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:29.233496 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-df505cd8-7acf-4b34-9a29-e49d89426283 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:29.233936 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-df505cd8-7acf-4b34-9a29-e49d89426283 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:29.234628 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-df505cd8-7acf-4b34-9a29-e49d89426283 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:29.235081 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-df505cd8-7acf-4b34-9a29-e49d89426283 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:29.235533 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-df505cd8-7acf-4b34-9a29-e49d89426283 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:29.238355 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:59:29.426142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-08d07df5-0161-4066-adbd-c9859d77970d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:29.432766 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-df505cd8-7acf-4b34-9a29-e49d89426283 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:29.434034 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-08d07df5-0161-4066-adbd-c9859d77970d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.215343 Aug 10 12:59:29.434853 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1135/2285] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:29 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:29.441463 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-df505cd8-7acf-4b34-9a29-e49d89426283 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.219009 Aug 10 12:59:29.442026 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1151/2286] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:29 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:29.833241 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0e75ceef-2e23-4a97-8d92-70bc90e14746 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:29.833855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0e75ceef-2e23-4a97-8d92-70bc90e14746 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:29.834095 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c6a45828-a093-446e-a51b-a6af331cc01d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:29.834706 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c6a45828-a093-446e-a51b-a6af331cc01d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:29.840282 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e75ceef-2e23-4a97-8d92-70bc90e14746 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:29.840701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e75ceef-2e23-4a97-8d92-70bc90e14746 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:29.841120 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c6a45828-a093-446e-a51b-a6af331cc01d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:29.841244 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e75ceef-2e23-4a97-8d92-70bc90e14746 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:29.841607 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c6a45828-a093-446e-a51b-a6af331cc01d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:29.841812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e75ceef-2e23-4a97-8d92-70bc90e14746 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:29.842072 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c6a45828-a093-446e-a51b-a6af331cc01d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:29.842263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e75ceef-2e23-4a97-8d92-70bc90e14746 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:29.842685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e75ceef-2e23-4a97-8d92-70bc90e14746 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:29.842810 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c6a45828-a093-446e-a51b-a6af331cc01d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:29.843221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c6a45828-a093-446e-a51b-a6af331cc01d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:29.843647 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c6a45828-a093-446e-a51b-a6af331cc01d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:30.039789 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0e75ceef-2e23-4a97-8d92-70bc90e14746 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:30.043863 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c6a45828-a093-446e-a51b-a6af331cc01d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:30.048864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0e75ceef-2e23-4a97-8d92-70bc90e14746 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:30.050512 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0e75ceef-2e23-4a97-8d92-70bc90e14746 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:30.051715 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0e75ceef-2e23-4a97-8d92-70bc90e14746 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.222850 Aug 10 12:59:30.052268 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1136/2287] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:29 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:59:30.052727 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c6a45828-a093-446e-a51b-a6af331cc01d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.222370 Aug 10 12:59:30.053380 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1152/2288] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:29 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:30.456376 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-025f4508-94d8-4557-b599-00768dcff67d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:30.456989 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-025f4508-94d8-4557-b599-00768dcff67d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:30.462310 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c988f96b-c8c7-4942-b1ad-c1451bf3c7f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:30.462871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-025f4508-94d8-4557-b599-00768dcff67d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:30.462994 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c988f96b-c8c7-4942-b1ad-c1451bf3c7f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:30.463407 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-025f4508-94d8-4557-b599-00768dcff67d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:30.463829 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-025f4508-94d8-4557-b599-00768dcff67d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:30.464516 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-025f4508-94d8-4557-b599-00768dcff67d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:30.464959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-025f4508-94d8-4557-b599-00768dcff67d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:30.465383 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-025f4508-94d8-4557-b599-00768dcff67d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:30.468821 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c988f96b-c8c7-4942-b1ad-c1451bf3c7f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:30.469298 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c988f96b-c8c7-4942-b1ad-c1451bf3c7f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:30.469728 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c988f96b-c8c7-4942-b1ad-c1451bf3c7f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:30.471138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c988f96b-c8c7-4942-b1ad-c1451bf3c7f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:30.471607 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c988f96b-c8c7-4942-b1ad-c1451bf3c7f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:30.472028 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c988f96b-c8c7-4942-b1ad-c1451bf3c7f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:30.659873 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c988f96b-c8c7-4942-b1ad-c1451bf3c7f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:30.663926 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-025f4508-94d8-4557-b599-00768dcff67d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:30.668192 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c988f96b-c8c7-4942-b1ad-c1451bf3c7f9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.209611 Aug 10 12:59:30.671240 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1153/2289] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:30 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:30.674131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-025f4508-94d8-4557-b599-00768dcff67d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.221497 Aug 10 12:59:30.674945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1137/2290] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:30 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:31.073590 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-edfba178-d6d6-48af-84e9-4ad4a8f68b68 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:31.074201 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7da5b2f1-0d52-49a1-9427-7449e38e5a19 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:31.074582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-edfba178-d6d6-48af-84e9-4ad4a8f68b68 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:31.075133 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7da5b2f1-0d52-49a1-9427-7449e38e5a19 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:31.081045 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-edfba178-d6d6-48af-84e9-4ad4a8f68b68 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:31.081530 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-edfba178-d6d6-48af-84e9-4ad4a8f68b68 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:31.081715 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7da5b2f1-0d52-49a1-9427-7449e38e5a19 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:31.081967 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-edfba178-d6d6-48af-84e9-4ad4a8f68b68 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:31.082198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7da5b2f1-0d52-49a1-9427-7449e38e5a19 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:31.082643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7da5b2f1-0d52-49a1-9427-7449e38e5a19 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:31.082771 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-edfba178-d6d6-48af-84e9-4ad4a8f68b68 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:31.083131 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-edfba178-d6d6-48af-84e9-4ad4a8f68b68 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:31.083336 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7da5b2f1-0d52-49a1-9427-7449e38e5a19 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:31.083579 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-edfba178-d6d6-48af-84e9-4ad4a8f68b68 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:31.083783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7da5b2f1-0d52-49a1-9427-7449e38e5a19 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:31.084202 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7da5b2f1-0d52-49a1-9427-7449e38e5a19 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:31.284074 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-edfba178-d6d6-48af-84e9-4ad4a8f68b68 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:31.287791 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7da5b2f1-0d52-49a1-9427-7449e38e5a19 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:31.292175 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-edfba178-d6d6-48af-84e9-4ad4a8f68b68 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.222504 Aug 10 12:59:31.292755 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1154/2291] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:31 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:31.296269 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7da5b2f1-0d52-49a1-9427-7449e38e5a19 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:31.297837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7da5b2f1-0d52-49a1-9427-7449e38e5a19 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:31.299249 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7da5b2f1-0d52-49a1-9427-7449e38e5a19 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.228871 Aug 10 12:59:31.299876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1138/2292] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:31 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:31.692365 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-34c228f6-13f6-4c7d-9323-32315c1d6740 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:31.692974 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-34c228f6-13f6-4c7d-9323-32315c1d6740 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:31.695954 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ac8ac20a-f17d-4968-9c0a-9052b39337bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:31.696111 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ac8ac20a-f17d-4968-9c0a-9052b39337bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:31.698890 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34c228f6-13f6-4c7d-9323-32315c1d6740 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:31.699395 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34c228f6-13f6-4c7d-9323-32315c1d6740 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:31.699831 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34c228f6-13f6-4c7d-9323-32315c1d6740 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:31.700518 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34c228f6-13f6-4c7d-9323-32315c1d6740 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:31.700962 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34c228f6-13f6-4c7d-9323-32315c1d6740 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:31.701380 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34c228f6-13f6-4c7d-9323-32315c1d6740 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:31.701887 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac8ac20a-f17d-4968-9c0a-9052b39337bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:31.702373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac8ac20a-f17d-4968-9c0a-9052b39337bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:31.702808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac8ac20a-f17d-4968-9c0a-9052b39337bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:31.703530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac8ac20a-f17d-4968-9c0a-9052b39337bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:31.703982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac8ac20a-f17d-4968-9c0a-9052b39337bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:31.704405 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac8ac20a-f17d-4968-9c0a-9052b39337bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:31.900743 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-34c228f6-13f6-4c7d-9323-32315c1d6740 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:31.904723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ac8ac20a-f17d-4968-9c0a-9052b39337bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:31.914533 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-34c228f6-13f6-4c7d-9323-32315c1d6740 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.221709 Aug 10 12:59:31.914533 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1155/2293] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:31 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:31.914803 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ac8ac20a-f17d-4968-9c0a-9052b39337bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.220998 Aug 10 12:59:31.914803 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1139/2294] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:31 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:32.314271 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d1f241de-6915-49fd-886b-dd58acaad89a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:32.314929 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d1f241de-6915-49fd-886b-dd58acaad89a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:32.321328 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1f241de-6915-49fd-886b-dd58acaad89a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:32.321815 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1f241de-6915-49fd-886b-dd58acaad89a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:32.321963 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6cdafad9-ae03-4293-a734-49ac5d82340e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:32.322361 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1f241de-6915-49fd-886b-dd58acaad89a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:32.322483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6cdafad9-ae03-4293-a734-49ac5d82340e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:32.322922 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1f241de-6915-49fd-886b-dd58acaad89a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:32.323406 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1f241de-6915-49fd-886b-dd58acaad89a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:32.323832 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1f241de-6915-49fd-886b-dd58acaad89a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:32.328677 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6cdafad9-ae03-4293-a734-49ac5d82340e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:32.329150 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6cdafad9-ae03-4293-a734-49ac5d82340e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:32.330170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6cdafad9-ae03-4293-a734-49ac5d82340e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:32.330853 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6cdafad9-ae03-4293-a734-49ac5d82340e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:32.331321 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6cdafad9-ae03-4293-a734-49ac5d82340e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:32.331739 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6cdafad9-ae03-4293-a734-49ac5d82340e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:32.334269 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:59:32.515751 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d1f241de-6915-49fd-886b-dd58acaad89a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:32.522890 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6cdafad9-ae03-4293-a734-49ac5d82340e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:32.524336 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d1f241de-6915-49fd-886b-dd58acaad89a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.214475 Aug 10 12:59:32.524913 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1156/2295] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:32 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:32.531563 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6cdafad9-ae03-4293-a734-49ac5d82340e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:32.533012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6cdafad9-ae03-4293-a734-49ac5d82340e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:32.534156 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6cdafad9-ae03-4293-a734-49ac5d82340e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.216278 Aug 10 12:59:32.534701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1140/2296] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:32 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:32.933842 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-be31b37e-293d-4d06-b0ba-6e5f0e0d9dad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:32.934565 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-be31b37e-293d-4d06-b0ba-6e5f0e0d9dad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:32.934697 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d5e8cac3-cf1e-424b-8643-a3a8fb7e1c21 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:32.935368 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d5e8cac3-cf1e-424b-8643-a3a8fb7e1c21 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:32.941714 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be31b37e-293d-4d06-b0ba-6e5f0e0d9dad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:32.942189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be31b37e-293d-4d06-b0ba-6e5f0e0d9dad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:32.942524 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d5e8cac3-cf1e-424b-8643-a3a8fb7e1c21 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:32.942654 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be31b37e-293d-4d06-b0ba-6e5f0e0d9dad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:32.943002 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d5e8cac3-cf1e-424b-8643-a3a8fb7e1c21 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:32.943314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be31b37e-293d-4d06-b0ba-6e5f0e0d9dad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:32.943462 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d5e8cac3-cf1e-424b-8643-a3a8fb7e1c21 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:32.943763 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be31b37e-293d-4d06-b0ba-6e5f0e0d9dad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:32.944145 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d5e8cac3-cf1e-424b-8643-a3a8fb7e1c21 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:32.944264 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be31b37e-293d-4d06-b0ba-6e5f0e0d9dad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:32.944591 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d5e8cac3-cf1e-424b-8643-a3a8fb7e1c21 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:32.945008 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d5e8cac3-cf1e-424b-8643-a3a8fb7e1c21 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:33.087909 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d5e8cac3-cf1e-424b-8643-a3a8fb7e1c21 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:33.096325 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d5e8cac3-cf1e-424b-8643-a3a8fb7e1c21 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.166879 Aug 10 12:59:33.096918 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1157/2297] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:32 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:33.221940 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-be31b37e-293d-4d06-b0ba-6e5f0e0d9dad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:33.230145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-be31b37e-293d-4d06-b0ba-6e5f0e0d9dad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.300203 Aug 10 12:59:33.230702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1141/2298] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:32 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:33.545660 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-65b67206-9477-4075-b293-4e67f16a5470 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:33.546276 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-65b67206-9477-4075-b293-4e67f16a5470 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:33.552979 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-65b67206-9477-4075-b293-4e67f16a5470 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:33.553460 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-65b67206-9477-4075-b293-4e67f16a5470 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:33.553896 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-65b67206-9477-4075-b293-4e67f16a5470 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:33.554590 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-65b67206-9477-4075-b293-4e67f16a5470 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:33.555041 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-65b67206-9477-4075-b293-4e67f16a5470 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:33.555490 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-65b67206-9477-4075-b293-4e67f16a5470 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:33.556318 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ce863d3b-ac61-4c6f-87ff-d9bd3e9e8258 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:33.556925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ce863d3b-ac61-4c6f-87ff-d9bd3e9e8258 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:33.563115 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce863d3b-ac61-4c6f-87ff-d9bd3e9e8258 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:33.563625 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce863d3b-ac61-4c6f-87ff-d9bd3e9e8258 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:33.564092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce863d3b-ac61-4c6f-87ff-d9bd3e9e8258 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:33.564773 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce863d3b-ac61-4c6f-87ff-d9bd3e9e8258 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:33.565222 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce863d3b-ac61-4c6f-87ff-d9bd3e9e8258 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:33.565639 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ce863d3b-ac61-4c6f-87ff-d9bd3e9e8258 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:33.747273 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-65b67206-9477-4075-b293-4e67f16a5470 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:33.751386 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ce863d3b-ac61-4c6f-87ff-d9bd3e9e8258 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:33.756161 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-65b67206-9477-4075-b293-4e67f16a5470 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.214350 Aug 10 12:59:33.756754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1158/2299] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:33 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:33.760319 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ce863d3b-ac61-4c6f-87ff-d9bd3e9e8258 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:33.761812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ce863d3b-ac61-4c6f-87ff-d9bd3e9e8258 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:33.762971 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ce863d3b-ac61-4c6f-87ff-d9bd3e9e8258 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.210730 Aug 10 12:59:33.763552 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1142/2300] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:33 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:59:34.117986 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9daa0048-ff08-4d7b-b5bd-42a056053d6a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:34.118529 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9daa0048-ff08-4d7b-b5bd-42a056053d6a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:34.124447 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9daa0048-ff08-4d7b-b5bd-42a056053d6a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:34.124920 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9daa0048-ff08-4d7b-b5bd-42a056053d6a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:34.125352 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9daa0048-ff08-4d7b-b5bd-42a056053d6a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:34.126028 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9daa0048-ff08-4d7b-b5bd-42a056053d6a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:34.126501 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9daa0048-ff08-4d7b-b5bd-42a056053d6a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:34.126921 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9daa0048-ff08-4d7b-b5bd-42a056053d6a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:34.251594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d62f983a-249a-443b-9972-1e9dddcd55e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:34.252201 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d62f983a-249a-443b-9972-1e9dddcd55e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:34.254133 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9daa0048-ff08-4d7b-b5bd-42a056053d6a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:34.258367 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d62f983a-249a-443b-9972-1e9dddcd55e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:34.258857 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d62f983a-249a-443b-9972-1e9dddcd55e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:34.259320 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d62f983a-249a-443b-9972-1e9dddcd55e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:34.260017 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d62f983a-249a-443b-9972-1e9dddcd55e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:34.260465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d62f983a-249a-443b-9972-1e9dddcd55e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:34.260884 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d62f983a-249a-443b-9972-1e9dddcd55e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:34.262834 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9daa0048-ff08-4d7b-b5bd-42a056053d6a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.148803 Aug 10 12:59:34.263458 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1159/2301] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:34 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:34.389237 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d62f983a-249a-443b-9972-1e9dddcd55e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:34.397958 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d62f983a-249a-443b-9972-1e9dddcd55e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.150406 Aug 10 12:59:34.398546 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1143/2302] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:34 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:34.776754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-62b2f174-590f-40fc-89b8-a868410a9e84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:34.777369 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-62b2f174-590f-40fc-89b8-a868410a9e84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:34.784307 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-62b2f174-590f-40fc-89b8-a868410a9e84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:34.784794 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-62b2f174-590f-40fc-89b8-a868410a9e84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:34.785227 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-62b2f174-590f-40fc-89b8-a868410a9e84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:34.785923 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-62b2f174-590f-40fc-89b8-a868410a9e84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:34.786372 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-62b2f174-590f-40fc-89b8-a868410a9e84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:34.786798 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-62b2f174-590f-40fc-89b8-a868410a9e84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:34.787423 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e06debc6-99bc-4228-bd53-db5ce117bdc8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:34.788072 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e06debc6-99bc-4228-bd53-db5ce117bdc8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:34.794330 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e06debc6-99bc-4228-bd53-db5ce117bdc8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:34.794818 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e06debc6-99bc-4228-bd53-db5ce117bdc8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:34.795264 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e06debc6-99bc-4228-bd53-db5ce117bdc8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:34.795960 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e06debc6-99bc-4228-bd53-db5ce117bdc8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:34.796414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e06debc6-99bc-4228-bd53-db5ce117bdc8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:34.796837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e06debc6-99bc-4228-bd53-db5ce117bdc8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:34.991473 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-62b2f174-590f-40fc-89b8-a868410a9e84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:34.995399 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e06debc6-99bc-4228-bd53-db5ce117bdc8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:34.999387 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-62b2f174-590f-40fc-89b8-a868410a9e84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.226503 Aug 10 12:59:34.999968 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1160/2303] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:34 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:35.004222 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e06debc6-99bc-4228-bd53-db5ce117bdc8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:35.005737 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e06debc6-99bc-4228-bd53-db5ce117bdc8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:35.006899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e06debc6-99bc-4228-bd53-db5ce117bdc8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.224213 Aug 10 12:59:35.007473 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1144/2304] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:34 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:35.285349 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-32866207-25c7-4b18-9c65-5610782849d1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:35.286082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-32866207-25c7-4b18-9c65-5610782849d1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:35.292521 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-32866207-25c7-4b18-9c65-5610782849d1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:35.293008 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-32866207-25c7-4b18-9c65-5610782849d1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:35.293493 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-32866207-25c7-4b18-9c65-5610782849d1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:35.294191 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-32866207-25c7-4b18-9c65-5610782849d1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:35.294649 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-32866207-25c7-4b18-9c65-5610782849d1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:35.295075 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-32866207-25c7-4b18-9c65-5610782849d1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:35.420705 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-dab46f48-9d7a-45e3-8779-8c730e92097d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:35.421317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-dab46f48-9d7a-45e3-8779-8c730e92097d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:35.424711 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-32866207-25c7-4b18-9c65-5610782849d1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:35.427596 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dab46f48-9d7a-45e3-8779-8c730e92097d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:35.428080 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dab46f48-9d7a-45e3-8779-8c730e92097d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:35.428515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dab46f48-9d7a-45e3-8779-8c730e92097d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:35.429207 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dab46f48-9d7a-45e3-8779-8c730e92097d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:35.429657 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dab46f48-9d7a-45e3-8779-8c730e92097d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:35.430079 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dab46f48-9d7a-45e3-8779-8c730e92097d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:35.432985 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-32866207-25c7-4b18-9c65-5610782849d1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.152278 Aug 10 12:59:35.433557 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1161/2305] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:35 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:35.558227 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-dab46f48-9d7a-45e3-8779-8c730e92097d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:35.566716 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-dab46f48-9d7a-45e3-8779-8c730e92097d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.149961 Aug 10 12:59:35.567298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1145/2306] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:35 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:36.020307 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4b01fbd9-9b10-48af-be8a-44b08d5c3435 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:36.020925 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4b01fbd9-9b10-48af-be8a-44b08d5c3435 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:36.027366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b01fbd9-9b10-48af-be8a-44b08d5c3435 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:36.027854 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b01fbd9-9b10-48af-be8a-44b08d5c3435 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:36.028296 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b01fbd9-9b10-48af-be8a-44b08d5c3435 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:36.028985 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b01fbd9-9b10-48af-be8a-44b08d5c3435 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:36.029435 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b01fbd9-9b10-48af-be8a-44b08d5c3435 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:36.029795 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-77416652-004e-4bb2-a5f6-033a7d7b2c42 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:36.030199 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b01fbd9-9b10-48af-be8a-44b08d5c3435 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:36.030412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-77416652-004e-4bb2-a5f6-033a7d7b2c42 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:36.037455 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-77416652-004e-4bb2-a5f6-033a7d7b2c42 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:36.037974 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-77416652-004e-4bb2-a5f6-033a7d7b2c42 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:36.038410 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-77416652-004e-4bb2-a5f6-033a7d7b2c42 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:36.039105 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-77416652-004e-4bb2-a5f6-033a7d7b2c42 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:36.039584 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-77416652-004e-4bb2-a5f6-033a7d7b2c42 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:36.040009 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-77416652-004e-4bb2-a5f6-033a7d7b2c42 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:36.226837 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4b01fbd9-9b10-48af-be8a-44b08d5c3435 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:36.230666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-77416652-004e-4bb2-a5f6-033a7d7b2c42 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:36.235345 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4b01fbd9-9b10-48af-be8a-44b08d5c3435 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.218896 Aug 10 12:59:36.236465 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1162/2307] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:36 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:36.240113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-77416652-004e-4bb2-a5f6-033a7d7b2c42 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:36.241631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-77416652-004e-4bb2-a5f6-033a7d7b2c42 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:36.242791 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-77416652-004e-4bb2-a5f6-033a7d7b2c42 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.216835 Aug 10 12:59:36.243417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1146/2308] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:36 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:36.455435 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e4f2d4e4-4905-4eca-a326-cc4f3be5270d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:36.455954 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e4f2d4e4-4905-4eca-a326-cc4f3be5270d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:36.457762 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=98 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:59:36.462380 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4f2d4e4-4905-4eca-a326-cc4f3be5270d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:36.462859 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4f2d4e4-4905-4eca-a326-cc4f3be5270d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:36.463324 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4f2d4e4-4905-4eca-a326-cc4f3be5270d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:36.469113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4f2d4e4-4905-4eca-a326-cc4f3be5270d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:36.469113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4f2d4e4-4905-4eca-a326-cc4f3be5270d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:36.469113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4f2d4e4-4905-4eca-a326-cc4f3be5270d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:36.587814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ed05b7e1-59c0-44b7-8e7a-7f311a3f00d8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:36.588426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ed05b7e1-59c0-44b7-8e7a-7f311a3f00d8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:36.594190 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ed05b7e1-59c0-44b7-8e7a-7f311a3f00d8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:36.594675 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ed05b7e1-59c0-44b7-8e7a-7f311a3f00d8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:36.595678 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ed05b7e1-59c0-44b7-8e7a-7f311a3f00d8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:36.596455 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ed05b7e1-59c0-44b7-8e7a-7f311a3f00d8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:36.596621 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e4f2d4e4-4905-4eca-a326-cc4f3be5270d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:36.596822 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ed05b7e1-59c0-44b7-8e7a-7f311a3f00d8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:36.597244 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ed05b7e1-59c0-44b7-8e7a-7f311a3f00d8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:36.605672 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e4f2d4e4-4905-4eca-a326-cc4f3be5270d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.154833 Aug 10 12:59:36.606437 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1163/2309] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:36 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:36.728392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ed05b7e1-59c0-44b7-8e7a-7f311a3f00d8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:36.736939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ed05b7e1-59c0-44b7-8e7a-7f311a3f00d8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.153076 Aug 10 12:59:36.737532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1147/2310] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:36 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:37.258071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c01dca83-2141-4b20-a3de-0ca3d2a1efcf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:37.258693 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c01dca83-2141-4b20-a3de-0ca3d2a1efcf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:37.265374 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c01dca83-2141-4b20-a3de-0ca3d2a1efcf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:37.265784 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c70ed419-eb5e-4ca3-ac32-3a27f0342b18 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:37.266195 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c01dca83-2141-4b20-a3de-0ca3d2a1efcf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:37.266326 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c01dca83-2141-4b20-a3de-0ca3d2a1efcf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:37.266590 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c70ed419-eb5e-4ca3-ac32-3a27f0342b18 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:37.266945 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c01dca83-2141-4b20-a3de-0ca3d2a1efcf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:37.267420 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c01dca83-2141-4b20-a3de-0ca3d2a1efcf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:37.267845 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c01dca83-2141-4b20-a3de-0ca3d2a1efcf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:37.273054 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c70ed419-eb5e-4ca3-ac32-3a27f0342b18 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:37.273605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c70ed419-eb5e-4ca3-ac32-3a27f0342b18 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:37.274045 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c70ed419-eb5e-4ca3-ac32-3a27f0342b18 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:37.274727 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c70ed419-eb5e-4ca3-ac32-3a27f0342b18 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:37.275205 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c70ed419-eb5e-4ca3-ac32-3a27f0342b18 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:37.275615 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c70ed419-eb5e-4ca3-ac32-3a27f0342b18 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:37.458835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c01dca83-2141-4b20-a3de-0ca3d2a1efcf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:37.462735 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c70ed419-eb5e-4ca3-ac32-3a27f0342b18 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:37.466773 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c01dca83-2141-4b20-a3de-0ca3d2a1efcf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.212593 Aug 10 12:59:37.467378 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1164/2311] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:37 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:37.471045 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c70ed419-eb5e-4ca3-ac32-3a27f0342b18 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:37.472556 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c70ed419-eb5e-4ca3-ac32-3a27f0342b18 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:37.473690 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c70ed419-eb5e-4ca3-ac32-3a27f0342b18 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.211729 Aug 10 12:59:37.474230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1148/2312] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:37 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:37.626175 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e865fd2c-3405-402d-adfc-0d28a539e987 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:37.626901 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e865fd2c-3405-402d-adfc-0d28a539e987 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:37.632934 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e865fd2c-3405-402d-adfc-0d28a539e987 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:37.633414 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e865fd2c-3405-402d-adfc-0d28a539e987 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:37.633856 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e865fd2c-3405-402d-adfc-0d28a539e987 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:37.634540 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e865fd2c-3405-402d-adfc-0d28a539e987 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:37.635028 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e865fd2c-3405-402d-adfc-0d28a539e987 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:37.635479 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e865fd2c-3405-402d-adfc-0d28a539e987 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:37.758455 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3c369381-a716-4629-8782-c3af66f358a6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:37.759056 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3c369381-a716-4629-8782-c3af66f358a6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:37.764829 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c369381-a716-4629-8782-c3af66f358a6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:37.765307 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c369381-a716-4629-8782-c3af66f358a6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:37.765734 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c369381-a716-4629-8782-c3af66f358a6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:37.766414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c369381-a716-4629-8782-c3af66f358a6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:37.766901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c369381-a716-4629-8782-c3af66f358a6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:37.767453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c369381-a716-4629-8782-c3af66f358a6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:37.768274 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e865fd2c-3405-402d-adfc-0d28a539e987 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:37.776317 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e865fd2c-3405-402d-adfc-0d28a539e987 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.154085 Aug 10 12:59:37.776893 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1165/2313] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:37 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:37.893132 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3c369381-a716-4629-8782-c3af66f358a6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:37.900923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3c369381-a716-4629-8782-c3af66f358a6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.146319 Aug 10 12:59:37.901485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1149/2314] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:37 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:38.488497 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-29d925d0-9da7-4ce6-88b4-9c89045cf532 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:38.489110 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-29d925d0-9da7-4ce6-88b4-9c89045cf532 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:38.495627 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-29d925d0-9da7-4ce6-88b4-9c89045cf532 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:38.496102 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-29d925d0-9da7-4ce6-88b4-9c89045cf532 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:38.496530 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-29d925d0-9da7-4ce6-88b4-9c89045cf532 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:38.497205 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-29d925d0-9da7-4ce6-88b4-9c89045cf532 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:38.497506 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6dd8dadc-d5dd-4ec3-8e0c-709c32b804a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:38.497915 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-29d925d0-9da7-4ce6-88b4-9c89045cf532 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:38.498050 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-29d925d0-9da7-4ce6-88b4-9c89045cf532 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:38.498156 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6dd8dadc-d5dd-4ec3-8e0c-709c32b804a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:38.504990 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6dd8dadc-d5dd-4ec3-8e0c-709c32b804a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:38.505474 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6dd8dadc-d5dd-4ec3-8e0c-709c32b804a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:38.505912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6dd8dadc-d5dd-4ec3-8e0c-709c32b804a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:38.506595 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6dd8dadc-d5dd-4ec3-8e0c-709c32b804a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:38.507048 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6dd8dadc-d5dd-4ec3-8e0c-709c32b804a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:38.507497 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6dd8dadc-d5dd-4ec3-8e0c-709c32b804a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:38.686901 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-29d925d0-9da7-4ce6-88b4-9c89045cf532 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:38.695608 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-29d925d0-9da7-4ce6-88b4-9c89045cf532 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.211362 Aug 10 12:59:38.696181 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1166/2315] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:38 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:38.698877 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6dd8dadc-d5dd-4ec3-8e0c-709c32b804a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:38.707372 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6dd8dadc-d5dd-4ec3-8e0c-709c32b804a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:38.708967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6dd8dadc-d5dd-4ec3-8e0c-709c32b804a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:38.710188 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6dd8dadc-d5dd-4ec3-8e0c-709c32b804a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.216818 Aug 10 12:59:38.710740 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1150/2316] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:38 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:38.797960 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-06109d2f-5bd6-4e12-9f56-fd5fcd0bca87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:38.799274 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-06109d2f-5bd6-4e12-9f56-fd5fcd0bca87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:38.805176 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06109d2f-5bd6-4e12-9f56-fd5fcd0bca87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:38.805660 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06109d2f-5bd6-4e12-9f56-fd5fcd0bca87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:38.806103 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06109d2f-5bd6-4e12-9f56-fd5fcd0bca87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:38.806825 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06109d2f-5bd6-4e12-9f56-fd5fcd0bca87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:38.807308 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06109d2f-5bd6-4e12-9f56-fd5fcd0bca87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:38.807736 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06109d2f-5bd6-4e12-9f56-fd5fcd0bca87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:38.922167 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-281eea25-0898-4f19-877d-c4a367ed03fa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:38.922886 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-281eea25-0898-4f19-877d-c4a367ed03fa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:38.929515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-281eea25-0898-4f19-877d-c4a367ed03fa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:38.929999 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-281eea25-0898-4f19-877d-c4a367ed03fa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:38.930426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-281eea25-0898-4f19-877d-c4a367ed03fa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:38.931115 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-281eea25-0898-4f19-877d-c4a367ed03fa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:38.931597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-281eea25-0898-4f19-877d-c4a367ed03fa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:38.932018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-281eea25-0898-4f19-877d-c4a367ed03fa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:38.933299 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-06109d2f-5bd6-4e12-9f56-fd5fcd0bca87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:38.935635 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:59:38.942710 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-06109d2f-5bd6-4e12-9f56-fd5fcd0bca87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.148555 Aug 10 12:59:38.943410 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1167/2317] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:38 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:39.062186 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-281eea25-0898-4f19-877d-c4a367ed03fa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:39.070216 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-281eea25-0898-4f19-877d-c4a367ed03fa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.151894 Aug 10 12:59:39.070781 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1151/2318] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:38 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:39.717361 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6da867f9-cf72-4850-a8b6-9cad203de233 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:39.717970 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6da867f9-cf72-4850-a8b6-9cad203de233 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:39.725775 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6da867f9-cf72-4850-a8b6-9cad203de233 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:39.726246 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6da867f9-cf72-4850-a8b6-9cad203de233 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:39.726671 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6da867f9-cf72-4850-a8b6-9cad203de233 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:39.727381 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6da867f9-cf72-4850-a8b6-9cad203de233 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:39.727825 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6da867f9-cf72-4850-a8b6-9cad203de233 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:39.728241 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6da867f9-cf72-4850-a8b6-9cad203de233 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:39.733161 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-03a85792-5394-4874-99db-9ebfcd8f634c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:39.733806 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-03a85792-5394-4874-99db-9ebfcd8f634c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:39.741233 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03a85792-5394-4874-99db-9ebfcd8f634c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:39.741724 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03a85792-5394-4874-99db-9ebfcd8f634c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:39.742158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03a85792-5394-4874-99db-9ebfcd8f634c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:39.742849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03a85792-5394-4874-99db-9ebfcd8f634c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:39.743328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03a85792-5394-4874-99db-9ebfcd8f634c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:39.743755 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03a85792-5394-4874-99db-9ebfcd8f634c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:39.929346 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6da867f9-cf72-4850-a8b6-9cad203de233 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:39.933338 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-03a85792-5394-4874-99db-9ebfcd8f634c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:39.937414 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6da867f9-cf72-4850-a8b6-9cad203de233 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.223929 Aug 10 12:59:39.937987 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1168/2319] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:39 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:39.942585 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-03a85792-5394-4874-99db-9ebfcd8f634c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:39.944126 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-03a85792-5394-4874-99db-9ebfcd8f634c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:39.945273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-03a85792-5394-4874-99db-9ebfcd8f634c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.215979 Aug 10 12:59:39.945814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1152/2320] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:39 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:39.964495 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-57c3ae60-2508-491c-98f3-e1b5316a58b5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:39.965106 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-57c3ae60-2508-491c-98f3-e1b5316a58b5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:39.971586 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57c3ae60-2508-491c-98f3-e1b5316a58b5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:39.972008 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57c3ae60-2508-491c-98f3-e1b5316a58b5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:39.972459 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57c3ae60-2508-491c-98f3-e1b5316a58b5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:39.973131 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57c3ae60-2508-491c-98f3-e1b5316a58b5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:39.973585 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57c3ae60-2508-491c-98f3-e1b5316a58b5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:39.974012 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57c3ae60-2508-491c-98f3-e1b5316a58b5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:40.091790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-049ad7f0-5f90-468b-9fc2-d34cc1fa34da tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:40.092402 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-049ad7f0-5f90-468b-9fc2-d34cc1fa34da tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:40.098963 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-049ad7f0-5f90-468b-9fc2-d34cc1fa34da tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:40.099276 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-57c3ae60-2508-491c-98f3-e1b5316a58b5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:40.099473 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-049ad7f0-5f90-468b-9fc2-d34cc1fa34da tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:40.099905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-049ad7f0-5f90-468b-9fc2-d34cc1fa34da tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:40.100607 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-049ad7f0-5f90-468b-9fc2-d34cc1fa34da tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:40.101058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-049ad7f0-5f90-468b-9fc2-d34cc1fa34da tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:40.101482 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-049ad7f0-5f90-468b-9fc2-d34cc1fa34da tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:40.107433 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-57c3ae60-2508-491c-98f3-e1b5316a58b5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.146636 Aug 10 12:59:40.107994 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1169/2321] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:39 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:40.230586 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-049ad7f0-5f90-468b-9fc2-d34cc1fa34da tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:40.238852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-049ad7f0-5f90-468b-9fc2-d34cc1fa34da tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.150921 Aug 10 12:59:40.239591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1153/2322] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:40 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:40.959641 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f91a2091-1184-4c8f-84c1-b206bf7d55a9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:40.960254 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f91a2091-1184-4c8f-84c1-b206bf7d55a9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:40.966647 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f91a2091-1184-4c8f-84c1-b206bf7d55a9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:40.967128 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f91a2091-1184-4c8f-84c1-b206bf7d55a9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:40.967595 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f91a2091-1184-4c8f-84c1-b206bf7d55a9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:40.968039 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-062aa69c-f70a-493c-8583-65cadb6075ef tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:40.968438 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f91a2091-1184-4c8f-84c1-b206bf7d55a9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:40.968708 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-062aa69c-f70a-493c-8583-65cadb6075ef tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:40.968822 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f91a2091-1184-4c8f-84c1-b206bf7d55a9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:40.969185 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f91a2091-1184-4c8f-84c1-b206bf7d55a9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:40.975131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-062aa69c-f70a-493c-8583-65cadb6075ef tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:40.975647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-062aa69c-f70a-493c-8583-65cadb6075ef tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:40.976095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-062aa69c-f70a-493c-8583-65cadb6075ef tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:40.976774 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-062aa69c-f70a-493c-8583-65cadb6075ef tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:40.977366 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-062aa69c-f70a-493c-8583-65cadb6075ef tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:40.977797 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-062aa69c-f70a-493c-8583-65cadb6075ef tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:41.165478 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f91a2091-1184-4c8f-84c1-b206bf7d55a9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:41.168843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-062aa69c-f70a-493c-8583-65cadb6075ef tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:41.174444 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f91a2091-1184-4c8f-84c1-b206bf7d55a9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.218685 Aug 10 12:59:41.175026 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1170/2323] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:40 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:41.178909 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-062aa69c-f70a-493c-8583-65cadb6075ef tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:41.179625 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7186c5d0-f64c-4984-bf13-4c45772b8ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:41.180235 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7186c5d0-f64c-4984-bf13-4c45772b8ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:41.180462 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-062aa69c-f70a-493c-8583-65cadb6075ef tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:41.181685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-062aa69c-f70a-493c-8583-65cadb6075ef tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.217692 Aug 10 12:59:41.182167 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1154/2324] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:40 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:41.186036 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7186c5d0-f64c-4984-bf13-4c45772b8ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:41.186517 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7186c5d0-f64c-4984-bf13-4c45772b8ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:41.187078 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7186c5d0-f64c-4984-bf13-4c45772b8ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:41.189957 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7186c5d0-f64c-4984-bf13-4c45772b8ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:41.189957 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7186c5d0-f64c-4984-bf13-4c45772b8ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:41.189957 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7186c5d0-f64c-4984-bf13-4c45772b8ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:41.263817 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e74a1c2f-eba3-4029-a184-b6a451c5335f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:41.264437 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e74a1c2f-eba3-4029-a184-b6a451c5335f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:41.276566 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e74a1c2f-eba3-4029-a184-b6a451c5335f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:41.277061 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e74a1c2f-eba3-4029-a184-b6a451c5335f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:41.277495 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e74a1c2f-eba3-4029-a184-b6a451c5335f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:41.278196 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e74a1c2f-eba3-4029-a184-b6a451c5335f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:41.278648 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e74a1c2f-eba3-4029-a184-b6a451c5335f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:41.279068 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e74a1c2f-eba3-4029-a184-b6a451c5335f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:41.359424 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-7186c5d0-f64c-4984-bf13-4c45772b8ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:41.368185 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7186c5d0-f64c-4984-bf13-4c45772b8ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.192162 Aug 10 12:59:41.369040 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1171/2325] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:41 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:41.423842 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e74a1c2f-eba3-4029-a184-b6a451c5335f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:41.431762 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e74a1c2f-eba3-4029-a184-b6a451c5335f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.175596 Aug 10 12:59:41.432327 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1155/2326] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:41 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:42.197887 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-61bfac06-457d-4b20-ae31-ec78d1b4ed64 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:42.198413 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-61bfac06-457d-4b20-ae31-ec78d1b4ed64 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:42.205426 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-61bfac06-457d-4b20-ae31-ec78d1b4ed64 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:42.205949 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-61bfac06-457d-4b20-ae31-ec78d1b4ed64 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:42.206377 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-61bfac06-457d-4b20-ae31-ec78d1b4ed64 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:42.207062 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-61bfac06-457d-4b20-ae31-ec78d1b4ed64 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:42.207532 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-61bfac06-457d-4b20-ae31-ec78d1b4ed64 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:42.207958 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-61bfac06-457d-4b20-ae31-ec78d1b4ed64 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:42.210706 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b9bd91f1-8537-4ab3-bc2c-17ef0142808a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:42.211337 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b9bd91f1-8537-4ab3-bc2c-17ef0142808a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:42.217505 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b9bd91f1-8537-4ab3-bc2c-17ef0142808a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:42.217974 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b9bd91f1-8537-4ab3-bc2c-17ef0142808a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:42.218397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b9bd91f1-8537-4ab3-bc2c-17ef0142808a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:42.219074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b9bd91f1-8537-4ab3-bc2c-17ef0142808a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:42.219538 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b9bd91f1-8537-4ab3-bc2c-17ef0142808a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:42.219953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b9bd91f1-8537-4ab3-bc2c-17ef0142808a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:42.616469 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-61bfac06-457d-4b20-ae31-ec78d1b4ed64 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:42.624478 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-61bfac06-457d-4b20-ae31-ec78d1b4ed64 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.430596 Aug 10 12:59:42.625060 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1172/2327] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:42 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:42.630820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b9bd91f1-8537-4ab3-bc2c-17ef0142808a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:42.633029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:59:42.635680 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9f132a1b-06a8-4a05-896c-519b331337b9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:42.636295 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9f132a1b-06a8-4a05-896c-519b331337b9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:42.640336 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b9bd91f1-8537-4ab3-bc2c-17ef0142808a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:42.641821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b9bd91f1-8537-4ab3-bc2c-17ef0142808a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:42.642265 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9f132a1b-06a8-4a05-896c-519b331337b9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:42.642961 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9f132a1b-06a8-4a05-896c-519b331337b9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:42.643094 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b9bd91f1-8537-4ab3-bc2c-17ef0142808a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.436364 Aug 10 12:59:42.643436 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9f132a1b-06a8-4a05-896c-519b331337b9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:42.643647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1156/2328] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:42 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:59:42.644136 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9f132a1b-06a8-4a05-896c-519b331337b9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:42.644600 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9f132a1b-06a8-4a05-896c-519b331337b9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:42.645027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9f132a1b-06a8-4a05-896c-519b331337b9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:42.651801 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-36cd2cbc-4e1e-467b-aeeb-e204f3fcb4ad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:42.651801 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-36cd2cbc-4e1e-467b-aeeb-e204f3fcb4ad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:42.654362 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36cd2cbc-4e1e-467b-aeeb-e204f3fcb4ad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:42.654841 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36cd2cbc-4e1e-467b-aeeb-e204f3fcb4ad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:42.655290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36cd2cbc-4e1e-467b-aeeb-e204f3fcb4ad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:42.655973 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36cd2cbc-4e1e-467b-aeeb-e204f3fcb4ad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:42.656416 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36cd2cbc-4e1e-467b-aeeb-e204f3fcb4ad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:42.656832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36cd2cbc-4e1e-467b-aeeb-e204f3fcb4ad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:42.842859 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9f132a1b-06a8-4a05-896c-519b331337b9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:42.850198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-36cd2cbc-4e1e-467b-aeeb-e204f3fcb4ad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:42.852436 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9f132a1b-06a8-4a05-896c-519b331337b9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.220340 Aug 10 12:59:42.853046 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1173/2329] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:42 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:42.858400 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-36cd2cbc-4e1e-467b-aeeb-e204f3fcb4ad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.213810 Aug 10 12:59:42.858951 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1157/2330] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:42 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:43.648018 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-760125c2-bc34-4f9e-91e2-b3f60ace2f78 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:43.648595 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-760125c2-bc34-4f9e-91e2-b3f60ace2f78 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:43.654966 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-760125c2-bc34-4f9e-91e2-b3f60ace2f78 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:43.655478 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-760125c2-bc34-4f9e-91e2-b3f60ace2f78 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:43.655920 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-760125c2-bc34-4f9e-91e2-b3f60ace2f78 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:43.656603 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-760125c2-bc34-4f9e-91e2-b3f60ace2f78 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:43.657057 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-760125c2-bc34-4f9e-91e2-b3f60ace2f78 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:43.657483 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-760125c2-bc34-4f9e-91e2-b3f60ace2f78 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:43.673633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-cfa60138-0741-429e-a3a1-eccd61f091db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:43.674521 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-cfa60138-0741-429e-a3a1-eccd61f091db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:43.681023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cfa60138-0741-429e-a3a1-eccd61f091db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:43.681503 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cfa60138-0741-429e-a3a1-eccd61f091db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:43.681934 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cfa60138-0741-429e-a3a1-eccd61f091db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:43.682624 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cfa60138-0741-429e-a3a1-eccd61f091db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:43.683261 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cfa60138-0741-429e-a3a1-eccd61f091db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:43.683692 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cfa60138-0741-429e-a3a1-eccd61f091db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:43.856338 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-760125c2-bc34-4f9e-91e2-b3f60ace2f78 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:43.862802 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-cfa60138-0741-429e-a3a1-eccd61f091db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:43.864785 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-760125c2-bc34-4f9e-91e2-b3f60ace2f78 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.220685 Aug 10 12:59:43.865687 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1174/2331] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:43 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:43.873003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-cfa60138-0741-429e-a3a1-eccd61f091db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:43.875001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-cfa60138-0741-429e-a3a1-eccd61f091db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:43.875190 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-788589e2-e3da-47de-815b-877753c646e4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:43.875769 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-788589e2-e3da-47de-815b-877753c646e4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:43.875974 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-cfa60138-0741-429e-a3a1-eccd61f091db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.206335 Aug 10 12:59:43.880122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1158/2332] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:43 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:43.881826 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5ac9ab25-d6ae-4d98-9659-183e59db2b3c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:43.882998 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-788589e2-e3da-47de-815b-877753c646e4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:43.883144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5ac9ab25-d6ae-4d98-9659-183e59db2b3c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:43.883511 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-788589e2-e3da-47de-815b-877753c646e4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:43.883940 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-788589e2-e3da-47de-815b-877753c646e4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:43.884619 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-788589e2-e3da-47de-815b-877753c646e4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:43.885063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-788589e2-e3da-47de-815b-877753c646e4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:43.885480 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-788589e2-e3da-47de-815b-877753c646e4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:43.888853 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ac9ab25-d6ae-4d98-9659-183e59db2b3c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:43.889369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ac9ab25-d6ae-4d98-9659-183e59db2b3c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:43.889818 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ac9ab25-d6ae-4d98-9659-183e59db2b3c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:43.890494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ac9ab25-d6ae-4d98-9659-183e59db2b3c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:43.890945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ac9ab25-d6ae-4d98-9659-183e59db2b3c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:43.891415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ac9ab25-d6ae-4d98-9659-183e59db2b3c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:44.078850 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-788589e2-e3da-47de-815b-877753c646e4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:44.083320 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5ac9ab25-d6ae-4d98-9659-183e59db2b3c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:44.087651 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-788589e2-e3da-47de-815b-877753c646e4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.216353 Aug 10 12:59:44.088238 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1175/2333] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:43 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:44.091687 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5ac9ab25-d6ae-4d98-9659-183e59db2b3c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.213301 Aug 10 12:59:44.092279 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1159/2334] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:43 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:44.887757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8e1617c3-369b-4b95-9f2d-64c86090f7ed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:44.888352 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8e1617c3-369b-4b95-9f2d-64c86090f7ed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:44.895671 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8e1617c3-369b-4b95-9f2d-64c86090f7ed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:44.896149 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8e1617c3-369b-4b95-9f2d-64c86090f7ed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:44.896581 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8e1617c3-369b-4b95-9f2d-64c86090f7ed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:44.897263 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8e1617c3-369b-4b95-9f2d-64c86090f7ed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:44.897714 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8e1617c3-369b-4b95-9f2d-64c86090f7ed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:44.898131 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8e1617c3-369b-4b95-9f2d-64c86090f7ed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:44.900499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e9805ca7-5ec4-4ef4-815b-e8c7beed9a2c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:44.901107 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e9805ca7-5ec4-4ef4-815b-e8c7beed9a2c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:44.907360 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9805ca7-5ec4-4ef4-815b-e8c7beed9a2c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:44.908350 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9805ca7-5ec4-4ef4-815b-e8c7beed9a2c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:44.908837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9805ca7-5ec4-4ef4-815b-e8c7beed9a2c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:44.909517 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9805ca7-5ec4-4ef4-815b-e8c7beed9a2c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:44.909962 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9805ca7-5ec4-4ef4-815b-e8c7beed9a2c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:44.910377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9805ca7-5ec4-4ef4-815b-e8c7beed9a2c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:45.098835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-8e1617c3-369b-4b95-9f2d-64c86090f7ed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:45.105744 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e9805ca7-5ec4-4ef4-815b-e8c7beed9a2c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:45.106954 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8e1617c3-369b-4b95-9f2d-64c86090f7ed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.223050 Aug 10 12:59:45.108664 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1176/2335] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:44 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:45.113633 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-dd88380f-21cd-482f-a57e-803bc71a6ace tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:45.114244 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-dd88380f-21cd-482f-a57e-803bc71a6ace tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:45.115617 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e9805ca7-5ec4-4ef4-815b-e8c7beed9a2c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:45.117363 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e9805ca7-5ec4-4ef4-815b-e8c7beed9a2c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:45.118534 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e9805ca7-5ec4-4ef4-815b-e8c7beed9a2c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.221893 Aug 10 12:59:45.119313 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1160/2336] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:44 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:45.120109 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dd88380f-21cd-482f-a57e-803bc71a6ace tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:45.120599 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dd88380f-21cd-482f-a57e-803bc71a6ace tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:45.121037 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dd88380f-21cd-482f-a57e-803bc71a6ace tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:45.121847 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dd88380f-21cd-482f-a57e-803bc71a6ace tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:45.122306 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dd88380f-21cd-482f-a57e-803bc71a6ace tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:45.122729 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dd88380f-21cd-482f-a57e-803bc71a6ace tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:45.124508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-786e7f6d-19db-42b3-afd9-ff46331aebf6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:45.125109 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-786e7f6d-19db-42b3-afd9-ff46331aebf6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:45.131339 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-786e7f6d-19db-42b3-afd9-ff46331aebf6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:45.131940 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-786e7f6d-19db-42b3-afd9-ff46331aebf6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:45.132494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-786e7f6d-19db-42b3-afd9-ff46331aebf6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:45.133219 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-786e7f6d-19db-42b3-afd9-ff46331aebf6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:45.133753 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-786e7f6d-19db-42b3-afd9-ff46331aebf6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:45.134172 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-786e7f6d-19db-42b3-afd9-ff46331aebf6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:45.321848 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-dd88380f-21cd-482f-a57e-803bc71a6ace tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:45.324746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-786e7f6d-19db-42b3-afd9-ff46331aebf6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:45.330049 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-dd88380f-21cd-482f-a57e-803bc71a6ace tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.221324 Aug 10 12:59:45.330625 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1177/2337] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:45 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:45.332772 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-786e7f6d-19db-42b3-afd9-ff46331aebf6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.212206 Aug 10 12:59:45.333338 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1161/2338] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:45 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:46.128318 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ad130fb9-6387-45c9-85ca-fcf12ffed328 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:46.128919 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ad130fb9-6387-45c9-85ca-fcf12ffed328 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:46.135351 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad130fb9-6387-45c9-85ca-fcf12ffed328 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:46.135828 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad130fb9-6387-45c9-85ca-fcf12ffed328 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:46.136257 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad130fb9-6387-45c9-85ca-fcf12ffed328 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:46.136937 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad130fb9-6387-45c9-85ca-fcf12ffed328 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:46.137379 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad130fb9-6387-45c9-85ca-fcf12ffed328 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:46.137798 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad130fb9-6387-45c9-85ca-fcf12ffed328 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:46.141318 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bcb59076-9897-4169-a4a5-477bca2d1bb9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:46.141990 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bcb59076-9897-4169-a4a5-477bca2d1bb9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:46.149222 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bcb59076-9897-4169-a4a5-477bca2d1bb9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:46.149706 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bcb59076-9897-4169-a4a5-477bca2d1bb9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:46.150133 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bcb59076-9897-4169-a4a5-477bca2d1bb9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:46.150824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bcb59076-9897-4169-a4a5-477bca2d1bb9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:46.151303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bcb59076-9897-4169-a4a5-477bca2d1bb9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:46.151726 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bcb59076-9897-4169-a4a5-477bca2d1bb9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:46.337310 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ad130fb9-6387-45c9-85ca-fcf12ffed328 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:46.341166 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-bcb59076-9897-4169-a4a5-477bca2d1bb9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:46.345595 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ad130fb9-6387-45c9-85ca-fcf12ffed328 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.221729 Aug 10 12:59:46.346252 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1178/2339] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:46 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:46.350346 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-bcb59076-9897-4169-a4a5-477bca2d1bb9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:46.352772 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bdb6d12d-ea8e-4412-ae69-aac4faf69d5d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:46.352772 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bdb6d12d-ea8e-4412-ae69-aac4faf69d5d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:46.353030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-bcb59076-9897-4169-a4a5-477bca2d1bb9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:46.353163 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bcb59076-9897-4169-a4a5-477bca2d1bb9 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.215600 Aug 10 12:59:46.354039 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1162/2340] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:46 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 12:59:46.358405 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bdb6d12d-ea8e-4412-ae69-aac4faf69d5d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:46.358984 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bdb6d12d-ea8e-4412-ae69-aac4faf69d5d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:46.359513 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bdb6d12d-ea8e-4412-ae69-aac4faf69d5d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:46.360197 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bdb6d12d-ea8e-4412-ae69-aac4faf69d5d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:46.361218 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bdb6d12d-ea8e-4412-ae69-aac4faf69d5d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:46.361635 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bdb6d12d-ea8e-4412-ae69-aac4faf69d5d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:46.369852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-50cb2f33-2198-4ade-848f-40ca977d22ac tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:46.370452 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-50cb2f33-2198-4ade-848f-40ca977d22ac tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:46.376293 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50cb2f33-2198-4ade-848f-40ca977d22ac tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:46.377316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50cb2f33-2198-4ade-848f-40ca977d22ac tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:46.377773 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50cb2f33-2198-4ade-848f-40ca977d22ac tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:46.378430 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50cb2f33-2198-4ade-848f-40ca977d22ac tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:46.378873 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50cb2f33-2198-4ade-848f-40ca977d22ac tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:46.379309 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50cb2f33-2198-4ade-848f-40ca977d22ac tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:46.545228 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-bdb6d12d-ea8e-4412-ae69-aac4faf69d5d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:46.554381 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bdb6d12d-ea8e-4412-ae69-aac4faf69d5d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.206711 Aug 10 12:59:46.555144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1179/2341] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:46 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:46.571159 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-50cb2f33-2198-4ade-848f-40ca977d22ac tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:46.579702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-50cb2f33-2198-4ade-848f-40ca977d22ac tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.213335 Aug 10 12:59:46.580333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1163/2342] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:46 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:47.366913 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1ac483db-7711-449e-9cb4-1f32c60e3570 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:47.367556 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1ac483db-7711-449e-9cb4-1f32c60e3570 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:47.374179 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1ac483db-7711-449e-9cb4-1f32c60e3570 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:47.374661 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1ac483db-7711-449e-9cb4-1f32c60e3570 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:47.375096 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1ac483db-7711-449e-9cb4-1f32c60e3570 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:47.375809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1ac483db-7711-449e-9cb4-1f32c60e3570 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:47.376791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1ac483db-7711-449e-9cb4-1f32c60e3570 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:47.377223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-934eec60-ec98-43eb-9188-33ede0e87cfc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:47.377650 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1ac483db-7711-449e-9cb4-1f32c60e3570 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:47.377849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-934eec60-ec98-43eb-9188-33ede0e87cfc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:47.384181 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-934eec60-ec98-43eb-9188-33ede0e87cfc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:47.384663 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-934eec60-ec98-43eb-9188-33ede0e87cfc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:47.385109 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-934eec60-ec98-43eb-9188-33ede0e87cfc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:47.385799 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-934eec60-ec98-43eb-9188-33ede0e87cfc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:47.386254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-934eec60-ec98-43eb-9188-33ede0e87cfc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:47.386683 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-934eec60-ec98-43eb-9188-33ede0e87cfc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:47.572543 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-1ac483db-7711-449e-9cb4-1f32c60e3570 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:47.577551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-934eec60-ec98-43eb-9188-33ede0e87cfc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:47.581296 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1ac483db-7711-449e-9cb4-1f32c60e3570 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.218254 Aug 10 12:59:47.581977 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1180/2343] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:47 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:47.587511 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4ae7056b-88ee-4c60-b94c-1bdfb87f9a96 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:47.588130 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4ae7056b-88ee-4c60-b94c-1bdfb87f9a96 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:47.591093 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-934eec60-ec98-43eb-9188-33ede0e87cfc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:47.592926 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-934eec60-ec98-43eb-9188-33ede0e87cfc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:47.593996 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4ae7056b-88ee-4c60-b94c-1bdfb87f9a96 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:47.595863 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4ae7056b-88ee-4c60-b94c-1bdfb87f9a96 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:47.595863 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4ae7056b-88ee-4c60-b94c-1bdfb87f9a96 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:47.595863 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4ae7056b-88ee-4c60-b94c-1bdfb87f9a96 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:47.596261 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4ae7056b-88ee-4c60-b94c-1bdfb87f9a96 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:47.596382 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-934eec60-ec98-43eb-9188-33ede0e87cfc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.221838 Aug 10 12:59:47.596687 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4ae7056b-88ee-4c60-b94c-1bdfb87f9a96 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:47.603385 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1164/2344] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:47 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:47.603385 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a71761f5-1ebc-4bd0-9d7f-42d875fcd0e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:47.603385 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a71761f5-1ebc-4bd0-9d7f-42d875fcd0e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:47.609065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a71761f5-1ebc-4bd0-9d7f-42d875fcd0e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:47.609674 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a71761f5-1ebc-4bd0-9d7f-42d875fcd0e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:47.610214 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a71761f5-1ebc-4bd0-9d7f-42d875fcd0e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:47.611004 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a71761f5-1ebc-4bd0-9d7f-42d875fcd0e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:47.611671 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a71761f5-1ebc-4bd0-9d7f-42d875fcd0e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:47.612197 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a71761f5-1ebc-4bd0-9d7f-42d875fcd0e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:47.804627 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4ae7056b-88ee-4c60-b94c-1bdfb87f9a96 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:47.808769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a71761f5-1ebc-4bd0-9d7f-42d875fcd0e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:47.812572 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4ae7056b-88ee-4c60-b94c-1bdfb87f9a96 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.229380 Aug 10 12:59:47.813147 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1181/2345] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:47 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:47.818170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a71761f5-1ebc-4bd0-9d7f-42d875fcd0e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.219978 Aug 10 12:59:47.818735 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1165/2346] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:47 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:48.602691 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ef1c0119-a964-4367-8601-c53a4e5651bd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:48.603252 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ef1c0119-a964-4367-8601-c53a4e5651bd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:48.609887 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef1c0119-a964-4367-8601-c53a4e5651bd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:48.610355 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef1c0119-a964-4367-8601-c53a4e5651bd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:48.610819 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef1c0119-a964-4367-8601-c53a4e5651bd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:48.611734 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef1c0119-a964-4367-8601-c53a4e5651bd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:48.612183 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef1c0119-a964-4367-8601-c53a4e5651bd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:48.612600 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef1c0119-a964-4367-8601-c53a4e5651bd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:48.620236 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-aded1629-cfca-4959-a699-441257607930 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:48.620842 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-aded1629-cfca-4959-a699-441257607930 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:48.626887 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aded1629-cfca-4959-a699-441257607930 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:48.627408 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aded1629-cfca-4959-a699-441257607930 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:48.627840 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aded1629-cfca-4959-a699-441257607930 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:48.628523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aded1629-cfca-4959-a699-441257607930 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:48.628978 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aded1629-cfca-4959-a699-441257607930 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:48.629467 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aded1629-cfca-4959-a699-441257607930 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:48.802356 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ef1c0119-a964-4367-8601-c53a4e5651bd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:48.810187 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ef1c0119-a964-4367-8601-c53a4e5651bd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.211437 Aug 10 12:59:48.810759 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1182/2347] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:48 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:48.829063 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-aded1629-cfca-4959-a699-441257607930 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:48.835234 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-eced4d9b-f012-4aa6-a1c6-daa3d8cb77c2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:48.835847 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-eced4d9b-f012-4aa6-a1c6-daa3d8cb77c2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:48.840041 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-aded1629-cfca-4959-a699-441257607930 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:48.842866 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-aded1629-cfca-4959-a699-441257607930 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:48.842866 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-aded1629-cfca-4959-a699-441257607930 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.226412 Aug 10 12:59:48.843589 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1166/2348] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:48 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:48.843724 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eced4d9b-f012-4aa6-a1c6-daa3d8cb77c2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:48.844195 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eced4d9b-f012-4aa6-a1c6-daa3d8cb77c2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:48.844624 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eced4d9b-f012-4aa6-a1c6-daa3d8cb77c2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:48.845402 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eced4d9b-f012-4aa6-a1c6-daa3d8cb77c2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:48.845954 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eced4d9b-f012-4aa6-a1c6-daa3d8cb77c2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:48.846262 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eced4d9b-f012-4aa6-a1c6-daa3d8cb77c2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:48.848947 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-68a87484-a134-4049-ae00-c1897e9cf73e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:48.849624 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-68a87484-a134-4049-ae00-c1897e9cf73e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:48.855913 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68a87484-a134-4049-ae00-c1897e9cf73e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:48.856412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68a87484-a134-4049-ae00-c1897e9cf73e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:48.856919 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68a87484-a134-4049-ae00-c1897e9cf73e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:48.857690 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68a87484-a134-4049-ae00-c1897e9cf73e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:48.858234 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68a87484-a134-4049-ae00-c1897e9cf73e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:48.858734 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68a87484-a134-4049-ae00-c1897e9cf73e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:49.051427 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-eced4d9b-f012-4aa6-a1c6-daa3d8cb77c2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:49.055044 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-68a87484-a134-4049-ae00-c1897e9cf73e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:49.059546 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-eced4d9b-f012-4aa6-a1c6-daa3d8cb77c2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.228455 Aug 10 12:59:49.060121 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1183/2349] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:48 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:49.063186 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-68a87484-a134-4049-ae00-c1897e9cf73e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.218255 Aug 10 12:59:49.064413 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1167/2350] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:48 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:49.832024 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8a50bde9-d049-4f4d-8609-006cb0ec6609 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:49.832635 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8a50bde9-d049-4f4d-8609-006cb0ec6609 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:49.838953 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a50bde9-d049-4f4d-8609-006cb0ec6609 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:49.839463 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a50bde9-d049-4f4d-8609-006cb0ec6609 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:49.839895 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a50bde9-d049-4f4d-8609-006cb0ec6609 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:49.840580 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a50bde9-d049-4f4d-8609-006cb0ec6609 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:49.841054 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a50bde9-d049-4f4d-8609-006cb0ec6609 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:49.841474 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a50bde9-d049-4f4d-8609-006cb0ec6609 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:49.856706 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:59:49.866671 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-83e6c63e-9637-4989-89c4-80de5e13fb2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:49.876330 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-83e6c63e-9637-4989-89c4-80de5e13fb2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:49.876330 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83e6c63e-9637-4989-89c4-80de5e13fb2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:49.876330 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83e6c63e-9637-4989-89c4-80de5e13fb2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:49.876330 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83e6c63e-9637-4989-89c4-80de5e13fb2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:49.877013 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83e6c63e-9637-4989-89c4-80de5e13fb2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:49.877013 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83e6c63e-9637-4989-89c4-80de5e13fb2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:49.877013 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83e6c63e-9637-4989-89c4-80de5e13fb2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:50.026345 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-8a50bde9-d049-4f4d-8609-006cb0ec6609 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:50.035847 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8a50bde9-d049-4f4d-8609-006cb0ec6609 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.207757 Aug 10 12:59:50.036805 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1184/2351] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:49 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:50.054161 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-83e6c63e-9637-4989-89c4-80de5e13fb2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:50.062447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-83e6c63e-9637-4989-89c4-80de5e13fb2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:50.064114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-83e6c63e-9637-4989-89c4-80de5e13fb2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:50.065271 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-83e6c63e-9637-4989-89c4-80de5e13fb2a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.202647 Aug 10 12:59:50.065841 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1168/2352] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:49 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:50.082122 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5652fb0d-73be-4ef1-812b-d429797cc586 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:50.082734 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5652fb0d-73be-4ef1-812b-d429797cc586 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:50.085316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4befa9e0-fa12-4cb0-97d1-873a19721bcb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:50.085921 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4befa9e0-fa12-4cb0-97d1-873a19721bcb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:50.088722 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5652fb0d-73be-4ef1-812b-d429797cc586 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:50.089201 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5652fb0d-73be-4ef1-812b-d429797cc586 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:50.089665 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5652fb0d-73be-4ef1-812b-d429797cc586 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:50.090353 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5652fb0d-73be-4ef1-812b-d429797cc586 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:50.090813 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5652fb0d-73be-4ef1-812b-d429797cc586 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:50.091255 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5652fb0d-73be-4ef1-812b-d429797cc586 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:50.092460 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4befa9e0-fa12-4cb0-97d1-873a19721bcb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:50.093025 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4befa9e0-fa12-4cb0-97d1-873a19721bcb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:50.093544 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4befa9e0-fa12-4cb0-97d1-873a19721bcb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:50.094268 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4befa9e0-fa12-4cb0-97d1-873a19721bcb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:50.094789 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4befa9e0-fa12-4cb0-97d1-873a19721bcb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:50.096466 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4befa9e0-fa12-4cb0-97d1-873a19721bcb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:50.284815 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5652fb0d-73be-4ef1-812b-d429797cc586 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:50.288324 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4befa9e0-fa12-4cb0-97d1-873a19721bcb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:50.292807 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5652fb0d-73be-4ef1-812b-d429797cc586 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.215137 Aug 10 12:59:50.293381 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1185/2353] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:50 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:50.296425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4befa9e0-fa12-4cb0-97d1-873a19721bcb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.215090 Aug 10 12:59:50.296987 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1169/2354] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:50 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:51.057276 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9adaaad2-11e9-4f0e-8d3b-e919146c216e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:51.057878 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9adaaad2-11e9-4f0e-8d3b-e919146c216e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:51.064273 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9adaaad2-11e9-4f0e-8d3b-e919146c216e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:51.064757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9adaaad2-11e9-4f0e-8d3b-e919146c216e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:51.065196 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9adaaad2-11e9-4f0e-8d3b-e919146c216e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:51.065888 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9adaaad2-11e9-4f0e-8d3b-e919146c216e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:51.066342 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9adaaad2-11e9-4f0e-8d3b-e919146c216e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:51.066769 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9adaaad2-11e9-4f0e-8d3b-e919146c216e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:51.089113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7f40b245-b7be-4f8e-910c-1e8e6d7a6bfc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:51.089743 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7f40b245-b7be-4f8e-910c-1e8e6d7a6bfc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:51.096731 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f40b245-b7be-4f8e-910c-1e8e6d7a6bfc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:51.097205 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f40b245-b7be-4f8e-910c-1e8e6d7a6bfc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:51.097633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f40b245-b7be-4f8e-910c-1e8e6d7a6bfc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:51.098316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f40b245-b7be-4f8e-910c-1e8e6d7a6bfc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:51.098762 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f40b245-b7be-4f8e-910c-1e8e6d7a6bfc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:51.099199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f40b245-b7be-4f8e-910c-1e8e6d7a6bfc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:51.256949 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9adaaad2-11e9-4f0e-8d3b-e919146c216e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:51.265089 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9adaaad2-11e9-4f0e-8d3b-e919146c216e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.211692 Aug 10 12:59:51.265684 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1186/2355] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:51 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:51.273578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7f40b245-b7be-4f8e-910c-1e8e6d7a6bfc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:51.282295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7f40b245-b7be-4f8e-910c-1e8e6d7a6bfc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:51.284738 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7f40b245-b7be-4f8e-910c-1e8e6d7a6bfc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:51.285902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7f40b245-b7be-4f8e-910c-1e8e6d7a6bfc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.200819 Aug 10 12:59:51.286453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1170/2356] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:51 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:51.313846 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e89759d2-7929-466c-a431-b1a7255a9cba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:51.314540 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e89759d2-7929-466c-a431-b1a7255a9cba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:51.317651 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-399cb9cf-d421-4d28-8760-a29c8f80a0bc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:51.318258 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-399cb9cf-d421-4d28-8760-a29c8f80a0bc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:51.320824 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e89759d2-7929-466c-a431-b1a7255a9cba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:51.321312 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e89759d2-7929-466c-a431-b1a7255a9cba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:51.321751 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e89759d2-7929-466c-a431-b1a7255a9cba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:51.322443 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e89759d2-7929-466c-a431-b1a7255a9cba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:51.322927 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e89759d2-7929-466c-a431-b1a7255a9cba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:51.323385 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e89759d2-7929-466c-a431-b1a7255a9cba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:51.324074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-399cb9cf-d421-4d28-8760-a29c8f80a0bc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:51.324584 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-399cb9cf-d421-4d28-8760-a29c8f80a0bc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:51.325015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-399cb9cf-d421-4d28-8760-a29c8f80a0bc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:51.325701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-399cb9cf-d421-4d28-8760-a29c8f80a0bc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:51.326150 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-399cb9cf-d421-4d28-8760-a29c8f80a0bc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:51.326572 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-399cb9cf-d421-4d28-8760-a29c8f80a0bc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:51.516633 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e89759d2-7929-466c-a431-b1a7255a9cba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:51.520165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-399cb9cf-d421-4d28-8760-a29c8f80a0bc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:51.525334 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e89759d2-7929-466c-a431-b1a7255a9cba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.215263 Aug 10 12:59:51.525915 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1187/2357] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:51 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:51.528421 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-399cb9cf-d421-4d28-8760-a29c8f80a0bc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.214663 Aug 10 12:59:51.528983 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1171/2358] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:51 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:52.286102 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-76ef4210-07c8-4a0a-a7bf-0e5d4ab00cfc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:52.286716 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-76ef4210-07c8-4a0a-a7bf-0e5d4ab00cfc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:52.293175 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-76ef4210-07c8-4a0a-a7bf-0e5d4ab00cfc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:52.293655 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-76ef4210-07c8-4a0a-a7bf-0e5d4ab00cfc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:52.294090 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-76ef4210-07c8-4a0a-a7bf-0e5d4ab00cfc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:52.294775 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-76ef4210-07c8-4a0a-a7bf-0e5d4ab00cfc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:52.295255 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-76ef4210-07c8-4a0a-a7bf-0e5d4ab00cfc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:52.295679 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-76ef4210-07c8-4a0a-a7bf-0e5d4ab00cfc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:52.309460 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-562705d6-b2bc-4ff9-8099-9029f0fd9924 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:52.310149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-562705d6-b2bc-4ff9-8099-9029f0fd9924 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:52.317491 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-562705d6-b2bc-4ff9-8099-9029f0fd9924 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:52.318002 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-562705d6-b2bc-4ff9-8099-9029f0fd9924 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:52.318434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-562705d6-b2bc-4ff9-8099-9029f0fd9924 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:52.319154 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-562705d6-b2bc-4ff9-8099-9029f0fd9924 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:52.319642 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-562705d6-b2bc-4ff9-8099-9029f0fd9924 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:52.320068 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-562705d6-b2bc-4ff9-8099-9029f0fd9924 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:52.493416 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-76ef4210-07c8-4a0a-a7bf-0e5d4ab00cfc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:52.497377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-562705d6-b2bc-4ff9-8099-9029f0fd9924 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:52.501500 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-76ef4210-07c8-4a0a-a7bf-0e5d4ab00cfc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.219408 Aug 10 12:59:52.502938 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1188/2359] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:52 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:52.506275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-562705d6-b2bc-4ff9-8099-9029f0fd9924 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:52.507838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-562705d6-b2bc-4ff9-8099-9029f0fd9924 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:52.508980 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-562705d6-b2bc-4ff9-8099-9029f0fd9924 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.203515 Aug 10 12:59:52.509528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1172/2360] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:52 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:52.546985 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9152db18-7fa4-4c39-b3a6-784d26feb5ac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:52.547688 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9152db18-7fa4-4c39-b3a6-784d26feb5ac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:52.550018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c20a5260-251f-457f-bd50-32e86e755ae2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:52.550834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c20a5260-251f-457f-bd50-32e86e755ae2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:52.554409 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9152db18-7fa4-4c39-b3a6-784d26feb5ac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:52.554883 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9152db18-7fa4-4c39-b3a6-784d26feb5ac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:52.555338 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9152db18-7fa4-4c39-b3a6-784d26feb5ac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:52.556014 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9152db18-7fa4-4c39-b3a6-784d26feb5ac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:52.556455 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9152db18-7fa4-4c39-b3a6-784d26feb5ac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:52.556587 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c20a5260-251f-457f-bd50-32e86e755ae2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:52.556876 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9152db18-7fa4-4c39-b3a6-784d26feb5ac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:52.557062 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c20a5260-251f-457f-bd50-32e86e755ae2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:52.557519 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c20a5260-251f-457f-bd50-32e86e755ae2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:52.558211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c20a5260-251f-457f-bd50-32e86e755ae2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:52.558661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c20a5260-251f-457f-bd50-32e86e755ae2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:52.559083 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c20a5260-251f-457f-bd50-32e86e755ae2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:52.573694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:59:52.753578 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9152db18-7fa4-4c39-b3a6-784d26feb5ac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:52.757091 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c20a5260-251f-457f-bd50-32e86e755ae2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:52.761657 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9152db18-7fa4-4c39-b3a6-784d26feb5ac tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.218709 Aug 10 12:59:52.762235 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1189/2361] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:52 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:52.765264 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c20a5260-251f-457f-bd50-32e86e755ae2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.219507 Aug 10 12:59:52.765826 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1173/2362] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:52 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:53.523037 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fa07f946-2030-4ad6-8bea-266d801eaef0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:53.523705 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fa07f946-2030-4ad6-8bea-266d801eaef0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:53.530099 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa07f946-2030-4ad6-8bea-266d801eaef0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:53.530619 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa07f946-2030-4ad6-8bea-266d801eaef0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:53.531000 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa07f946-2030-4ad6-8bea-266d801eaef0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:53.531395 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d060e524-f282-46f7-af7b-a1ec76544ee2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:53.531812 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa07f946-2030-4ad6-8bea-266d801eaef0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:53.532002 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d060e524-f282-46f7-af7b-a1ec76544ee2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:53.532127 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa07f946-2030-4ad6-8bea-266d801eaef0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:53.532535 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa07f946-2030-4ad6-8bea-266d801eaef0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:53.539461 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d060e524-f282-46f7-af7b-a1ec76544ee2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:53.539935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d060e524-f282-46f7-af7b-a1ec76544ee2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:53.540363 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d060e524-f282-46f7-af7b-a1ec76544ee2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:53.541041 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d060e524-f282-46f7-af7b-a1ec76544ee2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:53.541482 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d060e524-f282-46f7-af7b-a1ec76544ee2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:53.541905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d060e524-f282-46f7-af7b-a1ec76544ee2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:53.718746 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fa07f946-2030-4ad6-8bea-266d801eaef0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:53.727452 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fa07f946-2030-4ad6-8bea-266d801eaef0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.208323 Aug 10 12:59:53.728035 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1190/2363] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:53 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:53.731108 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d060e524-f282-46f7-af7b-a1ec76544ee2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:53.739950 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d060e524-f282-46f7-af7b-a1ec76544ee2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:53.741741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d060e524-f282-46f7-af7b-a1ec76544ee2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:53.742887 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d060e524-f282-46f7-af7b-a1ec76544ee2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.215426 Aug 10 12:59:53.743471 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1174/2364] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:53 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:53.783088 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-cbb56880-05a0-485e-a760-6d9676262be0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:53.784371 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-cbb56880-05a0-485e-a760-6d9676262be0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:53.787818 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-01d774e8-6b93-4763-93da-bf52ccb8b974 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:53.788538 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-01d774e8-6b93-4763-93da-bf52ccb8b974 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:53.790153 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cbb56880-05a0-485e-a760-6d9676262be0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:53.790627 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cbb56880-05a0-485e-a760-6d9676262be0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:53.791056 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cbb56880-05a0-485e-a760-6d9676262be0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:53.791764 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cbb56880-05a0-485e-a760-6d9676262be0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:53.792215 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cbb56880-05a0-485e-a760-6d9676262be0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:53.795309 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cbb56880-05a0-485e-a760-6d9676262be0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:53.795424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01d774e8-6b93-4763-93da-bf52ccb8b974 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:53.795424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01d774e8-6b93-4763-93da-bf52ccb8b974 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:53.795424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01d774e8-6b93-4763-93da-bf52ccb8b974 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:53.796100 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01d774e8-6b93-4763-93da-bf52ccb8b974 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:53.796547 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01d774e8-6b93-4763-93da-bf52ccb8b974 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:53.796964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01d774e8-6b93-4763-93da-bf52ccb8b974 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:53.989254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-01d774e8-6b93-4763-93da-bf52ccb8b974 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:53.992555 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-cbb56880-05a0-485e-a760-6d9676262be0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:53.997351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-01d774e8-6b93-4763-93da-bf52ccb8b974 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.214345 Aug 10 12:59:53.999200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1175/2365] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:53 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:54.000504 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-cbb56880-05a0-485e-a760-6d9676262be0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.221294 Aug 10 12:59:54.001062 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1191/2366] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:53 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:54.749020 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e724fb87-aea4-44e6-b6b9-64098f043d44 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:54.749572 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e724fb87-aea4-44e6-b6b9-64098f043d44 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:54.756993 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e724fb87-aea4-44e6-b6b9-64098f043d44 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:54.757469 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e724fb87-aea4-44e6-b6b9-64098f043d44 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:54.757897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e724fb87-aea4-44e6-b6b9-64098f043d44 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:54.758569 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e724fb87-aea4-44e6-b6b9-64098f043d44 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:54.759014 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e724fb87-aea4-44e6-b6b9-64098f043d44 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:54.759508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e724fb87-aea4-44e6-b6b9-64098f043d44 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:54.766467 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0be80ee5-344b-4231-8590-cd28c80b7760 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:54.767165 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0be80ee5-344b-4231-8590-cd28c80b7760 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:54.773853 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0be80ee5-344b-4231-8590-cd28c80b7760 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:54.774332 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0be80ee5-344b-4231-8590-cd28c80b7760 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:54.774772 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0be80ee5-344b-4231-8590-cd28c80b7760 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:54.775487 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0be80ee5-344b-4231-8590-cd28c80b7760 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:54.775943 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0be80ee5-344b-4231-8590-cd28c80b7760 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:54.776367 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0be80ee5-344b-4231-8590-cd28c80b7760 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:54.855548 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:59:54.855862 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Wed Aug 10 12:59:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 (ip 10.222.0.49) !!! Aug 10 12:59:54.958187 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e724fb87-aea4-44e6-b6b9-64098f043d44 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:54.964531 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0be80ee5-344b-4231-8590-cd28c80b7760 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:54.966370 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e724fb87-aea4-44e6-b6b9-64098f043d44 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.221483 Aug 10 12:59:54.966961 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1176/2367] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:54 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:54.974433 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0be80ee5-344b-4231-8590-cd28c80b7760 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:54.976015 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0be80ee5-344b-4231-8590-cd28c80b7760 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:54.977211 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0be80ee5-344b-4231-8590-cd28c80b7760 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.214639 Aug 10 12:59:54.977949 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1192/2368] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:54 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:55.020410 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0b9faf05-d4bf-47fa-b4e0-bc327348b0ca tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:55.021099 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0b9faf05-d4bf-47fa-b4e0-bc327348b0ca tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:55.021726 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8e45bea4-456e-427a-a0d7-adbcde0314d4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:55.022350 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8e45bea4-456e-427a-a0d7-adbcde0314d4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:55.027350 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b9faf05-d4bf-47fa-b4e0-bc327348b0ca tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:55.027883 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b9faf05-d4bf-47fa-b4e0-bc327348b0ca tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:55.028322 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b9faf05-d4bf-47fa-b4e0-bc327348b0ca tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:55.028915 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8e45bea4-456e-427a-a0d7-adbcde0314d4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:55.029033 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b9faf05-d4bf-47fa-b4e0-bc327348b0ca tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:55.029407 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8e45bea4-456e-427a-a0d7-adbcde0314d4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:55.029528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b9faf05-d4bf-47fa-b4e0-bc327348b0ca tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:55.029849 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8e45bea4-456e-427a-a0d7-adbcde0314d4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:55.030633 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8e45bea4-456e-427a-a0d7-adbcde0314d4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:55.031091 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8e45bea4-456e-427a-a0d7-adbcde0314d4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:55.031552 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8e45bea4-456e-427a-a0d7-adbcde0314d4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:55.037370 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b9faf05-d4bf-47fa-b4e0-bc327348b0ca tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:55.237946 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-8e45bea4-456e-427a-a0d7-adbcde0314d4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:55.242088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0b9faf05-d4bf-47fa-b4e0-bc327348b0ca tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:55.246142 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8e45bea4-456e-427a-a0d7-adbcde0314d4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.228688 Aug 10 12:59:55.246725 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1193/2369] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:55 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:55.249996 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0b9faf05-d4bf-47fa-b4e0-bc327348b0ca tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.234149 Aug 10 12:59:55.250560 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1177/2370] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:55 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:55.988887 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0646872d-9138-49d1-bbfc-57611ba70887 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:55.989502 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0646872d-9138-49d1-bbfc-57611ba70887 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:55.995954 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0646872d-9138-49d1-bbfc-57611ba70887 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:55.996474 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0646872d-9138-49d1-bbfc-57611ba70887 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:55.996872 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0646872d-9138-49d1-bbfc-57611ba70887 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:55.997557 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0646872d-9138-49d1-bbfc-57611ba70887 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:55.998062 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0646872d-9138-49d1-bbfc-57611ba70887 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:55.998423 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0646872d-9138-49d1-bbfc-57611ba70887 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:56.001731 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-55ec4236-a9eb-4d49-bd62-e995e69c4efa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:56.002343 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-55ec4236-a9eb-4d49-bd62-e995e69c4efa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:56.009625 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55ec4236-a9eb-4d49-bd62-e995e69c4efa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:56.010110 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55ec4236-a9eb-4d49-bd62-e995e69c4efa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:56.010542 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55ec4236-a9eb-4d49-bd62-e995e69c4efa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:56.011255 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55ec4236-a9eb-4d49-bd62-e995e69c4efa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:56.011710 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55ec4236-a9eb-4d49-bd62-e995e69c4efa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:56.012133 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55ec4236-a9eb-4d49-bd62-e995e69c4efa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:56.201451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-55ec4236-a9eb-4d49-bd62-e995e69c4efa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:56.204332 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0646872d-9138-49d1-bbfc-57611ba70887 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:56.211159 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-55ec4236-a9eb-4d49-bd62-e995e69c4efa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:56.217306 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-55ec4236-a9eb-4d49-bd62-e995e69c4efa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:56.217481 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0646872d-9138-49d1-bbfc-57611ba70887 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.228354 Aug 10 12:59:56.217481 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1194/2371] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:55 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:56.217696 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-55ec4236-a9eb-4d49-bd62-e995e69c4efa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.216105 Aug 10 12:59:56.217696 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1178/2372] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:55 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:56.268585 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3ec163cf-cc2e-4a7b-8af5-ca611cbf9dfb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:56.269935 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3ec163cf-cc2e-4a7b-8af5-ca611cbf9dfb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:56.272037 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7802a3af-e86e-4001-885d-a1934ff2058b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:56.272655 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7802a3af-e86e-4001-885d-a1934ff2058b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:56.276204 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ec163cf-cc2e-4a7b-8af5-ca611cbf9dfb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:56.276906 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ec163cf-cc2e-4a7b-8af5-ca611cbf9dfb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:56.277537 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ec163cf-cc2e-4a7b-8af5-ca611cbf9dfb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:56.278256 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ec163cf-cc2e-4a7b-8af5-ca611cbf9dfb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:56.278554 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7802a3af-e86e-4001-885d-a1934ff2058b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:56.278700 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ec163cf-cc2e-4a7b-8af5-ca611cbf9dfb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:56.279040 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7802a3af-e86e-4001-885d-a1934ff2058b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:56.279335 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ec163cf-cc2e-4a7b-8af5-ca611cbf9dfb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:56.279528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7802a3af-e86e-4001-885d-a1934ff2058b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:56.280406 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7802a3af-e86e-4001-885d-a1934ff2058b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:56.280860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7802a3af-e86e-4001-885d-a1934ff2058b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:56.281527 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7802a3af-e86e-4001-885d-a1934ff2058b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:56.471601 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3ec163cf-cc2e-4a7b-8af5-ca611cbf9dfb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:56.475891 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7802a3af-e86e-4001-885d-a1934ff2058b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:56.480080 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3ec163cf-cc2e-4a7b-8af5-ca611cbf9dfb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.215407 Aug 10 12:59:56.480659 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1195/2373] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:56 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:56.484103 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7802a3af-e86e-4001-885d-a1934ff2058b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.216616 Aug 10 12:59:56.484665 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1179/2374] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:56 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:57.237006 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4b7dde9c-970e-4b68-b9e1-512256403fda tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:57.237626 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4b7dde9c-970e-4b68-b9e1-512256403fda tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:57.240941 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-af819b9d-b3fa-4ada-96b4-8b8c3c3ce967 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:57.241586 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-af819b9d-b3fa-4ada-96b4-8b8c3c3ce967 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:57.244766 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b7dde9c-970e-4b68-b9e1-512256403fda tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:57.245254 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b7dde9c-970e-4b68-b9e1-512256403fda tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:57.245685 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b7dde9c-970e-4b68-b9e1-512256403fda tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:57.246499 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b7dde9c-970e-4b68-b9e1-512256403fda tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:57.246951 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b7dde9c-970e-4b68-b9e1-512256403fda tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:57.247408 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4b7dde9c-970e-4b68-b9e1-512256403fda tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:57.247959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-af819b9d-b3fa-4ada-96b4-8b8c3c3ce967 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:57.248447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-af819b9d-b3fa-4ada-96b4-8b8c3c3ce967 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:57.248882 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-af819b9d-b3fa-4ada-96b4-8b8c3c3ce967 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:57.249563 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-af819b9d-b3fa-4ada-96b4-8b8c3c3ce967 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:57.250010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-af819b9d-b3fa-4ada-96b4-8b8c3c3ce967 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:57.250430 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-af819b9d-b3fa-4ada-96b4-8b8c3c3ce967 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:57.436409 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4b7dde9c-970e-4b68-b9e1-512256403fda tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:57.444926 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4b7dde9c-970e-4b68-b9e1-512256403fda tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.211825 Aug 10 12:59:57.445549 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1196/2375] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:57 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:57.449184 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-af819b9d-b3fa-4ada-96b4-8b8c3c3ce967 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:57.458198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-af819b9d-b3fa-4ada-96b4-8b8c3c3ce967 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:57.459714 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-af819b9d-b3fa-4ada-96b4-8b8c3c3ce967 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:57.460839 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-af819b9d-b3fa-4ada-96b4-8b8c3c3ce967 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.224619 Aug 10 12:59:57.461387 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1180/2376] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:57 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:57.501456 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8a29664c-eb6d-4f1e-acd1-09aca99ae20d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:57.502068 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8a29664c-eb6d-4f1e-acd1-09aca99ae20d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:57.504066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a19b5204-9afb-4955-a757-4cb2cadd8bf3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:57.504674 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a19b5204-9afb-4955-a757-4cb2cadd8bf3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:57.507970 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a29664c-eb6d-4f1e-acd1-09aca99ae20d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:57.508452 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a29664c-eb6d-4f1e-acd1-09aca99ae20d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:57.508884 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a29664c-eb6d-4f1e-acd1-09aca99ae20d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:57.509577 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a29664c-eb6d-4f1e-acd1-09aca99ae20d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:57.510031 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a29664c-eb6d-4f1e-acd1-09aca99ae20d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:57.510453 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a29664c-eb6d-4f1e-acd1-09aca99ae20d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:57.510565 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a19b5204-9afb-4955-a757-4cb2cadd8bf3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:57.510933 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a19b5204-9afb-4955-a757-4cb2cadd8bf3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:57.511401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a19b5204-9afb-4955-a757-4cb2cadd8bf3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:57.512087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a19b5204-9afb-4955-a757-4cb2cadd8bf3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:57.512539 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a19b5204-9afb-4955-a757-4cb2cadd8bf3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:57.512970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a19b5204-9afb-4955-a757-4cb2cadd8bf3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:57.921729 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a19b5204-9afb-4955-a757-4cb2cadd8bf3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:57.925717 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-8a29664c-eb6d-4f1e-acd1-09aca99ae20d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:57.930248 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a19b5204-9afb-4955-a757-4cb2cadd8bf3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.429805 Aug 10 12:59:57.930824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1181/2377] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:57 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:57.933660 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8a29664c-eb6d-4f1e-acd1-09aca99ae20d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.436230 Aug 10 12:59:57.934224 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1197/2378] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:57 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:58.466465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7823eae0-857e-4f39-9bbb-551b5d405806 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:58.467014 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7823eae0-857e-4f39-9bbb-551b5d405806 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:58.473997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7823eae0-857e-4f39-9bbb-551b5d405806 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:58.474480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7823eae0-857e-4f39-9bbb-551b5d405806 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:58.474915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7823eae0-857e-4f39-9bbb-551b5d405806 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:58.475622 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7823eae0-857e-4f39-9bbb-551b5d405806 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:58.476076 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7823eae0-857e-4f39-9bbb-551b5d405806 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:58.476512 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7823eae0-857e-4f39-9bbb-551b5d405806 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:58.484255 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-98fe311b-6cbf-4991-a17d-7aa2cb66ce58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:58.484873 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-98fe311b-6cbf-4991-a17d-7aa2cb66ce58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:58.491915 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-98fe311b-6cbf-4991-a17d-7aa2cb66ce58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:58.492395 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-98fe311b-6cbf-4991-a17d-7aa2cb66ce58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:58.492823 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-98fe311b-6cbf-4991-a17d-7aa2cb66ce58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:58.493511 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-98fe311b-6cbf-4991-a17d-7aa2cb66ce58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:58.494597 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-98fe311b-6cbf-4991-a17d-7aa2cb66ce58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:58.495030 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-98fe311b-6cbf-4991-a17d-7aa2cb66ce58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:58.517268 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 12:59:58.517426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Wed Aug 10 12:59:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a (ip 10.222.0.49) !!! Aug 10 12:59:58.680689 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7823eae0-857e-4f39-9bbb-551b5d405806 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:58.683862 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-98fe311b-6cbf-4991-a17d-7aa2cb66ce58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:58.688696 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7823eae0-857e-4f39-9bbb-551b5d405806 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.226150 Aug 10 12:59:58.689273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1182/2379] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:58 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:58.692403 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-98fe311b-6cbf-4991-a17d-7aa2cb66ce58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:58.693896 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-98fe311b-6cbf-4991-a17d-7aa2cb66ce58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:58.695064 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-98fe311b-6cbf-4991-a17d-7aa2cb66ce58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.214630 Aug 10 12:59:58.695747 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1198/2380] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:58 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 12:59:58.952014 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3b38a09d-71d2-4367-a204-1e1020e43e30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:58.952615 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3b38a09d-71d2-4367-a204-1e1020e43e30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:58.955026 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-55959785-b9d7-4b89-8bfd-2a3426653b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:58.955668 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-55959785-b9d7-4b89-8bfd-2a3426653b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:58.959262 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3b38a09d-71d2-4367-a204-1e1020e43e30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:58.959736 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3b38a09d-71d2-4367-a204-1e1020e43e30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:58.960167 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3b38a09d-71d2-4367-a204-1e1020e43e30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:58.960858 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3b38a09d-71d2-4367-a204-1e1020e43e30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:58.961302 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3b38a09d-71d2-4367-a204-1e1020e43e30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:58.961714 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3b38a09d-71d2-4367-a204-1e1020e43e30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:58.962341 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-55959785-b9d7-4b89-8bfd-2a3426653b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:58.962826 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-55959785-b9d7-4b89-8bfd-2a3426653b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:58.963284 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-55959785-b9d7-4b89-8bfd-2a3426653b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:58.963975 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-55959785-b9d7-4b89-8bfd-2a3426653b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:58.964425 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-55959785-b9d7-4b89-8bfd-2a3426653b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:58.964847 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-55959785-b9d7-4b89-8bfd-2a3426653b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:59.158576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3b38a09d-71d2-4367-a204-1e1020e43e30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:59.162102 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-55959785-b9d7-4b89-8bfd-2a3426653b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:59.166732 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3b38a09d-71d2-4367-a204-1e1020e43e30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.218617 Aug 10 12:59:59.167325 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1183/2381] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:58 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:59.169970 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-55959785-b9d7-4b89-8bfd-2a3426653b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.218678 Aug 10 12:59:59.170551 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1199/2382] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:58 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 12:59:59.710420 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-625af1cf-f9a2-4f5e-802b-4aa73b29c5ba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:59.712629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-625af1cf-f9a2-4f5e-802b-4aa73b29c5ba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:59.713471 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=98 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 12:59:59.717750 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5c64d7f0-befa-4ee4-a5e3-dd16bfead7ff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 12:59:59.718206 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-625af1cf-f9a2-4f5e-802b-4aa73b29c5ba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:59.718341 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5c64d7f0-befa-4ee4-a5e3-dd16bfead7ff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 12:59:59.718625 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-625af1cf-f9a2-4f5e-802b-4aa73b29c5ba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:59.719059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-625af1cf-f9a2-4f5e-802b-4aa73b29c5ba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:59.719784 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-625af1cf-f9a2-4f5e-802b-4aa73b29c5ba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:59.720238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-625af1cf-f9a2-4f5e-802b-4aa73b29c5ba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:59.720685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-625af1cf-f9a2-4f5e-802b-4aa73b29c5ba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:59.725119 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c64d7f0-befa-4ee4-a5e3-dd16bfead7ff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:59.729373 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c64d7f0-befa-4ee4-a5e3-dd16bfead7ff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:59.729373 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c64d7f0-befa-4ee4-a5e3-dd16bfead7ff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:59.729373 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c64d7f0-befa-4ee4-a5e3-dd16bfead7ff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 12:59:59.729373 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c64d7f0-befa-4ee4-a5e3-dd16bfead7ff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 12:59:59.729793 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c64d7f0-befa-4ee4-a5e3-dd16bfead7ff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 12:59:59.915303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-625af1cf-f9a2-4f5e-802b-4aa73b29c5ba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:59.918458 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5c64d7f0-befa-4ee4-a5e3-dd16bfead7ff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:59.923434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-625af1cf-f9a2-4f5e-802b-4aa73b29c5ba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.217463 Aug 10 12:59:59.924007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1184/2383] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 12:59:59 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 12:59:59.927464 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5c64d7f0-befa-4ee4-a5e3-dd16bfead7ff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:59.928951 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5c64d7f0-befa-4ee4-a5e3-dd16bfead7ff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 12:59:59.930099 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5c64d7f0-befa-4ee4-a5e3-dd16bfead7ff tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.216184 Aug 10 12:59:59.930641 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1200/2384] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 12:59:59 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:00:00.188853 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4b27479d-276c-4cb7-8989-4db7a4782fe6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:00.189492 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4b27479d-276c-4cb7-8989-4db7a4782fe6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:00.192439 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e807a06b-04b9-48e1-8d57-0e6f37f89379 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:00.193046 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e807a06b-04b9-48e1-8d57-0e6f37f89379 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:00.196105 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b27479d-276c-4cb7-8989-4db7a4782fe6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:00.196585 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b27479d-276c-4cb7-8989-4db7a4782fe6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:00.197015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b27479d-276c-4cb7-8989-4db7a4782fe6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:00.197704 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b27479d-276c-4cb7-8989-4db7a4782fe6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:00.198153 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b27479d-276c-4cb7-8989-4db7a4782fe6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:00.198575 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b27479d-276c-4cb7-8989-4db7a4782fe6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:00.198800 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e807a06b-04b9-48e1-8d57-0e6f37f89379 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:00.199313 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e807a06b-04b9-48e1-8d57-0e6f37f89379 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:00.199773 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e807a06b-04b9-48e1-8d57-0e6f37f89379 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:00.200455 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e807a06b-04b9-48e1-8d57-0e6f37f89379 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:00.200902 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e807a06b-04b9-48e1-8d57-0e6f37f89379 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:00.201317 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e807a06b-04b9-48e1-8d57-0e6f37f89379 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:00.203832 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:00:00.394353 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4b27479d-276c-4cb7-8989-4db7a4782fe6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:00.398999 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e807a06b-04b9-48e1-8d57-0e6f37f89379 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:00.402537 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4b27479d-276c-4cb7-8989-4db7a4782fe6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.217479 Aug 10 13:00:00.403119 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1185/2385] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:00 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:00.407135 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e807a06b-04b9-48e1-8d57-0e6f37f89379 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.219566 Aug 10 13:00:00.407739 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1201/2386] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:00 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:00.944607 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-80473b4d-f2ac-400b-b7e6-b9a94446092b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:00.945224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-80473b4d-f2ac-400b-b7e6-b9a94446092b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:00.951549 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80473b4d-f2ac-400b-b7e6-b9a94446092b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:00.955018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80473b4d-f2ac-400b-b7e6-b9a94446092b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:00.955018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80473b4d-f2ac-400b-b7e6-b9a94446092b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:00.955258 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-56ee7f13-79bc-4c49-9aa4-32a292ac4662 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:00.955680 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80473b4d-f2ac-400b-b7e6-b9a94446092b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:00.955784 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-56ee7f13-79bc-4c49-9aa4-32a292ac4662 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:00.955906 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80473b4d-f2ac-400b-b7e6-b9a94446092b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:00.955906 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80473b4d-f2ac-400b-b7e6-b9a94446092b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:00.960031 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56ee7f13-79bc-4c49-9aa4-32a292ac4662 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:00.960517 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56ee7f13-79bc-4c49-9aa4-32a292ac4662 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:00.960947 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56ee7f13-79bc-4c49-9aa4-32a292ac4662 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:00.961636 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56ee7f13-79bc-4c49-9aa4-32a292ac4662 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:00.962084 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56ee7f13-79bc-4c49-9aa4-32a292ac4662 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:00.962547 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56ee7f13-79bc-4c49-9aa4-32a292ac4662 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:01.153635 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-80473b4d-f2ac-400b-b7e6-b9a94446092b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:01.156787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-56ee7f13-79bc-4c49-9aa4-32a292ac4662 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:01.161957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-80473b4d-f2ac-400b-b7e6-b9a94446092b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.221535 Aug 10 13:00:01.162547 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1186/2387] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:00 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:01.165435 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-56ee7f13-79bc-4c49-9aa4-32a292ac4662 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:01.166921 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-56ee7f13-79bc-4c49-9aa4-32a292ac4662 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:01.168166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-56ee7f13-79bc-4c49-9aa4-32a292ac4662 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.219394 Aug 10 13:00:01.168712 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1202/2388] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:00 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:01.423532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e98b3091-3c64-4fc7-864c-6d559c461fad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:01.424135 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e98b3091-3c64-4fc7-864c-6d559c461fad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:01.428327 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bb7f68c5-26c1-4f6e-8ffd-15789b850ec4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:01.428936 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bb7f68c5-26c1-4f6e-8ffd-15789b850ec4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:01.430577 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e98b3091-3c64-4fc7-864c-6d559c461fad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:01.431062 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e98b3091-3c64-4fc7-864c-6d559c461fad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:01.431535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e98b3091-3c64-4fc7-864c-6d559c461fad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:01.432223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e98b3091-3c64-4fc7-864c-6d559c461fad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:01.432669 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e98b3091-3c64-4fc7-864c-6d559c461fad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:01.433092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e98b3091-3c64-4fc7-864c-6d559c461fad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:01.434712 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb7f68c5-26c1-4f6e-8ffd-15789b850ec4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:01.435213 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb7f68c5-26c1-4f6e-8ffd-15789b850ec4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:01.435643 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb7f68c5-26c1-4f6e-8ffd-15789b850ec4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:01.436319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb7f68c5-26c1-4f6e-8ffd-15789b850ec4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:01.436779 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb7f68c5-26c1-4f6e-8ffd-15789b850ec4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:01.437195 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb7f68c5-26c1-4f6e-8ffd-15789b850ec4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:01.477572 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:00:01.477774 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Wed Aug 10 13:00:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 (ip 10.222.0.49) !!! Aug 10 13:00:01.628271 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e98b3091-3c64-4fc7-864c-6d559c461fad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:01.632044 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-bb7f68c5-26c1-4f6e-8ffd-15789b850ec4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:01.636457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e98b3091-3c64-4fc7-864c-6d559c461fad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.216774 Aug 10 13:00:01.637038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1187/2389] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:01 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:01.639942 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bb7f68c5-26c1-4f6e-8ffd-15789b850ec4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.216158 Aug 10 13:00:01.640497 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1203/2390] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:01 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:02.183831 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9158dd7d-e648-4ba9-b479-0e68f4174dfc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:02.184442 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9158dd7d-e648-4ba9-b479-0e68f4174dfc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:02.190305 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-09f5dae0-aa3b-4ad3-8afe-236b0a0d915e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:02.190871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9158dd7d-e648-4ba9-b479-0e68f4174dfc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:02.191008 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-09f5dae0-aa3b-4ad3-8afe-236b0a0d915e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:02.191418 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9158dd7d-e648-4ba9-b479-0e68f4174dfc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:02.192064 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9158dd7d-e648-4ba9-b479-0e68f4174dfc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:02.192798 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9158dd7d-e648-4ba9-b479-0e68f4174dfc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:02.193254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9158dd7d-e648-4ba9-b479-0e68f4174dfc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:02.193676 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9158dd7d-e648-4ba9-b479-0e68f4174dfc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:02.197367 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09f5dae0-aa3b-4ad3-8afe-236b0a0d915e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:02.197841 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09f5dae0-aa3b-4ad3-8afe-236b0a0d915e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:02.198270 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09f5dae0-aa3b-4ad3-8afe-236b0a0d915e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:02.198955 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09f5dae0-aa3b-4ad3-8afe-236b0a0d915e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:02.199432 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09f5dae0-aa3b-4ad3-8afe-236b0a0d915e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:02.199854 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09f5dae0-aa3b-4ad3-8afe-236b0a0d915e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:02.386382 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9158dd7d-e648-4ba9-b479-0e68f4174dfc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:02.395840 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-09f5dae0-aa3b-4ad3-8afe-236b0a0d915e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:02.396028 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9158dd7d-e648-4ba9-b479-0e68f4174dfc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.215960 Aug 10 13:00:02.396945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1188/2391] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:02 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:02.406266 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-09f5dae0-aa3b-4ad3-8afe-236b0a0d915e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:02.407816 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-09f5dae0-aa3b-4ad3-8afe-236b0a0d915e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:02.409015 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-09f5dae0-aa3b-4ad3-8afe-236b0a0d915e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.222606 Aug 10 13:00:02.409570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1204/2392] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:02 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:02.657896 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-484613e1-18c1-4955-8481-a2d4bc0d6a14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:02.658432 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-484613e1-18c1-4955-8481-a2d4bc0d6a14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:02.659991 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b2e37356-b2fa-4802-b1ff-f705d6649632 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:02.660753 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b2e37356-b2fa-4802-b1ff-f705d6649632 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:02.664630 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-484613e1-18c1-4955-8481-a2d4bc0d6a14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:02.665172 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-484613e1-18c1-4955-8481-a2d4bc0d6a14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:02.665538 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-484613e1-18c1-4955-8481-a2d4bc0d6a14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:02.666224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-484613e1-18c1-4955-8481-a2d4bc0d6a14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:02.666615 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2e37356-b2fa-4802-b1ff-f705d6649632 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:02.666739 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-484613e1-18c1-4955-8481-a2d4bc0d6a14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:02.667081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-484613e1-18c1-4955-8481-a2d4bc0d6a14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:02.667223 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2e37356-b2fa-4802-b1ff-f705d6649632 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:02.667548 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2e37356-b2fa-4802-b1ff-f705d6649632 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:02.668221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2e37356-b2fa-4802-b1ff-f705d6649632 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:02.668671 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2e37356-b2fa-4802-b1ff-f705d6649632 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:02.669090 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2e37356-b2fa-4802-b1ff-f705d6649632 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:02.859697 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-484613e1-18c1-4955-8481-a2d4bc0d6a14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:02.867416 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b2e37356-b2fa-4802-b1ff-f705d6649632 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:02.868103 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-484613e1-18c1-4955-8481-a2d4bc0d6a14 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.214207 Aug 10 13:00:02.868686 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1189/2393] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:02 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:02.875659 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b2e37356-b2fa-4802-b1ff-f705d6649632 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.219507 Aug 10 13:00:02.876222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1205/2394] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:02 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:03.417254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-087f7997-f654-49a5-857b-b59f27e6b7fb tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:03.417854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-087f7997-f654-49a5-857b-b59f27e6b7fb tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:03.424360 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-087f7997-f654-49a5-857b-b59f27e6b7fb tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:03.424873 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-087f7997-f654-49a5-857b-b59f27e6b7fb tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:03.425397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-087f7997-f654-49a5-857b-b59f27e6b7fb tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:03.426314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-087f7997-f654-49a5-857b-b59f27e6b7fb tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:03.426763 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-087f7997-f654-49a5-857b-b59f27e6b7fb tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:03.427193 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-087f7997-f654-49a5-857b-b59f27e6b7fb tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:03.429961 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:00:03.432197 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b2f418f8-b82f-4b66-984a-648dbab95ded tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:03.432814 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b2f418f8-b82f-4b66-984a-648dbab95ded tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:03.439046 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2f418f8-b82f-4b66-984a-648dbab95ded tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:03.439569 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2f418f8-b82f-4b66-984a-648dbab95ded tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:03.440006 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2f418f8-b82f-4b66-984a-648dbab95ded tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:03.440785 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2f418f8-b82f-4b66-984a-648dbab95ded tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:03.441222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2f418f8-b82f-4b66-984a-648dbab95ded tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:03.441911 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b2f418f8-b82f-4b66-984a-648dbab95ded tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:03.624346 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-087f7997-f654-49a5-857b-b59f27e6b7fb tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:03.632453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-087f7997-f654-49a5-857b-b59f27e6b7fb tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.219094 Aug 10 13:00:03.633099 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1190/2395] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:03 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:03.635261 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b2f418f8-b82f-4b66-984a-648dbab95ded tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:03.643615 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b2f418f8-b82f-4b66-984a-648dbab95ded tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:03.645774 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b2f418f8-b82f-4b66-984a-648dbab95ded tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:03.646965 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b2f418f8-b82f-4b66-984a-648dbab95ded tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.218707 Aug 10 13:00:03.647546 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1206/2396] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:03 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:03.890499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fdbc7e99-70b8-4285-8d97-b12ef7d30836 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:03.891026 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fdbc7e99-70b8-4285-8d97-b12ef7d30836 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:03.896981 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a2c50346-516c-472c-b70a-9dd6e0c8fbae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:03.897378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdbc7e99-70b8-4285-8d97-b12ef7d30836 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:03.897593 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a2c50346-516c-472c-b70a-9dd6e0c8fbae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:03.897853 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdbc7e99-70b8-4285-8d97-b12ef7d30836 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:03.898287 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdbc7e99-70b8-4285-8d97-b12ef7d30836 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:03.898973 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdbc7e99-70b8-4285-8d97-b12ef7d30836 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:03.899446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdbc7e99-70b8-4285-8d97-b12ef7d30836 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:03.899871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdbc7e99-70b8-4285-8d97-b12ef7d30836 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:03.903492 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2c50346-516c-472c-b70a-9dd6e0c8fbae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:03.903977 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2c50346-516c-472c-b70a-9dd6e0c8fbae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:03.904409 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2c50346-516c-472c-b70a-9dd6e0c8fbae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:03.905092 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2c50346-516c-472c-b70a-9dd6e0c8fbae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:03.905540 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2c50346-516c-472c-b70a-9dd6e0c8fbae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:03.905962 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2c50346-516c-472c-b70a-9dd6e0c8fbae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:04.093996 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fdbc7e99-70b8-4285-8d97-b12ef7d30836 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:04.098117 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a2c50346-516c-472c-b70a-9dd6e0c8fbae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:04.102780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fdbc7e99-70b8-4285-8d97-b12ef7d30836 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.216157 Aug 10 13:00:04.103389 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1191/2397] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:03 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:04.106516 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a2c50346-516c-472c-b70a-9dd6e0c8fbae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.213391 Aug 10 13:00:04.107076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1207/2398] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:03 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:04.654444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2cce0350-c204-4edf-80f9-619feb345e1e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:04.655074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2cce0350-c204-4edf-80f9-619feb345e1e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:04.662641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2cce0350-c204-4edf-80f9-619feb345e1e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:04.663361 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2cce0350-c204-4edf-80f9-619feb345e1e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:04.663909 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2cce0350-c204-4edf-80f9-619feb345e1e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:04.664905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2cce0350-c204-4edf-80f9-619feb345e1e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:04.665158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2cce0350-c204-4edf-80f9-619feb345e1e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:04.665796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2cce0350-c204-4edf-80f9-619feb345e1e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:04.670131 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d7e668f4-31c0-4a72-9b84-a99cff079462 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:04.670948 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d7e668f4-31c0-4a72-9b84-a99cff079462 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:04.677643 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7e668f4-31c0-4a72-9b84-a99cff079462 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:04.678132 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7e668f4-31c0-4a72-9b84-a99cff079462 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:04.678569 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7e668f4-31c0-4a72-9b84-a99cff079462 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:04.679289 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7e668f4-31c0-4a72-9b84-a99cff079462 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:04.679743 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7e668f4-31c0-4a72-9b84-a99cff079462 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:04.680354 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7e668f4-31c0-4a72-9b84-a99cff079462 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:04.882638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2cce0350-c204-4edf-80f9-619feb345e1e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:04.886895 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d7e668f4-31c0-4a72-9b84-a99cff079462 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:04.892060 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2cce0350-c204-4edf-80f9-619feb345e1e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.241542 Aug 10 13:00:04.892741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1192/2399] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:04 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:04.898122 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d7e668f4-31c0-4a72-9b84-a99cff079462 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:04.899925 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d7e668f4-31c0-4a72-9b84-a99cff079462 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:04.901139 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d7e668f4-31c0-4a72-9b84-a99cff079462 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.235156 Aug 10 13:00:04.901706 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1208/2400] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:04 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:05.125198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-cd443e32-388c-4f76-837d-3dfb3929c87d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:05.125750 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-cd443e32-388c-4f76-837d-3dfb3929c87d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:05.128139 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-de3d7ca2-877a-4f6e-bc47-a8b34fd95327 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:05.129686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-de3d7ca2-877a-4f6e-bc47-a8b34fd95327 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:05.132379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd443e32-388c-4f76-837d-3dfb3929c87d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:05.132852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd443e32-388c-4f76-837d-3dfb3929c87d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:05.133285 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd443e32-388c-4f76-837d-3dfb3929c87d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:05.133969 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd443e32-388c-4f76-837d-3dfb3929c87d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:05.134418 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd443e32-388c-4f76-837d-3dfb3929c87d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:05.134834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd443e32-388c-4f76-837d-3dfb3929c87d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:05.135212 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-de3d7ca2-877a-4f6e-bc47-a8b34fd95327 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:05.135698 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-de3d7ca2-877a-4f6e-bc47-a8b34fd95327 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:05.136133 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-de3d7ca2-877a-4f6e-bc47-a8b34fd95327 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:05.136815 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-de3d7ca2-877a-4f6e-bc47-a8b34fd95327 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:05.137266 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-de3d7ca2-877a-4f6e-bc47-a8b34fd95327 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:05.137686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-de3d7ca2-877a-4f6e-bc47-a8b34fd95327 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:05.338437 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-cd443e32-388c-4f76-837d-3dfb3929c87d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:05.341255 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-de3d7ca2-877a-4f6e-bc47-a8b34fd95327 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:05.346405 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-cd443e32-388c-4f76-837d-3dfb3929c87d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.225104 Aug 10 13:00:05.347225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1193/2401] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:05 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:05.349418 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-de3d7ca2-877a-4f6e-bc47-a8b34fd95327 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.225090 Aug 10 13:00:05.349995 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1209/2402] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:05 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:05.918681 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b07ae60f-929a-4cda-b693-af0cff1487c5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:05.919250 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b07ae60f-929a-4cda-b693-af0cff1487c5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:05.923881 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-be215e45-87c4-4c54-a64c-45b5c472bc56 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:05.924493 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-be215e45-87c4-4c54-a64c-45b5c472bc56 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:05.926128 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b07ae60f-929a-4cda-b693-af0cff1487c5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:05.926746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b07ae60f-929a-4cda-b693-af0cff1487c5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:05.927198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b07ae60f-929a-4cda-b693-af0cff1487c5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:05.927905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b07ae60f-929a-4cda-b693-af0cff1487c5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:05.928356 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b07ae60f-929a-4cda-b693-af0cff1487c5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:05.928778 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b07ae60f-929a-4cda-b693-af0cff1487c5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:05.931422 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-be215e45-87c4-4c54-a64c-45b5c472bc56 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:05.931902 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-be215e45-87c4-4c54-a64c-45b5c472bc56 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:05.932346 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-be215e45-87c4-4c54-a64c-45b5c472bc56 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:05.933006 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-be215e45-87c4-4c54-a64c-45b5c472bc56 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:05.933448 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-be215e45-87c4-4c54-a64c-45b5c472bc56 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:05.933865 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-be215e45-87c4-4c54-a64c-45b5c472bc56 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:06.113912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b07ae60f-929a-4cda-b693-af0cff1487c5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:06.121823 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b07ae60f-929a-4cda-b693-af0cff1487c5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.207073 Aug 10 13:00:06.122392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1194/2403] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:05 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:06.127863 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-be215e45-87c4-4c54-a64c-45b5c472bc56 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:06.136965 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-be215e45-87c4-4c54-a64c-45b5c472bc56 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:06.138481 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-be215e45-87c4-4c54-a64c-45b5c472bc56 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:06.139656 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-be215e45-87c4-4c54-a64c-45b5c472bc56 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.219617 Aug 10 13:00:06.140206 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1210/2404] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:05 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:06.368643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1e74e786-f8e5-493e-95d8-707904d9cb71 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:06.369474 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1e74e786-f8e5-493e-95d8-707904d9cb71 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:06.369766 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-75a972c0-3f16-406b-9fa5-af7e25ca9586 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:06.370379 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-75a972c0-3f16-406b-9fa5-af7e25ca9586 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:06.375477 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1e74e786-f8e5-493e-95d8-707904d9cb71 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:06.375957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1e74e786-f8e5-493e-95d8-707904d9cb71 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:06.376205 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-75a972c0-3f16-406b-9fa5-af7e25ca9586 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:06.376393 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1e74e786-f8e5-493e-95d8-707904d9cb71 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:06.376706 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-75a972c0-3f16-406b-9fa5-af7e25ca9586 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:06.377086 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1e74e786-f8e5-493e-95d8-707904d9cb71 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:06.377204 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-75a972c0-3f16-406b-9fa5-af7e25ca9586 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:06.377538 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1e74e786-f8e5-493e-95d8-707904d9cb71 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:06.377805 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-75a972c0-3f16-406b-9fa5-af7e25ca9586 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:06.377960 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1e74e786-f8e5-493e-95d8-707904d9cb71 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:06.378255 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-75a972c0-3f16-406b-9fa5-af7e25ca9586 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:06.378767 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-75a972c0-3f16-406b-9fa5-af7e25ca9586 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:06.568943 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-75a972c0-3f16-406b-9fa5-af7e25ca9586 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:06.573003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1e74e786-f8e5-493e-95d8-707904d9cb71 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:06.576934 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-75a972c0-3f16-406b-9fa5-af7e25ca9586 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.210868 Aug 10 13:00:06.577508 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1211/2405] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:06 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:06.580819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1e74e786-f8e5-493e-95d8-707904d9cb71 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.216092 Aug 10 13:00:06.582058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1195/2406] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:06 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:07.143599 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-78bf8891-64d4-4242-8b6c-a8ca93928d9e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:07.144239 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-78bf8891-64d4-4242-8b6c-a8ca93928d9e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:07.146676 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=98 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:00:07.151339 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-78bf8891-64d4-4242-8b6c-a8ca93928d9e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:07.151811 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-78bf8891-64d4-4242-8b6c-a8ca93928d9e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:07.152239 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-78bf8891-64d4-4242-8b6c-a8ca93928d9e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:07.152914 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-78bf8891-64d4-4242-8b6c-a8ca93928d9e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:07.153360 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-78bf8891-64d4-4242-8b6c-a8ca93928d9e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:07.153776 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-78bf8891-64d4-4242-8b6c-a8ca93928d9e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:07.161862 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-14b95aa6-2f20-4866-89db-92eeae869e58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:07.162496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-14b95aa6-2f20-4866-89db-92eeae869e58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:07.168810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-14b95aa6-2f20-4866-89db-92eeae869e58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:07.169292 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-14b95aa6-2f20-4866-89db-92eeae869e58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:07.169723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-14b95aa6-2f20-4866-89db-92eeae869e58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:07.170404 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-14b95aa6-2f20-4866-89db-92eeae869e58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:07.170846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-14b95aa6-2f20-4866-89db-92eeae869e58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:07.171287 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-14b95aa6-2f20-4866-89db-92eeae869e58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:07.352876 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-78bf8891-64d4-4242-8b6c-a8ca93928d9e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:07.356354 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-14b95aa6-2f20-4866-89db-92eeae869e58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:07.361233 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-78bf8891-64d4-4242-8b6c-a8ca93928d9e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.221448 Aug 10 13:00:07.361808 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1212/2407] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:07 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:07.365339 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-14b95aa6-2f20-4866-89db-92eeae869e58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:07.366843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-14b95aa6-2f20-4866-89db-92eeae869e58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:07.368103 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-14b95aa6-2f20-4866-89db-92eeae869e58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.210267 Aug 10 13:00:07.368684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1196/2408] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:07 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:07.598092 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e1fc7126-97c3-4f8b-b8cd-6717fb6db21b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:07.598855 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e1fc7126-97c3-4f8b-b8cd-6717fb6db21b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:07.602053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4e4c1ba9-5bc4-46a5-bbe9-40d751999ebf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:07.602655 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4e4c1ba9-5bc4-46a5-bbe9-40d751999ebf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:07.605124 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1fc7126-97c3-4f8b-b8cd-6717fb6db21b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:07.605613 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1fc7126-97c3-4f8b-b8cd-6717fb6db21b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:07.606047 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1fc7126-97c3-4f8b-b8cd-6717fb6db21b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:07.606736 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1fc7126-97c3-4f8b-b8cd-6717fb6db21b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:07.607211 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1fc7126-97c3-4f8b-b8cd-6717fb6db21b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:07.607704 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1fc7126-97c3-4f8b-b8cd-6717fb6db21b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:07.608796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e4c1ba9-5bc4-46a5-bbe9-40d751999ebf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:07.609268 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e4c1ba9-5bc4-46a5-bbe9-40d751999ebf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:07.609691 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e4c1ba9-5bc4-46a5-bbe9-40d751999ebf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:07.610366 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e4c1ba9-5bc4-46a5-bbe9-40d751999ebf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:07.610812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e4c1ba9-5bc4-46a5-bbe9-40d751999ebf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:07.611244 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e4c1ba9-5bc4-46a5-bbe9-40d751999ebf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:07.814866 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e1fc7126-97c3-4f8b-b8cd-6717fb6db21b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:07.819376 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4e4c1ba9-5bc4-46a5-bbe9-40d751999ebf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:07.823545 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e1fc7126-97c3-4f8b-b8cd-6717fb6db21b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.229202 Aug 10 13:00:07.824128 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1213/2409] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:07 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:07.828025 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4e4c1ba9-5bc4-46a5-bbe9-40d751999ebf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.229681 Aug 10 13:00:07.828591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1197/2410] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:07 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:08.382804 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0d7f0b2b-7d0b-4830-ba70-0b33b3c74ee5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:08.383408 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0d7f0b2b-7d0b-4830-ba70-0b33b3c74ee5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:08.390006 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0d7f0b2b-7d0b-4830-ba70-0b33b3c74ee5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:08.390531 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0d7f0b2b-7d0b-4830-ba70-0b33b3c74ee5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:08.390972 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0d7f0b2b-7d0b-4830-ba70-0b33b3c74ee5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:08.391318 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-708c7a50-68cc-4017-ad2d-6ba69e5323f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:08.391763 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0d7f0b2b-7d0b-4830-ba70-0b33b3c74ee5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:08.391928 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-708c7a50-68cc-4017-ad2d-6ba69e5323f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:08.392133 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0d7f0b2b-7d0b-4830-ba70-0b33b3c74ee5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:08.392619 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0d7f0b2b-7d0b-4830-ba70-0b33b3c74ee5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:08.399006 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-708c7a50-68cc-4017-ad2d-6ba69e5323f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:08.399515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-708c7a50-68cc-4017-ad2d-6ba69e5323f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:08.399949 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-708c7a50-68cc-4017-ad2d-6ba69e5323f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:08.400640 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-708c7a50-68cc-4017-ad2d-6ba69e5323f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:08.401093 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-708c7a50-68cc-4017-ad2d-6ba69e5323f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:08.401517 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-708c7a50-68cc-4017-ad2d-6ba69e5323f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:08.589128 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0d7f0b2b-7d0b-4830-ba70-0b33b3c74ee5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:08.593075 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-708c7a50-68cc-4017-ad2d-6ba69e5323f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:08.597283 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0d7f0b2b-7d0b-4830-ba70-0b33b3c74ee5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.218894 Aug 10 13:00:08.598079 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1214/2411] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:08 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:08.601777 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-708c7a50-68cc-4017-ad2d-6ba69e5323f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:08.603310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-708c7a50-68cc-4017-ad2d-6ba69e5323f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:08.604723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-708c7a50-68cc-4017-ad2d-6ba69e5323f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.217311 Aug 10 13:00:08.605268 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1198/2412] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:08 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:08.846204 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-60a8181a-778a-4197-b10d-c7223cd9162c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:08.846847 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-60a8181a-778a-4197-b10d-c7223cd9162c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:08.849927 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b32b2511-61b6-4367-bbc0-e73cd585a59d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:08.850554 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b32b2511-61b6-4367-bbc0-e73cd585a59d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:08.853472 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60a8181a-778a-4197-b10d-c7223cd9162c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:08.854340 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60a8181a-778a-4197-b10d-c7223cd9162c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:08.854769 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60a8181a-778a-4197-b10d-c7223cd9162c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:08.855559 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60a8181a-778a-4197-b10d-c7223cd9162c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:08.856008 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60a8181a-778a-4197-b10d-c7223cd9162c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:08.856426 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-60a8181a-778a-4197-b10d-c7223cd9162c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:08.856948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b32b2511-61b6-4367-bbc0-e73cd585a59d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:08.857432 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b32b2511-61b6-4367-bbc0-e73cd585a59d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:08.857869 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b32b2511-61b6-4367-bbc0-e73cd585a59d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:08.858595 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b32b2511-61b6-4367-bbc0-e73cd585a59d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:08.859053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b32b2511-61b6-4367-bbc0-e73cd585a59d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:08.859510 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b32b2511-61b6-4367-bbc0-e73cd585a59d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:09.047387 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-60a8181a-778a-4197-b10d-c7223cd9162c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:09.050616 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b32b2511-61b6-4367-bbc0-e73cd585a59d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:09.051760 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-60a8181a-778a-4197-b10d-c7223cd9162c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.210112 Aug 10 13:00:09.053016 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1215/2413] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:08 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:09.059499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b32b2511-61b6-4367-bbc0-e73cd585a59d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.214864 Aug 10 13:00:09.060065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1199/2414] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:08 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:09.618133 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ee104c0e-20cd-423f-a6e1-3e373b871783 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:09.618749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ee104c0e-20cd-423f-a6e1-3e373b871783 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:09.625191 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee104c0e-20cd-423f-a6e1-3e373b871783 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:09.625675 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee104c0e-20cd-423f-a6e1-3e373b871783 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:09.626113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee104c0e-20cd-423f-a6e1-3e373b871783 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:09.626800 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee104c0e-20cd-423f-a6e1-3e373b871783 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:09.627274 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee104c0e-20cd-423f-a6e1-3e373b871783 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:09.627491 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-93292179-3f78-484a-98c3-886261167669 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:09.627913 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee104c0e-20cd-423f-a6e1-3e373b871783 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:09.628095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-93292179-3f78-484a-98c3-886261167669 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:09.634423 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93292179-3f78-484a-98c3-886261167669 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:09.634915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93292179-3f78-484a-98c3-886261167669 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:09.635391 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93292179-3f78-484a-98c3-886261167669 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:09.636065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93292179-3f78-484a-98c3-886261167669 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:09.636512 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93292179-3f78-484a-98c3-886261167669 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:09.636923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93292179-3f78-484a-98c3-886261167669 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:09.820084 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ee104c0e-20cd-423f-a6e1-3e373b871783 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:09.826769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-93292179-3f78-484a-98c3-886261167669 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:09.829054 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ee104c0e-20cd-423f-a6e1-3e373b871783 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.214838 Aug 10 13:00:09.829819 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1216/2415] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:09 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:09.836670 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-93292179-3f78-484a-98c3-886261167669 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:09.838167 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-93292179-3f78-484a-98c3-886261167669 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:09.839371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-93292179-3f78-484a-98c3-886261167669 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.215844 Aug 10 13:00:09.840076 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1200/2416] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:09 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:10.074616 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4af500af-b3ed-4bdf-8d6b-8407329195c8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:10.075282 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4af500af-b3ed-4bdf-8d6b-8407329195c8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:10.079667 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b4958fe8-4f8f-4dad-abf5-b04fda776875 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:10.080270 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b4958fe8-4f8f-4dad-abf5-b04fda776875 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:10.081256 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4af500af-b3ed-4bdf-8d6b-8407329195c8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:10.081745 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4af500af-b3ed-4bdf-8d6b-8407329195c8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:10.082179 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4af500af-b3ed-4bdf-8d6b-8407329195c8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:10.082866 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4af500af-b3ed-4bdf-8d6b-8407329195c8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:10.083361 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4af500af-b3ed-4bdf-8d6b-8407329195c8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:10.083784 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4af500af-b3ed-4bdf-8d6b-8407329195c8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:10.086039 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4958fe8-4f8f-4dad-abf5-b04fda776875 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:10.086515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4958fe8-4f8f-4dad-abf5-b04fda776875 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:10.086944 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4958fe8-4f8f-4dad-abf5-b04fda776875 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:10.087649 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4958fe8-4f8f-4dad-abf5-b04fda776875 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:10.088099 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4958fe8-4f8f-4dad-abf5-b04fda776875 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:10.088517 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4958fe8-4f8f-4dad-abf5-b04fda776875 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:10.279980 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4af500af-b3ed-4bdf-8d6b-8407329195c8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:10.282367 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:00:10.284010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b4958fe8-4f8f-4dad-abf5-b04fda776875 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:10.288929 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4af500af-b3ed-4bdf-8d6b-8407329195c8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.218109 Aug 10 13:00:10.289637 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1217/2417] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:10 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:10.292229 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b4958fe8-4f8f-4dad-abf5-b04fda776875 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.216289 Aug 10 13:00:10.298001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1201/2418] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:10 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:10.850785 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4143dd89-9f7b-49df-9be0-e16ee1c67cfa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:10.851431 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4143dd89-9f7b-49df-9be0-e16ee1c67cfa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:10.858011 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4143dd89-9f7b-49df-9be0-e16ee1c67cfa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:10.858485 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4143dd89-9f7b-49df-9be0-e16ee1c67cfa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:10.858912 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4143dd89-9f7b-49df-9be0-e16ee1c67cfa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:10.859646 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4143dd89-9f7b-49df-9be0-e16ee1c67cfa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:10.860090 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4143dd89-9f7b-49df-9be0-e16ee1c67cfa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:10.860507 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4143dd89-9f7b-49df-9be0-e16ee1c67cfa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:10.862326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e11330aa-b2f5-47f8-9e0a-42d765821c8d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:10.862963 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e11330aa-b2f5-47f8-9e0a-42d765821c8d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:10.869611 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e11330aa-b2f5-47f8-9e0a-42d765821c8d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:10.870095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e11330aa-b2f5-47f8-9e0a-42d765821c8d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:10.870532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e11330aa-b2f5-47f8-9e0a-42d765821c8d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:10.871321 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e11330aa-b2f5-47f8-9e0a-42d765821c8d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:10.871779 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e11330aa-b2f5-47f8-9e0a-42d765821c8d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:10.872217 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e11330aa-b2f5-47f8-9e0a-42d765821c8d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:11.068690 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4143dd89-9f7b-49df-9be0-e16ee1c67cfa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:11.072732 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e11330aa-b2f5-47f8-9e0a-42d765821c8d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:11.076792 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4143dd89-9f7b-49df-9be0-e16ee1c67cfa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.230934 Aug 10 13:00:11.077372 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1218/2419] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:10 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:11.081233 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e11330aa-b2f5-47f8-9e0a-42d765821c8d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:11.082765 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e11330aa-b2f5-47f8-9e0a-42d765821c8d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:11.084444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e11330aa-b2f5-47f8-9e0a-42d765821c8d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.226632 Aug 10 13:00:11.084987 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1202/2420] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:10 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:11.310290 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fcebfa33-f5bf-4375-9aee-63589ac27b7f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:11.310905 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fcebfa33-f5bf-4375-9aee-63589ac27b7f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:11.316996 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fcebfa33-f5bf-4375-9aee-63589ac27b7f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:11.317956 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fcebfa33-f5bf-4375-9aee-63589ac27b7f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:11.318109 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bf14fe07-2ab9-4a28-9423-3bff977f1c42 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:11.318617 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fcebfa33-f5bf-4375-9aee-63589ac27b7f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:11.318788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bf14fe07-2ab9-4a28-9423-3bff977f1c42 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:11.319355 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fcebfa33-f5bf-4375-9aee-63589ac27b7f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:11.319810 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fcebfa33-f5bf-4375-9aee-63589ac27b7f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:11.320241 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fcebfa33-f5bf-4375-9aee-63589ac27b7f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:11.324640 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf14fe07-2ab9-4a28-9423-3bff977f1c42 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:11.325124 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf14fe07-2ab9-4a28-9423-3bff977f1c42 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:11.325557 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf14fe07-2ab9-4a28-9423-3bff977f1c42 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:11.326240 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf14fe07-2ab9-4a28-9423-3bff977f1c42 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:11.326694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf14fe07-2ab9-4a28-9423-3bff977f1c42 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:11.327116 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf14fe07-2ab9-4a28-9423-3bff977f1c42 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:11.732538 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fcebfa33-f5bf-4375-9aee-63589ac27b7f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:11.735573 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-bf14fe07-2ab9-4a28-9423-3bff977f1c42 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:11.741019 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fcebfa33-f5bf-4375-9aee-63589ac27b7f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.434609 Aug 10 13:00:11.741591 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1219/2421] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:11 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:11.743759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bf14fe07-2ab9-4a28-9423-3bff977f1c42 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.430066 Aug 10 13:00:11.744396 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1203/2422] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:11 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:12.098456 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ebef33ee-5c6c-4c28-b7ef-0c185a83622b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:12.099543 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ebef33ee-5c6c-4c28-b7ef-0c185a83622b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:12.106239 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebef33ee-5c6c-4c28-b7ef-0c185a83622b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:12.106715 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebef33ee-5c6c-4c28-b7ef-0c185a83622b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:12.106999 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8ce0232f-83e3-46e8-af30-d4bd1f7f065e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:12.107489 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebef33ee-5c6c-4c28-b7ef-0c185a83622b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:12.107643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8ce0232f-83e3-46e8-af30-d4bd1f7f065e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:12.107842 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebef33ee-5c6c-4c28-b7ef-0c185a83622b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:12.108317 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebef33ee-5c6c-4c28-b7ef-0c185a83622b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:12.108736 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ebef33ee-5c6c-4c28-b7ef-0c185a83622b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:12.113884 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ce0232f-83e3-46e8-af30-d4bd1f7f065e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:12.114363 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ce0232f-83e3-46e8-af30-d4bd1f7f065e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:12.114880 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ce0232f-83e3-46e8-af30-d4bd1f7f065e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:12.115679 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ce0232f-83e3-46e8-af30-d4bd1f7f065e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:12.116137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ce0232f-83e3-46e8-af30-d4bd1f7f065e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:12.116563 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ce0232f-83e3-46e8-af30-d4bd1f7f065e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:12.302497 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ebef33ee-5c6c-4c28-b7ef-0c185a83622b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:12.306952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8ce0232f-83e3-46e8-af30-d4bd1f7f065e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:12.310496 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ebef33ee-5c6c-4c28-b7ef-0c185a83622b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.215885 Aug 10 13:00:12.311075 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1220/2423] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:12 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:12.315528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8ce0232f-83e3-46e8-af30-d4bd1f7f065e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:12.317022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8ce0232f-83e3-46e8-af30-d4bd1f7f065e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:12.318818 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8ce0232f-83e3-46e8-af30-d4bd1f7f065e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.215898 Aug 10 13:00:12.319401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1204/2424] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:12 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:12.761561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-70fecd99-e1f5-4361-98d5-7a55df5fdbdc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:12.762182 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-70fecd99-e1f5-4361-98d5-7a55df5fdbdc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:12.765118 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-cef5d75b-349f-4954-9780-828c8f59ef8f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:12.765727 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-cef5d75b-349f-4954-9780-828c8f59ef8f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:12.768311 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70fecd99-e1f5-4361-98d5-7a55df5fdbdc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:12.768796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70fecd99-e1f5-4361-98d5-7a55df5fdbdc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:12.769231 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70fecd99-e1f5-4361-98d5-7a55df5fdbdc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:12.769953 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70fecd99-e1f5-4361-98d5-7a55df5fdbdc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:12.770415 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70fecd99-e1f5-4361-98d5-7a55df5fdbdc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:12.770845 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70fecd99-e1f5-4361-98d5-7a55df5fdbdc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:12.771380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cef5d75b-349f-4954-9780-828c8f59ef8f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:12.771858 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cef5d75b-349f-4954-9780-828c8f59ef8f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:12.772292 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cef5d75b-349f-4954-9780-828c8f59ef8f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:12.772979 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cef5d75b-349f-4954-9780-828c8f59ef8f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:12.773430 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cef5d75b-349f-4954-9780-828c8f59ef8f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:12.773852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cef5d75b-349f-4954-9780-828c8f59ef8f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:12.960108 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-cef5d75b-349f-4954-9780-828c8f59ef8f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:12.966779 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-70fecd99-e1f5-4361-98d5-7a55df5fdbdc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:12.968067 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-cef5d75b-349f-4954-9780-828c8f59ef8f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.206726 Aug 10 13:00:12.968754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1205/2425] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:12 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:12.974777 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-70fecd99-e1f5-4361-98d5-7a55df5fdbdc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.217095 Aug 10 13:00:12.975363 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1221/2426] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:12 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:13.332870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-599281ef-1268-4335-acb1-79c2730a4e06 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:13.333632 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-599281ef-1268-4335-acb1-79c2730a4e06 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:13.339892 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-599281ef-1268-4335-acb1-79c2730a4e06 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:13.340374 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-599281ef-1268-4335-acb1-79c2730a4e06 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:13.340807 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-599281ef-1268-4335-acb1-79c2730a4e06 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:13.341486 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b0000e85-43b9-4c47-b891-f29a234cc2f5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:13.341912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-599281ef-1268-4335-acb1-79c2730a4e06 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:13.342016 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-599281ef-1268-4335-acb1-79c2730a4e06 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:13.342116 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b0000e85-43b9-4c47-b891-f29a234cc2f5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:13.342365 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-599281ef-1268-4335-acb1-79c2730a4e06 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:13.348205 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b0000e85-43b9-4c47-b891-f29a234cc2f5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:13.348689 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b0000e85-43b9-4c47-b891-f29a234cc2f5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:13.349129 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b0000e85-43b9-4c47-b891-f29a234cc2f5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:13.349813 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b0000e85-43b9-4c47-b891-f29a234cc2f5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:13.350263 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b0000e85-43b9-4c47-b891-f29a234cc2f5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:13.350693 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b0000e85-43b9-4c47-b891-f29a234cc2f5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:13.547702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-599281ef-1268-4335-acb1-79c2730a4e06 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:13.550104 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:00:13.552491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b0000e85-43b9-4c47-b891-f29a234cc2f5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:13.558065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-599281ef-1268-4335-acb1-79c2730a4e06 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.228985 Aug 10 13:00:13.567361 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1206/2427] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:13 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:13.567581 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b0000e85-43b9-4c47-b891-f29a234cc2f5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:13.567581 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b0000e85-43b9-4c47-b891-f29a234cc2f5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:13.567581 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b0000e85-43b9-4c47-b891-f29a234cc2f5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.226750 Aug 10 13:00:13.567967 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1222/2428] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:13 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:13.996852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8f1b48fb-0b4a-4b11-b407-73983dd7a251 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:13.997507 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2de73805-6219-4a29-966a-f8b08fc886dd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:13.997676 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8f1b48fb-0b4a-4b11-b407-73983dd7a251 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:13.998114 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2de73805-6219-4a29-966a-f8b08fc886dd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:14.003732 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f1b48fb-0b4a-4b11-b407-73983dd7a251 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:14.004170 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2de73805-6219-4a29-966a-f8b08fc886dd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:14.004293 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f1b48fb-0b4a-4b11-b407-73983dd7a251 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:14.004634 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f1b48fb-0b4a-4b11-b407-73983dd7a251 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:14.004751 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2de73805-6219-4a29-966a-f8b08fc886dd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:14.005587 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f1b48fb-0b4a-4b11-b407-73983dd7a251 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:14.005726 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2de73805-6219-4a29-966a-f8b08fc886dd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:14.006126 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f1b48fb-0b4a-4b11-b407-73983dd7a251 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:14.006554 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f1b48fb-0b4a-4b11-b407-73983dd7a251 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:14.006664 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2de73805-6219-4a29-966a-f8b08fc886dd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:14.007027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2de73805-6219-4a29-966a-f8b08fc886dd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:14.007521 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2de73805-6219-4a29-966a-f8b08fc886dd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:14.202144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8f1b48fb-0b4a-4b11-b407-73983dd7a251 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:14.209503 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2de73805-6219-4a29-966a-f8b08fc886dd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:14.210867 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8f1b48fb-0b4a-4b11-b407-73983dd7a251 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.218272 Aug 10 13:00:14.211484 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1207/2429] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:13 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:14.217504 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2de73805-6219-4a29-966a-f8b08fc886dd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.223753 Aug 10 13:00:14.218065 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1223/2430] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:13 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:14.407082 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:00:14.407639 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Wed Aug 10 13:00:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:00:14.579062 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d3821b1a-f3f1-49e5-ba4d-a892a1006809 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:14.579701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d3821b1a-f3f1-49e5-ba4d-a892a1006809 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:14.586348 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d3821b1a-f3f1-49e5-ba4d-a892a1006809 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:14.586808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d3821b1a-f3f1-49e5-ba4d-a892a1006809 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:14.587267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d3821b1a-f3f1-49e5-ba4d-a892a1006809 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:14.587681 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-562aeb51-b9eb-4a4e-8555-1d254073541e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:14.588141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d3821b1a-f3f1-49e5-ba4d-a892a1006809 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:14.588290 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-562aeb51-b9eb-4a4e-8555-1d254073541e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:14.588414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d3821b1a-f3f1-49e5-ba4d-a892a1006809 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:14.588797 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d3821b1a-f3f1-49e5-ba4d-a892a1006809 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:14.594481 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-562aeb51-b9eb-4a4e-8555-1d254073541e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:14.594956 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-562aeb51-b9eb-4a4e-8555-1d254073541e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:14.595418 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-562aeb51-b9eb-4a4e-8555-1d254073541e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:14.596097 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-562aeb51-b9eb-4a4e-8555-1d254073541e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:14.596564 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-562aeb51-b9eb-4a4e-8555-1d254073541e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:14.596985 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-562aeb51-b9eb-4a4e-8555-1d254073541e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:14.781729 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d3821b1a-f3f1-49e5-ba4d-a892a1006809 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:14.785535 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-562aeb51-b9eb-4a4e-8555-1d254073541e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:14.789849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d3821b1a-f3f1-49e5-ba4d-a892a1006809 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.214555 Aug 10 13:00:14.790414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1208/2431] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:14 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:14.794139 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-562aeb51-b9eb-4a4e-8555-1d254073541e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:14.795686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-562aeb51-b9eb-4a4e-8555-1d254073541e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:14.796848 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-562aeb51-b9eb-4a4e-8555-1d254073541e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.213152 Aug 10 13:00:14.797396 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1224/2432] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:14 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:15.232572 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e15a9a69-6082-4308-a2c2-7562ec4c2061 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:15.233174 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e15a9a69-6082-4308-a2c2-7562ec4c2061 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:15.238983 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-27eba74b-6d3f-4399-8288-9b4164626415 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:15.239259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e15a9a69-6082-4308-a2c2-7562ec4c2061 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:15.240275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e15a9a69-6082-4308-a2c2-7562ec4c2061 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:15.243631 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-27eba74b-6d3f-4399-8288-9b4164626415 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:15.254532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e15a9a69-6082-4308-a2c2-7562ec4c2061 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:15.254532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e15a9a69-6082-4308-a2c2-7562ec4c2061 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:15.254532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e15a9a69-6082-4308-a2c2-7562ec4c2061 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:15.254532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e15a9a69-6082-4308-a2c2-7562ec4c2061 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:15.255910 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-27eba74b-6d3f-4399-8288-9b4164626415 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:15.255910 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-27eba74b-6d3f-4399-8288-9b4164626415 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:15.255910 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-27eba74b-6d3f-4399-8288-9b4164626415 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:15.255910 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-27eba74b-6d3f-4399-8288-9b4164626415 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:15.256315 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-27eba74b-6d3f-4399-8288-9b4164626415 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:15.256315 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-27eba74b-6d3f-4399-8288-9b4164626415 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:15.445748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e15a9a69-6082-4308-a2c2-7562ec4c2061 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:15.452376 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-27eba74b-6d3f-4399-8288-9b4164626415 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:15.453908 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e15a9a69-6082-4308-a2c2-7562ec4c2061 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.225436 Aug 10 13:00:15.454562 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1209/2433] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:15 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:15.460564 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-27eba74b-6d3f-4399-8288-9b4164626415 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.225444 Aug 10 13:00:15.461208 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1225/2434] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:15 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:15.810527 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-92e79279-16cb-4317-914e-4074d489cce0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:15.811131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-92e79279-16cb-4317-914e-4074d489cce0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:15.818111 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-92e79279-16cb-4317-914e-4074d489cce0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:15.818596 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-92e79279-16cb-4317-914e-4074d489cce0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:15.819024 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-92e79279-16cb-4317-914e-4074d489cce0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:15.819732 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-92e79279-16cb-4317-914e-4074d489cce0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:15.820182 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-92e79279-16cb-4317-914e-4074d489cce0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:15.820306 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b6dd6ba0-18a2-48eb-9dd8-cd6a60ae33ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:15.820764 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-92e79279-16cb-4317-914e-4074d489cce0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:15.820884 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b6dd6ba0-18a2-48eb-9dd8-cd6a60ae33ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:15.827622 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b6dd6ba0-18a2-48eb-9dd8-cd6a60ae33ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:15.828095 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b6dd6ba0-18a2-48eb-9dd8-cd6a60ae33ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:15.828545 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b6dd6ba0-18a2-48eb-9dd8-cd6a60ae33ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:15.829226 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b6dd6ba0-18a2-48eb-9dd8-cd6a60ae33ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:15.829670 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b6dd6ba0-18a2-48eb-9dd8-cd6a60ae33ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:15.830084 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b6dd6ba0-18a2-48eb-9dd8-cd6a60ae33ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:16.012470 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-92e79279-16cb-4317-914e-4074d489cce0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:16.021555 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-92e79279-16cb-4317-914e-4074d489cce0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.213896 Aug 10 13:00:16.022276 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1210/2435] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:15 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:16.023957 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b6dd6ba0-18a2-48eb-9dd8-cd6a60ae33ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:16.032414 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b6dd6ba0-18a2-48eb-9dd8-cd6a60ae33ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:16.033895 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b6dd6ba0-18a2-48eb-9dd8-cd6a60ae33ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:16.035059 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b6dd6ba0-18a2-48eb-9dd8-cd6a60ae33ed tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.218693 Aug 10 13:00:16.035636 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1226/2436] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:15 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:16.475383 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c4f5fdb4-34b8-4f19-b816-c88e295322cc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:16.475909 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c4f5fdb4-34b8-4f19-b816-c88e295322cc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:16.481776 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ad16504a-5a00-4bf4-b0bc-68447f0146f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:16.482395 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ad16504a-5a00-4bf4-b0bc-68447f0146f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:16.482519 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4f5fdb4-34b8-4f19-b816-c88e295322cc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:16.482875 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4f5fdb4-34b8-4f19-b816-c88e295322cc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:16.483335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4f5fdb4-34b8-4f19-b816-c88e295322cc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:16.484022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4f5fdb4-34b8-4f19-b816-c88e295322cc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:16.484470 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4f5fdb4-34b8-4f19-b816-c88e295322cc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:16.484893 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4f5fdb4-34b8-4f19-b816-c88e295322cc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:16.488310 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad16504a-5a00-4bf4-b0bc-68447f0146f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:16.488797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad16504a-5a00-4bf4-b0bc-68447f0146f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:16.489228 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad16504a-5a00-4bf4-b0bc-68447f0146f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:16.490214 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad16504a-5a00-4bf4-b0bc-68447f0146f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:16.490668 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad16504a-5a00-4bf4-b0bc-68447f0146f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:16.491092 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ad16504a-5a00-4bf4-b0bc-68447f0146f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:16.677230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c4f5fdb4-34b8-4f19-b816-c88e295322cc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:16.681339 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ad16504a-5a00-4bf4-b0bc-68447f0146f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:16.685222 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c4f5fdb4-34b8-4f19-b816-c88e295322cc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.213929 Aug 10 13:00:16.685795 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1211/2437] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:16 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:16.689737 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ad16504a-5a00-4bf4-b0bc-68447f0146f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.212030 Aug 10 13:00:16.690298 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1227/2438] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:16 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:17.043398 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-698719c8-15c7-4bde-b6a1-e41236a730e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:17.044008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-698719c8-15c7-4bde-b6a1-e41236a730e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:17.050420 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-698719c8-15c7-4bde-b6a1-e41236a730e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:17.050902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-698719c8-15c7-4bde-b6a1-e41236a730e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:17.051384 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-698719c8-15c7-4bde-b6a1-e41236a730e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:17.052236 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-698719c8-15c7-4bde-b6a1-e41236a730e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:17.052844 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-698719c8-15c7-4bde-b6a1-e41236a730e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:17.053274 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-698719c8-15c7-4bde-b6a1-e41236a730e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:17.058387 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d69feec1-5b82-4081-9a35-be411808948e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:17.059001 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d69feec1-5b82-4081-9a35-be411808948e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:17.065317 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d69feec1-5b82-4081-9a35-be411808948e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:17.065801 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d69feec1-5b82-4081-9a35-be411808948e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:17.066240 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d69feec1-5b82-4081-9a35-be411808948e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:17.066929 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d69feec1-5b82-4081-9a35-be411808948e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:17.067512 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d69feec1-5b82-4081-9a35-be411808948e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:17.068081 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d69feec1-5b82-4081-9a35-be411808948e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:17.248802 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-698719c8-15c7-4bde-b6a1-e41236a730e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:17.259325 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-698719c8-15c7-4bde-b6a1-e41236a730e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.218836 Aug 10 13:00:17.259325 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1212/2439] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:17 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:17.261316 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d69feec1-5b82-4081-9a35-be411808948e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:17.269732 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d69feec1-5b82-4081-9a35-be411808948e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:17.272088 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d69feec1-5b82-4081-9a35-be411808948e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:17.273248 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d69feec1-5b82-4081-9a35-be411808948e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.218955 Aug 10 13:00:17.273801 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1228/2440] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:17 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:17.707368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a9a81776-8256-479e-a460-3dc6a3939fa1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:17.708039 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a9a81776-8256-479e-a460-3dc6a3939fa1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:17.711414 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5ebbfa74-1361-46a7-b8a2-51b47b4635d9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:17.712056 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5ebbfa74-1361-46a7-b8a2-51b47b4635d9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:17.714207 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9a81776-8256-479e-a460-3dc6a3939fa1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:17.714691 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9a81776-8256-479e-a460-3dc6a3939fa1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:17.715129 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9a81776-8256-479e-a460-3dc6a3939fa1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:17.715843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9a81776-8256-479e-a460-3dc6a3939fa1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:17.716288 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9a81776-8256-479e-a460-3dc6a3939fa1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:17.716861 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9a81776-8256-479e-a460-3dc6a3939fa1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:17.718304 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5ebbfa74-1361-46a7-b8a2-51b47b4635d9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:17.718855 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5ebbfa74-1361-46a7-b8a2-51b47b4635d9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:17.719466 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5ebbfa74-1361-46a7-b8a2-51b47b4635d9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:17.720222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5ebbfa74-1361-46a7-b8a2-51b47b4635d9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:17.720741 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5ebbfa74-1361-46a7-b8a2-51b47b4635d9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:17.721366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5ebbfa74-1361-46a7-b8a2-51b47b4635d9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:17.913601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a9a81776-8256-479e-a460-3dc6a3939fa1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:17.916950 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5ebbfa74-1361-46a7-b8a2-51b47b4635d9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:17.921533 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a9a81776-8256-479e-a460-3dc6a3939fa1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.218185 Aug 10 13:00:17.922100 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1213/2441] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:17 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:17.925203 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5ebbfa74-1361-46a7-b8a2-51b47b4635d9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.217916 Aug 10 13:00:17.925846 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1229/2442] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:17 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:18.280000 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-01a9c6b2-c6ea-428f-9439-820103368182 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:18.280702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-01a9c6b2-c6ea-428f-9439-820103368182 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:18.286918 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01a9c6b2-c6ea-428f-9439-820103368182 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:18.287427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01a9c6b2-c6ea-428f-9439-820103368182 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:18.287858 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01a9c6b2-c6ea-428f-9439-820103368182 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:18.288530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01a9c6b2-c6ea-428f-9439-820103368182 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:18.288976 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01a9c6b2-c6ea-428f-9439-820103368182 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:18.289397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01a9c6b2-c6ea-428f-9439-820103368182 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:18.296347 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d9384eb8-6f71-4fd8-a97c-6fd730d99031 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:18.297073 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d9384eb8-6f71-4fd8-a97c-6fd730d99031 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:18.303983 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d9384eb8-6f71-4fd8-a97c-6fd730d99031 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:18.304462 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d9384eb8-6f71-4fd8-a97c-6fd730d99031 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:18.305121 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d9384eb8-6f71-4fd8-a97c-6fd730d99031 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:18.305813 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d9384eb8-6f71-4fd8-a97c-6fd730d99031 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:18.306263 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d9384eb8-6f71-4fd8-a97c-6fd730d99031 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:18.306686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d9384eb8-6f71-4fd8-a97c-6fd730d99031 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:18.486582 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-01a9c6b2-c6ea-428f-9439-820103368182 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:18.494784 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-01a9c6b2-c6ea-428f-9439-820103368182 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.218593 Aug 10 13:00:18.495382 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1214/2443] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:18 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:18.497531 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d9384eb8-6f71-4fd8-a97c-6fd730d99031 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:18.506218 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d9384eb8-6f71-4fd8-a97c-6fd730d99031 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:18.507745 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d9384eb8-6f71-4fd8-a97c-6fd730d99031 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:18.508939 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d9384eb8-6f71-4fd8-a97c-6fd730d99031 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.216458 Aug 10 13:00:18.509492 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1230/2444] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:18 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:18.942743 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-640b72a3-640b-4ab3-90b7-cc5622ff259c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:18.943565 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-640b72a3-640b-4ab3-90b7-cc5622ff259c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:18.945693 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-98b437ff-a307-405e-b1d1-adefed73ce07 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:18.946315 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-98b437ff-a307-405e-b1d1-adefed73ce07 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:18.950452 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-640b72a3-640b-4ab3-90b7-cc5622ff259c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:18.950942 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-640b72a3-640b-4ab3-90b7-cc5622ff259c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:18.951424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-640b72a3-640b-4ab3-90b7-cc5622ff259c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:18.952123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-640b72a3-640b-4ab3-90b7-cc5622ff259c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:18.952296 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-98b437ff-a307-405e-b1d1-adefed73ce07 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:18.952576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-640b72a3-640b-4ab3-90b7-cc5622ff259c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:18.952775 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-98b437ff-a307-405e-b1d1-adefed73ce07 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:18.953003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-640b72a3-640b-4ab3-90b7-cc5622ff259c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:18.953209 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-98b437ff-a307-405e-b1d1-adefed73ce07 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:18.953891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-98b437ff-a307-405e-b1d1-adefed73ce07 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:18.954367 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-98b437ff-a307-405e-b1d1-adefed73ce07 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:18.954793 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-98b437ff-a307-405e-b1d1-adefed73ce07 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:19.153126 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-640b72a3-640b-4ab3-90b7-cc5622ff259c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:19.160043 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-98b437ff-a307-405e-b1d1-adefed73ce07 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:19.161011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-640b72a3-640b-4ab3-90b7-cc5622ff259c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.222250 Aug 10 13:00:19.161615 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1215/2445] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:18 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:19.168065 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-98b437ff-a307-405e-b1d1-adefed73ce07 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.226280 Aug 10 13:00:19.168620 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1231/2446] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:18 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:19.514856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f9e29a8f-3079-4831-931c-4ba8032a8907 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:19.515482 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f9e29a8f-3079-4831-931c-4ba8032a8907 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:19.522206 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f9e29a8f-3079-4831-931c-4ba8032a8907 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:19.522679 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f9e29a8f-3079-4831-931c-4ba8032a8907 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:19.523110 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f9e29a8f-3079-4831-931c-4ba8032a8907 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:19.523813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f9e29a8f-3079-4831-931c-4ba8032a8907 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:19.524260 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f9e29a8f-3079-4831-931c-4ba8032a8907 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:19.524679 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f9e29a8f-3079-4831-931c-4ba8032a8907 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:19.532052 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c3e58e96-d60c-4c84-8367-ef39a591a434 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:19.532690 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c3e58e96-d60c-4c84-8367-ef39a591a434 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:19.539638 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3e58e96-d60c-4c84-8367-ef39a591a434 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:19.540123 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3e58e96-d60c-4c84-8367-ef39a591a434 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:19.540558 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3e58e96-d60c-4c84-8367-ef39a591a434 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:19.541329 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3e58e96-d60c-4c84-8367-ef39a591a434 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:19.541785 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3e58e96-d60c-4c84-8367-ef39a591a434 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:19.542214 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3e58e96-d60c-4c84-8367-ef39a591a434 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:19.727363 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f9e29a8f-3079-4831-931c-4ba8032a8907 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:19.742864 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c3e58e96-d60c-4c84-8367-ef39a591a434 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:19.743206 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f9e29a8f-3079-4831-931c-4ba8032a8907 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.224488 Aug 10 13:00:19.743206 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1216/2447] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:19 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:19.743402 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c3e58e96-d60c-4c84-8367-ef39a591a434 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:19.743402 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c3e58e96-d60c-4c84-8367-ef39a591a434 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:19.743610 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c3e58e96-d60c-4c84-8367-ef39a591a434 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.215257 Aug 10 13:00:19.744144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1232/2448] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:19 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:20.182994 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5e3bc222-a5d5-4ee6-83cb-d794b5c50093 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:20.183636 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5e3bc222-a5d5-4ee6-83cb-d794b5c50093 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:20.188086 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-22f50189-3735-4e0e-b817-7969899d04cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:20.188695 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-22f50189-3735-4e0e-b817-7969899d04cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:20.189595 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e3bc222-a5d5-4ee6-83cb-d794b5c50093 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:20.190079 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e3bc222-a5d5-4ee6-83cb-d794b5c50093 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:20.190517 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e3bc222-a5d5-4ee6-83cb-d794b5c50093 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:20.191228 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e3bc222-a5d5-4ee6-83cb-d794b5c50093 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:20.191690 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e3bc222-a5d5-4ee6-83cb-d794b5c50093 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:20.192114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e3bc222-a5d5-4ee6-83cb-d794b5c50093 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:20.195168 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22f50189-3735-4e0e-b817-7969899d04cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:20.195673 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22f50189-3735-4e0e-b817-7969899d04cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:20.196101 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22f50189-3735-4e0e-b817-7969899d04cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:20.196782 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22f50189-3735-4e0e-b817-7969899d04cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:20.197227 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22f50189-3735-4e0e-b817-7969899d04cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:20.197646 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-22f50189-3735-4e0e-b817-7969899d04cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:20.384594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5e3bc222-a5d5-4ee6-83cb-d794b5c50093 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:20.388702 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-22f50189-3735-4e0e-b817-7969899d04cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:20.392586 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5e3bc222-a5d5-4ee6-83cb-d794b5c50093 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.213568 Aug 10 13:00:20.393163 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1217/2449] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:20 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:20.397891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-22f50189-3735-4e0e-b817-7969899d04cc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.213517 Aug 10 13:00:20.398444 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1233/2450] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:20 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:20.762205 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-635aecd8-4c24-4318-b13b-2f80292c5fed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:20.762811 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-635aecd8-4c24-4318-b13b-2f80292c5fed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:20.765612 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-777480e3-286c-412f-b52f-810fd33b16c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:20.766220 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-777480e3-286c-412f-b52f-810fd33b16c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:20.769380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-635aecd8-4c24-4318-b13b-2f80292c5fed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:20.769865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-635aecd8-4c24-4318-b13b-2f80292c5fed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:20.770295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-635aecd8-4c24-4318-b13b-2f80292c5fed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:20.771387 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-635aecd8-4c24-4318-b13b-2f80292c5fed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:20.771847 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-635aecd8-4c24-4318-b13b-2f80292c5fed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:20.772271 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-635aecd8-4c24-4318-b13b-2f80292c5fed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:20.772564 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-777480e3-286c-412f-b52f-810fd33b16c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:20.773038 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-777480e3-286c-412f-b52f-810fd33b16c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:20.773465 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-777480e3-286c-412f-b52f-810fd33b16c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:20.774146 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-777480e3-286c-412f-b52f-810fd33b16c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:20.774602 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-777480e3-286c-412f-b52f-810fd33b16c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:20.775022 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-777480e3-286c-412f-b52f-810fd33b16c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:20.791129 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:00:20.965138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-635aecd8-4c24-4318-b13b-2f80292c5fed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:20.972491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-777480e3-286c-412f-b52f-810fd33b16c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:20.973208 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-635aecd8-4c24-4318-b13b-2f80292c5fed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.214980 Aug 10 13:00:20.974355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1218/2451] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:20 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:20.982037 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-777480e3-286c-412f-b52f-810fd33b16c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:20.983669 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-777480e3-286c-412f-b52f-810fd33b16c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:20.984834 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-777480e3-286c-412f-b52f-810fd33b16c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.223029 Aug 10 13:00:20.985380 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1234/2452] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:20 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:21.414985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1f53f204-ddc0-4765-848e-f6e0eed04da7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:21.415736 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1f53f204-ddc0-4765-848e-f6e0eed04da7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:21.418675 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bb794328-c3e8-4d90-b322-142a7eb50c4f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:21.419301 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bb794328-c3e8-4d90-b322-142a7eb50c4f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:21.422005 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1f53f204-ddc0-4765-848e-f6e0eed04da7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:21.422515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1f53f204-ddc0-4765-848e-f6e0eed04da7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:21.422945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1f53f204-ddc0-4765-848e-f6e0eed04da7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:21.423795 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1f53f204-ddc0-4765-848e-f6e0eed04da7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:21.424245 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1f53f204-ddc0-4765-848e-f6e0eed04da7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:21.424662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1f53f204-ddc0-4765-848e-f6e0eed04da7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:21.425370 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb794328-c3e8-4d90-b322-142a7eb50c4f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:21.425851 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb794328-c3e8-4d90-b322-142a7eb50c4f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:21.426282 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb794328-c3e8-4d90-b322-142a7eb50c4f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:21.426977 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb794328-c3e8-4d90-b322-142a7eb50c4f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:21.427452 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb794328-c3e8-4d90-b322-142a7eb50c4f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:21.427875 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bb794328-c3e8-4d90-b322-142a7eb50c4f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:21.616848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1f53f204-ddc0-4765-848e-f6e0eed04da7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:21.624079 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-bb794328-c3e8-4d90-b322-142a7eb50c4f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:21.624835 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1f53f204-ddc0-4765-848e-f6e0eed04da7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.214259 Aug 10 13:00:21.625412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1219/2453] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:21 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:21.632873 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bb794328-c3e8-4d90-b322-142a7eb50c4f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.217973 Aug 10 13:00:21.633434 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1235/2454] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:21 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:21.995712 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bd253766-d3fa-49ab-8b1d-81489e7f8e8f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:21.996343 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bd253766-d3fa-49ab-8b1d-81489e7f8e8f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:22.003215 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd253766-d3fa-49ab-8b1d-81489e7f8e8f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:22.003938 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd253766-d3fa-49ab-8b1d-81489e7f8e8f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:22.004671 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd253766-d3fa-49ab-8b1d-81489e7f8e8f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:22.005961 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd253766-d3fa-49ab-8b1d-81489e7f8e8f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:22.006645 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd253766-d3fa-49ab-8b1d-81489e7f8e8f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:22.007452 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd253766-d3fa-49ab-8b1d-81489e7f8e8f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:22.008926 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-19a60b15-41cd-4235-91e9-9e6199ca7ea3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:22.009543 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-19a60b15-41cd-4235-91e9-9e6199ca7ea3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:22.016940 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19a60b15-41cd-4235-91e9-9e6199ca7ea3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:22.017426 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19a60b15-41cd-4235-91e9-9e6199ca7ea3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:22.017865 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19a60b15-41cd-4235-91e9-9e6199ca7ea3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:22.018669 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19a60b15-41cd-4235-91e9-9e6199ca7ea3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:22.019378 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19a60b15-41cd-4235-91e9-9e6199ca7ea3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:22.020027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-19a60b15-41cd-4235-91e9-9e6199ca7ea3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:22.216732 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-bd253766-d3fa-49ab-8b1d-81489e7f8e8f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:22.220499 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-19a60b15-41cd-4235-91e9-9e6199ca7ea3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:22.226328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bd253766-d3fa-49ab-8b1d-81489e7f8e8f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.234521 Aug 10 13:00:22.227446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1220/2455] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:21 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:22.229888 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-19a60b15-41cd-4235-91e9-9e6199ca7ea3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:22.233006 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-19a60b15-41cd-4235-91e9-9e6199ca7ea3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:22.233006 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-19a60b15-41cd-4235-91e9-9e6199ca7ea3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.228477 Aug 10 13:00:22.233882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1236/2456] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:22 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:22.647974 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5ee7bd3b-74e5-4efd-9e19-be3781feb252 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:22.648586 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5ee7bd3b-74e5-4efd-9e19-be3781feb252 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:22.653327 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-cb05975d-872a-48c8-b709-b609ba8dd98d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:22.653941 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-cb05975d-872a-48c8-b709-b609ba8dd98d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:22.654519 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ee7bd3b-74e5-4efd-9e19-be3781feb252 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:22.655004 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ee7bd3b-74e5-4efd-9e19-be3781feb252 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:22.655470 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ee7bd3b-74e5-4efd-9e19-be3781feb252 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:22.656161 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ee7bd3b-74e5-4efd-9e19-be3781feb252 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:22.656615 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ee7bd3b-74e5-4efd-9e19-be3781feb252 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:22.657036 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ee7bd3b-74e5-4efd-9e19-be3781feb252 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:22.660081 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cb05975d-872a-48c8-b709-b609ba8dd98d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:22.660563 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cb05975d-872a-48c8-b709-b609ba8dd98d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:22.661039 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cb05975d-872a-48c8-b709-b609ba8dd98d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:22.661772 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cb05975d-872a-48c8-b709-b609ba8dd98d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:22.662222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cb05975d-872a-48c8-b709-b609ba8dd98d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:22.662644 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cb05975d-872a-48c8-b709-b609ba8dd98d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:22.849597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5ee7bd3b-74e5-4efd-9e19-be3781feb252 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:22.852639 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-cb05975d-872a-48c8-b709-b609ba8dd98d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:22.857877 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5ee7bd3b-74e5-4efd-9e19-be3781feb252 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.214573 Aug 10 13:00:22.858512 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1221/2457] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:22 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:22.860917 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-cb05975d-872a-48c8-b709-b609ba8dd98d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.211381 Aug 10 13:00:22.861482 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1237/2458] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:22 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:23.249593 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0bdf1a68-898b-411e-9926-a4feacf49d65 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:23.250196 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0bdf1a68-898b-411e-9926-a4feacf49d65 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:23.256418 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ed044d92-e9cd-41db-8462-23902623e2a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:23.257018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0bdf1a68-898b-411e-9926-a4feacf49d65 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:23.257157 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ed044d92-e9cd-41db-8462-23902623e2a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:23.257429 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0bdf1a68-898b-411e-9926-a4feacf49d65 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:23.257858 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0bdf1a68-898b-411e-9926-a4feacf49d65 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:23.258543 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0bdf1a68-898b-411e-9926-a4feacf49d65 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:23.258989 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0bdf1a68-898b-411e-9926-a4feacf49d65 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:23.259432 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0bdf1a68-898b-411e-9926-a4feacf49d65 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:23.263573 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ed044d92-e9cd-41db-8462-23902623e2a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:23.264058 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ed044d92-e9cd-41db-8462-23902623e2a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:23.264494 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ed044d92-e9cd-41db-8462-23902623e2a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:23.265189 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ed044d92-e9cd-41db-8462-23902623e2a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:23.265640 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ed044d92-e9cd-41db-8462-23902623e2a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:23.266061 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ed044d92-e9cd-41db-8462-23902623e2a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:23.452942 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0bdf1a68-898b-411e-9926-a4feacf49d65 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:23.456836 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ed044d92-e9cd-41db-8462-23902623e2a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:23.461406 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0bdf1a68-898b-411e-9926-a4feacf49d65 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.216343 Aug 10 13:00:23.461983 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1222/2459] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:23 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:23.465539 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ed044d92-e9cd-41db-8462-23902623e2a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:23.467026 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ed044d92-e9cd-41db-8462-23902623e2a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:23.468193 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ed044d92-e9cd-41db-8462-23902623e2a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.216064 Aug 10 13:00:23.468878 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1238/2460] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:23 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:23.880566 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8ff5cb4a-2387-4f8c-8d46-50104eb888e4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:23.881473 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8ff5cb4a-2387-4f8c-8d46-50104eb888e4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:23.882525 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7c311bae-781a-4eb9-8a8b-adce4bcef944 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:23.883144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7c311bae-781a-4eb9-8a8b-adce4bcef944 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:23.887363 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ff5cb4a-2387-4f8c-8d46-50104eb888e4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:23.887839 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ff5cb4a-2387-4f8c-8d46-50104eb888e4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:23.888295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ff5cb4a-2387-4f8c-8d46-50104eb888e4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:23.888980 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ff5cb4a-2387-4f8c-8d46-50104eb888e4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:23.889101 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c311bae-781a-4eb9-8a8b-adce4bcef944 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:23.889428 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ff5cb4a-2387-4f8c-8d46-50104eb888e4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:23.889559 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c311bae-781a-4eb9-8a8b-adce4bcef944 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:23.889845 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ff5cb4a-2387-4f8c-8d46-50104eb888e4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:23.889963 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c311bae-781a-4eb9-8a8b-adce4bcef944 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:23.890550 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c311bae-781a-4eb9-8a8b-adce4bcef944 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:23.891014 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c311bae-781a-4eb9-8a8b-adce4bcef944 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:23.891478 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7c311bae-781a-4eb9-8a8b-adce4bcef944 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:23.905095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:00:24.082131 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-7c311bae-781a-4eb9-8a8b-adce4bcef944 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:24.085443 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8ff5cb4a-2387-4f8c-8d46-50104eb888e4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:24.091848 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7c311bae-781a-4eb9-8a8b-adce4bcef944 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.213832 Aug 10 13:00:24.092439 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1239/2461] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:23 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:24.094862 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8ff5cb4a-2387-4f8c-8d46-50104eb888e4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.219043 Aug 10 13:00:24.095594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1223/2462] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:23 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:24.483124 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1fe88f83-e8c3-4930-acbf-b05109610d94 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:24.483725 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1fe88f83-e8c3-4930-acbf-b05109610d94 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:24.490160 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1fe88f83-e8c3-4930-acbf-b05109610d94 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:24.490641 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1fe88f83-e8c3-4930-acbf-b05109610d94 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:24.491077 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1fe88f83-e8c3-4930-acbf-b05109610d94 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:24.491790 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1fe88f83-e8c3-4930-acbf-b05109610d94 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:24.491979 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-19c7c55b-4885-4221-bc49-4e853dc73561 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:24.492241 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1fe88f83-e8c3-4930-acbf-b05109610d94 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:24.492583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-19c7c55b-4885-4221-bc49-4e853dc73561 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:24.492702 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1fe88f83-e8c3-4930-acbf-b05109610d94 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:24.498769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19c7c55b-4885-4221-bc49-4e853dc73561 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:24.499385 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19c7c55b-4885-4221-bc49-4e853dc73561 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:24.499824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19c7c55b-4885-4221-bc49-4e853dc73561 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:24.500501 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19c7c55b-4885-4221-bc49-4e853dc73561 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:24.500964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19c7c55b-4885-4221-bc49-4e853dc73561 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:24.501381 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19c7c55b-4885-4221-bc49-4e853dc73561 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:24.686482 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-1fe88f83-e8c3-4930-acbf-b05109610d94 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:24.693834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-19c7c55b-4885-4221-bc49-4e853dc73561 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:24.695898 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1fe88f83-e8c3-4930-acbf-b05109610d94 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.217047 Aug 10 13:00:24.696875 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1240/2463] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:24 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:24.702542 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-19c7c55b-4885-4221-bc49-4e853dc73561 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:24.704083 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-19c7c55b-4885-4221-bc49-4e853dc73561 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:24.705236 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-19c7c55b-4885-4221-bc49-4e853dc73561 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.217263 Aug 10 13:00:24.705786 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1224/2464] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:24 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:25.114978 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-367fd7c4-92b1-474d-8a4e-6dee4ae2d884 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:25.115613 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-367fd7c4-92b1-474d-8a4e-6dee4ae2d884 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:25.117087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6bf55436-d079-4e42-9407-192e17ece7c6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:25.117709 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6bf55436-d079-4e42-9407-192e17ece7c6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:25.122526 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-367fd7c4-92b1-474d-8a4e-6dee4ae2d884 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:25.123044 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-367fd7c4-92b1-474d-8a4e-6dee4ae2d884 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:25.123509 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-367fd7c4-92b1-474d-8a4e-6dee4ae2d884 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:25.124204 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-367fd7c4-92b1-474d-8a4e-6dee4ae2d884 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:25.124653 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-367fd7c4-92b1-474d-8a4e-6dee4ae2d884 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:25.124775 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6bf55436-d079-4e42-9407-192e17ece7c6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:25.125113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-367fd7c4-92b1-474d-8a4e-6dee4ae2d884 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:25.125238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6bf55436-d079-4e42-9407-192e17ece7c6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:25.125772 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6bf55436-d079-4e42-9407-192e17ece7c6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:25.126461 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6bf55436-d079-4e42-9407-192e17ece7c6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:25.126904 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6bf55436-d079-4e42-9407-192e17ece7c6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:25.127352 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6bf55436-d079-4e42-9407-192e17ece7c6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:25.539776 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-367fd7c4-92b1-474d-8a4e-6dee4ae2d884 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:25.542603 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6bf55436-d079-4e42-9407-192e17ece7c6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:25.548201 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-367fd7c4-92b1-474d-8a4e-6dee4ae2d884 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.437130 Aug 10 13:00:25.548785 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1241/2465] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:25 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:25.550617 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6bf55436-d079-4e42-9407-192e17ece7c6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.437265 Aug 10 13:00:25.551203 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1225/2466] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:25 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:25.716940 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e5a22b3b-11df-4f68-9580-6dc423d18805 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:25.717662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e5a22b3b-11df-4f68-9580-6dc423d18805 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:25.723971 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5a22b3b-11df-4f68-9580-6dc423d18805 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:25.724768 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5a22b3b-11df-4f68-9580-6dc423d18805 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:25.725206 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5a22b3b-11df-4f68-9580-6dc423d18805 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:25.725898 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5a22b3b-11df-4f68-9580-6dc423d18805 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:25.726347 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5a22b3b-11df-4f68-9580-6dc423d18805 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:25.726762 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5a22b3b-11df-4f68-9580-6dc423d18805 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:25.730706 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c570688c-1457-46ad-b808-ee2e4c496342 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:25.731427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c570688c-1457-46ad-b808-ee2e4c496342 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:25.737156 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c570688c-1457-46ad-b808-ee2e4c496342 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:25.737831 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c570688c-1457-46ad-b808-ee2e4c496342 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:25.738269 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c570688c-1457-46ad-b808-ee2e4c496342 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:25.738953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c570688c-1457-46ad-b808-ee2e4c496342 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:25.739450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c570688c-1457-46ad-b808-ee2e4c496342 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:25.739870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c570688c-1457-46ad-b808-ee2e4c496342 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:25.923615 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e5a22b3b-11df-4f68-9580-6dc423d18805 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:25.930379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c570688c-1457-46ad-b808-ee2e4c496342 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:25.932144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e5a22b3b-11df-4f68-9580-6dc423d18805 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.219006 Aug 10 13:00:25.932725 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1242/2467] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:25 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:25.938739 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c570688c-1457-46ad-b808-ee2e4c496342 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:25.940273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c570688c-1457-46ad-b808-ee2e4c496342 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:25.941414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c570688c-1457-46ad-b808-ee2e4c496342 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.216635 Aug 10 13:00:25.941958 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1226/2468] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:25 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:00:26.570273 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-dd31a71c-febf-4dde-9a45-08e2ef5c56eb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:26.570874 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-dd31a71c-febf-4dde-9a45-08e2ef5c56eb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:26.572273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0f30472b-433c-4020-bdde-ff945efa91a2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:26.572885 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0f30472b-433c-4020-bdde-ff945efa91a2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:26.577087 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dd31a71c-febf-4dde-9a45-08e2ef5c56eb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:26.577568 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dd31a71c-febf-4dde-9a45-08e2ef5c56eb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:26.578004 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dd31a71c-febf-4dde-9a45-08e2ef5c56eb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:26.578719 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dd31a71c-febf-4dde-9a45-08e2ef5c56eb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:26.579163 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0f30472b-433c-4020-bdde-ff945efa91a2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:26.579320 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dd31a71c-febf-4dde-9a45-08e2ef5c56eb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:26.579607 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dd31a71c-febf-4dde-9a45-08e2ef5c56eb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:26.579805 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0f30472b-433c-4020-bdde-ff945efa91a2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:26.580082 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0f30472b-433c-4020-bdde-ff945efa91a2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:26.580760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0f30472b-433c-4020-bdde-ff945efa91a2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:26.581205 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0f30472b-433c-4020-bdde-ff945efa91a2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:26.581621 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0f30472b-433c-4020-bdde-ff945efa91a2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:26.772273 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-dd31a71c-febf-4dde-9a45-08e2ef5c56eb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:26.776875 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0f30472b-433c-4020-bdde-ff945efa91a2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:26.780809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-dd31a71c-febf-4dde-9a45-08e2ef5c56eb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.215157 Aug 10 13:00:26.781575 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1243/2469] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:26 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:26.784375 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0f30472b-433c-4020-bdde-ff945efa91a2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.216438 Aug 10 13:00:26.787388 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1227/2470] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:26 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:26.954100 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0ab6934c-1b15-47d5-88d4-21edc461ba9b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:26.954720 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0ab6934c-1b15-47d5-88d4-21edc461ba9b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:26.961389 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ab6934c-1b15-47d5-88d4-21edc461ba9b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:26.961874 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ab6934c-1b15-47d5-88d4-21edc461ba9b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:26.962308 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ab6934c-1b15-47d5-88d4-21edc461ba9b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:26.963000 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ab6934c-1b15-47d5-88d4-21edc461ba9b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:26.963482 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ab6934c-1b15-47d5-88d4-21edc461ba9b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:26.963909 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ab6934c-1b15-47d5-88d4-21edc461ba9b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:26.965005 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-77772d12-47b8-4543-b9d1-003897cd5d8b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:26.965613 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-77772d12-47b8-4543-b9d1-003897cd5d8b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:26.971510 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-77772d12-47b8-4543-b9d1-003897cd5d8b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:26.971986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-77772d12-47b8-4543-b9d1-003897cd5d8b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:26.972420 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-77772d12-47b8-4543-b9d1-003897cd5d8b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:26.973102 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-77772d12-47b8-4543-b9d1-003897cd5d8b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:26.973593 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-77772d12-47b8-4543-b9d1-003897cd5d8b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:26.974241 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-77772d12-47b8-4543-b9d1-003897cd5d8b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:27.158717 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0ab6934c-1b15-47d5-88d4-21edc461ba9b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:27.162115 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-77772d12-47b8-4543-b9d1-003897cd5d8b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:27.167170 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0ab6934c-1b15-47d5-88d4-21edc461ba9b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.216866 Aug 10 13:00:27.167859 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1244/2471] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:26 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:27.170533 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-77772d12-47b8-4543-b9d1-003897cd5d8b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:27.172102 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-77772d12-47b8-4543-b9d1-003897cd5d8b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:27.173248 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-77772d12-47b8-4543-b9d1-003897cd5d8b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.212058 Aug 10 13:00:27.173795 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1228/2472] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:26 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:00:27.802302 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-65b81b64-761e-4bd2-9bd0-f2f1ae75bd9f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:27.802944 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-65b81b64-761e-4bd2-9bd0-f2f1ae75bd9f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:27.805169 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6cb8f825-30ac-4c59-a487-e40213a01f18 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:27.805789 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6cb8f825-30ac-4c59-a487-e40213a01f18 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:27.809494 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-65b81b64-761e-4bd2-9bd0-f2f1ae75bd9f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:27.809973 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-65b81b64-761e-4bd2-9bd0-f2f1ae75bd9f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:27.810404 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-65b81b64-761e-4bd2-9bd0-f2f1ae75bd9f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:27.811087 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-65b81b64-761e-4bd2-9bd0-f2f1ae75bd9f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:27.811555 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-65b81b64-761e-4bd2-9bd0-f2f1ae75bd9f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:27.811975 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-65b81b64-761e-4bd2-9bd0-f2f1ae75bd9f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:27.812086 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6cb8f825-30ac-4c59-a487-e40213a01f18 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:27.812556 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6cb8f825-30ac-4c59-a487-e40213a01f18 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:27.812991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6cb8f825-30ac-4c59-a487-e40213a01f18 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:27.813681 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6cb8f825-30ac-4c59-a487-e40213a01f18 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:27.814134 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6cb8f825-30ac-4c59-a487-e40213a01f18 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:27.814560 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6cb8f825-30ac-4c59-a487-e40213a01f18 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:28.002689 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-65b81b64-761e-4bd2-9bd0-f2f1ae75bd9f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:28.007113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6cb8f825-30ac-4c59-a487-e40213a01f18 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:28.011588 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-65b81b64-761e-4bd2-9bd0-f2f1ae75bd9f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.213102 Aug 10 13:00:28.012175 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1245/2473] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:27 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:28.015015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6cb8f825-30ac-4c59-a487-e40213a01f18 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.213830 Aug 10 13:00:28.015603 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1229/2474] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:27 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:28.188168 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8451d8cb-2e17-478a-9d64-83f896b72d69 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:28.188710 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8451d8cb-2e17-478a-9d64-83f896b72d69 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:28.195932 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8451d8cb-2e17-478a-9d64-83f896b72d69 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:28.196471 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8451d8cb-2e17-478a-9d64-83f896b72d69 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:28.196885 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a27683f0-dddc-4305-9318-7790f6f576c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:28.197021 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8451d8cb-2e17-478a-9d64-83f896b72d69 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:28.197497 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a27683f0-dddc-4305-9318-7790f6f576c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:28.197605 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8451d8cb-2e17-478a-9d64-83f896b72d69 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:28.198036 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8451d8cb-2e17-478a-9d64-83f896b72d69 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:28.198453 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8451d8cb-2e17-478a-9d64-83f896b72d69 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:28.203302 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a27683f0-dddc-4305-9318-7790f6f576c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:28.203778 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a27683f0-dddc-4305-9318-7790f6f576c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:28.204209 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a27683f0-dddc-4305-9318-7790f6f576c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:28.204888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a27683f0-dddc-4305-9318-7790f6f576c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:28.205339 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a27683f0-dddc-4305-9318-7790f6f576c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:28.205759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a27683f0-dddc-4305-9318-7790f6f576c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:28.396407 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-8451d8cb-2e17-478a-9d64-83f896b72d69 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:28.399581 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a27683f0-dddc-4305-9318-7790f6f576c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:28.404583 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8451d8cb-2e17-478a-9d64-83f896b72d69 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.220384 Aug 10 13:00:28.405283 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1246/2475] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:28 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:28.408053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a27683f0-dddc-4305-9318-7790f6f576c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:28.409543 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a27683f0-dddc-4305-9318-7790f6f576c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:28.410708 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a27683f0-dddc-4305-9318-7790f6f576c6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.218567 Aug 10 13:00:28.411585 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1230/2476] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:28 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:29.034293 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-489f8c19-9c3a-4306-ac73-09e7ba288490 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:29.034905 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-489f8c19-9c3a-4306-ac73-09e7ba288490 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:29.036881 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7bc14143-d747-45e4-a090-ddf074173890 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:29.037546 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7bc14143-d747-45e4-a090-ddf074173890 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:29.042044 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-489f8c19-9c3a-4306-ac73-09e7ba288490 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:29.042527 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-489f8c19-9c3a-4306-ac73-09e7ba288490 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:29.042961 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-489f8c19-9c3a-4306-ac73-09e7ba288490 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:29.043682 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-489f8c19-9c3a-4306-ac73-09e7ba288490 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:29.043901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7bc14143-d747-45e4-a090-ddf074173890 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:29.044131 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-489f8c19-9c3a-4306-ac73-09e7ba288490 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:29.044388 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7bc14143-d747-45e4-a090-ddf074173890 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:29.044555 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-489f8c19-9c3a-4306-ac73-09e7ba288490 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:29.044820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7bc14143-d747-45e4-a090-ddf074173890 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:29.045507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7bc14143-d747-45e4-a090-ddf074173890 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:29.045954 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7bc14143-d747-45e4-a090-ddf074173890 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:29.046378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7bc14143-d747-45e4-a090-ddf074173890 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:29.238902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7bc14143-d747-45e4-a090-ddf074173890 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:29.248355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7bc14143-d747-45e4-a090-ddf074173890 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.215889 Aug 10 13:00:29.248934 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1231/2477] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:29 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:29.249314 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-489f8c19-9c3a-4306-ac73-09e7ba288490 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:29.258959 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-489f8c19-9c3a-4306-ac73-09e7ba288490 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.228936 Aug 10 13:00:29.260006 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1247/2478] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:29 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:29.428938 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5db9075d-1159-4c8b-924a-55f963166e76 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:29.428938 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5db9075d-1159-4c8b-924a-55f963166e76 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:29.433430 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5db9075d-1159-4c8b-924a-55f963166e76 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:29.433910 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5db9075d-1159-4c8b-924a-55f963166e76 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:29.434036 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f3038237-16d2-4066-a893-5a2d799670f8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:29.434343 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5db9075d-1159-4c8b-924a-55f963166e76 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:29.434509 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f3038237-16d2-4066-a893-5a2d799670f8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:29.435029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5db9075d-1159-4c8b-924a-55f963166e76 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:29.435506 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5db9075d-1159-4c8b-924a-55f963166e76 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:29.435932 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5db9075d-1159-4c8b-924a-55f963166e76 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:29.440351 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f3038237-16d2-4066-a893-5a2d799670f8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:29.440835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f3038237-16d2-4066-a893-5a2d799670f8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:29.441270 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f3038237-16d2-4066-a893-5a2d799670f8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:29.441959 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f3038237-16d2-4066-a893-5a2d799670f8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:29.442919 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f3038237-16d2-4066-a893-5a2d799670f8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:29.443370 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f3038237-16d2-4066-a893-5a2d799670f8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:29.630977 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5db9075d-1159-4c8b-924a-55f963166e76 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:29.638637 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f3038237-16d2-4066-a893-5a2d799670f8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:29.639292 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5db9075d-1159-4c8b-924a-55f963166e76 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.216804 Aug 10 13:00:29.639871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1232/2479] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:29 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:29.647777 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f3038237-16d2-4066-a893-5a2d799670f8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:29.649513 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f3038237-16d2-4066-a893-5a2d799670f8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:29.650754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f3038237-16d2-4066-a893-5a2d799670f8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.220707 Aug 10 13:00:29.651593 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1248/2480] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:29 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:00:30.269547 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b57c007d-3ab4-4786-8970-848fd13d42b2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:30.270182 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b57c007d-3ab4-4786-8970-848fd13d42b2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:30.273120 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=98 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:00:30.278139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b57c007d-3ab4-4786-8970-848fd13d42b2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:30.278709 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b57c007d-3ab4-4786-8970-848fd13d42b2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:30.279152 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b57c007d-3ab4-4786-8970-848fd13d42b2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:30.279952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b57c007d-3ab4-4786-8970-848fd13d42b2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:30.280404 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b57c007d-3ab4-4786-8970-848fd13d42b2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:30.280828 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b57c007d-3ab4-4786-8970-848fd13d42b2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:30.281548 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f7805cd0-8502-414d-925a-26e1e930bd8f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:30.282132 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f7805cd0-8502-414d-925a-26e1e930bd8f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:30.288950 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f7805cd0-8502-414d-925a-26e1e930bd8f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:30.289501 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f7805cd0-8502-414d-925a-26e1e930bd8f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:30.294097 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f7805cd0-8502-414d-925a-26e1e930bd8f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:30.294097 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f7805cd0-8502-414d-925a-26e1e930bd8f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:30.294097 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f7805cd0-8502-414d-925a-26e1e930bd8f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:30.294097 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f7805cd0-8502-414d-925a-26e1e930bd8f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:30.475544 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b57c007d-3ab4-4786-8970-848fd13d42b2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:30.479937 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f7805cd0-8502-414d-925a-26e1e930bd8f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:30.483755 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b57c007d-3ab4-4786-8970-848fd13d42b2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.218027 Aug 10 13:00:30.484330 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1233/2481] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:30 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:30.488202 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f7805cd0-8502-414d-925a-26e1e930bd8f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.211256 Aug 10 13:00:30.488868 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1249/2482] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:30 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:30.659452 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bfe724ae-82f6-4412-9f41-7c9af938243c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:30.660213 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bfe724ae-82f6-4412-9f41-7c9af938243c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:30.666342 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bfe724ae-82f6-4412-9f41-7c9af938243c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:30.666821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bfe724ae-82f6-4412-9f41-7c9af938243c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:30.667315 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bfe724ae-82f6-4412-9f41-7c9af938243c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:30.668005 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bfe724ae-82f6-4412-9f41-7c9af938243c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:30.668672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bfe724ae-82f6-4412-9f41-7c9af938243c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:30.668877 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bfe724ae-82f6-4412-9f41-7c9af938243c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:30.674930 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2c9db468-0a52-44c1-bfd0-097db99bb2da tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:30.675867 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2c9db468-0a52-44c1-bfd0-097db99bb2da tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:30.682934 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c9db468-0a52-44c1-bfd0-097db99bb2da tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:30.683441 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c9db468-0a52-44c1-bfd0-097db99bb2da tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:30.683870 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c9db468-0a52-44c1-bfd0-097db99bb2da tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:30.684555 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c9db468-0a52-44c1-bfd0-097db99bb2da tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:30.685001 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c9db468-0a52-44c1-bfd0-097db99bb2da tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:30.685416 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2c9db468-0a52-44c1-bfd0-097db99bb2da tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:30.873478 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-bfe724ae-82f6-4412-9f41-7c9af938243c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:30.877381 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2c9db468-0a52-44c1-bfd0-097db99bb2da tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:30.881418 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bfe724ae-82f6-4412-9f41-7c9af938243c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.225894 Aug 10 13:00:30.881988 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1234/2483] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:30 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:30.886328 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2c9db468-0a52-44c1-bfd0-097db99bb2da tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:30.888016 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2c9db468-0a52-44c1-bfd0-097db99bb2da tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:30.889119 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2c9db468-0a52-44c1-bfd0-097db99bb2da tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.219005 Aug 10 13:00:30.889712 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1250/2484] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:30 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:00:31.506125 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-afa40ed3-4367-4b71-a68f-ac1fe693c6e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:31.506869 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-afa40ed3-4367-4b71-a68f-ac1fe693c6e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:31.510003 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-85586d04-b06a-49e2-947d-618482e4b230 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:31.510611 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-85586d04-b06a-49e2-947d-618482e4b230 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:31.513365 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-afa40ed3-4367-4b71-a68f-ac1fe693c6e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:31.513848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-afa40ed3-4367-4b71-a68f-ac1fe693c6e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:31.514283 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-afa40ed3-4367-4b71-a68f-ac1fe693c6e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:31.514972 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-afa40ed3-4367-4b71-a68f-ac1fe693c6e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:31.515456 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-afa40ed3-4367-4b71-a68f-ac1fe693c6e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:31.515881 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-afa40ed3-4367-4b71-a68f-ac1fe693c6e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:31.516842 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-85586d04-b06a-49e2-947d-618482e4b230 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:31.517313 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-85586d04-b06a-49e2-947d-618482e4b230 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:31.517740 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-85586d04-b06a-49e2-947d-618482e4b230 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:31.518413 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-85586d04-b06a-49e2-947d-618482e4b230 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:31.518856 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-85586d04-b06a-49e2-947d-618482e4b230 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:31.519297 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-85586d04-b06a-49e2-947d-618482e4b230 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:31.522539 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:00:31.712739 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-afa40ed3-4367-4b71-a68f-ac1fe693c6e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:31.716589 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-85586d04-b06a-49e2-947d-618482e4b230 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:31.720919 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-afa40ed3-4367-4b71-a68f-ac1fe693c6e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.219154 Aug 10 13:00:31.721502 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1235/2485] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:31 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:31.724776 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-85586d04-b06a-49e2-947d-618482e4b230 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.218544 Aug 10 13:00:31.725332 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1251/2486] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:31 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:31.903281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-baabe2d7-d975-41ab-b01e-75bc83457ca5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:31.903809 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-baabe2d7-d975-41ab-b01e-75bc83457ca5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:31.909679 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-baabe2d7-d975-41ab-b01e-75bc83457ca5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:31.910156 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-baabe2d7-d975-41ab-b01e-75bc83457ca5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:31.910583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-baabe2d7-d975-41ab-b01e-75bc83457ca5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:31.911950 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-baabe2d7-d975-41ab-b01e-75bc83457ca5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:31.912690 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-baabe2d7-d975-41ab-b01e-75bc83457ca5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:31.913114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-baabe2d7-d975-41ab-b01e-75bc83457ca5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:31.917529 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ae3d1314-3f19-405c-9784-ed5b201713ac tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:31.918122 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ae3d1314-3f19-405c-9784-ed5b201713ac tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:31.924025 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ae3d1314-3f19-405c-9784-ed5b201713ac tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:31.924501 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ae3d1314-3f19-405c-9784-ed5b201713ac tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:31.924929 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ae3d1314-3f19-405c-9784-ed5b201713ac tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:31.925616 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ae3d1314-3f19-405c-9784-ed5b201713ac tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:31.926060 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ae3d1314-3f19-405c-9784-ed5b201713ac tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:31.926475 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ae3d1314-3f19-405c-9784-ed5b201713ac tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:32.115672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-baabe2d7-d975-41ab-b01e-75bc83457ca5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:32.119359 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ae3d1314-3f19-405c-9784-ed5b201713ac tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:32.124053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-baabe2d7-d975-41ab-b01e-75bc83457ca5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.224801 Aug 10 13:00:32.124797 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1236/2487] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:31 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:32.127871 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ae3d1314-3f19-405c-9784-ed5b201713ac tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:32.129386 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ae3d1314-3f19-405c-9784-ed5b201713ac tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:32.131158 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ae3d1314-3f19-405c-9784-ed5b201713ac tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.217636 Aug 10 13:00:32.131756 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1252/2488] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:31 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:32.742788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-cee8bac5-c634-4ca0-a513-54e3f3cff928 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:32.743382 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-cee8bac5-c634-4ca0-a513-54e3f3cff928 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:32.745344 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a53a0ca8-54a9-4e86-a86c-473c2987c7ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:32.745954 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a53a0ca8-54a9-4e86-a86c-473c2987c7ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:32.749827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cee8bac5-c634-4ca0-a513-54e3f3cff928 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:32.750298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cee8bac5-c634-4ca0-a513-54e3f3cff928 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:32.750723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cee8bac5-c634-4ca0-a513-54e3f3cff928 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:32.751437 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cee8bac5-c634-4ca0-a513-54e3f3cff928 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:32.751883 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cee8bac5-c634-4ca0-a513-54e3f3cff928 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:32.752299 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cee8bac5-c634-4ca0-a513-54e3f3cff928 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:32.752407 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a53a0ca8-54a9-4e86-a86c-473c2987c7ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:32.752769 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a53a0ca8-54a9-4e86-a86c-473c2987c7ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:32.753196 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a53a0ca8-54a9-4e86-a86c-473c2987c7ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:32.753873 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a53a0ca8-54a9-4e86-a86c-473c2987c7ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:32.754318 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a53a0ca8-54a9-4e86-a86c-473c2987c7ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:32.754948 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a53a0ca8-54a9-4e86-a86c-473c2987c7ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:32.945379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-cee8bac5-c634-4ca0-a513-54e3f3cff928 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:32.949133 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a53a0ca8-54a9-4e86-a86c-473c2987c7ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:32.953522 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-cee8bac5-c634-4ca0-a513-54e3f3cff928 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.215056 Aug 10 13:00:32.954101 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1237/2489] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:32 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:32.956928 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a53a0ca8-54a9-4e86-a86c-473c2987c7ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.215304 Aug 10 13:00:32.957495 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1253/2490] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:32 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:33.145329 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-94a12f8a-cc9e-42af-8ed2-18bc576bae97 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:33.146745 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-94a12f8a-cc9e-42af-8ed2-18bc576bae97 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:33.153009 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94a12f8a-cc9e-42af-8ed2-18bc576bae97 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:33.153495 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94a12f8a-cc9e-42af-8ed2-18bc576bae97 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:33.154045 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94a12f8a-cc9e-42af-8ed2-18bc576bae97 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:33.154735 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94a12f8a-cc9e-42af-8ed2-18bc576bae97 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:33.155203 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94a12f8a-cc9e-42af-8ed2-18bc576bae97 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:33.155633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94a12f8a-cc9e-42af-8ed2-18bc576bae97 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:33.155762 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-792adbdc-c711-44cc-8530-8e97113b083d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:33.156670 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-792adbdc-c711-44cc-8530-8e97113b083d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:33.164225 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-792adbdc-c711-44cc-8530-8e97113b083d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:33.164834 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-792adbdc-c711-44cc-8530-8e97113b083d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:33.165406 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-792adbdc-c711-44cc-8530-8e97113b083d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:33.166109 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-792adbdc-c711-44cc-8530-8e97113b083d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:33.166626 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-792adbdc-c711-44cc-8530-8e97113b083d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:33.167063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-792adbdc-c711-44cc-8530-8e97113b083d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:33.353472 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-94a12f8a-cc9e-42af-8ed2-18bc576bae97 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:33.357686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-792adbdc-c711-44cc-8530-8e97113b083d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:33.361769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-94a12f8a-cc9e-42af-8ed2-18bc576bae97 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.220539 Aug 10 13:00:33.362341 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1238/2491] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:33 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:33.366537 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-792adbdc-c711-44cc-8530-8e97113b083d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:33.368123 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-792adbdc-c711-44cc-8530-8e97113b083d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:33.369340 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-792adbdc-c711-44cc-8530-8e97113b083d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.218292 Aug 10 13:00:33.369894 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1254/2492] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:33 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:00:33.975543 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1f1fe764-17b8-4af7-9d32-407c7b75806c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:33.976161 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1f1fe764-17b8-4af7-9d32-407c7b75806c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:33.977987 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-294df5b7-8322-415c-873f-a2c9bdfb7b62 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:33.978598 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-294df5b7-8322-415c-873f-a2c9bdfb7b62 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:33.983030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1f1fe764-17b8-4af7-9d32-407c7b75806c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:33.983579 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1f1fe764-17b8-4af7-9d32-407c7b75806c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:33.984013 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1f1fe764-17b8-4af7-9d32-407c7b75806c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:33.984708 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1f1fe764-17b8-4af7-9d32-407c7b75806c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:33.985162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1f1fe764-17b8-4af7-9d32-407c7b75806c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:33.985397 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-294df5b7-8322-415c-873f-a2c9bdfb7b62 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:33.985616 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1f1fe764-17b8-4af7-9d32-407c7b75806c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:33.985883 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-294df5b7-8322-415c-873f-a2c9bdfb7b62 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:33.986317 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-294df5b7-8322-415c-873f-a2c9bdfb7b62 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:33.987009 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-294df5b7-8322-415c-873f-a2c9bdfb7b62 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:33.987486 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-294df5b7-8322-415c-873f-a2c9bdfb7b62 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:33.987915 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-294df5b7-8322-415c-873f-a2c9bdfb7b62 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:34.180351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1f1fe764-17b8-4af7-9d32-407c7b75806c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:34.184063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-294df5b7-8322-415c-873f-a2c9bdfb7b62 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:34.188312 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1f1fe764-17b8-4af7-9d32-407c7b75806c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.216805 Aug 10 13:00:34.188881 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1239/2493] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:33 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:34.193191 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-294df5b7-8322-415c-873f-a2c9bdfb7b62 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.218235 Aug 10 13:00:34.193887 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1255/2494] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:33 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:34.383390 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b64bebc0-142b-4014-9a84-2b51a4a3d555 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:34.384001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b64bebc0-142b-4014-9a84-2b51a4a3d555 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:34.389898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b64bebc0-142b-4014-9a84-2b51a4a3d555 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:34.390375 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b64bebc0-142b-4014-9a84-2b51a4a3d555 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:34.390837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b64bebc0-142b-4014-9a84-2b51a4a3d555 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:34.391557 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b64bebc0-142b-4014-9a84-2b51a4a3d555 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:34.392005 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b64bebc0-142b-4014-9a84-2b51a4a3d555 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:34.392427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b64bebc0-142b-4014-9a84-2b51a4a3d555 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:34.393199 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6f9e9c90-dc13-44f7-8ebe-7a04f23fa69b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:34.393817 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6f9e9c90-dc13-44f7-8ebe-7a04f23fa69b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:34.394982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:00:34.400280 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f9e9c90-dc13-44f7-8ebe-7a04f23fa69b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:34.400757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f9e9c90-dc13-44f7-8ebe-7a04f23fa69b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:34.401189 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f9e9c90-dc13-44f7-8ebe-7a04f23fa69b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:34.401900 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f9e9c90-dc13-44f7-8ebe-7a04f23fa69b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:34.402382 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f9e9c90-dc13-44f7-8ebe-7a04f23fa69b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:34.402857 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f9e9c90-dc13-44f7-8ebe-7a04f23fa69b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:34.585374 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b64bebc0-142b-4014-9a84-2b51a4a3d555 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:34.593230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b64bebc0-142b-4014-9a84-2b51a4a3d555 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.213850 Aug 10 13:00:34.594128 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1240/2495] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:34 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:34.596692 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6f9e9c90-dc13-44f7-8ebe-7a04f23fa69b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:34.606184 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6f9e9c90-dc13-44f7-8ebe-7a04f23fa69b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:34.607760 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6f9e9c90-dc13-44f7-8ebe-7a04f23fa69b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:34.608931 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6f9e9c90-dc13-44f7-8ebe-7a04f23fa69b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.219855 Aug 10 13:00:34.609494 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1256/2496] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:34 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:35.210333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-81564f6f-7a58-40de-b0d8-b20316a4033d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:35.211087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-81564f6f-7a58-40de-b0d8-b20316a4033d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:35.213735 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2ee7fc82-f987-496c-a067-dfbeccc745c7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:35.214359 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2ee7fc82-f987-496c-a067-dfbeccc745c7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:35.217582 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81564f6f-7a58-40de-b0d8-b20316a4033d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:35.218058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81564f6f-7a58-40de-b0d8-b20316a4033d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:35.218492 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81564f6f-7a58-40de-b0d8-b20316a4033d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:35.219196 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81564f6f-7a58-40de-b0d8-b20316a4033d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:35.219642 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81564f6f-7a58-40de-b0d8-b20316a4033d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:35.220060 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81564f6f-7a58-40de-b0d8-b20316a4033d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:35.220712 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2ee7fc82-f987-496c-a067-dfbeccc745c7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:35.221188 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2ee7fc82-f987-496c-a067-dfbeccc745c7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:35.221621 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2ee7fc82-f987-496c-a067-dfbeccc745c7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:35.222309 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2ee7fc82-f987-496c-a067-dfbeccc745c7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:35.222762 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2ee7fc82-f987-496c-a067-dfbeccc745c7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:35.223219 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2ee7fc82-f987-496c-a067-dfbeccc745c7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:35.422380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-81564f6f-7a58-40de-b0d8-b20316a4033d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:35.426476 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2ee7fc82-f987-496c-a067-dfbeccc745c7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:35.430405 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-81564f6f-7a58-40de-b0d8-b20316a4033d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.224094 Aug 10 13:00:35.430997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1241/2497] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:35 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:35.434805 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2ee7fc82-f987-496c-a067-dfbeccc745c7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.224905 Aug 10 13:00:35.435581 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1257/2498] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:35 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:35.614657 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-00939a10-fdf0-4c78-b1ec-64d338197c60 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:35.615862 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-00939a10-fdf0-4c78-b1ec-64d338197c60 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:35.621707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-00939a10-fdf0-4c78-b1ec-64d338197c60 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:35.622182 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-00939a10-fdf0-4c78-b1ec-64d338197c60 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:35.622610 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-00939a10-fdf0-4c78-b1ec-64d338197c60 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:35.623308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-00939a10-fdf0-4c78-b1ec-64d338197c60 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:35.623796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-00939a10-fdf0-4c78-b1ec-64d338197c60 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:35.624211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-00939a10-fdf0-4c78-b1ec-64d338197c60 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:35.632271 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6355cb13-8108-4e5f-b5d5-94443ac404f0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:35.632881 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6355cb13-8108-4e5f-b5d5-94443ac404f0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:35.638857 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6355cb13-8108-4e5f-b5d5-94443ac404f0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:35.639466 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6355cb13-8108-4e5f-b5d5-94443ac404f0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:35.640058 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6355cb13-8108-4e5f-b5d5-94443ac404f0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:35.640743 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6355cb13-8108-4e5f-b5d5-94443ac404f0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:35.641186 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6355cb13-8108-4e5f-b5d5-94443ac404f0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:35.641602 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6355cb13-8108-4e5f-b5d5-94443ac404f0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:35.823919 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-00939a10-fdf0-4c78-b1ec-64d338197c60 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:35.830852 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6355cb13-8108-4e5f-b5d5-94443ac404f0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:35.831796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-00939a10-fdf0-4c78-b1ec-64d338197c60 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.220882 Aug 10 13:00:35.832379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1242/2499] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:35 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:35.840654 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6355cb13-8108-4e5f-b5d5-94443ac404f0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:35.842131 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6355cb13-8108-4e5f-b5d5-94443ac404f0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:35.843340 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6355cb13-8108-4e5f-b5d5-94443ac404f0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.215568 Aug 10 13:00:35.843890 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1258/2500] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:35 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:36.451865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0c6cda04-5174-45fe-9463-ae54008f4e0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:36.452471 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0c6cda04-5174-45fe-9463-ae54008f4e0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:36.456317 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3c9433af-7b49-4424-82fa-709cd6b3c701 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:36.456976 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3c9433af-7b49-4424-82fa-709cd6b3c701 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:36.458902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0c6cda04-5174-45fe-9463-ae54008f4e0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:36.459994 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0c6cda04-5174-45fe-9463-ae54008f4e0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:36.460427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0c6cda04-5174-45fe-9463-ae54008f4e0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:36.461114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0c6cda04-5174-45fe-9463-ae54008f4e0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:36.461555 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0c6cda04-5174-45fe-9463-ae54008f4e0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:36.461973 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0c6cda04-5174-45fe-9463-ae54008f4e0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:36.463730 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3c9433af-7b49-4424-82fa-709cd6b3c701 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:36.464212 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3c9433af-7b49-4424-82fa-709cd6b3c701 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:36.464644 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3c9433af-7b49-4424-82fa-709cd6b3c701 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:36.465323 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3c9433af-7b49-4424-82fa-709cd6b3c701 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:36.465800 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3c9433af-7b49-4424-82fa-709cd6b3c701 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:36.466227 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3c9433af-7b49-4424-82fa-709cd6b3c701 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:36.657370 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0c6cda04-5174-45fe-9463-ae54008f4e0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:36.660336 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3c9433af-7b49-4424-82fa-709cd6b3c701 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:36.666473 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0c6cda04-5174-45fe-9463-ae54008f4e0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.218320 Aug 10 13:00:36.667642 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1243/2501] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:36 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:36.669453 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3c9433af-7b49-4424-82fa-709cd6b3c701 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.216867 Aug 10 13:00:36.670033 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1259/2502] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:36 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:36.854098 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2b6c4c75-8728-4705-aea3-3f66ea4f0db4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:36.854626 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2b6c4c75-8728-4705-aea3-3f66ea4f0db4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:36.860501 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b6c4c75-8728-4705-aea3-3f66ea4f0db4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:36.860977 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b6c4c75-8728-4705-aea3-3f66ea4f0db4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:36.861404 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b6c4c75-8728-4705-aea3-3f66ea4f0db4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:36.862081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b6c4c75-8728-4705-aea3-3f66ea4f0db4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:36.862523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b6c4c75-8728-4705-aea3-3f66ea4f0db4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:36.862944 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b6c4c75-8728-4705-aea3-3f66ea4f0db4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:36.867340 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0e14f40f-1bec-44ed-bfd2-df1d59349ba5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:36.867958 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0e14f40f-1bec-44ed-bfd2-df1d59349ba5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:36.873757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e14f40f-1bec-44ed-bfd2-df1d59349ba5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:36.874234 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e14f40f-1bec-44ed-bfd2-df1d59349ba5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:36.874662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e14f40f-1bec-44ed-bfd2-df1d59349ba5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:36.875384 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e14f40f-1bec-44ed-bfd2-df1d59349ba5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:36.875831 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e14f40f-1bec-44ed-bfd2-df1d59349ba5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:36.876255 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e14f40f-1bec-44ed-bfd2-df1d59349ba5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:37.059343 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2b6c4c75-8728-4705-aea3-3f66ea4f0db4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:37.066167 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0e14f40f-1bec-44ed-bfd2-df1d59349ba5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:37.067314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2b6c4c75-8728-4705-aea3-3f66ea4f0db4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.217942 Aug 10 13:00:37.067898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1244/2503] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:36 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:37.074747 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0e14f40f-1bec-44ed-bfd2-df1d59349ba5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:37.076252 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0e14f40f-1bec-44ed-bfd2-df1d59349ba5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:37.077395 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0e14f40f-1bec-44ed-bfd2-df1d59349ba5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.214756 Aug 10 13:00:37.077943 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1260/2504] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:36 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:37.689420 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b41997a3-631c-416e-8ac1-c3eb78e3dccd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:37.690033 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b41997a3-631c-416e-8ac1-c3eb78e3dccd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:37.690803 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-45098288-238a-4b9d-8adb-fecb5bb2c6e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:37.691443 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-45098288-238a-4b9d-8adb-fecb5bb2c6e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:37.693828 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=98 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:00:37.696621 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b41997a3-631c-416e-8ac1-c3eb78e3dccd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:37.697098 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b41997a3-631c-416e-8ac1-c3eb78e3dccd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:37.697533 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b41997a3-631c-416e-8ac1-c3eb78e3dccd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:37.698224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b41997a3-631c-416e-8ac1-c3eb78e3dccd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:37.698356 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-45098288-238a-4b9d-8adb-fecb5bb2c6e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:37.698675 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b41997a3-631c-416e-8ac1-c3eb78e3dccd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:37.698805 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-45098288-238a-4b9d-8adb-fecb5bb2c6e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:37.699094 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b41997a3-631c-416e-8ac1-c3eb78e3dccd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:37.699241 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-45098288-238a-4b9d-8adb-fecb5bb2c6e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:37.699914 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-45098288-238a-4b9d-8adb-fecb5bb2c6e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:37.700376 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-45098288-238a-4b9d-8adb-fecb5bb2c6e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:37.700812 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-45098288-238a-4b9d-8adb-fecb5bb2c6e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:37.895705 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-45098288-238a-4b9d-8adb-fecb5bb2c6e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:37.900183 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b41997a3-631c-416e-8ac1-c3eb78e3dccd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:37.904401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-45098288-238a-4b9d-8adb-fecb5bb2c6e2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.217368 Aug 10 13:00:37.905179 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1261/2505] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:37 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:37.908570 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b41997a3-631c-416e-8ac1-c3eb78e3dccd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.223216 Aug 10 13:00:37.909140 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1245/2506] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:37 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:38.089518 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c2ff30c9-7af6-4457-a4c6-998cccc083e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:38.090078 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c2ff30c9-7af6-4457-a4c6-998cccc083e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:38.096081 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c2ff30c9-7af6-4457-a4c6-998cccc083e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:38.096565 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c2ff30c9-7af6-4457-a4c6-998cccc083e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:38.097003 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c2ff30c9-7af6-4457-a4c6-998cccc083e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:38.097693 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c2ff30c9-7af6-4457-a4c6-998cccc083e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:38.098145 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c2ff30c9-7af6-4457-a4c6-998cccc083e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:38.098571 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c2ff30c9-7af6-4457-a4c6-998cccc083e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:38.100924 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6343447b-f2c2-4198-88ae-0c695970d222 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:38.101524 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6343447b-f2c2-4198-88ae-0c695970d222 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:38.107552 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6343447b-f2c2-4198-88ae-0c695970d222 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:38.108025 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6343447b-f2c2-4198-88ae-0c695970d222 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:38.108591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6343447b-f2c2-4198-88ae-0c695970d222 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:38.109312 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6343447b-f2c2-4198-88ae-0c695970d222 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:38.109781 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6343447b-f2c2-4198-88ae-0c695970d222 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:38.110251 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6343447b-f2c2-4198-88ae-0c695970d222 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:38.294768 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c2ff30c9-7af6-4457-a4c6-998cccc083e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:38.297861 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6343447b-f2c2-4198-88ae-0c695970d222 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:38.302991 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c2ff30c9-7af6-4457-a4c6-998cccc083e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.217474 Aug 10 13:00:38.303607 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1262/2507] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:38 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:38.306349 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6343447b-f2c2-4198-88ae-0c695970d222 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:38.307881 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6343447b-f2c2-4198-88ae-0c695970d222 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:38.309056 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6343447b-f2c2-4198-88ae-0c695970d222 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.212607 Aug 10 13:00:38.309601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1246/2508] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:38 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:38.925797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-04a66a25-fd94-43d1-afee-0365fa9d6b13 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:38.926469 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-04a66a25-fd94-43d1-afee-0365fa9d6b13 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:38.929755 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c36402e3-bc5a-4ac0-add7-293a45225e36 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:38.930370 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c36402e3-bc5a-4ac0-add7-293a45225e36 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:38.933290 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-04a66a25-fd94-43d1-afee-0365fa9d6b13 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:38.933779 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-04a66a25-fd94-43d1-afee-0365fa9d6b13 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:38.934214 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-04a66a25-fd94-43d1-afee-0365fa9d6b13 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:38.934907 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-04a66a25-fd94-43d1-afee-0365fa9d6b13 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:38.935391 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-04a66a25-fd94-43d1-afee-0365fa9d6b13 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:38.935818 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-04a66a25-fd94-43d1-afee-0365fa9d6b13 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:38.936761 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c36402e3-bc5a-4ac0-add7-293a45225e36 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:38.937241 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c36402e3-bc5a-4ac0-add7-293a45225e36 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:38.937676 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c36402e3-bc5a-4ac0-add7-293a45225e36 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:38.938361 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c36402e3-bc5a-4ac0-add7-293a45225e36 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:38.938809 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c36402e3-bc5a-4ac0-add7-293a45225e36 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:38.939263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c36402e3-bc5a-4ac0-add7-293a45225e36 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:39.128089 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-04a66a25-fd94-43d1-afee-0365fa9d6b13 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:39.134827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c36402e3-bc5a-4ac0-add7-293a45225e36 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:39.136133 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-04a66a25-fd94-43d1-afee-0365fa9d6b13 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.214148 Aug 10 13:00:39.136913 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1263/2509] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:38 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:39.143802 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c36402e3-bc5a-4ac0-add7-293a45225e36 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.217927 Aug 10 13:00:39.144367 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1247/2510] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:38 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:39.324538 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e87249b1-7f49-48c9-bf69-fe970d3d4696 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:39.325147 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e87249b1-7f49-48c9-bf69-fe970d3d4696 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:39.331280 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e87249b1-7f49-48c9-bf69-fe970d3d4696 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:39.331765 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e87249b1-7f49-48c9-bf69-fe970d3d4696 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:39.332196 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e87249b1-7f49-48c9-bf69-fe970d3d4696 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:39.332885 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e87249b1-7f49-48c9-bf69-fe970d3d4696 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:39.333340 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e87249b1-7f49-48c9-bf69-fe970d3d4696 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:39.333558 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a91617df-1825-443b-aa62-9730a88626f1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:39.334368 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e87249b1-7f49-48c9-bf69-fe970d3d4696 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:39.335164 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a91617df-1825-443b-aa62-9730a88626f1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:39.341903 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a91617df-1825-443b-aa62-9730a88626f1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:39.342456 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a91617df-1825-443b-aa62-9730a88626f1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:39.342909 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a91617df-1825-443b-aa62-9730a88626f1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:39.343619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a91617df-1825-443b-aa62-9730a88626f1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:39.344065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a91617df-1825-443b-aa62-9730a88626f1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:39.344485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a91617df-1825-443b-aa62-9730a88626f1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:39.527744 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e87249b1-7f49-48c9-bf69-fe970d3d4696 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:39.531952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a91617df-1825-443b-aa62-9730a88626f1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:39.535892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e87249b1-7f49-48c9-bf69-fe970d3d4696 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.215193 Aug 10 13:00:39.536655 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1264/2511] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:39 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:39.541777 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a91617df-1825-443b-aa62-9730a88626f1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:39.543428 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a91617df-1825-443b-aa62-9730a88626f1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:39.544685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a91617df-1825-443b-aa62-9730a88626f1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.216271 Aug 10 13:00:39.545358 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1248/2512] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:39 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:40.157043 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3949cf55-17af-4ece-9bbd-7920671cd104 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:40.157662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3949cf55-17af-4ece-9bbd-7920671cd104 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:40.165129 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3949cf55-17af-4ece-9bbd-7920671cd104 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:40.165384 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-db3aea78-9559-4b00-8e59-a997f5305ed9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:40.165809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3949cf55-17af-4ece-9bbd-7920671cd104 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:40.166040 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3949cf55-17af-4ece-9bbd-7920671cd104 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:40.166153 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-db3aea78-9559-4b00-8e59-a997f5305ed9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:40.166735 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3949cf55-17af-4ece-9bbd-7920671cd104 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:40.167210 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3949cf55-17af-4ece-9bbd-7920671cd104 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:40.167647 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3949cf55-17af-4ece-9bbd-7920671cd104 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:40.172668 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-db3aea78-9559-4b00-8e59-a997f5305ed9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:40.173154 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-db3aea78-9559-4b00-8e59-a997f5305ed9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:40.173589 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-db3aea78-9559-4b00-8e59-a997f5305ed9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:40.174280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-db3aea78-9559-4b00-8e59-a997f5305ed9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:40.174733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-db3aea78-9559-4b00-8e59-a997f5305ed9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:40.175156 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-db3aea78-9559-4b00-8e59-a997f5305ed9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:40.355061 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3949cf55-17af-4ece-9bbd-7920671cd104 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:40.362979 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3949cf55-17af-4ece-9bbd-7920671cd104 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.209760 Aug 10 13:00:40.363584 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1265/2513] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:40 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:40.366230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-db3aea78-9559-4b00-8e59-a997f5305ed9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:40.374527 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-db3aea78-9559-4b00-8e59-a997f5305ed9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.213609 Aug 10 13:00:40.375086 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1249/2514] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:40 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:40.557892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2209fa22-9e9a-443d-83c5-1a6ac819881c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:40.558499 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2209fa22-9e9a-443d-83c5-1a6ac819881c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:40.564337 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2209fa22-9e9a-443d-83c5-1a6ac819881c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:40.564814 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2209fa22-9e9a-443d-83c5-1a6ac819881c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:40.565240 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2209fa22-9e9a-443d-83c5-1a6ac819881c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:40.565923 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2209fa22-9e9a-443d-83c5-1a6ac819881c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:40.566369 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2209fa22-9e9a-443d-83c5-1a6ac819881c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:40.566783 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2209fa22-9e9a-443d-83c5-1a6ac819881c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:40.567228 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3b05eacd-e269-4f8d-a69f-12482ffa4c7a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:40.567718 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3b05eacd-e269-4f8d-a69f-12482ffa4c7a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:40.575066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3b05eacd-e269-4f8d-a69f-12482ffa4c7a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:40.575483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3b05eacd-e269-4f8d-a69f-12482ffa4c7a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:40.575912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3b05eacd-e269-4f8d-a69f-12482ffa4c7a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:40.576598 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3b05eacd-e269-4f8d-a69f-12482ffa4c7a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:40.577040 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3b05eacd-e269-4f8d-a69f-12482ffa4c7a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:40.577456 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3b05eacd-e269-4f8d-a69f-12482ffa4c7a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:40.761321 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2209fa22-9e9a-443d-83c5-1a6ac819881c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:40.764369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3b05eacd-e269-4f8d-a69f-12482ffa4c7a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:40.769837 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2209fa22-9e9a-443d-83c5-1a6ac819881c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.215709 Aug 10 13:00:40.770519 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1266/2515] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:40 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:40.772804 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3b05eacd-e269-4f8d-a69f-12482ffa4c7a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:40.774309 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3b05eacd-e269-4f8d-a69f-12482ffa4c7a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:40.775485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3b05eacd-e269-4f8d-a69f-12482ffa4c7a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.212627 Aug 10 13:00:40.776192 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1250/2516] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:40 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:41.383985 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e1a4dc64-b166-4dd6-bf67-b2c9f4d7a85e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:41.384617 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e1a4dc64-b166-4dd6-bf67-b2c9f4d7a85e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:41.391341 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1a4dc64-b166-4dd6-bf67-b2c9f4d7a85e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:41.391834 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1a4dc64-b166-4dd6-bf67-b2c9f4d7a85e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:41.392273 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1a4dc64-b166-4dd6-bf67-b2c9f4d7a85e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:41.392965 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1a4dc64-b166-4dd6-bf67-b2c9f4d7a85e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:41.393420 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1a4dc64-b166-4dd6-bf67-b2c9f4d7a85e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:41.393842 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1a4dc64-b166-4dd6-bf67-b2c9f4d7a85e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:41.394870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b06bdf1e-f307-4927-a797-9d7fcf99ab06 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:41.395513 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b06bdf1e-f307-4927-a797-9d7fcf99ab06 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:41.401917 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b06bdf1e-f307-4927-a797-9d7fcf99ab06 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:41.402403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b06bdf1e-f307-4927-a797-9d7fcf99ab06 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:41.402839 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b06bdf1e-f307-4927-a797-9d7fcf99ab06 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:41.403560 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b06bdf1e-f307-4927-a797-9d7fcf99ab06 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:41.404022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b06bdf1e-f307-4927-a797-9d7fcf99ab06 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:41.404449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b06bdf1e-f307-4927-a797-9d7fcf99ab06 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:41.813807 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e1a4dc64-b166-4dd6-bf67-b2c9f4d7a85e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:41.816819 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:00:41.817176 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b06bdf1e-f307-4927-a797-9d7fcf99ab06 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:41.824432 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e1a4dc64-b166-4dd6-bf67-b2c9f4d7a85e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.444263 Aug 10 13:00:41.825252 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1267/2517] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:41 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:41.826828 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b06bdf1e-f307-4927-a797-9d7fcf99ab06 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.435697 Aug 10 13:00:41.827640 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1251/2518] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:41 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:41.829876 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5c4259d1-dde9-4e42-a143-723efd78851c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:41.830479 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5c4259d1-dde9-4e42-a143-723efd78851c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:41.837848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-98eefc70-8282-4ca5-abaf-170a06928644 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:41.837848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-98eefc70-8282-4ca5-abaf-170a06928644 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:41.838084 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c4259d1-dde9-4e42-a143-723efd78851c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:41.838084 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c4259d1-dde9-4e42-a143-723efd78851c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:41.838084 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c4259d1-dde9-4e42-a143-723efd78851c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:41.838323 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98eefc70-8282-4ca5-abaf-170a06928644 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:41.838411 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c4259d1-dde9-4e42-a143-723efd78851c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:41.838774 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98eefc70-8282-4ca5-abaf-170a06928644 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:41.838905 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c4259d1-dde9-4e42-a143-723efd78851c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:41.839234 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98eefc70-8282-4ca5-abaf-170a06928644 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:41.839366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c4259d1-dde9-4e42-a143-723efd78851c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:41.839935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98eefc70-8282-4ca5-abaf-170a06928644 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:41.840388 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98eefc70-8282-4ca5-abaf-170a06928644 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:41.840820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98eefc70-8282-4ca5-abaf-170a06928644 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:42.039842 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5c4259d1-dde9-4e42-a143-723efd78851c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:42.042900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-98eefc70-8282-4ca5-abaf-170a06928644 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:42.048032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5c4259d1-dde9-4e42-a143-723efd78851c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.221814 Aug 10 13:00:42.048842 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1268/2519] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:41 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:42.052909 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-98eefc70-8282-4ca5-abaf-170a06928644 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:42.054664 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-98eefc70-8282-4ca5-abaf-170a06928644 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:42.056598 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-98eefc70-8282-4ca5-abaf-170a06928644 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.227643 Aug 10 13:00:42.056714 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1252/2520] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:41 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:00:42.852226 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-05a5ab90-0459-4f8e-b7f9-61ba141494df tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:42.852839 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-05a5ab90-0459-4f8e-b7f9-61ba141494df tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:42.859651 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-05a5ab90-0459-4f8e-b7f9-61ba141494df tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:42.860128 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-05a5ab90-0459-4f8e-b7f9-61ba141494df tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:42.860551 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-05a5ab90-0459-4f8e-b7f9-61ba141494df tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:42.860876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-845bcf8c-c9a9-4a93-b544-0b16aa935ddd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:42.861292 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-05a5ab90-0459-4f8e-b7f9-61ba141494df tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:42.861515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-845bcf8c-c9a9-4a93-b544-0b16aa935ddd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:42.861701 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-05a5ab90-0459-4f8e-b7f9-61ba141494df tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:42.862120 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-05a5ab90-0459-4f8e-b7f9-61ba141494df tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:42.868210 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-845bcf8c-c9a9-4a93-b544-0b16aa935ddd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:42.868697 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-845bcf8c-c9a9-4a93-b544-0b16aa935ddd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:42.869131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-845bcf8c-c9a9-4a93-b544-0b16aa935ddd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:42.869814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-845bcf8c-c9a9-4a93-b544-0b16aa935ddd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:42.870263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-845bcf8c-c9a9-4a93-b544-0b16aa935ddd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:42.870686 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-845bcf8c-c9a9-4a93-b544-0b16aa935ddd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:43.054866 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-05a5ab90-0459-4f8e-b7f9-61ba141494df tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:43.058085 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-845bcf8c-c9a9-4a93-b544-0b16aa935ddd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:43.063013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-05a5ab90-0459-4f8e-b7f9-61ba141494df tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.214797 Aug 10 13:00:43.065184 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1269/2521] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:42 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:43.066095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-845bcf8c-c9a9-4a93-b544-0b16aa935ddd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.208973 Aug 10 13:00:43.066819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1253/2522] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:42 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:43.070389 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b6968a88-8382-4cdb-bed9-ac2d891a03c4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:43.070998 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b6968a88-8382-4cdb-bed9-ac2d891a03c4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:43.076707 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b6968a88-8382-4cdb-bed9-ac2d891a03c4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:43.077180 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b6968a88-8382-4cdb-bed9-ac2d891a03c4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:43.077610 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b6968a88-8382-4cdb-bed9-ac2d891a03c4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:43.078289 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b6968a88-8382-4cdb-bed9-ac2d891a03c4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:43.078731 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b6968a88-8382-4cdb-bed9-ac2d891a03c4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:43.079150 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b6968a88-8382-4cdb-bed9-ac2d891a03c4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:43.085546 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b189b121-df45-4ef1-993e-562d8892cf22 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:43.086401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b189b121-df45-4ef1-993e-562d8892cf22 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:43.092276 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b189b121-df45-4ef1-993e-562d8892cf22 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:43.092836 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b189b121-df45-4ef1-993e-562d8892cf22 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:43.093340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b189b121-df45-4ef1-993e-562d8892cf22 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:43.094102 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b189b121-df45-4ef1-993e-562d8892cf22 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:43.094562 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b189b121-df45-4ef1-993e-562d8892cf22 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:43.094986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b189b121-df45-4ef1-993e-562d8892cf22 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:43.281967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b189b121-df45-4ef1-993e-562d8892cf22 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:43.285243 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b6968a88-8382-4cdb-bed9-ac2d891a03c4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:43.291010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b189b121-df45-4ef1-993e-562d8892cf22 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:43.292538 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b189b121-df45-4ef1-993e-562d8892cf22 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:43.293688 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b189b121-df45-4ef1-993e-562d8892cf22 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.212758 Aug 10 13:00:43.294191 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b6968a88-8382-4cdb-bed9-ac2d891a03c4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.228051 Aug 10 13:00:43.294353 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1254/2523] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:43 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:43.294753 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1270/2524] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:43 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:44.086957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-db5b6adf-e476-4cfc-b412-930316ee0068 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:44.087628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-db5b6adf-e476-4cfc-b412-930316ee0068 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:44.090391 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-cd58e087-5acc-4e8b-a353-6dea438e7828 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:44.091007 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-cd58e087-5acc-4e8b-a353-6dea438e7828 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:44.094323 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-db5b6adf-e476-4cfc-b412-930316ee0068 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:44.094800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-db5b6adf-e476-4cfc-b412-930316ee0068 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:44.095252 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-db5b6adf-e476-4cfc-b412-930316ee0068 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:44.095972 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-db5b6adf-e476-4cfc-b412-930316ee0068 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:44.096421 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-db5b6adf-e476-4cfc-b412-930316ee0068 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:44.096843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-db5b6adf-e476-4cfc-b412-930316ee0068 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:44.097300 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cd58e087-5acc-4e8b-a353-6dea438e7828 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:44.097776 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cd58e087-5acc-4e8b-a353-6dea438e7828 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:44.098210 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cd58e087-5acc-4e8b-a353-6dea438e7828 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:44.098892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cd58e087-5acc-4e8b-a353-6dea438e7828 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:44.100037 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cd58e087-5acc-4e8b-a353-6dea438e7828 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:44.100451 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cd58e087-5acc-4e8b-a353-6dea438e7828 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:44.305838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-db5b6adf-e476-4cfc-b412-930316ee0068 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:44.308682 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-cd58e087-5acc-4e8b-a353-6dea438e7828 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:44.314941 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-db5b6adf-e476-4cfc-b412-930316ee0068 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.232347 Aug 10 13:00:44.315568 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1255/2525] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:44 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:44.317043 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-cd58e087-5acc-4e8b-a353-6dea438e7828 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.230495 Aug 10 13:00:44.317758 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1271/2526] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:44 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:44.320508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-79b4f844-e896-44d8-8d90-29dd0c9e9d06 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:44.321104 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-79b4f844-e896-44d8-8d90-29dd0c9e9d06 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:44.322743 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-abb7be61-c00d-4063-81e5-af2c0c70159e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:44.323379 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-abb7be61-c00d-4063-81e5-af2c0c70159e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:44.326972 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-79b4f844-e896-44d8-8d90-29dd0c9e9d06 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:44.327479 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-79b4f844-e896-44d8-8d90-29dd0c9e9d06 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:44.327903 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-79b4f844-e896-44d8-8d90-29dd0c9e9d06 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:44.328587 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-79b4f844-e896-44d8-8d90-29dd0c9e9d06 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:44.329031 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-79b4f844-e896-44d8-8d90-29dd0c9e9d06 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:44.329158 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-abb7be61-c00d-4063-81e5-af2c0c70159e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:44.329451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-79b4f844-e896-44d8-8d90-29dd0c9e9d06 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:44.329568 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-abb7be61-c00d-4063-81e5-af2c0c70159e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:44.329969 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-abb7be61-c00d-4063-81e5-af2c0c70159e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:44.330657 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-abb7be61-c00d-4063-81e5-af2c0c70159e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:44.331124 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-abb7be61-c00d-4063-81e5-af2c0c70159e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:44.331708 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-abb7be61-c00d-4063-81e5-af2c0c70159e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:44.519294 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-79b4f844-e896-44d8-8d90-29dd0c9e9d06 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:44.521757 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:00:44.523059 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-abb7be61-c00d-4063-81e5-af2c0c70159e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:44.528421 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-79b4f844-e896-44d8-8d90-29dd0c9e9d06 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.211891 Aug 10 13:00:44.529003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1256/2527] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:44 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:44.532272 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-abb7be61-c00d-4063-81e5-af2c0c70159e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:44.533776 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-abb7be61-c00d-4063-81e5-af2c0c70159e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:44.534937 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-abb7be61-c00d-4063-81e5-af2c0c70159e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.215883 Aug 10 13:00:44.535649 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1272/2528] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:44 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:00:45.347304 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-91917eab-82ef-4499-b93b-47320b665a22 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:45.347826 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e57fd37d-797e-43e7-9b45-004973e3fb1d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:45.348207 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-91917eab-82ef-4499-b93b-47320b665a22 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:45.348334 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e57fd37d-797e-43e7-9b45-004973e3fb1d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:45.355255 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e57fd37d-797e-43e7-9b45-004973e3fb1d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:45.355444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91917eab-82ef-4499-b93b-47320b665a22 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:45.355765 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e57fd37d-797e-43e7-9b45-004973e3fb1d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:45.355923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91917eab-82ef-4499-b93b-47320b665a22 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:45.356195 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e57fd37d-797e-43e7-9b45-004973e3fb1d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:45.356321 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91917eab-82ef-4499-b93b-47320b665a22 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:45.356890 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91917eab-82ef-4499-b93b-47320b665a22 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:45.357041 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e57fd37d-797e-43e7-9b45-004973e3fb1d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:45.357336 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91917eab-82ef-4499-b93b-47320b665a22 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:45.357464 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e57fd37d-797e-43e7-9b45-004973e3fb1d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:45.357757 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91917eab-82ef-4499-b93b-47320b665a22 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:45.357866 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e57fd37d-797e-43e7-9b45-004973e3fb1d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:45.553897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-91917eab-82ef-4499-b93b-47320b665a22 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:45.557253 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e57fd37d-797e-43e7-9b45-004973e3fb1d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:45.561874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-91917eab-82ef-4499-b93b-47320b665a22 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.218504 Aug 10 13:00:45.562480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1257/2529] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:45 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:45.566005 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e57fd37d-797e-43e7-9b45-004973e3fb1d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.222270 Aug 10 13:00:45.566694 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1273/2530] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:45 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:45.566905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bc9cc17d-4357-4b44-995a-ba40ca8789ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:45.567534 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bc9cc17d-4357-4b44-995a-ba40ca8789ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:45.572266 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8431ce73-bb72-4cf6-b9be-289cb0bc5526 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:45.572880 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8431ce73-bb72-4cf6-b9be-289cb0bc5526 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:45.574116 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc9cc17d-4357-4b44-995a-ba40ca8789ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:45.574599 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc9cc17d-4357-4b44-995a-ba40ca8789ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:45.575027 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc9cc17d-4357-4b44-995a-ba40ca8789ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:45.575733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc9cc17d-4357-4b44-995a-ba40ca8789ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:45.576179 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc9cc17d-4357-4b44-995a-ba40ca8789ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:45.576594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc9cc17d-4357-4b44-995a-ba40ca8789ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:45.585383 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8431ce73-bb72-4cf6-b9be-289cb0bc5526 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:45.586002 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8431ce73-bb72-4cf6-b9be-289cb0bc5526 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:45.586433 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8431ce73-bb72-4cf6-b9be-289cb0bc5526 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:45.587125 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8431ce73-bb72-4cf6-b9be-289cb0bc5526 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:45.587613 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8431ce73-bb72-4cf6-b9be-289cb0bc5526 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:45.588083 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8431ce73-bb72-4cf6-b9be-289cb0bc5526 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:45.771889 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-bc9cc17d-4357-4b44-995a-ba40ca8789ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:45.778643 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-8431ce73-bb72-4cf6-b9be-289cb0bc5526 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:45.779902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bc9cc17d-4357-4b44-995a-ba40ca8789ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.216456 Aug 10 13:00:45.780644 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1258/2531] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:45 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:45.787796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-8431ce73-bb72-4cf6-b9be-289cb0bc5526 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:45.789315 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-8431ce73-bb72-4cf6-b9be-289cb0bc5526 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:45.790475 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8431ce73-bb72-4cf6-b9be-289cb0bc5526 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.222949 Aug 10 13:00:45.791031 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1274/2532] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:45 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:00:46.588675 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e2a165d7-4ee9-4b17-a28f-6be19741ddf0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:46.589229 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e2a165d7-4ee9-4b17-a28f-6be19741ddf0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:46.590126 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-641e24ee-87fa-4a4b-9130-7787cff12bbb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:46.590763 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-641e24ee-87fa-4a4b-9130-7787cff12bbb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:46.595761 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2a165d7-4ee9-4b17-a28f-6be19741ddf0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:46.596245 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2a165d7-4ee9-4b17-a28f-6be19741ddf0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:46.596673 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2a165d7-4ee9-4b17-a28f-6be19741ddf0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:46.597269 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-641e24ee-87fa-4a4b-9130-7787cff12bbb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:46.597391 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2a165d7-4ee9-4b17-a28f-6be19741ddf0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:46.597743 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-641e24ee-87fa-4a4b-9130-7787cff12bbb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:46.597894 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2a165d7-4ee9-4b17-a28f-6be19741ddf0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:46.598182 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-641e24ee-87fa-4a4b-9130-7787cff12bbb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:46.598316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2a165d7-4ee9-4b17-a28f-6be19741ddf0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:46.598847 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-641e24ee-87fa-4a4b-9130-7787cff12bbb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:46.599868 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-641e24ee-87fa-4a4b-9130-7787cff12bbb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:46.600307 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-641e24ee-87fa-4a4b-9130-7787cff12bbb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:46.859418 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e2a165d7-4ee9-4b17-a28f-6be19741ddf0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:46.868053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e2a165d7-4ee9-4b17-a28f-6be19741ddf0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.283815 Aug 10 13:00:46.878173 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1259/2533] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:46 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:46.878397 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-641e24ee-87fa-4a4b-9130-7787cff12bbb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:46.878520 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-07a23eed-577c-4039-b84f-9a27dcb8674a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:46.878520 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-07a23eed-577c-4039-b84f-9a27dcb8674a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:46.880463 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-641e24ee-87fa-4a4b-9130-7787cff12bbb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.293086 Aug 10 13:00:46.880607 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07a23eed-577c-4039-b84f-9a27dcb8674a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:46.881352 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1275/2534] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:46 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:46.882229 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07a23eed-577c-4039-b84f-9a27dcb8674a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:46.882836 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07a23eed-577c-4039-b84f-9a27dcb8674a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:46.883711 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07a23eed-577c-4039-b84f-9a27dcb8674a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:46.884277 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07a23eed-577c-4039-b84f-9a27dcb8674a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:46.884924 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07a23eed-577c-4039-b84f-9a27dcb8674a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:46.886080 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a86aa147-7565-41c7-9aab-efc2a4544c02 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:46.886802 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a86aa147-7565-41c7-9aab-efc2a4544c02 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:46.893291 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a86aa147-7565-41c7-9aab-efc2a4544c02 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:46.897349 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a86aa147-7565-41c7-9aab-efc2a4544c02 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:46.898002 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a86aa147-7565-41c7-9aab-efc2a4544c02 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:46.898732 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a86aa147-7565-41c7-9aab-efc2a4544c02 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:46.899309 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a86aa147-7565-41c7-9aab-efc2a4544c02 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:46.899730 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a86aa147-7565-41c7-9aab-efc2a4544c02 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:47.184246 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-07a23eed-577c-4039-b84f-9a27dcb8674a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:47.192121 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-07a23eed-577c-4039-b84f-9a27dcb8674a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.321982 Aug 10 13:00:47.192876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1260/2535] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:46 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:47.208140 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a86aa147-7565-41c7-9aab-efc2a4544c02 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:47.217646 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a86aa147-7565-41c7-9aab-efc2a4544c02 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:47.219151 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a86aa147-7565-41c7-9aab-efc2a4544c02 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:47.220334 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a86aa147-7565-41c7-9aab-efc2a4544c02 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.337977 Aug 10 13:00:47.221003 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1276/2536] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:46 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:00:47.889278 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b4765f28-025b-4ff6-92c4-f6b400afa0b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:47.889940 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b4765f28-025b-4ff6-92c4-f6b400afa0b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:47.896332 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4765f28-025b-4ff6-92c4-f6b400afa0b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:47.898355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4765f28-025b-4ff6-92c4-f6b400afa0b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:47.898355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4765f28-025b-4ff6-92c4-f6b400afa0b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:47.898355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4765f28-025b-4ff6-92c4-f6b400afa0b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:47.898355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4765f28-025b-4ff6-92c4-f6b400afa0b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:47.898787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4765f28-025b-4ff6-92c4-f6b400afa0b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:47.904407 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5f17119b-b6e7-47ba-b36c-80e664350774 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:47.905044 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5f17119b-b6e7-47ba-b36c-80e664350774 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:47.911711 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5f17119b-b6e7-47ba-b36c-80e664350774 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:47.912821 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5f17119b-b6e7-47ba-b36c-80e664350774 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:47.913252 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5f17119b-b6e7-47ba-b36c-80e664350774 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:47.913934 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5f17119b-b6e7-47ba-b36c-80e664350774 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:47.914382 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5f17119b-b6e7-47ba-b36c-80e664350774 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:47.914798 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5f17119b-b6e7-47ba-b36c-80e664350774 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:48.087647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b4765f28-025b-4ff6-92c4-f6b400afa0b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:48.095459 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b4765f28-025b-4ff6-92c4-f6b400afa0b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.210042 Aug 10 13:00:48.096033 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1261/2537] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:47 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:48.110095 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5f17119b-b6e7-47ba-b36c-80e664350774 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:48.119069 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5f17119b-b6e7-47ba-b36c-80e664350774 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.218395 Aug 10 13:00:48.119699 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1277/2538] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:47 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:48.214165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f5fa3606-d902-4251-90bf-1befdab09338 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:48.214779 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f5fa3606-d902-4251-90bf-1befdab09338 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:48.220702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f5fa3606-d902-4251-90bf-1befdab09338 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:48.221179 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f5fa3606-d902-4251-90bf-1befdab09338 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:48.221612 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f5fa3606-d902-4251-90bf-1befdab09338 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:48.222296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f5fa3606-d902-4251-90bf-1befdab09338 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:48.222751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f5fa3606-d902-4251-90bf-1befdab09338 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:48.223200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f5fa3606-d902-4251-90bf-1befdab09338 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:48.244854 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f55c089b-4241-4d30-b0bf-5a2630302f8d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:48.245386 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f55c089b-4241-4d30-b0bf-5a2630302f8d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:48.251196 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f55c089b-4241-4d30-b0bf-5a2630302f8d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:48.251682 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f55c089b-4241-4d30-b0bf-5a2630302f8d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:48.252108 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f55c089b-4241-4d30-b0bf-5a2630302f8d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:48.252783 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f55c089b-4241-4d30-b0bf-5a2630302f8d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:48.253227 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f55c089b-4241-4d30-b0bf-5a2630302f8d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:48.253643 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f55c089b-4241-4d30-b0bf-5a2630302f8d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:48.419571 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f5fa3606-d902-4251-90bf-1befdab09338 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:48.427578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f5fa3606-d902-4251-90bf-1befdab09338 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.217273 Aug 10 13:00:48.428837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1262/2539] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:48 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:48.431003 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f55c089b-4241-4d30-b0bf-5a2630302f8d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:48.439320 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f55c089b-4241-4d30-b0bf-5a2630302f8d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:48.440810 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f55c089b-4241-4d30-b0bf-5a2630302f8d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:48.441955 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f55c089b-4241-4d30-b0bf-5a2630302f8d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.201743 Aug 10 13:00:48.442504 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1278/2540] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:48 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:49.117496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d147d520-276a-4ac6-9ea7-58088b70aafa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:49.118102 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d147d520-276a-4ac6-9ea7-58088b70aafa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:49.124025 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d147d520-276a-4ac6-9ea7-58088b70aafa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:49.124500 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d147d520-276a-4ac6-9ea7-58088b70aafa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:49.124929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d147d520-276a-4ac6-9ea7-58088b70aafa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:49.125602 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d147d520-276a-4ac6-9ea7-58088b70aafa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:49.126053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d147d520-276a-4ac6-9ea7-58088b70aafa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:49.126470 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d147d520-276a-4ac6-9ea7-58088b70aafa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:49.140258 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bd1722c8-f30e-4b6e-a469-f5951ef3f8a3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:49.141534 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bd1722c8-f30e-4b6e-a469-f5951ef3f8a3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:49.148538 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bd1722c8-f30e-4b6e-a469-f5951ef3f8a3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:49.149023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bd1722c8-f30e-4b6e-a469-f5951ef3f8a3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:49.149458 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bd1722c8-f30e-4b6e-a469-f5951ef3f8a3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:49.150156 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bd1722c8-f30e-4b6e-a469-f5951ef3f8a3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:49.150612 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bd1722c8-f30e-4b6e-a469-f5951ef3f8a3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:49.151037 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bd1722c8-f30e-4b6e-a469-f5951ef3f8a3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:49.321420 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d147d520-276a-4ac6-9ea7-58088b70aafa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:49.329104 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-bd1722c8-f30e-4b6e-a469-f5951ef3f8a3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:49.329588 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d147d520-276a-4ac6-9ea7-58088b70aafa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.216377 Aug 10 13:00:49.330177 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1263/2541] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:49 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:49.338337 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bd1722c8-f30e-4b6e-a469-f5951ef3f8a3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.201813 Aug 10 13:00:49.349951 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1279/2542] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:49 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:49.449147 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-16c6228b-696a-4c95-9d89-73d5cce38924 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:49.449756 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-16c6228b-696a-4c95-9d89-73d5cce38924 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:49.456064 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-16c6228b-696a-4c95-9d89-73d5cce38924 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:49.456543 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-16c6228b-696a-4c95-9d89-73d5cce38924 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:49.457000 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-16c6228b-696a-4c95-9d89-73d5cce38924 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:49.457679 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-16c6228b-696a-4c95-9d89-73d5cce38924 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:49.458125 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-16c6228b-696a-4c95-9d89-73d5cce38924 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:49.458544 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-16c6228b-696a-4c95-9d89-73d5cce38924 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:49.464548 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f083cbd6-ad98-471e-99cd-78ffd6f28e7b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:49.465152 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f083cbd6-ad98-471e-99cd-78ffd6f28e7b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:49.471019 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f083cbd6-ad98-471e-99cd-78ffd6f28e7b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:49.471520 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f083cbd6-ad98-471e-99cd-78ffd6f28e7b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:49.471948 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f083cbd6-ad98-471e-99cd-78ffd6f28e7b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:49.472626 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f083cbd6-ad98-471e-99cd-78ffd6f28e7b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:49.473067 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f083cbd6-ad98-471e-99cd-78ffd6f28e7b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:49.473484 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f083cbd6-ad98-471e-99cd-78ffd6f28e7b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:49.645865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-16c6228b-696a-4c95-9d89-73d5cce38924 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:49.654448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-16c6228b-696a-4c95-9d89-73d5cce38924 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.209106 Aug 10 13:00:49.655016 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1264/2543] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:49 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:49.663318 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f083cbd6-ad98-471e-99cd-78ffd6f28e7b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:49.671782 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f083cbd6-ad98-471e-99cd-78ffd6f28e7b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:49.673310 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f083cbd6-ad98-471e-99cd-78ffd6f28e7b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:49.674465 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f083cbd6-ad98-471e-99cd-78ffd6f28e7b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.213750 Aug 10 13:00:49.675023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1280/2544] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:49 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:50.351346 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5fa5b73d-4312-4c8e-89a2-80bbfe9f44f1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:50.351892 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5fa5b73d-4312-4c8e-89a2-80bbfe9f44f1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:50.358297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5fa5b73d-4312-4c8e-89a2-80bbfe9f44f1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:50.358783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5fa5b73d-4312-4c8e-89a2-80bbfe9f44f1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:50.359241 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5fa5b73d-4312-4c8e-89a2-80bbfe9f44f1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:50.359931 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5fa5b73d-4312-4c8e-89a2-80bbfe9f44f1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:50.360379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5fa5b73d-4312-4c8e-89a2-80bbfe9f44f1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:50.360819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5fa5b73d-4312-4c8e-89a2-80bbfe9f44f1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:50.368574 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1279cf70-d004-49c2-aa30-01e3fbe53e82 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:50.369185 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1279cf70-d004-49c2-aa30-01e3fbe53e82 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:50.375549 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1279cf70-d004-49c2-aa30-01e3fbe53e82 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:50.376026 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1279cf70-d004-49c2-aa30-01e3fbe53e82 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:50.376458 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1279cf70-d004-49c2-aa30-01e3fbe53e82 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:50.377144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1279cf70-d004-49c2-aa30-01e3fbe53e82 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:50.377596 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1279cf70-d004-49c2-aa30-01e3fbe53e82 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:50.378023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1279cf70-d004-49c2-aa30-01e3fbe53e82 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:50.560152 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5fa5b73d-4312-4c8e-89a2-80bbfe9f44f1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:50.564329 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-1279cf70-d004-49c2-aa30-01e3fbe53e82 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:50.570267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5fa5b73d-4312-4c8e-89a2-80bbfe9f44f1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.223189 Aug 10 13:00:50.571022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1265/2545] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:50 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:50.573108 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1279cf70-d004-49c2-aa30-01e3fbe53e82 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.208267 Aug 10 13:00:50.573722 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1281/2546] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:50 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:50.676473 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4e983892-3be5-464b-a796-74d66e571109 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:50.677106 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4e983892-3be5-464b-a796-74d66e571109 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:50.684006 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e983892-3be5-464b-a796-74d66e571109 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:50.684490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e983892-3be5-464b-a796-74d66e571109 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:50.684925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e983892-3be5-464b-a796-74d66e571109 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:50.685615 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e983892-3be5-464b-a796-74d66e571109 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:50.686091 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e983892-3be5-464b-a796-74d66e571109 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:50.686541 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e983892-3be5-464b-a796-74d66e571109 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:50.699048 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7536c481-8b90-410e-b438-25f6891dc13e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:50.699703 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7536c481-8b90-410e-b438-25f6891dc13e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:50.705557 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7536c481-8b90-410e-b438-25f6891dc13e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:50.706029 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7536c481-8b90-410e-b438-25f6891dc13e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:50.706459 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7536c481-8b90-410e-b438-25f6891dc13e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:50.707143 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7536c481-8b90-410e-b438-25f6891dc13e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:50.707617 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7536c481-8b90-410e-b438-25f6891dc13e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:50.708038 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7536c481-8b90-410e-b438-25f6891dc13e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:50.876328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4e983892-3be5-464b-a796-74d66e571109 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:50.884900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4e983892-3be5-464b-a796-74d66e571109 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.212314 Aug 10 13:00:50.885484 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1266/2547] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:50 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:50.891955 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-7536c481-8b90-410e-b438-25f6891dc13e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:50.900749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-7536c481-8b90-410e-b438-25f6891dc13e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:50.902246 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-7536c481-8b90-410e-b438-25f6891dc13e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:50.903458 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7536c481-8b90-410e-b438-25f6891dc13e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.208292 Aug 10 13:00:50.904014 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1282/2548] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:50 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:51.591535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-23e3f45a-3892-459d-bad1-642177935286 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:51.592284 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-23e3f45a-3892-459d-bad1-642177935286 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:51.598741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23e3f45a-3892-459d-bad1-642177935286 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:51.599402 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23e3f45a-3892-459d-bad1-642177935286 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:51.599860 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3abd415e-6070-4261-8f51-f82914fb9c8d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:51.600303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23e3f45a-3892-459d-bad1-642177935286 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:51.600576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23e3f45a-3892-459d-bad1-642177935286 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:51.600687 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3abd415e-6070-4261-8f51-f82914fb9c8d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:51.601022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23e3f45a-3892-459d-bad1-642177935286 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:51.601442 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23e3f45a-3892-459d-bad1-642177935286 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:51.607536 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3abd415e-6070-4261-8f51-f82914fb9c8d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:51.608020 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3abd415e-6070-4261-8f51-f82914fb9c8d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:51.608454 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3abd415e-6070-4261-8f51-f82914fb9c8d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:51.609142 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3abd415e-6070-4261-8f51-f82914fb9c8d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:51.609593 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3abd415e-6070-4261-8f51-f82914fb9c8d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:51.610018 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3abd415e-6070-4261-8f51-f82914fb9c8d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:51.794304 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-23e3f45a-3892-459d-bad1-642177935286 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:51.796811 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3abd415e-6070-4261-8f51-f82914fb9c8d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:51.802240 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-23e3f45a-3892-459d-bad1-642177935286 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.214497 Aug 10 13:00:51.803423 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1267/2549] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:51 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:51.805511 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3abd415e-6070-4261-8f51-f82914fb9c8d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.209679 Aug 10 13:00:51.806202 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1283/2550] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:51 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:51.905499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-83058754-4aa4-4b41-8f96-81d7c8171a17 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:51.906044 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-83058754-4aa4-4b41-8f96-81d7c8171a17 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:51.912737 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83058754-4aa4-4b41-8f96-81d7c8171a17 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:51.913225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83058754-4aa4-4b41-8f96-81d7c8171a17 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:51.913663 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83058754-4aa4-4b41-8f96-81d7c8171a17 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:51.914349 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83058754-4aa4-4b41-8f96-81d7c8171a17 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:51.914805 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83058754-4aa4-4b41-8f96-81d7c8171a17 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:51.915259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83058754-4aa4-4b41-8f96-81d7c8171a17 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:51.927093 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-31fb61ec-54a2-4937-9f09-df7275512753 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:51.928440 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-31fb61ec-54a2-4937-9f09-df7275512753 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:51.934264 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-31fb61ec-54a2-4937-9f09-df7275512753 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:51.934739 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-31fb61ec-54a2-4937-9f09-df7275512753 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:51.935165 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-31fb61ec-54a2-4937-9f09-df7275512753 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:51.935863 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-31fb61ec-54a2-4937-9f09-df7275512753 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:51.936311 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-31fb61ec-54a2-4937-9f09-df7275512753 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:51.936731 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-31fb61ec-54a2-4937-9f09-df7275512753 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:51.951418 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:00:52.113519 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-83058754-4aa4-4b41-8f96-81d7c8171a17 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:52.117716 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-31fb61ec-54a2-4937-9f09-df7275512753 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:52.121904 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-83058754-4aa4-4b41-8f96-81d7c8171a17 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.220053 Aug 10 13:00:52.122486 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1268/2551] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:51 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:52.126301 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-31fb61ec-54a2-4937-9f09-df7275512753 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:52.127835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-31fb61ec-54a2-4937-9f09-df7275512753 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:52.129008 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-31fb61ec-54a2-4937-9f09-df7275512753 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.205803 Aug 10 13:00:52.129559 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1284/2552] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:51 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:52.824408 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7bfd2da4-5043-43d8-a031-ad7c9ac6d08c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:52.825027 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7bfd2da4-5043-43d8-a031-ad7c9ac6d08c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:52.826411 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4178e90e-bf3b-41b7-9391-c8f1a2867ff2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:52.827023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4178e90e-bf3b-41b7-9391-c8f1a2867ff2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:52.831663 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7bfd2da4-5043-43d8-a031-ad7c9ac6d08c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:52.832150 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7bfd2da4-5043-43d8-a031-ad7c9ac6d08c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:52.832704 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7bfd2da4-5043-43d8-a031-ad7c9ac6d08c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:52.833277 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4178e90e-bf3b-41b7-9391-c8f1a2867ff2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:52.833402 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7bfd2da4-5043-43d8-a031-ad7c9ac6d08c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:52.834264 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4178e90e-bf3b-41b7-9391-c8f1a2867ff2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:52.834532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7bfd2da4-5043-43d8-a031-ad7c9ac6d08c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:52.834694 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4178e90e-bf3b-41b7-9391-c8f1a2867ff2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:52.835163 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7bfd2da4-5043-43d8-a031-ad7c9ac6d08c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:52.835401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4178e90e-bf3b-41b7-9391-c8f1a2867ff2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:52.835853 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4178e90e-bf3b-41b7-9391-c8f1a2867ff2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:52.836266 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4178e90e-bf3b-41b7-9391-c8f1a2867ff2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:53.028660 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4178e90e-bf3b-41b7-9391-c8f1a2867ff2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:53.032012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7bfd2da4-5043-43d8-a031-ad7c9ac6d08c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:53.036939 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4178e90e-bf3b-41b7-9391-c8f1a2867ff2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.214367 Aug 10 13:00:53.038102 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1285/2553] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:52 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:53.040143 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7bfd2da4-5043-43d8-a031-ad7c9ac6d08c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.219619 Aug 10 13:00:53.040698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1269/2554] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:52 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:53.142810 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8b303638-da89-4a6f-8e4b-df9fb88416ed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:53.143408 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8b303638-da89-4a6f-8e4b-df9fb88416ed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:53.149728 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b303638-da89-4a6f-8e4b-df9fb88416ed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:53.150198 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b303638-da89-4a6f-8e4b-df9fb88416ed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:53.150628 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b303638-da89-4a6f-8e4b-df9fb88416ed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:53.150959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4e5d2982-20c4-4896-85b7-156e66ab1ced tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:53.151333 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b303638-da89-4a6f-8e4b-df9fb88416ed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:53.151646 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4e5d2982-20c4-4896-85b7-156e66ab1ced tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:53.151769 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b303638-da89-4a6f-8e4b-df9fb88416ed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:53.152186 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b303638-da89-4a6f-8e4b-df9fb88416ed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:53.157512 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e5d2982-20c4-4896-85b7-156e66ab1ced tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:53.157991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e5d2982-20c4-4896-85b7-156e66ab1ced tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:53.158425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e5d2982-20c4-4896-85b7-156e66ab1ced tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:53.159113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e5d2982-20c4-4896-85b7-156e66ab1ced tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:53.159591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e5d2982-20c4-4896-85b7-156e66ab1ced tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:53.160018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e5d2982-20c4-4896-85b7-156e66ab1ced tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:53.351393 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-8b303638-da89-4a6f-8e4b-df9fb88416ed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:53.354876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4e5d2982-20c4-4896-85b7-156e66ab1ced tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:53.359623 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8b303638-da89-4a6f-8e4b-df9fb88416ed tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.220614 Aug 10 13:00:53.360203 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1286/2555] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:53 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:53.363565 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4e5d2982-20c4-4896-85b7-156e66ab1ced tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:53.365207 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4e5d2982-20c4-4896-85b7-156e66ab1ced tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:53.366467 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4e5d2982-20c4-4896-85b7-156e66ab1ced tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.219343 Aug 10 13:00:53.367094 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1270/2556] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:53 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:54.059649 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-876a4190-8879-444a-80a5-edb2268d70a1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:54.060273 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-876a4190-8879-444a-80a5-edb2268d70a1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:54.061182 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-79a91498-a916-477c-a7ea-5612a4528b44 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:54.061859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-79a91498-a916-477c-a7ea-5612a4528b44 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:54.067397 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-876a4190-8879-444a-80a5-edb2268d70a1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:54.067829 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-876a4190-8879-444a-80a5-edb2268d70a1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:54.068203 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-79a91498-a916-477c-a7ea-5612a4528b44 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:54.068390 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-876a4190-8879-444a-80a5-edb2268d70a1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:54.068698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-79a91498-a916-477c-a7ea-5612a4528b44 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:54.069101 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-876a4190-8879-444a-80a5-edb2268d70a1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:54.069232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-79a91498-a916-477c-a7ea-5612a4528b44 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:54.069584 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-876a4190-8879-444a-80a5-edb2268d70a1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:54.069800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-79a91498-a916-477c-a7ea-5612a4528b44 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:54.070036 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-876a4190-8879-444a-80a5-edb2268d70a1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:54.070249 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-79a91498-a916-477c-a7ea-5612a4528b44 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:54.070670 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-79a91498-a916-477c-a7ea-5612a4528b44 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:54.262664 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-876a4190-8879-444a-80a5-edb2268d70a1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:54.269784 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-79a91498-a916-477c-a7ea-5612a4528b44 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:54.270470 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-876a4190-8879-444a-80a5-edb2268d70a1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.214869 Aug 10 13:00:54.271048 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1287/2557] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:54 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:54.278280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-79a91498-a916-477c-a7ea-5612a4528b44 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.220813 Aug 10 13:00:54.279127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1271/2558] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:54 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:54.381223 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-81b57e49-e68d-4e09-b4dd-c80006ee7442 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:54.381836 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-81b57e49-e68d-4e09-b4dd-c80006ee7442 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:54.387820 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-81b57e49-e68d-4e09-b4dd-c80006ee7442 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:54.388295 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-81b57e49-e68d-4e09-b4dd-c80006ee7442 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:54.388729 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-81b57e49-e68d-4e09-b4dd-c80006ee7442 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:54.389415 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-81b57e49-e68d-4e09-b4dd-c80006ee7442 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:54.389786 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d31acca8-a20f-49ca-a9c3-8622244d556c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:54.389906 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-81b57e49-e68d-4e09-b4dd-c80006ee7442 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:54.390302 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-81b57e49-e68d-4e09-b4dd-c80006ee7442 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:54.390416 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d31acca8-a20f-49ca-a9c3-8622244d556c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:54.396891 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d31acca8-a20f-49ca-a9c3-8622244d556c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:54.398472 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d31acca8-a20f-49ca-a9c3-8622244d556c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:54.398913 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d31acca8-a20f-49ca-a9c3-8622244d556c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:54.399648 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d31acca8-a20f-49ca-a9c3-8622244d556c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:54.400105 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d31acca8-a20f-49ca-a9c3-8622244d556c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:54.400533 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d31acca8-a20f-49ca-a9c3-8622244d556c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:54.584770 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-81b57e49-e68d-4e09-b4dd-c80006ee7442 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:54.588736 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d31acca8-a20f-49ca-a9c3-8622244d556c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:54.592655 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-81b57e49-e68d-4e09-b4dd-c80006ee7442 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.215423 Aug 10 13:00:54.593233 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1288/2559] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:54 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:54.597113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d31acca8-a20f-49ca-a9c3-8622244d556c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:54.598677 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d31acca8-a20f-49ca-a9c3-8622244d556c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:54.600604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d31acca8-a20f-49ca-a9c3-8622244d556c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.214751 Aug 10 13:00:54.601161 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1272/2560] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:54 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:00:55.291896 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-becd762f-286c-4927-ae4f-e27777e0fdaf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:55.292619 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-becd762f-286c-4927-ae4f-e27777e0fdaf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:55.298945 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-becd762f-286c-4927-ae4f-e27777e0fdaf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:55.301018 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-becd762f-286c-4927-ae4f-e27777e0fdaf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:55.301018 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-becd762f-286c-4927-ae4f-e27777e0fdaf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:55.301018 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-becd762f-286c-4927-ae4f-e27777e0fdaf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:55.301345 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bd61051c-cd41-4613-a4c0-1bbadaace219 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:55.301784 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-becd762f-286c-4927-ae4f-e27777e0fdaf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:55.301897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bd61051c-cd41-4613-a4c0-1bbadaace219 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:55.302009 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-becd762f-286c-4927-ae4f-e27777e0fdaf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:55.307696 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd61051c-cd41-4613-a4c0-1bbadaace219 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:55.308223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd61051c-cd41-4613-a4c0-1bbadaace219 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:55.308638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd61051c-cd41-4613-a4c0-1bbadaace219 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:55.309319 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd61051c-cd41-4613-a4c0-1bbadaace219 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:55.309771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd61051c-cd41-4613-a4c0-1bbadaace219 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:55.310190 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd61051c-cd41-4613-a4c0-1bbadaace219 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:55.325648 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:00:55.727741 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-becd762f-286c-4927-ae4f-e27777e0fdaf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:55.732364 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-bd61051c-cd41-4613-a4c0-1bbadaace219 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:55.736004 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-becd762f-286c-4927-ae4f-e27777e0fdaf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.447977 Aug 10 13:00:55.736743 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1289/2561] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:55 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:55.741504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bd61051c-cd41-4613-a4c0-1bbadaace219 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.444802 Aug 10 13:00:55.742071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1273/2562] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:55 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:55.742214 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a6a27b9e-532a-4c3c-aa44-1b73d16a9371 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:55.742716 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a6a27b9e-532a-4c3c-aa44-1b73d16a9371 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:55.747066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a2d50f0c-d111-47ec-afb0-f17a39aa4b1b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:55.747877 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a2d50f0c-d111-47ec-afb0-f17a39aa4b1b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:55.748586 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a6a27b9e-532a-4c3c-aa44-1b73d16a9371 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:55.749070 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a6a27b9e-532a-4c3c-aa44-1b73d16a9371 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:55.749501 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a6a27b9e-532a-4c3c-aa44-1b73d16a9371 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:55.750316 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a6a27b9e-532a-4c3c-aa44-1b73d16a9371 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:55.750766 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a6a27b9e-532a-4c3c-aa44-1b73d16a9371 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:55.751208 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a6a27b9e-532a-4c3c-aa44-1b73d16a9371 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:55.754684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a2d50f0c-d111-47ec-afb0-f17a39aa4b1b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:55.755169 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a2d50f0c-d111-47ec-afb0-f17a39aa4b1b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:55.755706 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a2d50f0c-d111-47ec-afb0-f17a39aa4b1b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:55.756401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a2d50f0c-d111-47ec-afb0-f17a39aa4b1b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:55.757083 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a2d50f0c-d111-47ec-afb0-f17a39aa4b1b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:55.757634 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a2d50f0c-d111-47ec-afb0-f17a39aa4b1b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:55.941658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a2d50f0c-d111-47ec-afb0-f17a39aa4b1b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:55.945092 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a6a27b9e-532a-4c3c-aa44-1b73d16a9371 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:55.950303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a2d50f0c-d111-47ec-afb0-f17a39aa4b1b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:55.951932 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a2d50f0c-d111-47ec-afb0-f17a39aa4b1b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:55.952974 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a6a27b9e-532a-4c3c-aa44-1b73d16a9371 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.215083 Aug 10 13:00:55.953127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a2d50f0c-d111-47ec-afb0-f17a39aa4b1b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.209638 Aug 10 13:00:55.953585 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1290/2563] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:55 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:55.953879 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1274/2564] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:55 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:00:56.759645 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9d44e4b8-a4a5-46f8-8d26-271921fda9dd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:56.760257 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9d44e4b8-a4a5-46f8-8d26-271921fda9dd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:56.763208 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ba4649c9-94ea-4f3c-83a6-3c7c21aa06e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:56.763813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ba4649c9-94ea-4f3c-83a6-3c7c21aa06e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:56.766305 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d44e4b8-a4a5-46f8-8d26-271921fda9dd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:56.766782 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d44e4b8-a4a5-46f8-8d26-271921fda9dd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:56.767229 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d44e4b8-a4a5-46f8-8d26-271921fda9dd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:56.767912 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d44e4b8-a4a5-46f8-8d26-271921fda9dd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:56.768356 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d44e4b8-a4a5-46f8-8d26-271921fda9dd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:56.768774 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d44e4b8-a4a5-46f8-8d26-271921fda9dd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:56.770147 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ba4649c9-94ea-4f3c-83a6-3c7c21aa06e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:56.770621 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ba4649c9-94ea-4f3c-83a6-3c7c21aa06e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:56.771046 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ba4649c9-94ea-4f3c-83a6-3c7c21aa06e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:56.771888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ba4649c9-94ea-4f3c-83a6-3c7c21aa06e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:56.772337 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ba4649c9-94ea-4f3c-83a6-3c7c21aa06e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:56.772757 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ba4649c9-94ea-4f3c-83a6-3c7c21aa06e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:56.961958 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9d44e4b8-a4a5-46f8-8d26-271921fda9dd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:56.966129 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ba4649c9-94ea-4f3c-83a6-3c7c21aa06e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:56.969890 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9d44e4b8-a4a5-46f8-8d26-271921fda9dd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.215289 Aug 10 13:00:56.975487 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1291/2565] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:56 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:56.975487 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5ac863ea-526e-4421-a090-9c96f8ba5e47 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:56.975753 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ba4649c9-94ea-4f3c-83a6-3c7c21aa06e1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.216146 Aug 10 13:00:56.976091 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5ac863ea-526e-4421-a090-9c96f8ba5e47 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:56.976529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1275/2566] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:56 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:56.981531 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f6d16023-dbb2-4535-8f97-8dc588d641e0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:56.982297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f6d16023-dbb2-4535-8f97-8dc588d641e0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:56.983927 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5ac863ea-526e-4421-a090-9c96f8ba5e47 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:56.984651 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5ac863ea-526e-4421-a090-9c96f8ba5e47 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:56.985307 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5ac863ea-526e-4421-a090-9c96f8ba5e47 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:56.986213 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5ac863ea-526e-4421-a090-9c96f8ba5e47 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:56.986726 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5ac863ea-526e-4421-a090-9c96f8ba5e47 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:56.987391 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5ac863ea-526e-4421-a090-9c96f8ba5e47 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:56.988309 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6d16023-dbb2-4535-8f97-8dc588d641e0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:56.988789 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6d16023-dbb2-4535-8f97-8dc588d641e0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:56.989282 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6d16023-dbb2-4535-8f97-8dc588d641e0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:56.990628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6d16023-dbb2-4535-8f97-8dc588d641e0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:56.991083 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6d16023-dbb2-4535-8f97-8dc588d641e0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:56.991543 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6d16023-dbb2-4535-8f97-8dc588d641e0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:57.182265 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5ac863ea-526e-4421-a090-9c96f8ba5e47 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:57.185599 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f6d16023-dbb2-4535-8f97-8dc588d641e0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:57.190234 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5ac863ea-526e-4421-a090-9c96f8ba5e47 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.218821 Aug 10 13:00:57.190808 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1292/2567] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:56 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:57.194783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f6d16023-dbb2-4535-8f97-8dc588d641e0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:57.196307 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f6d16023-dbb2-4535-8f97-8dc588d641e0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:57.197450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f6d16023-dbb2-4535-8f97-8dc588d641e0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.220015 Aug 10 13:00:57.197994 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1276/2568] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:56 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:00:57.993168 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fe7fad06-e979-49af-8c3b-884a1a279ae1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:57.993779 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fe7fad06-e979-49af-8c3b-884a1a279ae1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:57.997040 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6192657e-15a5-4d30-93d9-99644a50d190 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:57.997673 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6192657e-15a5-4d30-93d9-99644a50d190 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:58.000318 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe7fad06-e979-49af-8c3b-884a1a279ae1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:58.000796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe7fad06-e979-49af-8c3b-884a1a279ae1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:58.001222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe7fad06-e979-49af-8c3b-884a1a279ae1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:58.001902 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe7fad06-e979-49af-8c3b-884a1a279ae1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:58.002344 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe7fad06-e979-49af-8c3b-884a1a279ae1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:58.002762 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe7fad06-e979-49af-8c3b-884a1a279ae1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:58.004122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6192657e-15a5-4d30-93d9-99644a50d190 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:58.004601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6192657e-15a5-4d30-93d9-99644a50d190 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:58.005034 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6192657e-15a5-4d30-93d9-99644a50d190 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:58.006068 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6192657e-15a5-4d30-93d9-99644a50d190 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:58.006704 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6192657e-15a5-4d30-93d9-99644a50d190 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:58.007133 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6192657e-15a5-4d30-93d9-99644a50d190 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:58.199468 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fe7fad06-e979-49af-8c3b-884a1a279ae1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:58.209656 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fe7fad06-e979-49af-8c3b-884a1a279ae1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.220306 Aug 10 13:00:58.210254 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1293/2569] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:57 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:58.210673 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6192657e-15a5-4d30-93d9-99644a50d190 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:58.215119 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-eca653c4-058e-4747-8318-eaca73b0b2d0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:58.215836 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-eca653c4-058e-4747-8318-eaca73b0b2d0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:58.219365 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6192657e-15a5-4d30-93d9-99644a50d190 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.226172 Aug 10 13:00:58.220107 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1277/2570] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:57 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:58.221863 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eca653c4-058e-4747-8318-eaca73b0b2d0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:58.222399 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eca653c4-058e-4747-8318-eaca73b0b2d0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:58.222884 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eca653c4-058e-4747-8318-eaca73b0b2d0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:58.223656 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eca653c4-058e-4747-8318-eaca73b0b2d0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:58.224163 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eca653c4-058e-4747-8318-eaca73b0b2d0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:58.225907 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eca653c4-058e-4747-8318-eaca73b0b2d0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:58.226195 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-81ead3f6-3437-447a-904b-e01f67e73dc4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:58.226796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-81ead3f6-3437-447a-904b-e01f67e73dc4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:58.232834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81ead3f6-3437-447a-904b-e01f67e73dc4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:58.233313 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81ead3f6-3437-447a-904b-e01f67e73dc4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:58.233746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81ead3f6-3437-447a-904b-e01f67e73dc4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:58.234432 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81ead3f6-3437-447a-904b-e01f67e73dc4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:58.234881 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81ead3f6-3437-447a-904b-e01f67e73dc4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:58.235326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81ead3f6-3437-447a-904b-e01f67e73dc4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:58.420657 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-81ead3f6-3437-447a-904b-e01f67e73dc4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:58.423267 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-eca653c4-058e-4747-8318-eaca73b0b2d0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:58.429460 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-81ead3f6-3437-447a-904b-e01f67e73dc4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:58.430957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-81ead3f6-3437-447a-904b-e01f67e73dc4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:58.431760 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-eca653c4-058e-4747-8318-eaca73b0b2d0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.220547 Aug 10 13:00:58.432138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-81ead3f6-3437-447a-904b-e01f67e73dc4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.210974 Aug 10 13:00:58.432337 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1294/2571] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:58 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:58.432689 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1278/2572] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:58 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:00:59.232020 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ee507ce2-d65a-4c01-ae8f-4d8ba6bade63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:59.232614 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ee507ce2-d65a-4c01-ae8f-4d8ba6bade63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:59.239099 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee507ce2-d65a-4c01-ae8f-4d8ba6bade63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:59.239601 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee507ce2-d65a-4c01-ae8f-4d8ba6bade63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:59.241200 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee507ce2-d65a-4c01-ae8f-4d8ba6bade63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:59.241906 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee507ce2-d65a-4c01-ae8f-4d8ba6bade63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:59.242256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7977e664-9954-4b80-9f8d-aca0a7c82bba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:59.242674 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee507ce2-d65a-4c01-ae8f-4d8ba6bade63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:59.242778 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ee507ce2-d65a-4c01-ae8f-4d8ba6bade63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:59.242875 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7977e664-9954-4b80-9f8d-aca0a7c82bba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:59.249280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7977e664-9954-4b80-9f8d-aca0a7c82bba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:59.249763 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7977e664-9954-4b80-9f8d-aca0a7c82bba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:59.250202 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7977e664-9954-4b80-9f8d-aca0a7c82bba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:59.250901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7977e664-9954-4b80-9f8d-aca0a7c82bba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:59.251384 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7977e664-9954-4b80-9f8d-aca0a7c82bba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:59.251817 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7977e664-9954-4b80-9f8d-aca0a7c82bba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:59.448705 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ee507ce2-d65a-4c01-ae8f-4d8ba6bade63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:59.452002 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7977e664-9954-4b80-9f8d-aca0a7c82bba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:59.457009 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ee507ce2-d65a-4c01-ae8f-4d8ba6bade63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.229073 Aug 10 13:00:59.457592 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1295/2573] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:59 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:59.461412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7977e664-9954-4b80-9f8d-aca0a7c82bba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.223524 Aug 10 13:00:59.462188 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3870494b-b9aa-4e16-ab5e-352aae01a7e4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:59.462339 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1279/2574] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:59 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:00:59.473142 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3870494b-b9aa-4e16-ab5e-352aae01a7e4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:59.473142 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3870494b-b9aa-4e16-ab5e-352aae01a7e4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:59.473142 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3870494b-b9aa-4e16-ab5e-352aae01a7e4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:59.473142 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3870494b-b9aa-4e16-ab5e-352aae01a7e4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:59.473593 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3870494b-b9aa-4e16-ab5e-352aae01a7e4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:59.473593 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3870494b-b9aa-4e16-ab5e-352aae01a7e4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:59.473593 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3870494b-b9aa-4e16-ab5e-352aae01a7e4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:59.477873 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c4cbd0c6-b074-4319-ac92-3b2fe4150c3a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:00:59.478483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c4cbd0c6-b074-4319-ac92-3b2fe4150c3a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:00:59.484678 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4cbd0c6-b074-4319-ac92-3b2fe4150c3a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:59.485099 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4cbd0c6-b074-4319-ac92-3b2fe4150c3a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:59.485537 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4cbd0c6-b074-4319-ac92-3b2fe4150c3a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:59.486227 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4cbd0c6-b074-4319-ac92-3b2fe4150c3a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:00:59.486677 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4cbd0c6-b074-4319-ac92-3b2fe4150c3a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:00:59.487102 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4cbd0c6-b074-4319-ac92-3b2fe4150c3a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:00:59.660807 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3870494b-b9aa-4e16-ab5e-352aae01a7e4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:59.669644 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3870494b-b9aa-4e16-ab5e-352aae01a7e4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.211070 Aug 10 13:00:59.670216 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1296/2575] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:00:59 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:00:59.677606 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c4cbd0c6-b074-4319-ac92-3b2fe4150c3a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:59.685860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c4cbd0c6-b074-4319-ac92-3b2fe4150c3a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:59.687397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c4cbd0c6-b074-4319-ac92-3b2fe4150c3a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:00:59.688544 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c4cbd0c6-b074-4319-ac92-3b2fe4150c3a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.225428 Aug 10 13:00:59.689102 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1280/2576] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:00:59 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:01:00.477590 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-eb1dbf2f-e539-47de-876f-348aebcfb97e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:00.478202 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-eb1dbf2f-e539-47de-876f-348aebcfb97e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:00.483035 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b731926c-583b-4e79-b1a5-94fec4c0533b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:00.483665 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b731926c-583b-4e79-b1a5-94fec4c0533b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:00.484849 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eb1dbf2f-e539-47de-876f-348aebcfb97e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:00.485331 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eb1dbf2f-e539-47de-876f-348aebcfb97e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:00.485769 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eb1dbf2f-e539-47de-876f-348aebcfb97e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:00.485939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=96 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:00.486459 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eb1dbf2f-e539-47de-876f-348aebcfb97e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:00.486917 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eb1dbf2f-e539-47de-876f-348aebcfb97e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:00.487368 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eb1dbf2f-e539-47de-876f-348aebcfb97e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:00.491152 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b731926c-583b-4e79-b1a5-94fec4c0533b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:00.491659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b731926c-583b-4e79-b1a5-94fec4c0533b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:00.492090 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b731926c-583b-4e79-b1a5-94fec4c0533b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:00.492771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b731926c-583b-4e79-b1a5-94fec4c0533b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:00.493211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b731926c-583b-4e79-b1a5-94fec4c0533b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:00.493631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b731926c-583b-4e79-b1a5-94fec4c0533b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:00.684427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b731926c-583b-4e79-b1a5-94fec4c0533b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:00.690270 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-eb1dbf2f-e539-47de-876f-348aebcfb97e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:00.693009 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b731926c-583b-4e79-b1a5-94fec4c0533b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.213854 Aug 10 13:01:00.694314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1281/2577] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:00 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:00.698932 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-12fa1458-6e38-41cb-a811-c1d91c9e894a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:00.699631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-12fa1458-6e38-41cb-a811-c1d91c9e894a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:00.705445 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12fa1458-6e38-41cb-a811-c1d91c9e894a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:00.706006 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12fa1458-6e38-41cb-a811-c1d91c9e894a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:00.706565 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12fa1458-6e38-41cb-a811-c1d91c9e894a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:00.707472 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12fa1458-6e38-41cb-a811-c1d91c9e894a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:00.707977 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12fa1458-6e38-41cb-a811-c1d91c9e894a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:00.708523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12fa1458-6e38-41cb-a811-c1d91c9e894a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:00.712533 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-eb1dbf2f-e539-47de-876f-348aebcfb97e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.238892 Aug 10 13:01:00.723649 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1297/2578] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:00 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:00.735641 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ce32fbb0-c8ca-48b5-bdcd-05f8ab029637 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:00.735641 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ce32fbb0-c8ca-48b5-bdcd-05f8ab029637 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:00.739208 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce32fbb0-c8ca-48b5-bdcd-05f8ab029637 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:00.739838 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce32fbb0-c8ca-48b5-bdcd-05f8ab029637 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:00.740999 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce32fbb0-c8ca-48b5-bdcd-05f8ab029637 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:00.741687 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce32fbb0-c8ca-48b5-bdcd-05f8ab029637 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:00.742134 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce32fbb0-c8ca-48b5-bdcd-05f8ab029637 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:00.742553 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce32fbb0-c8ca-48b5-bdcd-05f8ab029637 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:00.907465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-12fa1458-6e38-41cb-a811-c1d91c9e894a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:00.915168 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ce32fbb0-c8ca-48b5-bdcd-05f8ab029637 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:00.916241 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-12fa1458-6e38-41cb-a811-c1d91c9e894a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.220831 Aug 10 13:01:00.917032 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1282/2579] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:00 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:00.923608 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ce32fbb0-c8ca-48b5-bdcd-05f8ab029637 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:00.925101 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ce32fbb0-c8ca-48b5-bdcd-05f8ab029637 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:00.926259 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ce32fbb0-c8ca-48b5-bdcd-05f8ab029637 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.201041 Aug 10 13:01:00.926817 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1298/2580] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:00 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:01:01.714340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-43b15bbe-8fa7-4aae-b2ab-9ba6e4e8ae81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:01.715007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-43b15bbe-8fa7-4aae-b2ab-9ba6e4e8ae81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:01.721344 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-43b15bbe-8fa7-4aae-b2ab-9ba6e4e8ae81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:01.721848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-43b15bbe-8fa7-4aae-b2ab-9ba6e4e8ae81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:01.722278 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-43b15bbe-8fa7-4aae-b2ab-9ba6e4e8ae81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:01.722955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-43b15bbe-8fa7-4aae-b2ab-9ba6e4e8ae81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:01.723430 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-43b15bbe-8fa7-4aae-b2ab-9ba6e4e8ae81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:01.723852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-43b15bbe-8fa7-4aae-b2ab-9ba6e4e8ae81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:01.738211 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0627cebf-6670-43c3-9bc3-449b3dacf947 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:01.738969 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0627cebf-6670-43c3-9bc3-449b3dacf947 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:01.746743 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0627cebf-6670-43c3-9bc3-449b3dacf947 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:01.747261 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0627cebf-6670-43c3-9bc3-449b3dacf947 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:01.747701 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0627cebf-6670-43c3-9bc3-449b3dacf947 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:01.748540 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0627cebf-6670-43c3-9bc3-449b3dacf947 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:01.749030 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0627cebf-6670-43c3-9bc3-449b3dacf947 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:01.749459 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0627cebf-6670-43c3-9bc3-449b3dacf947 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:01.940191 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-43b15bbe-8fa7-4aae-b2ab-9ba6e4e8ae81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:01.944470 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0627cebf-6670-43c3-9bc3-449b3dacf947 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:01.948518 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-43b15bbe-8fa7-4aae-b2ab-9ba6e4e8ae81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.237944 Aug 10 13:01:01.949124 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1283/2581] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:01 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:01.953883 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3ff8e1ec-7b6b-4f69-b39d-c7bd06a4e098 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:01.954314 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0627cebf-6670-43c3-9bc3-449b3dacf947 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.220328 Aug 10 13:01:01.954481 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3ff8e1ec-7b6b-4f69-b39d-c7bd06a4e098 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:01.954978 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1299/2582] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:01 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:01.960210 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c8f53800-e575-4c8f-a0f6-0c2ed28532e4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:01.961697 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c8f53800-e575-4c8f-a0f6-0c2ed28532e4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:01.962483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ff8e1ec-7b6b-4f69-b39d-c7bd06a4e098 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:01.962973 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ff8e1ec-7b6b-4f69-b39d-c7bd06a4e098 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:01.963436 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ff8e1ec-7b6b-4f69-b39d-c7bd06a4e098 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:01.964134 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ff8e1ec-7b6b-4f69-b39d-c7bd06a4e098 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:01.964585 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ff8e1ec-7b6b-4f69-b39d-c7bd06a4e098 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:01.965008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ff8e1ec-7b6b-4f69-b39d-c7bd06a4e098 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:01.968564 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c8f53800-e575-4c8f-a0f6-0c2ed28532e4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:01.969084 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c8f53800-e575-4c8f-a0f6-0c2ed28532e4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:01.970794 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c8f53800-e575-4c8f-a0f6-0c2ed28532e4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:01.970794 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c8f53800-e575-4c8f-a0f6-0c2ed28532e4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:01.970794 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c8f53800-e575-4c8f-a0f6-0c2ed28532e4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:01.971126 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c8f53800-e575-4c8f-a0f6-0c2ed28532e4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:02.161827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3ff8e1ec-7b6b-4f69-b39d-c7bd06a4e098 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:02.166262 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c8f53800-e575-4c8f-a0f6-0c2ed28532e4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:02.170728 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3ff8e1ec-7b6b-4f69-b39d-c7bd06a4e098 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.220622 Aug 10 13:01:02.171329 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1284/2583] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:01 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:02.174630 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c8f53800-e575-4c8f-a0f6-0c2ed28532e4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:02.176168 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c8f53800-e575-4c8f-a0f6-0c2ed28532e4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:02.177320 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c8f53800-e575-4c8f-a0f6-0c2ed28532e4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.221266 Aug 10 13:01:02.177877 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1300/2584] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:01 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:01:02.971168 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0bc9beb5-1e95-4bcc-bf3b-9cccb2a2e537 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:02.971799 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0bc9beb5-1e95-4bcc-bf3b-9cccb2a2e537 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:02.977945 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0dc18663-aac3-4ca8-80ae-80eae5a7a984 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:02.978576 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0dc18663-aac3-4ca8-80ae-80eae5a7a984 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:02.979350 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0bc9beb5-1e95-4bcc-bf3b-9cccb2a2e537 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:02.979835 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0bc9beb5-1e95-4bcc-bf3b-9cccb2a2e537 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:02.980270 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0bc9beb5-1e95-4bcc-bf3b-9cccb2a2e537 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:02.980962 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0bc9beb5-1e95-4bcc-bf3b-9cccb2a2e537 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:02.981415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0bc9beb5-1e95-4bcc-bf3b-9cccb2a2e537 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:02.981843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0bc9beb5-1e95-4bcc-bf3b-9cccb2a2e537 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:02.984948 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0dc18663-aac3-4ca8-80ae-80eae5a7a984 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:02.985416 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0dc18663-aac3-4ca8-80ae-80eae5a7a984 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:02.985851 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0dc18663-aac3-4ca8-80ae-80eae5a7a984 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:02.986530 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0dc18663-aac3-4ca8-80ae-80eae5a7a984 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:02.986978 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0dc18663-aac3-4ca8-80ae-80eae5a7a984 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:02.987420 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0dc18663-aac3-4ca8-80ae-80eae5a7a984 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:02.992204 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:03.176401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0dc18663-aac3-4ca8-80ae-80eae5a7a984 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:03.180688 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0bc9beb5-1e95-4bcc-bf3b-9cccb2a2e537 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:03.184552 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0dc18663-aac3-4ca8-80ae-80eae5a7a984 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.211098 Aug 10 13:01:03.185124 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1301/2585] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:02 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:03.189006 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0bc9beb5-1e95-4bcc-bf3b-9cccb2a2e537 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.221749 Aug 10 13:01:03.189563 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1285/2586] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:02 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:03.191256 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0278fa15-a5c4-4e87-93aa-59c3521aa94d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:03.191856 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0278fa15-a5c4-4e87-93aa-59c3521aa94d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:03.198455 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0278fa15-a5c4-4e87-93aa-59c3521aa94d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:03.198936 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0278fa15-a5c4-4e87-93aa-59c3521aa94d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:03.199395 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0278fa15-a5c4-4e87-93aa-59c3521aa94d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:03.200078 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0278fa15-a5c4-4e87-93aa-59c3521aa94d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:03.200527 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0278fa15-a5c4-4e87-93aa-59c3521aa94d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:03.200637 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ef41cab5-bbb2-410e-a664-0e5becf03f8a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:03.200949 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0278fa15-a5c4-4e87-93aa-59c3521aa94d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:03.201189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ef41cab5-bbb2-410e-a664-0e5becf03f8a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:03.207358 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef41cab5-bbb2-410e-a664-0e5becf03f8a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:03.207829 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef41cab5-bbb2-410e-a664-0e5becf03f8a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:03.208258 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef41cab5-bbb2-410e-a664-0e5becf03f8a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:03.209571 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef41cab5-bbb2-410e-a664-0e5becf03f8a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:03.210320 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef41cab5-bbb2-410e-a664-0e5becf03f8a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:03.210775 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef41cab5-bbb2-410e-a664-0e5becf03f8a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:03.396773 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0278fa15-a5c4-4e87-93aa-59c3521aa94d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:03.400750 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ef41cab5-bbb2-410e-a664-0e5becf03f8a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:03.405320 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0278fa15-a5c4-4e87-93aa-59c3521aa94d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.217469 Aug 10 13:01:03.406224 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1302/2587] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:03 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:03.410442 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ef41cab5-bbb2-410e-a664-0e5becf03f8a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:03.412629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ef41cab5-bbb2-410e-a664-0e5becf03f8a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:03.413773 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ef41cab5-bbb2-410e-a664-0e5becf03f8a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.217252 Aug 10 13:01:03.414502 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1286/2588] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:03 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:01:04.206691 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d81fff54-73a7-4206-b3e2-e9f57285a295 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:04.207290 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d81fff54-73a7-4206-b3e2-e9f57285a295 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:04.210594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1cdf21d4-5ed4-495a-864c-3a6addf18866 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:04.211224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1cdf21d4-5ed4-495a-864c-3a6addf18866 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:04.214103 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d81fff54-73a7-4206-b3e2-e9f57285a295 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:04.214589 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d81fff54-73a7-4206-b3e2-e9f57285a295 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:04.215023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d81fff54-73a7-4206-b3e2-e9f57285a295 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:04.215736 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d81fff54-73a7-4206-b3e2-e9f57285a295 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:04.216193 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d81fff54-73a7-4206-b3e2-e9f57285a295 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:04.216615 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d81fff54-73a7-4206-b3e2-e9f57285a295 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:04.217621 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cdf21d4-5ed4-495a-864c-3a6addf18866 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:04.218145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cdf21d4-5ed4-495a-864c-3a6addf18866 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:04.218639 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cdf21d4-5ed4-495a-864c-3a6addf18866 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:04.219362 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cdf21d4-5ed4-495a-864c-3a6addf18866 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:04.219817 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cdf21d4-5ed4-495a-864c-3a6addf18866 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:04.220245 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1cdf21d4-5ed4-495a-864c-3a6addf18866 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:04.409406 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1cdf21d4-5ed4-495a-864c-3a6addf18866 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:04.411541 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d81fff54-73a7-4206-b3e2-e9f57285a295 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:04.418040 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1cdf21d4-5ed4-495a-864c-3a6addf18866 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.211818 Aug 10 13:01:04.418616 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1287/2589] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:04 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:04.420395 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d81fff54-73a7-4206-b3e2-e9f57285a295 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.217663 Aug 10 13:01:04.421037 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1303/2590] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:04 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:04.436853 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5b768096-c6be-4868-9313-c42298384a3e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:04.437559 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5b768096-c6be-4868-9313-c42298384a3e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:04.441570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f9ec047f-1d7a-4dff-843c-a7cce4682ed6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:04.442178 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f9ec047f-1d7a-4dff-843c-a7cce4682ed6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:04.444185 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5b768096-c6be-4868-9313-c42298384a3e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:04.444674 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5b768096-c6be-4868-9313-c42298384a3e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:04.445110 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5b768096-c6be-4868-9313-c42298384a3e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:04.445910 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5b768096-c6be-4868-9313-c42298384a3e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:04.446380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5b768096-c6be-4868-9313-c42298384a3e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:04.446797 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5b768096-c6be-4868-9313-c42298384a3e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:04.448732 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f9ec047f-1d7a-4dff-843c-a7cce4682ed6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:04.449206 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f9ec047f-1d7a-4dff-843c-a7cce4682ed6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:04.449659 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f9ec047f-1d7a-4dff-843c-a7cce4682ed6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:04.450336 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f9ec047f-1d7a-4dff-843c-a7cce4682ed6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:04.450781 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f9ec047f-1d7a-4dff-843c-a7cce4682ed6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:04.451221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f9ec047f-1d7a-4dff-843c-a7cce4682ed6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:04.640318 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5b768096-c6be-4868-9313-c42298384a3e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:04.643607 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f9ec047f-1d7a-4dff-843c-a7cce4682ed6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:04.649783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5b768096-c6be-4868-9313-c42298384a3e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:04.651293 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5b768096-c6be-4868-9313-c42298384a3e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:04.652482 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5b768096-c6be-4868-9313-c42298384a3e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.219638 Aug 10 13:01:04.652735 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f9ec047f-1d7a-4dff-843c-a7cce4682ed6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.214994 Aug 10 13:01:04.653044 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1288/2591] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:04 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:01:04.653381 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1304/2592] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:04 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:05.440362 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3f211c6f-5a68-487e-8e13-c3121451e4c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:05.440981 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3f211c6f-5a68-487e-8e13-c3121451e4c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:05.443258 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-611e4a1e-af2e-4335-8fe9-e537110d154b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:05.443989 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-611e4a1e-af2e-4335-8fe9-e537110d154b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:05.447910 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f211c6f-5a68-487e-8e13-c3121451e4c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:05.448385 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f211c6f-5a68-487e-8e13-c3121451e4c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:05.448814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f211c6f-5a68-487e-8e13-c3121451e4c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:05.449499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f211c6f-5a68-487e-8e13-c3121451e4c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:05.449945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f211c6f-5a68-487e-8e13-c3121451e4c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:05.450363 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f211c6f-5a68-487e-8e13-c3121451e4c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:05.450686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-611e4a1e-af2e-4335-8fe9-e537110d154b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:05.451163 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-611e4a1e-af2e-4335-8fe9-e537110d154b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:05.451620 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-611e4a1e-af2e-4335-8fe9-e537110d154b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:05.452450 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-611e4a1e-af2e-4335-8fe9-e537110d154b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:05.452904 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-611e4a1e-af2e-4335-8fe9-e537110d154b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:05.453325 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-611e4a1e-af2e-4335-8fe9-e537110d154b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:05.646072 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3f211c6f-5a68-487e-8e13-c3121451e4c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:05.649368 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-611e4a1e-af2e-4335-8fe9-e537110d154b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:05.654763 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3f211c6f-5a68-487e-8e13-c3121451e4c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.218220 Aug 10 13:01:05.655366 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1289/2593] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:05 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:05.657090 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-611e4a1e-af2e-4335-8fe9-e537110d154b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.217782 Aug 10 13:01:05.657654 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1305/2594] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:05 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:05.673942 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c9887c14-652c-4f77-8a0f-7b6199fce24b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:05.674542 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c9887c14-652c-4f77-8a0f-7b6199fce24b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:05.675931 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d4aa4eb4-19ab-4fc9-a7c4-41532e2dee59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:05.676540 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d4aa4eb4-19ab-4fc9-a7c4-41532e2dee59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:05.681343 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9887c14-652c-4f77-8a0f-7b6199fce24b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:05.681924 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9887c14-652c-4f77-8a0f-7b6199fce24b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:05.682364 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9887c14-652c-4f77-8a0f-7b6199fce24b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:05.683040 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9887c14-652c-4f77-8a0f-7b6199fce24b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:05.683150 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d4aa4eb4-19ab-4fc9-a7c4-41532e2dee59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:05.683554 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d4aa4eb4-19ab-4fc9-a7c4-41532e2dee59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:05.683698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9887c14-652c-4f77-8a0f-7b6199fce24b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:05.683984 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d4aa4eb4-19ab-4fc9-a7c4-41532e2dee59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:05.684094 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9887c14-652c-4f77-8a0f-7b6199fce24b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:05.684670 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d4aa4eb4-19ab-4fc9-a7c4-41532e2dee59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:05.685121 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d4aa4eb4-19ab-4fc9-a7c4-41532e2dee59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:05.685543 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d4aa4eb4-19ab-4fc9-a7c4-41532e2dee59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:05.687927 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:05.880685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c9887c14-652c-4f77-8a0f-7b6199fce24b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:05.883791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d4aa4eb4-19ab-4fc9-a7c4-41532e2dee59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:05.888916 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c9887c14-652c-4f77-8a0f-7b6199fce24b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.218791 Aug 10 13:01:05.889499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1290/2595] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:05 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:05.892183 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d4aa4eb4-19ab-4fc9-a7c4-41532e2dee59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:05.893680 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d4aa4eb4-19ab-4fc9-a7c4-41532e2dee59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:05.894865 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d4aa4eb4-19ab-4fc9-a7c4-41532e2dee59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.222617 Aug 10 13:01:05.895451 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1306/2596] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:05 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:06.677265 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-24708bcb-ca9a-4af9-b4d7-4c1f1963d6d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:06.678472 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-54c2c694-b825-4d6d-9c0e-f262171dffdf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:06.679058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-24708bcb-ca9a-4af9-b4d7-4c1f1963d6d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:06.679214 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-54c2c694-b825-4d6d-9c0e-f262171dffdf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:06.685587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54c2c694-b825-4d6d-9c0e-f262171dffdf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:06.686066 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54c2c694-b825-4d6d-9c0e-f262171dffdf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:06.686548 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54c2c694-b825-4d6d-9c0e-f262171dffdf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:06.687425 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54c2c694-b825-4d6d-9c0e-f262171dffdf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:06.687871 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54c2c694-b825-4d6d-9c0e-f262171dffdf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:06.688290 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54c2c694-b825-4d6d-9c0e-f262171dffdf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:06.689785 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24708bcb-ca9a-4af9-b4d7-4c1f1963d6d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:06.690270 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24708bcb-ca9a-4af9-b4d7-4c1f1963d6d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:06.690705 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24708bcb-ca9a-4af9-b4d7-4c1f1963d6d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:06.691448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24708bcb-ca9a-4af9-b4d7-4c1f1963d6d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:06.691902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24708bcb-ca9a-4af9-b4d7-4c1f1963d6d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:06.692439 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24708bcb-ca9a-4af9-b4d7-4c1f1963d6d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:06.918567 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-54c2c694-b825-4d6d-9c0e-f262171dffdf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:06.923009 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-24708bcb-ca9a-4af9-b4d7-4c1f1963d6d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:06.926789 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-54c2c694-b825-4d6d-9c0e-f262171dffdf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.253289 Aug 10 13:01:06.927429 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1307/2597] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:06 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:06.932710 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-24708bcb-ca9a-4af9-b4d7-4c1f1963d6d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.260286 Aug 10 13:01:06.933077 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-32c9d94b-ec6c-4dab-8808-7c67503a57a4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:06.944601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1291/2598] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:06 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:06.944822 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-32c9d94b-ec6c-4dab-8808-7c67503a57a4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:06.944955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3377c932-70c1-44f1-9927-7b1f86bc2acb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:06.944955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3377c932-70c1-44f1-9927-7b1f86bc2acb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:06.945137 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-32c9d94b-ec6c-4dab-8808-7c67503a57a4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:06.945137 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-32c9d94b-ec6c-4dab-8808-7c67503a57a4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:06.945137 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-32c9d94b-ec6c-4dab-8808-7c67503a57a4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:06.945137 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-32c9d94b-ec6c-4dab-8808-7c67503a57a4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:06.945446 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-32c9d94b-ec6c-4dab-8808-7c67503a57a4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:06.945446 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-32c9d94b-ec6c-4dab-8808-7c67503a57a4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:06.945869 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3377c932-70c1-44f1-9927-7b1f86bc2acb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:06.946470 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3377c932-70c1-44f1-9927-7b1f86bc2acb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:06.947750 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3377c932-70c1-44f1-9927-7b1f86bc2acb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:06.948454 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3377c932-70c1-44f1-9927-7b1f86bc2acb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:06.948903 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3377c932-70c1-44f1-9927-7b1f86bc2acb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:06.949348 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3377c932-70c1-44f1-9927-7b1f86bc2acb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:07.164489 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-32c9d94b-ec6c-4dab-8808-7c67503a57a4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:07.172504 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-32c9d94b-ec6c-4dab-8808-7c67503a57a4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.243212 Aug 10 13:01:07.173292 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1308/2599] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:06 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:07.175525 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3377c932-70c1-44f1-9927-7b1f86bc2acb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:07.184350 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3377c932-70c1-44f1-9927-7b1f86bc2acb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:07.185859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3377c932-70c1-44f1-9927-7b1f86bc2acb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:07.187007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3377c932-70c1-44f1-9927-7b1f86bc2acb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.252472 Aug 10 13:01:07.187608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1292/2600] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:06 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:01:07.949810 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-466c08c9-aa00-477e-b878-587e72cdbe61 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:07.950413 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-466c08c9-aa00-477e-b878-587e72cdbe61 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:07.952819 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=96 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:07.957480 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-466c08c9-aa00-477e-b878-587e72cdbe61 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:07.957956 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-466c08c9-aa00-477e-b878-587e72cdbe61 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:07.958382 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-466c08c9-aa00-477e-b878-587e72cdbe61 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:07.959619 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-466c08c9-aa00-477e-b878-587e72cdbe61 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:07.960063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-466c08c9-aa00-477e-b878-587e72cdbe61 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:07.960477 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-466c08c9-aa00-477e-b878-587e72cdbe61 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:07.960880 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b7bbdad1-cf8f-4ec4-9c48-71d1f05bd21f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:07.961499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b7bbdad1-cf8f-4ec4-9c48-71d1f05bd21f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:07.967605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b7bbdad1-cf8f-4ec4-9c48-71d1f05bd21f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:07.968086 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b7bbdad1-cf8f-4ec4-9c48-71d1f05bd21f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:07.971117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b7bbdad1-cf8f-4ec4-9c48-71d1f05bd21f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:07.971117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b7bbdad1-cf8f-4ec4-9c48-71d1f05bd21f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:07.971117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b7bbdad1-cf8f-4ec4-9c48-71d1f05bd21f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:07.971117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b7bbdad1-cf8f-4ec4-9c48-71d1f05bd21f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:08.163244 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-466c08c9-aa00-477e-b878-587e72cdbe61 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:08.166071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b7bbdad1-cf8f-4ec4-9c48-71d1f05bd21f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:08.171315 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-466c08c9-aa00-477e-b878-587e72cdbe61 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.225288 Aug 10 13:01:08.171953 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1309/2601] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:07 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:08.174116 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b7bbdad1-cf8f-4ec4-9c48-71d1f05bd21f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.217824 Aug 10 13:01:08.174673 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1293/2602] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:07 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:08.193673 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7bb98212-1727-4a60-9b0a-5fe9e5cbe783 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:08.194272 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7bb98212-1727-4a60-9b0a-5fe9e5cbe783 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:08.200234 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7bb98212-1727-4a60-9b0a-5fe9e5cbe783 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:08.200655 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7bb98212-1727-4a60-9b0a-5fe9e5cbe783 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:08.201084 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7bb98212-1727-4a60-9b0a-5fe9e5cbe783 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:08.201761 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7bb98212-1727-4a60-9b0a-5fe9e5cbe783 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:08.202267 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7bb98212-1727-4a60-9b0a-5fe9e5cbe783 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:08.202641 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7bb98212-1727-4a60-9b0a-5fe9e5cbe783 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:08.209925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-499cd9c3-8ab0-4912-a87b-c67970765aae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:08.210518 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-499cd9c3-8ab0-4912-a87b-c67970765aae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:08.216329 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-499cd9c3-8ab0-4912-a87b-c67970765aae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:08.216805 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-499cd9c3-8ab0-4912-a87b-c67970765aae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:08.217227 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-499cd9c3-8ab0-4912-a87b-c67970765aae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:08.219937 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-499cd9c3-8ab0-4912-a87b-c67970765aae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:08.219937 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-499cd9c3-8ab0-4912-a87b-c67970765aae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:08.219937 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-499cd9c3-8ab0-4912-a87b-c67970765aae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:08.612970 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-7bb98212-1727-4a60-9b0a-5fe9e5cbe783 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:08.621944 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7bb98212-1727-4a60-9b0a-5fe9e5cbe783 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.432401 Aug 10 13:01:08.622491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1310/2603] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:08 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:08.624351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-499cd9c3-8ab0-4912-a87b-c67970765aae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:08.633468 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-499cd9c3-8ab0-4912-a87b-c67970765aae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:08.634995 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-499cd9c3-8ab0-4912-a87b-c67970765aae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:08.636166 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-499cd9c3-8ab0-4912-a87b-c67970765aae tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.430718 Aug 10 13:01:08.636717 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1294/2604] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:08 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:09.192840 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a3093bfe-9b03-44a7-8793-6daec62e26d3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:09.194286 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a3093bfe-9b03-44a7-8793-6daec62e26d3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:09.195800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fe7d37e5-8e32-4b24-8a69-f51ea6c84673 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:09.196429 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fe7d37e5-8e32-4b24-8a69-f51ea6c84673 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:09.200651 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a3093bfe-9b03-44a7-8793-6daec62e26d3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:09.201170 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a3093bfe-9b03-44a7-8793-6daec62e26d3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:09.201608 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a3093bfe-9b03-44a7-8793-6daec62e26d3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:09.202305 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a3093bfe-9b03-44a7-8793-6daec62e26d3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:09.202590 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe7d37e5-8e32-4b24-8a69-f51ea6c84673 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:09.202761 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a3093bfe-9b03-44a7-8793-6daec62e26d3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:09.203068 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe7d37e5-8e32-4b24-8a69-f51ea6c84673 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:09.203219 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a3093bfe-9b03-44a7-8793-6daec62e26d3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:09.203541 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe7d37e5-8e32-4b24-8a69-f51ea6c84673 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:09.204231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe7d37e5-8e32-4b24-8a69-f51ea6c84673 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:09.204675 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe7d37e5-8e32-4b24-8a69-f51ea6c84673 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:09.205096 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe7d37e5-8e32-4b24-8a69-f51ea6c84673 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:09.402945 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a3093bfe-9b03-44a7-8793-6daec62e26d3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:09.409557 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fe7d37e5-8e32-4b24-8a69-f51ea6c84673 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:09.410919 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a3093bfe-9b03-44a7-8793-6daec62e26d3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.221832 Aug 10 13:01:09.411533 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1311/2605] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:09 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:09.418462 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fe7d37e5-8e32-4b24-8a69-f51ea6c84673 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.227151 Aug 10 13:01:09.419114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1295/2606] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:09 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:09.643933 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5c62db79-8133-42a5-a28c-f4fc3f795f5d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:09.644542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5c62db79-8133-42a5-a28c-f4fc3f795f5d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:09.651021 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c62db79-8133-42a5-a28c-f4fc3f795f5d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:09.651475 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c62db79-8133-42a5-a28c-f4fc3f795f5d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:09.651906 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c62db79-8133-42a5-a28c-f4fc3f795f5d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:09.652580 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c62db79-8133-42a5-a28c-f4fc3f795f5d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:09.653027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c62db79-8133-42a5-a28c-f4fc3f795f5d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:09.653444 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5c62db79-8133-42a5-a28c-f4fc3f795f5d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:09.659113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-56226979-7f6d-4640-bce2-f4887f3add59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:09.659746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-56226979-7f6d-4640-bce2-f4887f3add59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:09.666327 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56226979-7f6d-4640-bce2-f4887f3add59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:09.666810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56226979-7f6d-4640-bce2-f4887f3add59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:09.667266 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56226979-7f6d-4640-bce2-f4887f3add59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:09.667964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56226979-7f6d-4640-bce2-f4887f3add59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:09.668411 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56226979-7f6d-4640-bce2-f4887f3add59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:09.668860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56226979-7f6d-4640-bce2-f4887f3add59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:09.835544 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5c62db79-8133-42a5-a28c-f4fc3f795f5d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:09.843420 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5c62db79-8133-42a5-a28c-f4fc3f795f5d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.203274 Aug 10 13:01:09.843988 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1312/2607] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:09 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:09.856597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-56226979-7f6d-4640-bce2-f4887f3add59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:09.864924 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-56226979-7f6d-4640-bce2-f4887f3add59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:09.866529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-56226979-7f6d-4640-bce2-f4887f3add59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:09.867709 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-56226979-7f6d-4640-bce2-f4887f3add59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.212454 Aug 10 13:01:09.868271 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1296/2608] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:09 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:10.438430 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4a0675dd-07c7-4e5c-a98c-f13861c760ce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:10.438973 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4a0675dd-07c7-4e5c-a98c-f13861c760ce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:10.439485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-76073cb4-74d9-413b-8b31-c0dc0b057a1e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:10.440089 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-76073cb4-74d9-413b-8b31-c0dc0b057a1e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:10.445592 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4a0675dd-07c7-4e5c-a98c-f13861c760ce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:10.446077 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4a0675dd-07c7-4e5c-a98c-f13861c760ce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:10.446374 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76073cb4-74d9-413b-8b31-c0dc0b057a1e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:10.446497 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4a0675dd-07c7-4e5c-a98c-f13861c760ce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:10.446848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76073cb4-74d9-413b-8b31-c0dc0b057a1e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:10.447201 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4a0675dd-07c7-4e5c-a98c-f13861c760ce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:10.447317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76073cb4-74d9-413b-8b31-c0dc0b057a1e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:10.447649 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4a0675dd-07c7-4e5c-a98c-f13861c760ce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:10.447974 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76073cb4-74d9-413b-8b31-c0dc0b057a1e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:10.448097 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4a0675dd-07c7-4e5c-a98c-f13861c760ce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:10.448421 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76073cb4-74d9-413b-8b31-c0dc0b057a1e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:10.448839 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76073cb4-74d9-413b-8b31-c0dc0b057a1e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:10.641766 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4a0675dd-07c7-4e5c-a98c-f13861c760ce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:10.644836 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-76073cb4-74d9-413b-8b31-c0dc0b057a1e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:10.650040 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4a0675dd-07c7-4e5c-a98c-f13861c760ce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.215460 Aug 10 13:01:10.650618 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1313/2609] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:10 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:10.652735 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-76073cb4-74d9-413b-8b31-c0dc0b057a1e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.217051 Aug 10 13:01:10.653317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1297/2610] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:10 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:10.865592 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a9be32be-3429-43a5-832f-16e607c9f964 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:10.866208 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a9be32be-3429-43a5-832f-16e607c9f964 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:10.872150 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a9be32be-3429-43a5-832f-16e607c9f964 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:10.872634 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a9be32be-3429-43a5-832f-16e607c9f964 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:10.873067 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a9be32be-3429-43a5-832f-16e607c9f964 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:10.873744 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a9be32be-3429-43a5-832f-16e607c9f964 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:10.874191 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a9be32be-3429-43a5-832f-16e607c9f964 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:10.874610 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a9be32be-3429-43a5-832f-16e607c9f964 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:10.890902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f54d112e-c4f8-4dad-9bf9-83ef7adbd63d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:10.891643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f54d112e-c4f8-4dad-9bf9-83ef7adbd63d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:10.898145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f54d112e-c4f8-4dad-9bf9-83ef7adbd63d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:10.898625 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f54d112e-c4f8-4dad-9bf9-83ef7adbd63d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:10.899055 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f54d112e-c4f8-4dad-9bf9-83ef7adbd63d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:10.899813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f54d112e-c4f8-4dad-9bf9-83ef7adbd63d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:10.900254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f54d112e-c4f8-4dad-9bf9-83ef7adbd63d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:10.900672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f54d112e-c4f8-4dad-9bf9-83ef7adbd63d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:11.075028 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a9be32be-3429-43a5-832f-16e607c9f964 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:11.083002 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a9be32be-3429-43a5-832f-16e607c9f964 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.221842 Aug 10 13:01:11.083812 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1314/2611] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:10 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:11.086211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f54d112e-c4f8-4dad-9bf9-83ef7adbd63d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:11.094723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f54d112e-c4f8-4dad-9bf9-83ef7adbd63d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:11.096254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f54d112e-c4f8-4dad-9bf9-83ef7adbd63d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:11.097435 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f54d112e-c4f8-4dad-9bf9-83ef7adbd63d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.210667 Aug 10 13:01:11.098005 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1298/2612] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:10 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:11.671787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-49faa1e4-00e9-4717-a43d-ffc6fd9b8215 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:11.672385 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-49faa1e4-00e9-4717-a43d-ffc6fd9b8215 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:11.673599 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-53b7be02-e1f5-41ba-ad17-ce9539331688 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:11.674213 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-53b7be02-e1f5-41ba-ad17-ce9539331688 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:11.679043 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-49faa1e4-00e9-4717-a43d-ffc6fd9b8215 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:11.679859 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-49faa1e4-00e9-4717-a43d-ffc6fd9b8215 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:11.680294 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-49faa1e4-00e9-4717-a43d-ffc6fd9b8215 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:11.680523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53b7be02-e1f5-41ba-ad17-ce9539331688 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:11.680991 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-49faa1e4-00e9-4717-a43d-ffc6fd9b8215 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:11.681108 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53b7be02-e1f5-41ba-ad17-ce9539331688 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:11.681430 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53b7be02-e1f5-41ba-ad17-ce9539331688 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:11.681546 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-49faa1e4-00e9-4717-a43d-ffc6fd9b8215 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:11.681893 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-49faa1e4-00e9-4717-a43d-ffc6fd9b8215 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:11.682116 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53b7be02-e1f5-41ba-ad17-ce9539331688 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:11.682565 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53b7be02-e1f5-41ba-ad17-ce9539331688 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:11.682989 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-53b7be02-e1f5-41ba-ad17-ce9539331688 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:11.871915 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-49faa1e4-00e9-4717-a43d-ffc6fd9b8215 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:11.878697 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-53b7be02-e1f5-41ba-ad17-ce9539331688 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:11.879905 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-49faa1e4-00e9-4717-a43d-ffc6fd9b8215 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.211969 Aug 10 13:01:11.880664 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1315/2613] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:11 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:11.886709 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-53b7be02-e1f5-41ba-ad17-ce9539331688 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.216875 Aug 10 13:01:11.887290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1299/2614] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:11 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:12.104627 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-97f0c183-6df0-4663-bb46-aca21c9f4288 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:12.105229 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-97f0c183-6df0-4663-bb46-aca21c9f4288 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:12.111073 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-97f0c183-6df0-4663-bb46-aca21c9f4288 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:12.111577 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-97f0c183-6df0-4663-bb46-aca21c9f4288 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:12.112003 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-97f0c183-6df0-4663-bb46-aca21c9f4288 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:12.112678 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-97f0c183-6df0-4663-bb46-aca21c9f4288 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:12.113129 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-97f0c183-6df0-4663-bb46-aca21c9f4288 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:12.113544 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-97f0c183-6df0-4663-bb46-aca21c9f4288 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:12.120398 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-de4ab96f-4223-45d9-b703-fe8853afd4b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:12.120999 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-de4ab96f-4223-45d9-b703-fe8853afd4b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:12.126790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-de4ab96f-4223-45d9-b703-fe8853afd4b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:12.127287 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-de4ab96f-4223-45d9-b703-fe8853afd4b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:12.127718 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-de4ab96f-4223-45d9-b703-fe8853afd4b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:12.128393 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-de4ab96f-4223-45d9-b703-fe8853afd4b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:12.128834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-de4ab96f-4223-45d9-b703-fe8853afd4b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:12.129248 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-de4ab96f-4223-45d9-b703-fe8853afd4b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:12.314282 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-97f0c183-6df0-4663-bb46-aca21c9f4288 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:12.317878 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-de4ab96f-4223-45d9-b703-fe8853afd4b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:12.323051 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-97f0c183-6df0-4663-bb46-aca21c9f4288 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.222390 Aug 10 13:01:12.327344 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1316/2615] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:12 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:12.327749 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-de4ab96f-4223-45d9-b703-fe8853afd4b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:12.328874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-de4ab96f-4223-45d9-b703-fe8853afd4b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:12.330012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-de4ab96f-4223-45d9-b703-fe8853afd4b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.213501 Aug 10 13:01:12.330752 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1300/2616] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:12 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:01:12.902076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e04f6da4-2b95-4169-b872-ec451efcbaea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:12.902689 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e04f6da4-2b95-4169-b872-ec451efcbaea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:12.907992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-14bc56eb-fc7a-4167-a679-f67575ef0504 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:12.908601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-14bc56eb-fc7a-4167-a679-f67575ef0504 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:12.909269 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e04f6da4-2b95-4169-b872-ec451efcbaea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:12.909747 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e04f6da4-2b95-4169-b872-ec451efcbaea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:12.910178 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e04f6da4-2b95-4169-b872-ec451efcbaea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:12.910859 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e04f6da4-2b95-4169-b872-ec451efcbaea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:12.911336 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e04f6da4-2b95-4169-b872-ec451efcbaea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:12.911830 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e04f6da4-2b95-4169-b872-ec451efcbaea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:12.915148 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-14bc56eb-fc7a-4167-a679-f67575ef0504 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:12.915664 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-14bc56eb-fc7a-4167-a679-f67575ef0504 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:12.916096 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-14bc56eb-fc7a-4167-a679-f67575ef0504 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:12.916856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-14bc56eb-fc7a-4167-a679-f67575ef0504 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:12.917313 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-14bc56eb-fc7a-4167-a679-f67575ef0504 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:12.917736 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-14bc56eb-fc7a-4167-a679-f67575ef0504 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:13.102427 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e04f6da4-2b95-4169-b872-ec451efcbaea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:13.104905 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:13.109889 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-14bc56eb-fc7a-4167-a679-f67575ef0504 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:13.111288 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e04f6da4-2b95-4169-b872-ec451efcbaea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.213029 Aug 10 13:01:13.111870 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1317/2617] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:12 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:13.118979 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-14bc56eb-fc7a-4167-a679-f67575ef0504 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.214763 Aug 10 13:01:13.128289 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1301/2618] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:12 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:13.344707 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-beb7a3a7-b0d5-47c0-b410-1644da6071d1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:13.345318 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-beb7a3a7-b0d5-47c0-b410-1644da6071d1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:13.351750 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-beb7a3a7-b0d5-47c0-b410-1644da6071d1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:13.352224 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-beb7a3a7-b0d5-47c0-b410-1644da6071d1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:13.352622 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-41081f79-db1f-4db3-9539-acbac3edc828 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:13.352766 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-beb7a3a7-b0d5-47c0-b410-1644da6071d1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:13.353232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-41081f79-db1f-4db3-9539-acbac3edc828 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:13.353359 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-beb7a3a7-b0d5-47c0-b410-1644da6071d1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:13.353742 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-beb7a3a7-b0d5-47c0-b410-1644da6071d1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:13.354422 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-beb7a3a7-b0d5-47c0-b410-1644da6071d1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:13.359376 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41081f79-db1f-4db3-9539-acbac3edc828 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:13.359856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41081f79-db1f-4db3-9539-acbac3edc828 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:13.360292 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41081f79-db1f-4db3-9539-acbac3edc828 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:13.360965 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41081f79-db1f-4db3-9539-acbac3edc828 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:13.361417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41081f79-db1f-4db3-9539-acbac3edc828 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:13.361839 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41081f79-db1f-4db3-9539-acbac3edc828 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:13.554661 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-beb7a3a7-b0d5-47c0-b410-1644da6071d1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:13.557705 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-41081f79-db1f-4db3-9539-acbac3edc828 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:13.563032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-beb7a3a7-b0d5-47c0-b410-1644da6071d1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.222454 Aug 10 13:01:13.563638 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1318/2619] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:13 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:13.566123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-41081f79-db1f-4db3-9539-acbac3edc828 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:13.567831 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-41081f79-db1f-4db3-9539-acbac3edc828 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:13.569583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-41081f79-db1f-4db3-9539-acbac3edc828 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.220924 Aug 10 13:01:13.570111 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1302/2620] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:13 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:14.133116 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-91afaff4-f1f1-4183-a841-d55c73501cc9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:14.133732 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-91afaff4-f1f1-4183-a841-d55c73501cc9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:14.140051 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-91afaff4-f1f1-4183-a841-d55c73501cc9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:14.140534 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-91afaff4-f1f1-4183-a841-d55c73501cc9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:14.140967 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-91afaff4-f1f1-4183-a841-d55c73501cc9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:14.141652 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-91afaff4-f1f1-4183-a841-d55c73501cc9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:14.142102 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-91afaff4-f1f1-4183-a841-d55c73501cc9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:14.142524 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-91afaff4-f1f1-4183-a841-d55c73501cc9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:14.148220 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6fa6f035-da9f-42c6-9cc5-5a64612a95b1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:14.148830 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6fa6f035-da9f-42c6-9cc5-5a64612a95b1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:14.155218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6fa6f035-da9f-42c6-9cc5-5a64612a95b1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:14.155701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6fa6f035-da9f-42c6-9cc5-5a64612a95b1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:14.156163 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6fa6f035-da9f-42c6-9cc5-5a64612a95b1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:14.156849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6fa6f035-da9f-42c6-9cc5-5a64612a95b1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:14.157307 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6fa6f035-da9f-42c6-9cc5-5a64612a95b1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:14.157731 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6fa6f035-da9f-42c6-9cc5-5a64612a95b1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:14.342143 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-91afaff4-f1f1-4183-a841-d55c73501cc9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:14.347594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6fa6f035-da9f-42c6-9cc5-5a64612a95b1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:14.351526 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-91afaff4-f1f1-4183-a841-d55c73501cc9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.222872 Aug 10 13:01:14.352276 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1319/2621] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:14 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:14.356271 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6fa6f035-da9f-42c6-9cc5-5a64612a95b1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.211970 Aug 10 13:01:14.357901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1303/2622] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:14 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:14.583621 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f9063fd9-96f5-4e1c-b57d-30b6f0b587da tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:14.584706 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f9063fd9-96f5-4e1c-b57d-30b6f0b587da tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:14.590705 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f9063fd9-96f5-4e1c-b57d-30b6f0b587da tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:14.591117 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f9063fd9-96f5-4e1c-b57d-30b6f0b587da tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:14.591574 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f9063fd9-96f5-4e1c-b57d-30b6f0b587da tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:14.592253 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f9063fd9-96f5-4e1c-b57d-30b6f0b587da tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:14.592696 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f9063fd9-96f5-4e1c-b57d-30b6f0b587da tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:14.593110 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f9063fd9-96f5-4e1c-b57d-30b6f0b587da tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:14.593576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7626ff1c-037f-4169-b8fa-c0d47b895dd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:14.594185 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7626ff1c-037f-4169-b8fa-c0d47b895dd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:14.600162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7626ff1c-037f-4169-b8fa-c0d47b895dd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:14.600624 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7626ff1c-037f-4169-b8fa-c0d47b895dd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:14.601058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7626ff1c-037f-4169-b8fa-c0d47b895dd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:14.601741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7626ff1c-037f-4169-b8fa-c0d47b895dd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:14.602185 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7626ff1c-037f-4169-b8fa-c0d47b895dd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:14.602612 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7626ff1c-037f-4169-b8fa-c0d47b895dd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:14.786306 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f9063fd9-96f5-4e1c-b57d-30b6f0b587da tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:14.789476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7626ff1c-037f-4169-b8fa-c0d47b895dd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:14.794664 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f9063fd9-96f5-4e1c-b57d-30b6f0b587da tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.214857 Aug 10 13:01:14.795253 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1320/2623] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:14 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:14.797728 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7626ff1c-037f-4169-b8fa-c0d47b895dd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:14.799259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7626ff1c-037f-4169-b8fa-c0d47b895dd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:14.800408 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7626ff1c-037f-4169-b8fa-c0d47b895dd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.210661 Aug 10 13:01:14.800948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1304/2624] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:14 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:15.374217 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-31e7aabc-11b2-4fdf-8e80-7cb720bed2df tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:15.374818 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-31e7aabc-11b2-4fdf-8e80-7cb720bed2df tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:15.377856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b70a6249-0232-48b2-9458-14ea0ab771ed tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:15.378464 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b70a6249-0232-48b2-9458-14ea0ab771ed tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:15.381577 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-31e7aabc-11b2-4fdf-8e80-7cb720bed2df tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:15.382070 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-31e7aabc-11b2-4fdf-8e80-7cb720bed2df tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:15.382508 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-31e7aabc-11b2-4fdf-8e80-7cb720bed2df tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:15.383295 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-31e7aabc-11b2-4fdf-8e80-7cb720bed2df tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:15.383755 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-31e7aabc-11b2-4fdf-8e80-7cb720bed2df tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:15.384185 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-31e7aabc-11b2-4fdf-8e80-7cb720bed2df tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:15.385491 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b70a6249-0232-48b2-9458-14ea0ab771ed tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:15.385974 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b70a6249-0232-48b2-9458-14ea0ab771ed tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:15.386402 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b70a6249-0232-48b2-9458-14ea0ab771ed tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:15.387083 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b70a6249-0232-48b2-9458-14ea0ab771ed tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:15.387553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b70a6249-0232-48b2-9458-14ea0ab771ed tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:15.387970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b70a6249-0232-48b2-9458-14ea0ab771ed tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:15.584455 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-31e7aabc-11b2-4fdf-8e80-7cb720bed2df tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:15.590537 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b70a6249-0232-48b2-9458-14ea0ab771ed tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:15.592782 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-31e7aabc-11b2-4fdf-8e80-7cb720bed2df tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.222500 Aug 10 13:01:15.593371 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1321/2625] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:15 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:15.596022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b70a6249-0232-48b2-9458-14ea0ab771ed tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.222128 Aug 10 13:01:15.596717 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1305/2626] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:15 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:15.816329 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6e8130fa-7fd4-4625-a2d3-f5c2528ef5a4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:15.816951 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6e8130fa-7fd4-4625-a2d3-f5c2528ef5a4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:15.822966 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7d94e3bc-9981-4b78-b7a7-2760cb110165 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:15.823609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7d94e3bc-9981-4b78-b7a7-2760cb110165 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:15.823770 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6e8130fa-7fd4-4625-a2d3-f5c2528ef5a4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:15.824139 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6e8130fa-7fd4-4625-a2d3-f5c2528ef5a4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:15.824574 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6e8130fa-7fd4-4625-a2d3-f5c2528ef5a4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:15.825269 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6e8130fa-7fd4-4625-a2d3-f5c2528ef5a4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:15.825719 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6e8130fa-7fd4-4625-a2d3-f5c2528ef5a4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:15.826151 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6e8130fa-7fd4-4625-a2d3-f5c2528ef5a4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:15.829563 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d94e3bc-9981-4b78-b7a7-2760cb110165 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:15.830046 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d94e3bc-9981-4b78-b7a7-2760cb110165 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:15.830483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d94e3bc-9981-4b78-b7a7-2760cb110165 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:15.831226 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d94e3bc-9981-4b78-b7a7-2760cb110165 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:15.831820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d94e3bc-9981-4b78-b7a7-2760cb110165 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:15.832249 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d94e3bc-9981-4b78-b7a7-2760cb110165 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:16.022838 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6e8130fa-7fd4-4625-a2d3-f5c2528ef5a4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:16.025846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7d94e3bc-9981-4b78-b7a7-2760cb110165 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:16.028122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:16.031089 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6e8130fa-7fd4-4625-a2d3-f5c2528ef5a4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.218563 Aug 10 13:01:16.031700 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1322/2627] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:15 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:16.035099 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7d94e3bc-9981-4b78-b7a7-2760cb110165 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:16.036677 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7d94e3bc-9981-4b78-b7a7-2760cb110165 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:16.042079 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7d94e3bc-9981-4b78-b7a7-2760cb110165 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.218817 Aug 10 13:01:16.042079 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1306/2628] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:15 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:01:16.614968 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d03735da-d827-4149-b79d-bf044622fa1e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:16.615859 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d03735da-d827-4149-b79d-bf044622fa1e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:16.617900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5e5e232e-0a47-44bf-92cd-49107d38c738 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:16.618871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5e5e232e-0a47-44bf-92cd-49107d38c738 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:16.622783 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d03735da-d827-4149-b79d-bf044622fa1e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:16.623250 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d03735da-d827-4149-b79d-bf044622fa1e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:16.623682 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d03735da-d827-4149-b79d-bf044622fa1e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:16.624382 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d03735da-d827-4149-b79d-bf044622fa1e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:16.624824 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d03735da-d827-4149-b79d-bf044622fa1e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:16.625243 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d03735da-d827-4149-b79d-bf044622fa1e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:16.625767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e5e232e-0a47-44bf-92cd-49107d38c738 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:16.626258 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e5e232e-0a47-44bf-92cd-49107d38c738 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:16.626730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e5e232e-0a47-44bf-92cd-49107d38c738 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:16.627466 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e5e232e-0a47-44bf-92cd-49107d38c738 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:16.627917 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e5e232e-0a47-44bf-92cd-49107d38c738 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:16.628366 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e5e232e-0a47-44bf-92cd-49107d38c738 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:16.819449 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d03735da-d827-4149-b79d-bf044622fa1e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:16.825722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5e5e232e-0a47-44bf-92cd-49107d38c738 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:16.831523 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d03735da-d827-4149-b79d-bf044622fa1e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.216520 Aug 10 13:01:16.831523 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1323/2629] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:16 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:16.834450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5e5e232e-0a47-44bf-92cd-49107d38c738 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.220119 Aug 10 13:01:16.835013 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1307/2630] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:16 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:17.052697 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1b71c9d0-e15a-46d1-8b7c-9ca2cff2669c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:17.053245 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1b71c9d0-e15a-46d1-8b7c-9ca2cff2669c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:17.059347 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1b71c9d0-e15a-46d1-8b7c-9ca2cff2669c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:17.059829 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1b71c9d0-e15a-46d1-8b7c-9ca2cff2669c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:17.060268 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1b71c9d0-e15a-46d1-8b7c-9ca2cff2669c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:17.060954 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1b71c9d0-e15a-46d1-8b7c-9ca2cff2669c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:17.061406 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1b71c9d0-e15a-46d1-8b7c-9ca2cff2669c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:17.061829 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1b71c9d0-e15a-46d1-8b7c-9ca2cff2669c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:17.063104 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-28319eba-a590-4bad-9da8-1697c195b47e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:17.063743 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-28319eba-a590-4bad-9da8-1697c195b47e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:17.069568 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28319eba-a590-4bad-9da8-1697c195b47e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:17.069976 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28319eba-a590-4bad-9da8-1697c195b47e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:17.070400 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28319eba-a590-4bad-9da8-1697c195b47e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:17.071073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28319eba-a590-4bad-9da8-1697c195b47e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:17.071548 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28319eba-a590-4bad-9da8-1697c195b47e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:17.071963 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28319eba-a590-4bad-9da8-1697c195b47e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:17.252491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-1b71c9d0-e15a-46d1-8b7c-9ca2cff2669c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:17.256663 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-28319eba-a590-4bad-9da8-1697c195b47e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:17.261827 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1b71c9d0-e15a-46d1-8b7c-9ca2cff2669c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.213085 Aug 10 13:01:17.262649 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1324/2631] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:17 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:17.265326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-28319eba-a590-4bad-9da8-1697c195b47e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:17.266858 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-28319eba-a590-4bad-9da8-1697c195b47e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:17.268035 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-28319eba-a590-4bad-9da8-1697c195b47e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.208962 Aug 10 13:01:17.268586 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1308/2632] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:17 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:17.850026 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d8ef9872-7a13-4023-8f07-b7da09814d0c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:17.850565 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d8ef9872-7a13-4023-8f07-b7da09814d0c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:17.855948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6f57c4d3-6d4f-472d-8675-6cb2bc66ac10 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:17.856567 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6f57c4d3-6d4f-472d-8675-6cb2bc66ac10 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:17.857217 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d8ef9872-7a13-4023-8f07-b7da09814d0c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:17.857690 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d8ef9872-7a13-4023-8f07-b7da09814d0c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:17.858118 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d8ef9872-7a13-4023-8f07-b7da09814d0c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:17.858797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d8ef9872-7a13-4023-8f07-b7da09814d0c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:17.859267 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d8ef9872-7a13-4023-8f07-b7da09814d0c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:17.859686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d8ef9872-7a13-4023-8f07-b7da09814d0c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:17.862847 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f57c4d3-6d4f-472d-8675-6cb2bc66ac10 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:17.863377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f57c4d3-6d4f-472d-8675-6cb2bc66ac10 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:17.863817 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f57c4d3-6d4f-472d-8675-6cb2bc66ac10 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:17.864510 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f57c4d3-6d4f-472d-8675-6cb2bc66ac10 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:17.865530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f57c4d3-6d4f-472d-8675-6cb2bc66ac10 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:17.865964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f57c4d3-6d4f-472d-8675-6cb2bc66ac10 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:18.051036 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d8ef9872-7a13-4023-8f07-b7da09814d0c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:18.059694 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d8ef9872-7a13-4023-8f07-b7da09814d0c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.213686 Aug 10 13:01:18.060268 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1325/2633] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:17 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:18.062613 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6f57c4d3-6d4f-472d-8675-6cb2bc66ac10 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:18.070698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6f57c4d3-6d4f-472d-8675-6cb2bc66ac10 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.218841 Aug 10 13:01:18.071276 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1309/2634] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:17 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:18.283801 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fd0fe5a6-a87c-423a-9c99-6205fa00774a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:18.284447 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fd0fe5a6-a87c-423a-9c99-6205fa00774a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:18.290451 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fd0fe5a6-a87c-423a-9c99-6205fa00774a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:18.290928 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fd0fe5a6-a87c-423a-9c99-6205fa00774a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:18.291387 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fd0fe5a6-a87c-423a-9c99-6205fa00774a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:18.291505 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-42cc7bc3-94eb-4eb9-a220-9df695ce20be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:18.292074 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fd0fe5a6-a87c-423a-9c99-6205fa00774a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:18.292216 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-42cc7bc3-94eb-4eb9-a220-9df695ce20be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:18.292522 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fd0fe5a6-a87c-423a-9c99-6205fa00774a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:18.292941 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fd0fe5a6-a87c-423a-9c99-6205fa00774a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:18.298056 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-42cc7bc3-94eb-4eb9-a220-9df695ce20be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:18.298531 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-42cc7bc3-94eb-4eb9-a220-9df695ce20be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:18.298960 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-42cc7bc3-94eb-4eb9-a220-9df695ce20be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:18.299661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-42cc7bc3-94eb-4eb9-a220-9df695ce20be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:18.300108 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-42cc7bc3-94eb-4eb9-a220-9df695ce20be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:18.300524 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-42cc7bc3-94eb-4eb9-a220-9df695ce20be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:18.486461 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fd0fe5a6-a87c-423a-9c99-6205fa00774a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:18.489271 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-42cc7bc3-94eb-4eb9-a220-9df695ce20be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:18.495756 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fd0fe5a6-a87c-423a-9c99-6205fa00774a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.215895 Aug 10 13:01:18.496338 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1326/2635] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:18 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:18.498266 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-42cc7bc3-94eb-4eb9-a220-9df695ce20be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:18.499820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-42cc7bc3-94eb-4eb9-a220-9df695ce20be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:18.500977 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-42cc7bc3-94eb-4eb9-a220-9df695ce20be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.213728 Aug 10 13:01:18.501528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1310/2636] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:18 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:19.080066 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8670cb3b-7570-4c62-bb91-1866ef97ba2b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:19.080706 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8670cb3b-7570-4c62-bb91-1866ef97ba2b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:19.087749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8670cb3b-7570-4c62-bb91-1866ef97ba2b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:19.088232 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8670cb3b-7570-4c62-bb91-1866ef97ba2b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:19.088665 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8670cb3b-7570-4c62-bb91-1866ef97ba2b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:19.089350 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8670cb3b-7570-4c62-bb91-1866ef97ba2b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:19.089804 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8670cb3b-7570-4c62-bb91-1866ef97ba2b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:19.090225 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8670cb3b-7570-4c62-bb91-1866ef97ba2b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:19.091492 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7a8f2311-045a-4103-8430-0176d3a59bc2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:19.092110 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7a8f2311-045a-4103-8430-0176d3a59bc2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:19.097979 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a8f2311-045a-4103-8430-0176d3a59bc2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:19.098458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a8f2311-045a-4103-8430-0176d3a59bc2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:19.098889 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a8f2311-045a-4103-8430-0176d3a59bc2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:19.100396 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a8f2311-045a-4103-8430-0176d3a59bc2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:19.100849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a8f2311-045a-4103-8430-0176d3a59bc2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:19.101280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a8f2311-045a-4103-8430-0176d3a59bc2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:19.285419 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-8670cb3b-7570-4c62-bb91-1866ef97ba2b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:19.292845 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7a8f2311-045a-4103-8430-0176d3a59bc2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:19.294558 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8670cb3b-7570-4c62-bb91-1866ef97ba2b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.218327 Aug 10 13:01:19.295139 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1327/2637] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:19 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:19.300755 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7a8f2311-045a-4103-8430-0176d3a59bc2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.213360 Aug 10 13:01:19.301306 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1311/2638] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:19 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:19.517549 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2190ad2d-7de1-46bf-8b46-750f0e4c11c2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:19.518170 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2190ad2d-7de1-46bf-8b46-750f0e4c11c2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:19.524227 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-68ae093d-f1c5-44ac-859c-f542840ef886 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:19.524394 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2190ad2d-7de1-46bf-8b46-750f0e4c11c2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:19.524833 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-68ae093d-f1c5-44ac-859c-f542840ef886 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:19.524954 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2190ad2d-7de1-46bf-8b46-750f0e4c11c2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:19.525307 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2190ad2d-7de1-46bf-8b46-750f0e4c11c2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:19.526253 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2190ad2d-7de1-46bf-8b46-750f0e4c11c2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:19.526905 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2190ad2d-7de1-46bf-8b46-750f0e4c11c2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:19.527468 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2190ad2d-7de1-46bf-8b46-750f0e4c11c2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:19.531027 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68ae093d-f1c5-44ac-859c-f542840ef886 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:19.531529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68ae093d-f1c5-44ac-859c-f542840ef886 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:19.531952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68ae093d-f1c5-44ac-859c-f542840ef886 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:19.532631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68ae093d-f1c5-44ac-859c-f542840ef886 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:19.533072 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68ae093d-f1c5-44ac-859c-f542840ef886 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:19.533487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68ae093d-f1c5-44ac-859c-f542840ef886 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:19.723331 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2190ad2d-7de1-46bf-8b46-750f0e4c11c2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:19.728062 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-68ae093d-f1c5-44ac-859c-f542840ef886 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:19.732931 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2190ad2d-7de1-46bf-8b46-750f0e4c11c2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.219191 Aug 10 13:01:19.733833 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1328/2639] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:19 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:19.736620 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-68ae093d-f1c5-44ac-859c-f542840ef886 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:19.738124 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-68ae093d-f1c5-44ac-859c-f542840ef886 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:19.739300 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-68ae093d-f1c5-44ac-859c-f542840ef886 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.219267 Aug 10 13:01:19.740624 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1312/2640] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:19 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:20.316087 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3205f120-a4b2-4c79-be29-90f9df30a616 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:20.316645 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3205f120-a4b2-4c79-be29-90f9df30a616 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:20.321577 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-63162b09-8fcf-44cf-aea6-e8c463cc48bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:20.322191 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-63162b09-8fcf-44cf-aea6-e8c463cc48bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:20.323240 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3205f120-a4b2-4c79-be29-90f9df30a616 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:20.323721 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3205f120-a4b2-4c79-be29-90f9df30a616 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:20.324152 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3205f120-a4b2-4c79-be29-90f9df30a616 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:20.324839 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3205f120-a4b2-4c79-be29-90f9df30a616 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:20.325291 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3205f120-a4b2-4c79-be29-90f9df30a616 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:20.325710 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3205f120-a4b2-4c79-be29-90f9df30a616 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:20.328083 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-63162b09-8fcf-44cf-aea6-e8c463cc48bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:20.328552 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-63162b09-8fcf-44cf-aea6-e8c463cc48bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:20.328981 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-63162b09-8fcf-44cf-aea6-e8c463cc48bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:20.329657 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-63162b09-8fcf-44cf-aea6-e8c463cc48bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:20.330104 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-63162b09-8fcf-44cf-aea6-e8c463cc48bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:20.330521 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-63162b09-8fcf-44cf-aea6-e8c463cc48bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:20.519981 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3205f120-a4b2-4c79-be29-90f9df30a616 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:20.524635 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-63162b09-8fcf-44cf-aea6-e8c463cc48bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:20.528963 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3205f120-a4b2-4c79-be29-90f9df30a616 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.216744 Aug 10 13:01:20.529632 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1329/2641] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:20 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:20.533097 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-63162b09-8fcf-44cf-aea6-e8c463cc48bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.215783 Aug 10 13:01:20.533660 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1313/2642] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:20 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:20.756313 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9a3838d6-1d4c-4e62-8696-b02426746829 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:20.756959 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9a3838d6-1d4c-4e62-8696-b02426746829 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:20.762329 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0c911d6c-f7af-4f3d-889c-0213d6cfa5bb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:20.762943 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9a3838d6-1d4c-4e62-8696-b02426746829 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:20.763097 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0c911d6c-f7af-4f3d-889c-0213d6cfa5bb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:20.778071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9a3838d6-1d4c-4e62-8696-b02426746829 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:20.778071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9a3838d6-1d4c-4e62-8696-b02426746829 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:20.778071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9a3838d6-1d4c-4e62-8696-b02426746829 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:20.778071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9a3838d6-1d4c-4e62-8696-b02426746829 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:20.779333 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9a3838d6-1d4c-4e62-8696-b02426746829 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:20.779510 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0c911d6c-f7af-4f3d-889c-0213d6cfa5bb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:20.779510 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0c911d6c-f7af-4f3d-889c-0213d6cfa5bb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:20.779510 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0c911d6c-f7af-4f3d-889c-0213d6cfa5bb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:20.779510 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0c911d6c-f7af-4f3d-889c-0213d6cfa5bb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:20.779862 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0c911d6c-f7af-4f3d-889c-0213d6cfa5bb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:20.779862 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0c911d6c-f7af-4f3d-889c-0213d6cfa5bb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:20.970573 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9a3838d6-1d4c-4e62-8696-b02426746829 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:20.973234 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0c911d6c-f7af-4f3d-889c-0213d6cfa5bb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:20.978685 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9a3838d6-1d4c-4e62-8696-b02426746829 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.226842 Aug 10 13:01:20.979668 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1330/2643] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:20 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:20.982347 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0c911d6c-f7af-4f3d-889c-0213d6cfa5bb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:20.983882 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0c911d6c-f7af-4f3d-889c-0213d6cfa5bb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:20.985034 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0c911d6c-f7af-4f3d-889c-0213d6cfa5bb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.226612 Aug 10 13:01:20.985725 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1314/2644] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:20 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:21.552926 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-049f0351-353f-4bc1-831f-ef4a0b515850 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:21.553552 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-049f0351-353f-4bc1-831f-ef4a0b515850 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:21.553718 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0723e0c1-35ab-49e9-b7bb-2a6c670e0716 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:21.554289 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0723e0c1-35ab-49e9-b7bb-2a6c670e0716 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:21.560009 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-049f0351-353f-4bc1-831f-ef4a0b515850 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:21.560490 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-049f0351-353f-4bc1-831f-ef4a0b515850 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:21.560652 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0723e0c1-35ab-49e9-b7bb-2a6c670e0716 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:21.560918 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-049f0351-353f-4bc1-831f-ef4a0b515850 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:21.561091 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0723e0c1-35ab-49e9-b7bb-2a6c670e0716 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:21.561382 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0723e0c1-35ab-49e9-b7bb-2a6c670e0716 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:21.561609 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-049f0351-353f-4bc1-831f-ef4a0b515850 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:21.562045 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0723e0c1-35ab-49e9-b7bb-2a6c670e0716 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:21.562204 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-049f0351-353f-4bc1-831f-ef4a0b515850 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:21.562460 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-049f0351-353f-4bc1-831f-ef4a0b515850 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:21.562605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0723e0c1-35ab-49e9-b7bb-2a6c670e0716 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:21.562889 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0723e0c1-35ab-49e9-b7bb-2a6c670e0716 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:21.757385 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0723e0c1-35ab-49e9-b7bb-2a6c670e0716 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:21.761500 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-049f0351-353f-4bc1-831f-ef4a0b515850 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:21.765515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0723e0c1-35ab-49e9-b7bb-2a6c670e0716 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.216130 Aug 10 13:01:21.766085 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1315/2645] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:21 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:21.769390 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-049f0351-353f-4bc1-831f-ef4a0b515850 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.220959 Aug 10 13:01:21.769965 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1331/2646] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:21 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:22.000395 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-cbe41dc2-75b9-4d37-a066-f31571439eac tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:22.001007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-cbe41dc2-75b9-4d37-a066-f31571439eac tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:22.007501 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cbe41dc2-75b9-4d37-a066-f31571439eac tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:22.007702 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-cf677395-1c0b-4bab-9f01-b24359a19684 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:22.007985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cbe41dc2-75b9-4d37-a066-f31571439eac tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:22.008242 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-cf677395-1c0b-4bab-9f01-b24359a19684 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:22.008445 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cbe41dc2-75b9-4d37-a066-f31571439eac tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:22.009134 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cbe41dc2-75b9-4d37-a066-f31571439eac tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:22.009585 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cbe41dc2-75b9-4d37-a066-f31571439eac tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:22.010010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cbe41dc2-75b9-4d37-a066-f31571439eac tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:22.014233 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf677395-1c0b-4bab-9f01-b24359a19684 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:22.014716 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf677395-1c0b-4bab-9f01-b24359a19684 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:22.015151 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf677395-1c0b-4bab-9f01-b24359a19684 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:22.015859 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf677395-1c0b-4bab-9f01-b24359a19684 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:22.016308 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf677395-1c0b-4bab-9f01-b24359a19684 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:22.016729 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cf677395-1c0b-4bab-9f01-b24359a19684 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:22.205171 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-cbe41dc2-75b9-4d37-a066-f31571439eac tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:22.208096 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-cf677395-1c0b-4bab-9f01-b24359a19684 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:22.213807 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-cbe41dc2-75b9-4d37-a066-f31571439eac tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.217202 Aug 10 13:01:22.214376 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1316/2647] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:21 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:22.217805 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-cf677395-1c0b-4bab-9f01-b24359a19684 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:22.219328 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-cf677395-1c0b-4bab-9f01-b24359a19684 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:22.220483 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-cf677395-1c0b-4bab-9f01-b24359a19684 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.217443 Aug 10 13:01:22.221175 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1332/2648] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:22 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:22.787779 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-03d2bc37-5377-4134-9ba7-85c8bd5a7b0e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:22.788390 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-03d2bc37-5377-4134-9ba7-85c8bd5a7b0e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:22.792229 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-26ec521e-b078-4006-8da6-0b7e7a8c6712 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:22.792833 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-26ec521e-b078-4006-8da6-0b7e7a8c6712 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:22.794751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03d2bc37-5377-4134-9ba7-85c8bd5a7b0e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:22.795261 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03d2bc37-5377-4134-9ba7-85c8bd5a7b0e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:22.795692 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03d2bc37-5377-4134-9ba7-85c8bd5a7b0e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:22.796377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03d2bc37-5377-4134-9ba7-85c8bd5a7b0e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:22.796821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03d2bc37-5377-4134-9ba7-85c8bd5a7b0e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:22.797238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03d2bc37-5377-4134-9ba7-85c8bd5a7b0e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:22.799038 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-26ec521e-b078-4006-8da6-0b7e7a8c6712 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:22.799546 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-26ec521e-b078-4006-8da6-0b7e7a8c6712 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:22.799965 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-26ec521e-b078-4006-8da6-0b7e7a8c6712 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:22.800637 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-26ec521e-b078-4006-8da6-0b7e7a8c6712 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:22.801078 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-26ec521e-b078-4006-8da6-0b7e7a8c6712 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:22.801492 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-26ec521e-b078-4006-8da6-0b7e7a8c6712 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:22.999018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-03d2bc37-5377-4134-9ba7-85c8bd5a7b0e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:23.002177 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-26ec521e-b078-4006-8da6-0b7e7a8c6712 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:23.007234 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-03d2bc37-5377-4134-9ba7-85c8bd5a7b0e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.223842 Aug 10 13:01:23.010224 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-26ec521e-b078-4006-8da6-0b7e7a8c6712 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.221653 Aug 10 13:01:23.011090 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1333/2649] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:22 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:23.019488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1317/2650] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:22 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:23.235582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9f30916e-9dbc-4546-a2b8-97ac697ad7b9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:23.236114 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9f30916e-9dbc-4546-a2b8-97ac697ad7b9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:23.242377 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9f30916e-9dbc-4546-a2b8-97ac697ad7b9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:23.242856 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9f30916e-9dbc-4546-a2b8-97ac697ad7b9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:23.243318 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9f30916e-9dbc-4546-a2b8-97ac697ad7b9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:23.243700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7f29c021-2bbc-46df-a7a4-fb4faac542ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:23.244015 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9f30916e-9dbc-4546-a2b8-97ac697ad7b9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:23.244313 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7f29c021-2bbc-46df-a7a4-fb4faac542ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:23.244449 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9f30916e-9dbc-4546-a2b8-97ac697ad7b9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:23.244876 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9f30916e-9dbc-4546-a2b8-97ac697ad7b9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:23.250316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f29c021-2bbc-46df-a7a4-fb4faac542ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:23.250797 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f29c021-2bbc-46df-a7a4-fb4faac542ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:23.251255 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f29c021-2bbc-46df-a7a4-fb4faac542ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:23.251945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f29c021-2bbc-46df-a7a4-fb4faac542ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:23.252393 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f29c021-2bbc-46df-a7a4-fb4faac542ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:23.252818 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f29c021-2bbc-46df-a7a4-fb4faac542ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:23.260363 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:23.445744 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9f30916e-9dbc-4546-a2b8-97ac697ad7b9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:23.449162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7f29c021-2bbc-46df-a7a4-fb4faac542ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:23.453721 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9f30916e-9dbc-4546-a2b8-97ac697ad7b9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.222135 Aug 10 13:01:23.454295 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1334/2651] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:23 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:23.457868 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7f29c021-2bbc-46df-a7a4-fb4faac542ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:23.459969 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7f29c021-2bbc-46df-a7a4-fb4faac542ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:23.461204 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7f29c021-2bbc-46df-a7a4-fb4faac542ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.221419 Aug 10 13:01:23.461836 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1318/2652] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:23 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:24.028698 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d264dd09-463d-4722-be8c-bbf5a1447258 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:24.029351 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d264dd09-463d-4722-be8c-bbf5a1447258 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:24.032031 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ed6727aa-dc40-4c94-97b8-ffdc44276278 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:24.032646 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ed6727aa-dc40-4c94-97b8-ffdc44276278 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:24.036140 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d264dd09-463d-4722-be8c-bbf5a1447258 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:24.036632 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d264dd09-463d-4722-be8c-bbf5a1447258 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:24.037254 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d264dd09-463d-4722-be8c-bbf5a1447258 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:24.038015 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d264dd09-463d-4722-be8c-bbf5a1447258 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:24.038671 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d264dd09-463d-4722-be8c-bbf5a1447258 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:24.039134 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d264dd09-463d-4722-be8c-bbf5a1447258 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:24.039468 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ed6727aa-dc40-4c94-97b8-ffdc44276278 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:24.039955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ed6727aa-dc40-4c94-97b8-ffdc44276278 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:24.040389 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ed6727aa-dc40-4c94-97b8-ffdc44276278 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:24.041071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ed6727aa-dc40-4c94-97b8-ffdc44276278 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:24.041516 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ed6727aa-dc40-4c94-97b8-ffdc44276278 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:24.041932 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ed6727aa-dc40-4c94-97b8-ffdc44276278 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:24.231279 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d264dd09-463d-4722-be8c-bbf5a1447258 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:24.234393 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ed6727aa-dc40-4c94-97b8-ffdc44276278 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:24.239388 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d264dd09-463d-4722-be8c-bbf5a1447258 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.214563 Aug 10 13:01:24.240510 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1335/2653] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:24 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:24.242786 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ed6727aa-dc40-4c94-97b8-ffdc44276278 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.214588 Aug 10 13:01:24.243385 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1319/2654] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:24 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:24.475816 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-916498f3-5a06-41e6-8346-3706568a12f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:24.476541 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-916498f3-5a06-41e6-8346-3706568a12f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:24.483144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-916498f3-5a06-41e6-8346-3706568a12f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:24.483601 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-916498f3-5a06-41e6-8346-3706568a12f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:24.484027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-916498f3-5a06-41e6-8346-3706568a12f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:24.484159 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2cc595e5-bf46-4339-b7a9-493bfbb7cb08 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:24.484709 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-916498f3-5a06-41e6-8346-3706568a12f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:24.484818 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2cc595e5-bf46-4339-b7a9-493bfbb7cb08 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:24.485215 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-916498f3-5a06-41e6-8346-3706568a12f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:24.485633 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-916498f3-5a06-41e6-8346-3706568a12f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:24.491317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2cc595e5-bf46-4339-b7a9-493bfbb7cb08 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:24.491803 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2cc595e5-bf46-4339-b7a9-493bfbb7cb08 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:24.492241 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2cc595e5-bf46-4339-b7a9-493bfbb7cb08 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:24.492938 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2cc595e5-bf46-4339-b7a9-493bfbb7cb08 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:24.493391 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2cc595e5-bf46-4339-b7a9-493bfbb7cb08 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:24.493817 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2cc595e5-bf46-4339-b7a9-493bfbb7cb08 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:24.681166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-916498f3-5a06-41e6-8346-3706568a12f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:24.684572 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2cc595e5-bf46-4339-b7a9-493bfbb7cb08 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:24.689407 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-916498f3-5a06-41e6-8346-3706568a12f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.218384 Aug 10 13:01:24.689981 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1336/2655] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:24 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:24.693088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2cc595e5-bf46-4339-b7a9-493bfbb7cb08 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:24.695329 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2cc595e5-bf46-4339-b7a9-493bfbb7cb08 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:24.696468 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2cc595e5-bf46-4339-b7a9-493bfbb7cb08 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.216201 Aug 10 13:01:24.697012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1320/2656] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:24 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:25.261044 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3598f9e5-e4fe-4567-8e8d-7612649f157e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:25.261660 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3598f9e5-e4fe-4567-8e8d-7612649f157e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:25.263773 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-822f2a7b-5da1-4820-9633-49aded0f356f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:25.264502 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-822f2a7b-5da1-4820-9633-49aded0f356f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:25.268340 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3598f9e5-e4fe-4567-8e8d-7612649f157e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:25.268855 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3598f9e5-e4fe-4567-8e8d-7612649f157e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:25.269289 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3598f9e5-e4fe-4567-8e8d-7612649f157e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:25.269982 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3598f9e5-e4fe-4567-8e8d-7612649f157e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:25.270431 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3598f9e5-e4fe-4567-8e8d-7612649f157e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:25.270576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-822f2a7b-5da1-4820-9633-49aded0f356f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:25.270852 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3598f9e5-e4fe-4567-8e8d-7612649f157e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:25.271664 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-822f2a7b-5da1-4820-9633-49aded0f356f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:25.272048 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-822f2a7b-5da1-4820-9633-49aded0f356f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:25.272741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-822f2a7b-5da1-4820-9633-49aded0f356f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:25.273191 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-822f2a7b-5da1-4820-9633-49aded0f356f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:25.273617 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-822f2a7b-5da1-4820-9633-49aded0f356f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:25.703507 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3598f9e5-e4fe-4567-8e8d-7612649f157e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:25.707557 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-822f2a7b-5da1-4820-9633-49aded0f356f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:25.712659 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3598f9e5-e4fe-4567-8e8d-7612649f157e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.455562 Aug 10 13:01:25.713237 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1337/2657] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:25 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:25.717303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-822f2a7b-5da1-4820-9633-49aded0f356f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.457576 Aug 10 13:01:25.717864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1321/2658] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:25 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:25.718251 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b572340e-6ca4-4d72-bd94-5d523c72fd5e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:25.719076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b572340e-6ca4-4d72-bd94-5d523c72fd5e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:25.723327 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fa82cc27-7644-44be-acb5-87808a7d8f70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:25.725148 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fa82cc27-7644-44be-acb5-87808a7d8f70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:25.726328 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b572340e-6ca4-4d72-bd94-5d523c72fd5e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:25.726903 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b572340e-6ca4-4d72-bd94-5d523c72fd5e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:25.727361 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b572340e-6ca4-4d72-bd94-5d523c72fd5e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:25.728056 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b572340e-6ca4-4d72-bd94-5d523c72fd5e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:25.728512 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b572340e-6ca4-4d72-bd94-5d523c72fd5e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:25.729190 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b572340e-6ca4-4d72-bd94-5d523c72fd5e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:25.731912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fa82cc27-7644-44be-acb5-87808a7d8f70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:25.732385 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fa82cc27-7644-44be-acb5-87808a7d8f70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:25.732813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fa82cc27-7644-44be-acb5-87808a7d8f70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:25.733522 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fa82cc27-7644-44be-acb5-87808a7d8f70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:25.733996 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fa82cc27-7644-44be-acb5-87808a7d8f70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:25.734444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fa82cc27-7644-44be-acb5-87808a7d8f70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:25.922058 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b572340e-6ca4-4d72-bd94-5d523c72fd5e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:25.926182 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fa82cc27-7644-44be-acb5-87808a7d8f70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:25.930173 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b572340e-6ca4-4d72-bd94-5d523c72fd5e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.215708 Aug 10 13:01:25.930756 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1338/2659] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:25 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:25.934787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fa82cc27-7644-44be-acb5-87808a7d8f70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:25.936331 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fa82cc27-7644-44be-acb5-87808a7d8f70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:25.937480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fa82cc27-7644-44be-acb5-87808a7d8f70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.218008 Aug 10 13:01:25.938027 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1322/2660] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:25 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:01:26.734147 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0c1a5af6-6f13-40ee-acb9-c64c8454fe0a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:26.734756 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0c1a5af6-6f13-40ee-acb9-c64c8454fe0a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:26.739293 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0fb3e9e1-1bdb-4ea2-b327-bc215e0ae372 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:26.740468 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0fb3e9e1-1bdb-4ea2-b327-bc215e0ae372 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:26.742359 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0c1a5af6-6f13-40ee-acb9-c64c8454fe0a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:26.742837 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0c1a5af6-6f13-40ee-acb9-c64c8454fe0a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:26.743296 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0c1a5af6-6f13-40ee-acb9-c64c8454fe0a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:26.744030 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0c1a5af6-6f13-40ee-acb9-c64c8454fe0a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:26.744474 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0c1a5af6-6f13-40ee-acb9-c64c8454fe0a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:26.744889 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0c1a5af6-6f13-40ee-acb9-c64c8454fe0a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:26.746903 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0fb3e9e1-1bdb-4ea2-b327-bc215e0ae372 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:26.747482 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0fb3e9e1-1bdb-4ea2-b327-bc215e0ae372 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:26.747908 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0fb3e9e1-1bdb-4ea2-b327-bc215e0ae372 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:26.748591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0fb3e9e1-1bdb-4ea2-b327-bc215e0ae372 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:26.749036 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0fb3e9e1-1bdb-4ea2-b327-bc215e0ae372 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:26.749459 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0fb3e9e1-1bdb-4ea2-b327-bc215e0ae372 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:26.764941 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:26.936776 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0c1a5af6-6f13-40ee-acb9-c64c8454fe0a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:26.944333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0fb3e9e1-1bdb-4ea2-b327-bc215e0ae372 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:26.945726 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0c1a5af6-6f13-40ee-acb9-c64c8454fe0a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.215439 Aug 10 13:01:26.946390 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1339/2661] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:26 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:26.951001 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ecb05954-44f3-437a-93b2-eead0d0c285f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:26.951700 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ecb05954-44f3-437a-93b2-eead0d0c285f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:26.953208 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0fb3e9e1-1bdb-4ea2-b327-bc215e0ae372 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.217633 Aug 10 13:01:26.953774 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1323/2662] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:26 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:26.960198 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ecb05954-44f3-437a-93b2-eead0d0c285f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:26.960756 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ecb05954-44f3-437a-93b2-eead0d0c285f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:26.961288 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ecb05954-44f3-437a-93b2-eead0d0c285f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:26.962062 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ecb05954-44f3-437a-93b2-eead0d0c285f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:26.962608 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ecb05954-44f3-437a-93b2-eead0d0c285f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:26.963092 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ecb05954-44f3-437a-93b2-eead0d0c285f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:26.970368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3811484c-aec4-4162-8c2c-a87c9f77a2b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:26.970978 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3811484c-aec4-4162-8c2c-a87c9f77a2b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:26.977055 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3811484c-aec4-4162-8c2c-a87c9f77a2b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:26.977537 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3811484c-aec4-4162-8c2c-a87c9f77a2b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:26.977974 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3811484c-aec4-4162-8c2c-a87c9f77a2b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:26.978663 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3811484c-aec4-4162-8c2c-a87c9f77a2b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:26.979415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3811484c-aec4-4162-8c2c-a87c9f77a2b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:26.979849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3811484c-aec4-4162-8c2c-a87c9f77a2b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:27.158175 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ecb05954-44f3-437a-93b2-eead0d0c285f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:27.164870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3811484c-aec4-4162-8c2c-a87c9f77a2b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:27.173675 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3811484c-aec4-4162-8c2c-a87c9f77a2b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:27.175198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3811484c-aec4-4162-8c2c-a87c9f77a2b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:27.176367 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3811484c-aec4-4162-8c2c-a87c9f77a2b0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.209767 Aug 10 13:01:27.176923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1324/2663] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:26 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:01:27.181641 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ecb05954-44f3-437a-93b2-eead0d0c285f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.234157 Aug 10 13:01:27.182223 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1340/2664] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:26 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:27.967458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7a2358ef-0bdf-4d82-b679-6a1ffd325dea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:27.968066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7a2358ef-0bdf-4d82-b679-6a1ffd325dea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:27.975011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a2358ef-0bdf-4d82-b679-6a1ffd325dea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:27.975269 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5cdc3823-e0a8-469a-9533-7453363437ff tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:27.975710 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a2358ef-0bdf-4d82-b679-6a1ffd325dea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:27.975937 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5cdc3823-e0a8-469a-9533-7453363437ff tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:27.976060 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a2358ef-0bdf-4d82-b679-6a1ffd325dea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:27.976624 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a2358ef-0bdf-4d82-b679-6a1ffd325dea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:27.977075 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a2358ef-0bdf-4d82-b679-6a1ffd325dea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:27.977500 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7a2358ef-0bdf-4d82-b679-6a1ffd325dea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:27.982277 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5cdc3823-e0a8-469a-9533-7453363437ff tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:27.982756 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5cdc3823-e0a8-469a-9533-7453363437ff tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:27.983195 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5cdc3823-e0a8-469a-9533-7453363437ff tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:27.983893 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5cdc3823-e0a8-469a-9533-7453363437ff tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:27.984338 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5cdc3823-e0a8-469a-9533-7453363437ff tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:27.984755 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5cdc3823-e0a8-469a-9533-7453363437ff tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:28.164542 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7a2358ef-0bdf-4d82-b679-6a1ffd325dea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:28.172673 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7a2358ef-0bdf-4d82-b679-6a1ffd325dea tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.209032 Aug 10 13:01:28.173251 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1325/2665] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:27 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:28.175135 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5cdc3823-e0a8-469a-9533-7453363437ff tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:28.185037 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5cdc3823-e0a8-469a-9533-7453363437ff tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.213876 Aug 10 13:01:28.185865 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1341/2666] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:27 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:28.204536 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-64ca7162-83f9-415f-8972-9b3bc13d7d59 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:28.205201 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-64ca7162-83f9-415f-8972-9b3bc13d7d59 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:28.206506 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-80bf17eb-e4c4-44f6-b766-448950a771a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:28.207115 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-80bf17eb-e4c4-44f6-b766-448950a771a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:28.214924 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64ca7162-83f9-415f-8972-9b3bc13d7d59 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:28.214924 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64ca7162-83f9-415f-8972-9b3bc13d7d59 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:28.214924 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64ca7162-83f9-415f-8972-9b3bc13d7d59 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:28.215598 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-80bf17eb-e4c4-44f6-b766-448950a771a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:28.215725 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64ca7162-83f9-415f-8972-9b3bc13d7d59 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:28.215815 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-80bf17eb-e4c4-44f6-b766-448950a771a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:28.215911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64ca7162-83f9-415f-8972-9b3bc13d7d59 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:28.216005 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-80bf17eb-e4c4-44f6-b766-448950a771a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:28.216104 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64ca7162-83f9-415f-8972-9b3bc13d7d59 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:28.216192 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-80bf17eb-e4c4-44f6-b766-448950a771a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:28.216192 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-80bf17eb-e4c4-44f6-b766-448950a771a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:28.216192 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-80bf17eb-e4c4-44f6-b766-448950a771a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:28.416243 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-64ca7162-83f9-415f-8972-9b3bc13d7d59 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:28.420108 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-80bf17eb-e4c4-44f6-b766-448950a771a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:28.424631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-64ca7162-83f9-415f-8972-9b3bc13d7d59 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.225402 Aug 10 13:01:28.425206 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1326/2667] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:28 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:28.428835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-80bf17eb-e4c4-44f6-b766-448950a771a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:28.430254 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-80bf17eb-e4c4-44f6-b766-448950a771a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:28.431436 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-80bf17eb-e4c4-44f6-b766-448950a771a5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.229717 Aug 10 13:01:28.431989 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1342/2668] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:28 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:29.194591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-760ec9da-e7bb-48de-a70b-194dc61aad52 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:29.195226 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-760ec9da-e7bb-48de-a70b-194dc61aad52 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:29.201596 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-760ec9da-e7bb-48de-a70b-194dc61aad52 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:29.202074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-760ec9da-e7bb-48de-a70b-194dc61aad52 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:29.202501 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-760ec9da-e7bb-48de-a70b-194dc61aad52 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:29.203187 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-760ec9da-e7bb-48de-a70b-194dc61aad52 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:29.203639 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-760ec9da-e7bb-48de-a70b-194dc61aad52 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:29.204056 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-760ec9da-e7bb-48de-a70b-194dc61aad52 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:29.207803 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3cacf7e6-6636-4339-9467-219d710954e8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:29.208415 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3cacf7e6-6636-4339-9467-219d710954e8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:29.215485 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3cacf7e6-6636-4339-9467-219d710954e8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:29.215964 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3cacf7e6-6636-4339-9467-219d710954e8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:29.216393 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3cacf7e6-6636-4339-9467-219d710954e8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:29.217079 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3cacf7e6-6636-4339-9467-219d710954e8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:29.217524 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3cacf7e6-6636-4339-9467-219d710954e8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:29.217947 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3cacf7e6-6636-4339-9467-219d710954e8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:29.408670 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-760ec9da-e7bb-48de-a70b-194dc61aad52 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:29.413311 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3cacf7e6-6636-4339-9467-219d710954e8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:29.417352 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-760ec9da-e7bb-48de-a70b-194dc61aad52 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.227406 Aug 10 13:01:29.417919 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1327/2669] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:29 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:29.421360 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3cacf7e6-6636-4339-9467-219d710954e8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.217378 Aug 10 13:01:29.421923 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1343/2670] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:29 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:29.445620 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-553fd421-ffb5-40bf-aeeb-ea72c0e30e33 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:29.446160 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-553fd421-ffb5-40bf-aeeb-ea72c0e30e33 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:29.452080 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-553fd421-ffb5-40bf-aeeb-ea72c0e30e33 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:29.452560 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-553fd421-ffb5-40bf-aeeb-ea72c0e30e33 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:29.452994 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-553fd421-ffb5-40bf-aeeb-ea72c0e30e33 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:29.453676 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-553fd421-ffb5-40bf-aeeb-ea72c0e30e33 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:29.453788 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-23b3958f-f3fc-40c7-a656-ac707cc0358e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:29.454126 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-553fd421-ffb5-40bf-aeeb-ea72c0e30e33 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:29.454483 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-23b3958f-f3fc-40c7-a656-ac707cc0358e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:29.454603 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-553fd421-ffb5-40bf-aeeb-ea72c0e30e33 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:29.460337 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23b3958f-f3fc-40c7-a656-ac707cc0358e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:29.460905 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23b3958f-f3fc-40c7-a656-ac707cc0358e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:29.461394 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23b3958f-f3fc-40c7-a656-ac707cc0358e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:29.462136 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23b3958f-f3fc-40c7-a656-ac707cc0358e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:29.462650 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23b3958f-f3fc-40c7-a656-ac707cc0358e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:29.463131 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-23b3958f-f3fc-40c7-a656-ac707cc0358e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:29.650447 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-23b3958f-f3fc-40c7-a656-ac707cc0358e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:29.653859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-553fd421-ffb5-40bf-aeeb-ea72c0e30e33 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:29.659251 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-23b3958f-f3fc-40c7-a656-ac707cc0358e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:29.660740 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-23b3958f-f3fc-40c7-a656-ac707cc0358e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:29.662329 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-553fd421-ffb5-40bf-aeeb-ea72c0e30e33 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.219902 Aug 10 13:01:29.662515 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-23b3958f-f3fc-40c7-a656-ac707cc0358e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.212119 Aug 10 13:01:29.662907 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1328/2671] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:29 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:29.667262 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1344/2672] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:29 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:30.439074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-84b0d303-a377-4ffa-8a1a-79a5104d9e81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:30.439711 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-84b0d303-a377-4ffa-8a1a-79a5104d9e81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:30.442888 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0f928040-3dc6-4f61-bd73-3cbce655f8fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:30.443656 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0f928040-3dc6-4f61-bd73-3cbce655f8fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:30.446163 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84b0d303-a377-4ffa-8a1a-79a5104d9e81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:30.446640 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84b0d303-a377-4ffa-8a1a-79a5104d9e81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:30.447064 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84b0d303-a377-4ffa-8a1a-79a5104d9e81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:30.447786 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84b0d303-a377-4ffa-8a1a-79a5104d9e81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:30.448232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84b0d303-a377-4ffa-8a1a-79a5104d9e81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:30.448649 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84b0d303-a377-4ffa-8a1a-79a5104d9e81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:30.449999 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f928040-3dc6-4f61-bd73-3cbce655f8fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:30.450478 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f928040-3dc6-4f61-bd73-3cbce655f8fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:30.450913 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f928040-3dc6-4f61-bd73-3cbce655f8fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:30.451630 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f928040-3dc6-4f61-bd73-3cbce655f8fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:30.452082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f928040-3dc6-4f61-bd73-3cbce655f8fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:30.452513 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0f928040-3dc6-4f61-bd73-3cbce655f8fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:30.645335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-84b0d303-a377-4ffa-8a1a-79a5104d9e81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:30.648292 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0f928040-3dc6-4f61-bd73-3cbce655f8fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:30.653550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-84b0d303-a377-4ffa-8a1a-79a5104d9e81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.218242 Aug 10 13:01:30.654136 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1329/2673] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:30 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:30.656439 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0f928040-3dc6-4f61-bd73-3cbce655f8fc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.217337 Aug 10 13:01:30.657169 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1345/2674] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:30 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:30.683776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-18f8740b-c272-4273-9c2c-b758eda0a3fd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:30.684477 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-18f8740b-c272-4273-9c2c-b758eda0a3fd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:30.684799 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-334123cf-e944-46c5-b6a3-2ae3cd1d39db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:30.685422 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-334123cf-e944-46c5-b6a3-2ae3cd1d39db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:30.686290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=98 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:30.690971 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-18f8740b-c272-4273-9c2c-b758eda0a3fd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:30.691183 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-334123cf-e944-46c5-b6a3-2ae3cd1d39db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:30.691519 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-18f8740b-c272-4273-9c2c-b758eda0a3fd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:30.691658 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-334123cf-e944-46c5-b6a3-2ae3cd1d39db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:30.691954 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-18f8740b-c272-4273-9c2c-b758eda0a3fd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:30.692155 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-334123cf-e944-46c5-b6a3-2ae3cd1d39db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:30.692644 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-18f8740b-c272-4273-9c2c-b758eda0a3fd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:30.692819 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-334123cf-e944-46c5-b6a3-2ae3cd1d39db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:30.693131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-18f8740b-c272-4273-9c2c-b758eda0a3fd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:30.693283 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-334123cf-e944-46c5-b6a3-2ae3cd1d39db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:30.693660 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-18f8740b-c272-4273-9c2c-b758eda0a3fd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:30.693771 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-334123cf-e944-46c5-b6a3-2ae3cd1d39db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:30.886579 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-18f8740b-c272-4273-9c2c-b758eda0a3fd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:30.890475 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-334123cf-e944-46c5-b6a3-2ae3cd1d39db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:30.899706 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-18f8740b-c272-4273-9c2c-b758eda0a3fd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.214581 Aug 10 13:01:30.899706 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1330/2675] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:30 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:30.899980 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-334123cf-e944-46c5-b6a3-2ae3cd1d39db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:30.901179 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-334123cf-e944-46c5-b6a3-2ae3cd1d39db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:30.902332 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-334123cf-e944-46c5-b6a3-2ae3cd1d39db tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.221407 Aug 10 13:01:30.903039 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1346/2676] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:30 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:31.676117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-39681c01-7472-46a5-807c-0a77c980fbcd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:31.676671 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-39681c01-7472-46a5-807c-0a77c980fbcd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:31.678060 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f49c1989-1abd-432b-b9ad-1df03f838a21 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:31.678718 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f49c1989-1abd-432b-b9ad-1df03f838a21 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:31.683323 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-39681c01-7472-46a5-807c-0a77c980fbcd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:31.683812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-39681c01-7472-46a5-807c-0a77c980fbcd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:31.684280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-39681c01-7472-46a5-807c-0a77c980fbcd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:31.684999 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-39681c01-7472-46a5-807c-0a77c980fbcd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:31.685117 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f49c1989-1abd-432b-b9ad-1df03f838a21 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:31.685454 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-39681c01-7472-46a5-807c-0a77c980fbcd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:31.685631 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f49c1989-1abd-432b-b9ad-1df03f838a21 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:31.685878 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-39681c01-7472-46a5-807c-0a77c980fbcd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:31.686005 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f49c1989-1abd-432b-b9ad-1df03f838a21 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:31.686551 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f49c1989-1abd-432b-b9ad-1df03f838a21 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:31.686994 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f49c1989-1abd-432b-b9ad-1df03f838a21 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:31.687434 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f49c1989-1abd-432b-b9ad-1df03f838a21 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:31.877199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-39681c01-7472-46a5-807c-0a77c980fbcd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:31.884216 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f49c1989-1abd-432b-b9ad-1df03f838a21 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:31.885866 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-39681c01-7472-46a5-807c-0a77c980fbcd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.214220 Aug 10 13:01:31.886484 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1331/2677] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:31 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:31.893054 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f49c1989-1abd-432b-b9ad-1df03f838a21 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.219099 Aug 10 13:01:31.899913 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1347/2678] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:31 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:31.916289 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d84a51a5-09fb-4178-bbe1-c00d474cd444 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:31.916778 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d84a51a5-09fb-4178-bbe1-c00d474cd444 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:31.922628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d84a51a5-09fb-4178-bbe1-c00d474cd444 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:31.923114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d84a51a5-09fb-4178-bbe1-c00d474cd444 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:31.923835 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d84a51a5-09fb-4178-bbe1-c00d474cd444 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:31.924517 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d84a51a5-09fb-4178-bbe1-c00d474cd444 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:31.924978 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d84a51a5-09fb-4178-bbe1-c00d474cd444 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:31.925406 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d84a51a5-09fb-4178-bbe1-c00d474cd444 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:31.925847 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f898137d-8750-4e6f-ac0b-7002212f7c83 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:31.926500 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f898137d-8750-4e6f-ac0b-7002212f7c83 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:31.933041 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f898137d-8750-4e6f-ac0b-7002212f7c83 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:31.933522 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f898137d-8750-4e6f-ac0b-7002212f7c83 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:31.934006 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f898137d-8750-4e6f-ac0b-7002212f7c83 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:31.934686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f898137d-8750-4e6f-ac0b-7002212f7c83 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:31.935134 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f898137d-8750-4e6f-ac0b-7002212f7c83 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:31.935576 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f898137d-8750-4e6f-ac0b-7002212f7c83 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:32.120034 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d84a51a5-09fb-4178-bbe1-c00d474cd444 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:32.123337 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f898137d-8750-4e6f-ac0b-7002212f7c83 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:32.128184 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d84a51a5-09fb-4178-bbe1-c00d474cd444 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.215822 Aug 10 13:01:32.128761 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1332/2679] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:31 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:32.132878 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f898137d-8750-4e6f-ac0b-7002212f7c83 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:32.134367 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f898137d-8750-4e6f-ac0b-7002212f7c83 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:32.135604 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f898137d-8750-4e6f-ac0b-7002212f7c83 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.213616 Aug 10 13:01:32.136383 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1348/2680] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:31 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:01:32.907158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b02d6607-c2af-4e80-b0ae-93acb53d7cf1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:32.908492 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b02d6607-c2af-4e80-b0ae-93acb53d7cf1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:32.914367 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-104ee0fb-343e-4b33-8622-173aee443fd9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:32.914973 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-104ee0fb-343e-4b33-8622-173aee443fd9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:32.915900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b02d6607-c2af-4e80-b0ae-93acb53d7cf1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:32.916535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b02d6607-c2af-4e80-b0ae-93acb53d7cf1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:32.916815 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b02d6607-c2af-4e80-b0ae-93acb53d7cf1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:32.917526 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b02d6607-c2af-4e80-b0ae-93acb53d7cf1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:32.917972 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b02d6607-c2af-4e80-b0ae-93acb53d7cf1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:32.918504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b02d6607-c2af-4e80-b0ae-93acb53d7cf1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:32.921211 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-104ee0fb-343e-4b33-8622-173aee443fd9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:32.921679 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-104ee0fb-343e-4b33-8622-173aee443fd9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:32.922107 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-104ee0fb-343e-4b33-8622-173aee443fd9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:32.922782 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-104ee0fb-343e-4b33-8622-173aee443fd9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:32.923248 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-104ee0fb-343e-4b33-8622-173aee443fd9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:32.923670 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-104ee0fb-343e-4b33-8622-173aee443fd9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:33.113871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b02d6607-c2af-4e80-b0ae-93acb53d7cf1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:33.118028 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-104ee0fb-343e-4b33-8622-173aee443fd9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:33.122239 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b02d6607-c2af-4e80-b0ae-93acb53d7cf1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.218897 Aug 10 13:01:33.122899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1333/2681] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:32 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:33.125967 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-104ee0fb-343e-4b33-8622-173aee443fd9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.215927 Aug 10 13:01:33.126543 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1349/2682] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:32 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:33.149740 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4f0cc323-94f9-42f3-a5f5-096a1192a99d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:33.150378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4f0cc323-94f9-42f3-a5f5-096a1192a99d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:33.156204 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f0cc323-94f9-42f3-a5f5-096a1192a99d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:33.156683 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f0cc323-94f9-42f3-a5f5-096a1192a99d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:33.157116 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f0cc323-94f9-42f3-a5f5-096a1192a99d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:33.157854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f0cc323-94f9-42f3-a5f5-096a1192a99d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:33.158251 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f0cc323-94f9-42f3-a5f5-096a1192a99d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:33.158672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f0cc323-94f9-42f3-a5f5-096a1192a99d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:33.158970 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ce59c109-3c1f-443b-bf4a-d36b32d1a021 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:33.159602 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ce59c109-3c1f-443b-bf4a-d36b32d1a021 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:33.166084 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce59c109-3c1f-443b-bf4a-d36b32d1a021 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:33.166560 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce59c109-3c1f-443b-bf4a-d36b32d1a021 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:33.166988 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce59c109-3c1f-443b-bf4a-d36b32d1a021 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:33.167707 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce59c109-3c1f-443b-bf4a-d36b32d1a021 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:33.168151 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce59c109-3c1f-443b-bf4a-d36b32d1a021 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:33.168564 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce59c109-3c1f-443b-bf4a-d36b32d1a021 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:33.353520 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4f0cc323-94f9-42f3-a5f5-096a1192a99d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:33.356996 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ce59c109-3c1f-443b-bf4a-d36b32d1a021 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:33.361791 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4f0cc323-94f9-42f3-a5f5-096a1192a99d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.215970 Aug 10 13:01:33.362564 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1334/2683] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:33 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:33.366333 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ce59c109-3c1f-443b-bf4a-d36b32d1a021 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:33.367979 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ce59c109-3c1f-443b-bf4a-d36b32d1a021 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:33.369347 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ce59c109-3c1f-443b-bf4a-d36b32d1a021 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.214132 Aug 10 13:01:33.369901 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1350/2684] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:33 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:34.143719 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b635c09d-e714-475b-b348-6adf7de62b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:34.144380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b635c09d-e714-475b-b348-6adf7de62b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:34.148265 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-cdc0771c-a638-4841-82e0-c0795d0f02b9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:34.148878 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-cdc0771c-a638-4841-82e0-c0795d0f02b9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:34.151524 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b635c09d-e714-475b-b348-6adf7de62b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:34.152018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b635c09d-e714-475b-b348-6adf7de62b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:34.152487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b635c09d-e714-475b-b348-6adf7de62b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:34.153182 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b635c09d-e714-475b-b348-6adf7de62b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:34.153637 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b635c09d-e714-475b-b348-6adf7de62b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:34.154098 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b635c09d-e714-475b-b348-6adf7de62b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:34.155153 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cdc0771c-a638-4841-82e0-c0795d0f02b9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:34.155664 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cdc0771c-a638-4841-82e0-c0795d0f02b9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:34.156095 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cdc0771c-a638-4841-82e0-c0795d0f02b9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:34.156781 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cdc0771c-a638-4841-82e0-c0795d0f02b9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:34.157229 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cdc0771c-a638-4841-82e0-c0795d0f02b9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:34.157650 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cdc0771c-a638-4841-82e0-c0795d0f02b9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:34.161573 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:34.345693 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-cdc0771c-a638-4841-82e0-c0795d0f02b9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:34.350310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b635c09d-e714-475b-b348-6adf7de62b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:34.355091 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-cdc0771c-a638-4841-82e0-c0795d0f02b9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.211166 Aug 10 13:01:34.355908 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1351/2685] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:34 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:34.359199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b635c09d-e714-475b-b348-6adf7de62b99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.219227 Aug 10 13:01:34.359767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1335/2686] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:34 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:34.389823 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e4442e68-c27e-4b69-bebb-586693a251f5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:34.390442 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e4442e68-c27e-4b69-bebb-586693a251f5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:34.393125 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9adca9b1-3a56-4a96-acf5-2bc381a7cc1a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:34.393732 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9adca9b1-3a56-4a96-acf5-2bc381a7cc1a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:34.397514 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4442e68-c27e-4b69-bebb-586693a251f5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:34.398373 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4442e68-c27e-4b69-bebb-586693a251f5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:34.398819 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4442e68-c27e-4b69-bebb-586693a251f5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:34.399545 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4442e68-c27e-4b69-bebb-586693a251f5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:34.400026 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4442e68-c27e-4b69-bebb-586693a251f5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:34.400427 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4442e68-c27e-4b69-bebb-586693a251f5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:34.400557 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9adca9b1-3a56-4a96-acf5-2bc381a7cc1a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:34.400960 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9adca9b1-3a56-4a96-acf5-2bc381a7cc1a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:34.401398 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9adca9b1-3a56-4a96-acf5-2bc381a7cc1a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:34.402096 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9adca9b1-3a56-4a96-acf5-2bc381a7cc1a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:34.402529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9adca9b1-3a56-4a96-acf5-2bc381a7cc1a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:34.402949 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9adca9b1-3a56-4a96-acf5-2bc381a7cc1a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:34.599941 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9adca9b1-3a56-4a96-acf5-2bc381a7cc1a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:34.600209 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e4442e68-c27e-4b69-bebb-586693a251f5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:34.609643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9adca9b1-3a56-4a96-acf5-2bc381a7cc1a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:34.610355 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e4442e68-c27e-4b69-bebb-586693a251f5 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.224344 Aug 10 13:01:34.611161 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1352/2687] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:34 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:34.611372 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9adca9b1-3a56-4a96-acf5-2bc381a7cc1a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:34.612567 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9adca9b1-3a56-4a96-acf5-2bc381a7cc1a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.223248 Aug 10 13:01:34.613375 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1336/2688] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:34 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:35.376980 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6f7a4325-7a31-4960-a4df-cfdb9db0ce56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:35.377606 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6f7a4325-7a31-4960-a4df-cfdb9db0ce56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:35.381129 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-89cdff7f-0afd-4863-886b-8f79f4550ae5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:35.382015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-89cdff7f-0afd-4863-886b-8f79f4550ae5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:35.384709 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f7a4325-7a31-4960-a4df-cfdb9db0ce56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:35.385197 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f7a4325-7a31-4960-a4df-cfdb9db0ce56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:35.385628 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f7a4325-7a31-4960-a4df-cfdb9db0ce56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:35.386319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f7a4325-7a31-4960-a4df-cfdb9db0ce56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:35.386989 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f7a4325-7a31-4960-a4df-cfdb9db0ce56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:35.387335 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f7a4325-7a31-4960-a4df-cfdb9db0ce56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:35.388504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-89cdff7f-0afd-4863-886b-8f79f4550ae5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:35.388980 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-89cdff7f-0afd-4863-886b-8f79f4550ae5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:35.389410 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-89cdff7f-0afd-4863-886b-8f79f4550ae5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:35.390278 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-89cdff7f-0afd-4863-886b-8f79f4550ae5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:35.390729 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-89cdff7f-0afd-4863-886b-8f79f4550ae5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:35.391291 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-89cdff7f-0afd-4863-886b-8f79f4550ae5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:35.590842 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-89cdff7f-0afd-4863-886b-8f79f4550ae5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:35.593948 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6f7a4325-7a31-4960-a4df-cfdb9db0ce56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:35.598964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-89cdff7f-0afd-4863-886b-8f79f4550ae5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.222376 Aug 10 13:01:35.600368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1337/2689] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:35 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:35.602647 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6f7a4325-7a31-4960-a4df-cfdb9db0ce56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.229562 Aug 10 13:01:35.603238 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1353/2690] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:35 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:35.631422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e0157180-3173-4888-ab9e-4adf8c7f8734 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:35.632166 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e0157180-3173-4888-ab9e-4adf8c7f8734 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:35.635632 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d1ba3121-c17f-4b9f-87be-68ed5ece68a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:35.636244 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d1ba3121-c17f-4b9f-87be-68ed5ece68a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:35.638508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0157180-3173-4888-ab9e-4adf8c7f8734 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:35.639121 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0157180-3173-4888-ab9e-4adf8c7f8734 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:35.639768 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0157180-3173-4888-ab9e-4adf8c7f8734 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:35.640562 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0157180-3173-4888-ab9e-4adf8c7f8734 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:35.641009 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0157180-3173-4888-ab9e-4adf8c7f8734 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:35.641558 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0157180-3173-4888-ab9e-4adf8c7f8734 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:35.642174 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1ba3121-c17f-4b9f-87be-68ed5ece68a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:35.642691 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1ba3121-c17f-4b9f-87be-68ed5ece68a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:35.643123 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1ba3121-c17f-4b9f-87be-68ed5ece68a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:35.644003 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1ba3121-c17f-4b9f-87be-68ed5ece68a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:35.644462 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1ba3121-c17f-4b9f-87be-68ed5ece68a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:35.644885 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1ba3121-c17f-4b9f-87be-68ed5ece68a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:35.838792 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e0157180-3173-4888-ab9e-4adf8c7f8734 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:35.842576 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d1ba3121-c17f-4b9f-87be-68ed5ece68a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:35.846943 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e0157180-3173-4888-ab9e-4adf8c7f8734 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.219435 Aug 10 13:01:35.847563 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1338/2691] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:35 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:35.851576 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d1ba3121-c17f-4b9f-87be-68ed5ece68a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:35.853076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d1ba3121-c17f-4b9f-87be-68ed5ece68a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:35.854498 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d1ba3121-c17f-4b9f-87be-68ed5ece68a2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.222671 Aug 10 13:01:35.855196 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1354/2692] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:35 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:36.622370 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-480f491a-6337-4b7b-9efb-f4aef68ecb51 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:36.622980 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-480f491a-6337-4b7b-9efb-f4aef68ecb51 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:36.624640 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-191bc7ca-6d35-4371-899e-442c41a41813 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:36.625319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-191bc7ca-6d35-4371-899e-442c41a41813 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:36.629452 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-480f491a-6337-4b7b-9efb-f4aef68ecb51 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:36.634668 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-480f491a-6337-4b7b-9efb-f4aef68ecb51 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:36.634668 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-480f491a-6337-4b7b-9efb-f4aef68ecb51 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:36.634668 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-480f491a-6337-4b7b-9efb-f4aef68ecb51 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:36.634668 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-480f491a-6337-4b7b-9efb-f4aef68ecb51 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:36.635034 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-191bc7ca-6d35-4371-899e-442c41a41813 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:36.635132 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-480f491a-6337-4b7b-9efb-f4aef68ecb51 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:36.635266 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-191bc7ca-6d35-4371-899e-442c41a41813 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:36.635266 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-191bc7ca-6d35-4371-899e-442c41a41813 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:36.635266 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-191bc7ca-6d35-4371-899e-442c41a41813 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:36.635266 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-191bc7ca-6d35-4371-899e-442c41a41813 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:36.635595 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-191bc7ca-6d35-4371-899e-442c41a41813 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:36.836506 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-191bc7ca-6d35-4371-899e-442c41a41813 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:36.839857 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-480f491a-6337-4b7b-9efb-f4aef68ecb51 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:36.844664 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-191bc7ca-6d35-4371-899e-442c41a41813 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.223993 Aug 10 13:01:36.845250 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1355/2693] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:36 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:36.848742 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-480f491a-6337-4b7b-9efb-f4aef68ecb51 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.231196 Aug 10 13:01:36.849321 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1339/2694] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:36 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:36.867501 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6ce4613e-f5ce-4b65-9a1f-ede31a9a51ba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:36.868170 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6ce4613e-f5ce-4b65-9a1f-ede31a9a51ba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:36.873956 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6ce4613e-f5ce-4b65-9a1f-ede31a9a51ba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:36.874433 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6ce4613e-f5ce-4b65-9a1f-ede31a9a51ba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:36.874865 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6ce4613e-f5ce-4b65-9a1f-ede31a9a51ba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:36.875588 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6ce4613e-f5ce-4b65-9a1f-ede31a9a51ba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:36.876037 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6ce4613e-f5ce-4b65-9a1f-ede31a9a51ba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:36.876456 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6ce4613e-f5ce-4b65-9a1f-ede31a9a51ba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:36.877549 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1076e014-21e7-429e-90bf-e5102a6f32d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:36.878157 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1076e014-21e7-429e-90bf-e5102a6f32d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:36.884679 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1076e014-21e7-429e-90bf-e5102a6f32d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:36.885155 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1076e014-21e7-429e-90bf-e5102a6f32d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:36.885587 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1076e014-21e7-429e-90bf-e5102a6f32d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:36.886265 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1076e014-21e7-429e-90bf-e5102a6f32d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:36.886713 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1076e014-21e7-429e-90bf-e5102a6f32d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:36.887133 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1076e014-21e7-429e-90bf-e5102a6f32d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:36.889689 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:37.070114 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6ce4613e-f5ce-4b65-9a1f-ede31a9a51ba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:37.073087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1076e014-21e7-429e-90bf-e5102a6f32d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:37.078123 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6ce4613e-f5ce-4b65-9a1f-ede31a9a51ba tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.214357 Aug 10 13:01:37.078798 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1356/2695] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:36 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:37.081626 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1076e014-21e7-429e-90bf-e5102a6f32d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:37.083138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1076e014-21e7-429e-90bf-e5102a6f32d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:37.084846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1076e014-21e7-429e-90bf-e5102a6f32d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.211088 Aug 10 13:01:37.085399 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1340/2696] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:36 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:37.866220 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-adc405ae-79db-479c-b5a2-8d487f43ff56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:37.866841 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-adc405ae-79db-479c-b5a2-8d487f43ff56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:37.869487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ddf9c8f3-b80d-478d-9c11-cd0f8eeb60f7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:37.876380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ddf9c8f3-b80d-478d-9c11-cd0f8eeb60f7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:37.876505 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-adc405ae-79db-479c-b5a2-8d487f43ff56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:37.876505 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-adc405ae-79db-479c-b5a2-8d487f43ff56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:37.876505 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-adc405ae-79db-479c-b5a2-8d487f43ff56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:37.876505 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-adc405ae-79db-479c-b5a2-8d487f43ff56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:37.876905 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-adc405ae-79db-479c-b5a2-8d487f43ff56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:37.876905 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-adc405ae-79db-479c-b5a2-8d487f43ff56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:37.877065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ddf9c8f3-b80d-478d-9c11-cd0f8eeb60f7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:37.877065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ddf9c8f3-b80d-478d-9c11-cd0f8eeb60f7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:37.877277 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ddf9c8f3-b80d-478d-9c11-cd0f8eeb60f7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:37.877884 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ddf9c8f3-b80d-478d-9c11-cd0f8eeb60f7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:37.878333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ddf9c8f3-b80d-478d-9c11-cd0f8eeb60f7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:37.878755 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ddf9c8f3-b80d-478d-9c11-cd0f8eeb60f7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:38.068269 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-adc405ae-79db-479c-b5a2-8d487f43ff56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:38.071640 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ddf9c8f3-b80d-478d-9c11-cd0f8eeb60f7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:38.076398 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-adc405ae-79db-479c-b5a2-8d487f43ff56 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.214091 Aug 10 13:01:38.077172 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1357/2697] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:37 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:38.079594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ddf9c8f3-b80d-478d-9c11-cd0f8eeb60f7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.213784 Aug 10 13:01:38.080156 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1341/2698] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:37 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:38.100129 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0ac1f89b-8c31-48ce-aa99-73834a138f71 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:38.100735 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0ac1f89b-8c31-48ce-aa99-73834a138f71 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:38.102507 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=98 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:38.107494 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ac1f89b-8c31-48ce-aa99-73834a138f71 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:38.108073 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ac1f89b-8c31-48ce-aa99-73834a138f71 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:38.108512 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ac1f89b-8c31-48ce-aa99-73834a138f71 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:38.108653 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-38ae450b-667c-4948-9b35-9e5d15a88411 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:38.109173 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-38ae450b-667c-4948-9b35-9e5d15a88411 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:38.109307 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ac1f89b-8c31-48ce-aa99-73834a138f71 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:38.109739 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ac1f89b-8c31-48ce-aa99-73834a138f71 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:38.110164 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0ac1f89b-8c31-48ce-aa99-73834a138f71 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:38.114969 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38ae450b-667c-4948-9b35-9e5d15a88411 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:38.115479 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38ae450b-667c-4948-9b35-9e5d15a88411 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:38.115917 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38ae450b-667c-4948-9b35-9e5d15a88411 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:38.116838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38ae450b-667c-4948-9b35-9e5d15a88411 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:38.117287 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38ae450b-667c-4948-9b35-9e5d15a88411 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:38.117715 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38ae450b-667c-4948-9b35-9e5d15a88411 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:38.313412 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0ac1f89b-8c31-48ce-aa99-73834a138f71 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:38.317240 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-38ae450b-667c-4948-9b35-9e5d15a88411 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:38.321699 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0ac1f89b-8c31-48ce-aa99-73834a138f71 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.225816 Aug 10 13:01:38.322280 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1358/2699] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:38 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:38.325707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-38ae450b-667c-4948-9b35-9e5d15a88411 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:38.327235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-38ae450b-667c-4948-9b35-9e5d15a88411 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:38.328386 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-38ae450b-667c-4948-9b35-9e5d15a88411 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.224170 Aug 10 13:01:38.328997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1342/2700] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:38 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:39.098163 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-01c73543-8f42-431b-8a38-263edcba97f1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:39.098697 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-01c73543-8f42-431b-8a38-263edcba97f1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:39.100772 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e2083deb-cf16-4dff-a3e2-ea01a7d3b5d9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:39.101387 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e2083deb-cf16-4dff-a3e2-ea01a7d3b5d9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:39.106389 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01c73543-8f42-431b-8a38-263edcba97f1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:39.106865 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01c73543-8f42-431b-8a38-263edcba97f1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:39.107319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01c73543-8f42-431b-8a38-263edcba97f1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:39.108005 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01c73543-8f42-431b-8a38-263edcba97f1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:39.108173 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2083deb-cf16-4dff-a3e2-ea01a7d3b5d9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:39.108446 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01c73543-8f42-431b-8a38-263edcba97f1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:39.108657 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2083deb-cf16-4dff-a3e2-ea01a7d3b5d9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:39.108860 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01c73543-8f42-431b-8a38-263edcba97f1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:39.109089 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2083deb-cf16-4dff-a3e2-ea01a7d3b5d9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:39.109781 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2083deb-cf16-4dff-a3e2-ea01a7d3b5d9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:39.110252 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2083deb-cf16-4dff-a3e2-ea01a7d3b5d9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:39.110676 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2083deb-cf16-4dff-a3e2-ea01a7d3b5d9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:39.299968 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-01c73543-8f42-431b-8a38-263edcba97f1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:39.303902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e2083deb-cf16-4dff-a3e2-ea01a7d3b5d9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:39.309088 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-01c73543-8f42-431b-8a38-263edcba97f1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.214988 Aug 10 13:01:39.309661 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1359/2701] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:39 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:39.312016 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e2083deb-cf16-4dff-a3e2-ea01a7d3b5d9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.215171 Aug 10 13:01:39.312582 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1343/2702] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:39 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:39.342695 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-24415d97-c21c-44f9-90f7-b9c88307fe4e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:39.343339 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-24415d97-c21c-44f9-90f7-b9c88307fe4e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:39.349222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24415d97-c21c-44f9-90f7-b9c88307fe4e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:39.350093 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24415d97-c21c-44f9-90f7-b9c88307fe4e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:39.350524 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24415d97-c21c-44f9-90f7-b9c88307fe4e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:39.350642 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9735abde-49f6-4a66-8d6d-649fe4b85305 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:39.351229 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24415d97-c21c-44f9-90f7-b9c88307fe4e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:39.351348 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9735abde-49f6-4a66-8d6d-649fe4b85305 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:39.351678 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24415d97-c21c-44f9-90f7-b9c88307fe4e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:39.352093 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-24415d97-c21c-44f9-90f7-b9c88307fe4e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:39.357247 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9735abde-49f6-4a66-8d6d-649fe4b85305 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:39.357730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9735abde-49f6-4a66-8d6d-649fe4b85305 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:39.358172 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9735abde-49f6-4a66-8d6d-649fe4b85305 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:39.358857 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9735abde-49f6-4a66-8d6d-649fe4b85305 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:39.359339 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9735abde-49f6-4a66-8d6d-649fe4b85305 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:39.359779 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9735abde-49f6-4a66-8d6d-649fe4b85305 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:39.545067 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-24415d97-c21c-44f9-90f7-b9c88307fe4e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:39.553657 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-24415d97-c21c-44f9-90f7-b9c88307fe4e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.214551 Aug 10 13:01:39.554240 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1360/2703] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:39 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:39.556128 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9735abde-49f6-4a66-8d6d-649fe4b85305 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:39.564555 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9735abde-49f6-4a66-8d6d-649fe4b85305 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:39.566065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9735abde-49f6-4a66-8d6d-649fe4b85305 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:39.567237 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9735abde-49f6-4a66-8d6d-649fe4b85305 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.220396 Aug 10 13:01:39.567793 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1344/2704] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:39 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:40.330898 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c09a4e77-f3af-48be-926f-c6a19c1248d1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:40.331544 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c09a4e77-f3af-48be-926f-c6a19c1248d1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:40.333307 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e1c38b8d-c1b2-4df8-8b08-d6e3dc3dda1f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:40.333928 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e1c38b8d-c1b2-4df8-8b08-d6e3dc3dda1f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:40.338216 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c09a4e77-f3af-48be-926f-c6a19c1248d1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:40.338703 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c09a4e77-f3af-48be-926f-c6a19c1248d1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:40.339136 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c09a4e77-f3af-48be-926f-c6a19c1248d1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:40.339858 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c09a4e77-f3af-48be-926f-c6a19c1248d1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:40.340101 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e1c38b8d-c1b2-4df8-8b08-d6e3dc3dda1f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:40.340308 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c09a4e77-f3af-48be-926f-c6a19c1248d1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:40.340573 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e1c38b8d-c1b2-4df8-8b08-d6e3dc3dda1f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:40.340735 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c09a4e77-f3af-48be-926f-c6a19c1248d1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:40.340998 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e1c38b8d-c1b2-4df8-8b08-d6e3dc3dda1f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:40.341668 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e1c38b8d-c1b2-4df8-8b08-d6e3dc3dda1f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:40.342113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e1c38b8d-c1b2-4df8-8b08-d6e3dc3dda1f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:40.342528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e1c38b8d-c1b2-4df8-8b08-d6e3dc3dda1f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:40.533153 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c09a4e77-f3af-48be-926f-c6a19c1248d1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:40.536342 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e1c38b8d-c1b2-4df8-8b08-d6e3dc3dda1f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:40.541920 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c09a4e77-f3af-48be-926f-c6a19c1248d1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.214905 Aug 10 13:01:40.542592 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1361/2705] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:40 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:40.544864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e1c38b8d-c1b2-4df8-8b08-d6e3dc3dda1f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.215553 Aug 10 13:01:40.545591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1345/2706] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:40 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:40.574886 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-180b5fdd-d829-4304-9d98-ef46d4edae84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:40.575518 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-180b5fdd-d829-4304-9d98-ef46d4edae84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:40.581277 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-180b5fdd-d829-4304-9d98-ef46d4edae84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:40.581760 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-180b5fdd-d829-4304-9d98-ef46d4edae84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:40.582197 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-180b5fdd-d829-4304-9d98-ef46d4edae84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:40.582879 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-180b5fdd-d829-4304-9d98-ef46d4edae84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:40.583366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-180b5fdd-d829-4304-9d98-ef46d4edae84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:40.584399 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-180b5fdd-d829-4304-9d98-ef46d4edae84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:40.590517 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-04d734a5-7230-4ca7-9877-2af75b66f854 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:40.591122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-04d734a5-7230-4ca7-9877-2af75b66f854 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:40.596952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04d734a5-7230-4ca7-9877-2af75b66f854 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:40.597429 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04d734a5-7230-4ca7-9877-2af75b66f854 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:40.597869 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04d734a5-7230-4ca7-9877-2af75b66f854 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:40.598545 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04d734a5-7230-4ca7-9877-2af75b66f854 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:40.598992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04d734a5-7230-4ca7-9877-2af75b66f854 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:40.599620 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04d734a5-7230-4ca7-9877-2af75b66f854 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:40.762003 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-180b5fdd-d829-4304-9d98-ef46d4edae84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:40.770017 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-180b5fdd-d829-4304-9d98-ef46d4edae84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.198780 Aug 10 13:01:40.770600 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1362/2707] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:40 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:40.789211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-04d734a5-7230-4ca7-9877-2af75b66f854 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:40.797453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-04d734a5-7230-4ca7-9877-2af75b66f854 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:40.798941 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-04d734a5-7230-4ca7-9877-2af75b66f854 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:40.800119 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-04d734a5-7230-4ca7-9877-2af75b66f854 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.213484 Aug 10 13:01:40.800669 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1346/2708] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:40 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:01:41.564054 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-faab1d95-30eb-451c-a353-4d91ef3c8854 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:41.564616 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-faab1d95-30eb-451c-a353-4d91ef3c8854 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:41.566570 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8c9ed82d-0747-427a-bc1c-85deb3ffe75f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:41.567192 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8c9ed82d-0747-427a-bc1c-85deb3ffe75f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:41.571814 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-faab1d95-30eb-451c-a353-4d91ef3c8854 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:41.572294 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-faab1d95-30eb-451c-a353-4d91ef3c8854 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:41.572729 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-faab1d95-30eb-451c-a353-4d91ef3c8854 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:41.573417 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-faab1d95-30eb-451c-a353-4d91ef3c8854 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:41.573860 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-faab1d95-30eb-451c-a353-4d91ef3c8854 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:41.573973 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c9ed82d-0747-427a-bc1c-85deb3ffe75f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:41.574279 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-faab1d95-30eb-451c-a353-4d91ef3c8854 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:41.574445 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c9ed82d-0747-427a-bc1c-85deb3ffe75f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:41.574873 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c9ed82d-0747-427a-bc1c-85deb3ffe75f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:41.575587 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c9ed82d-0747-427a-bc1c-85deb3ffe75f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:41.576035 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c9ed82d-0747-427a-bc1c-85deb3ffe75f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:41.576451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c9ed82d-0747-427a-bc1c-85deb3ffe75f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:41.983276 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-faab1d95-30eb-451c-a353-4d91ef3c8854 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:41.991222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-faab1d95-30eb-451c-a353-4d91ef3c8854 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.431159 Aug 10 13:01:41.992142 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1363/2709] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:41 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:41.993953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8c9ed82d-0747-427a-bc1c-85deb3ffe75f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:42.000845 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-73de1d15-6305-4b6b-a531-24b3a1f382f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:42.001463 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-73de1d15-6305-4b6b-a531-24b3a1f382f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:42.004506 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8c9ed82d-0747-427a-bc1c-85deb3ffe75f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.441580 Aug 10 13:01:42.009238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1347/2710] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:41 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:42.012814 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73de1d15-6305-4b6b-a531-24b3a1f382f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:42.013229 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73de1d15-6305-4b6b-a531-24b3a1f382f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:42.013669 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73de1d15-6305-4b6b-a531-24b3a1f382f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:42.014379 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73de1d15-6305-4b6b-a531-24b3a1f382f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:42.014831 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73de1d15-6305-4b6b-a531-24b3a1f382f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:42.015286 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73de1d15-6305-4b6b-a531-24b3a1f382f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:42.108280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7d1758a3-d4fa-4ab5-83bc-4f1ce0e1d8d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:42.108968 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7d1758a3-d4fa-4ab5-83bc-4f1ce0e1d8d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:42.116255 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d1758a3-d4fa-4ab5-83bc-4f1ce0e1d8d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:42.116737 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d1758a3-d4fa-4ab5-83bc-4f1ce0e1d8d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:42.117166 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d1758a3-d4fa-4ab5-83bc-4f1ce0e1d8d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:42.118163 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d1758a3-d4fa-4ab5-83bc-4f1ce0e1d8d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:42.118422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d1758a3-d4fa-4ab5-83bc-4f1ce0e1d8d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:42.118860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d1758a3-d4fa-4ab5-83bc-4f1ce0e1d8d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:42.150074 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-73de1d15-6305-4b6b-a531-24b3a1f382f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:42.158019 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-73de1d15-6305-4b6b-a531-24b3a1f382f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.161764 Aug 10 13:01:42.158598 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1364/2711] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:41 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:42.247003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7d1758a3-d4fa-4ab5-83bc-4f1ce0e1d8d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:42.255836 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7d1758a3-d4fa-4ab5-83bc-4f1ce0e1d8d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:42.257363 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7d1758a3-d4fa-4ab5-83bc-4f1ce0e1d8d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:42.258521 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7d1758a3-d4fa-4ab5-83bc-4f1ce0e1d8d8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.251979 Aug 10 13:01:42.259081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1348/2712] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:42 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:01:43.026508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-590ea819-6d22-4680-bb03-6853943b413c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:43.027122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-590ea819-6d22-4680-bb03-6853943b413c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:43.033324 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-590ea819-6d22-4680-bb03-6853943b413c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:43.033796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-590ea819-6d22-4680-bb03-6853943b413c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:43.034222 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-590ea819-6d22-4680-bb03-6853943b413c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:43.034898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-590ea819-6d22-4680-bb03-6853943b413c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:43.035371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-590ea819-6d22-4680-bb03-6853943b413c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:43.035788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-590ea819-6d22-4680-bb03-6853943b413c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:43.078548 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-92e5fff0-0cf5-43cb-a589-77994e3f013c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:43.079159 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-92e5fff0-0cf5-43cb-a589-77994e3f013c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:43.085614 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-92e5fff0-0cf5-43cb-a589-77994e3f013c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:43.086092 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-92e5fff0-0cf5-43cb-a589-77994e3f013c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:43.086521 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-92e5fff0-0cf5-43cb-a589-77994e3f013c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:43.087228 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-92e5fff0-0cf5-43cb-a589-77994e3f013c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:43.087674 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-92e5fff0-0cf5-43cb-a589-77994e3f013c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:43.088090 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-92e5fff0-0cf5-43cb-a589-77994e3f013c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:43.225518 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-590ea819-6d22-4680-bb03-6853943b413c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:43.233998 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-590ea819-6d22-4680-bb03-6853943b413c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.211372 Aug 10 13:01:43.234702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1349/2713] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:43 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:43.239350 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4b80ab16-6d5e-4ee6-acb8-b801e635a864 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:43.240069 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4b80ab16-6d5e-4ee6-acb8-b801e635a864 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:43.245688 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b80ab16-6d5e-4ee6-acb8-b801e635a864 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:43.246173 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b80ab16-6d5e-4ee6-acb8-b801e635a864 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:43.246737 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b80ab16-6d5e-4ee6-acb8-b801e635a864 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:43.247456 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b80ab16-6d5e-4ee6-acb8-b801e635a864 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:43.247905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b80ab16-6d5e-4ee6-acb8-b801e635a864 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:43.248330 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b80ab16-6d5e-4ee6-acb8-b801e635a864 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:43.250879 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-92e5fff0-0cf5-43cb-a589-77994e3f013c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:43.259331 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-92e5fff0-0cf5-43cb-a589-77994e3f013c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.250365 Aug 10 13:01:43.260048 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1365/2714] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:43 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:43.281390 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-37472669-b5c6-452f-b733-9cfd7ec52578 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:43.281610 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-37472669-b5c6-452f-b733-9cfd7ec52578 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:43.288378 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-37472669-b5c6-452f-b733-9cfd7ec52578 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:43.288930 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-37472669-b5c6-452f-b733-9cfd7ec52578 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:43.289428 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-37472669-b5c6-452f-b733-9cfd7ec52578 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:43.290123 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-37472669-b5c6-452f-b733-9cfd7ec52578 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:43.290567 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-37472669-b5c6-452f-b733-9cfd7ec52578 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:43.290988 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-37472669-b5c6-452f-b733-9cfd7ec52578 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:43.432329 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4b80ab16-6d5e-4ee6-acb8-b801e635a864 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:43.440212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4b80ab16-6d5e-4ee6-acb8-b801e635a864 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.204533 Aug 10 13:01:43.440776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1350/2715] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:43 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:43.461351 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-37472669-b5c6-452f-b733-9cfd7ec52578 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:43.470406 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-37472669-b5c6-452f-b733-9cfd7ec52578 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:43.471932 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-37472669-b5c6-452f-b733-9cfd7ec52578 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:43.473084 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-37472669-b5c6-452f-b733-9cfd7ec52578 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.196230 Aug 10 13:01:43.473647 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1366/2716] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:43 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:44.256229 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fdc8b3c6-75e7-403e-b0f3-ec130b8b3f25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:44.256846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fdc8b3c6-75e7-403e-b0f3-ec130b8b3f25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:44.263482 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdc8b3c6-75e7-403e-b0f3-ec130b8b3f25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:44.263972 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdc8b3c6-75e7-403e-b0f3-ec130b8b3f25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:44.264414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdc8b3c6-75e7-403e-b0f3-ec130b8b3f25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:44.265110 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdc8b3c6-75e7-403e-b0f3-ec130b8b3f25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:44.265564 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdc8b3c6-75e7-403e-b0f3-ec130b8b3f25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:44.265997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdc8b3c6-75e7-403e-b0f3-ec130b8b3f25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:44.280715 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b1e7fb1c-a7b5-4bc9-9807-51990c9cd776 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:44.281918 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b1e7fb1c-a7b5-4bc9-9807-51990c9cd776 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:44.289219 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1e7fb1c-a7b5-4bc9-9807-51990c9cd776 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:44.289781 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1e7fb1c-a7b5-4bc9-9807-51990c9cd776 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:44.290275 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1e7fb1c-a7b5-4bc9-9807-51990c9cd776 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:44.291255 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1e7fb1c-a7b5-4bc9-9807-51990c9cd776 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:44.292068 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1e7fb1c-a7b5-4bc9-9807-51990c9cd776 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:44.292891 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1e7fb1c-a7b5-4bc9-9807-51990c9cd776 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:44.463421 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fdc8b3c6-75e7-403e-b0f3-ec130b8b3f25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:44.470637 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b1e7fb1c-a7b5-4bc9-9807-51990c9cd776 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:44.471613 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fdc8b3c6-75e7-403e-b0f3-ec130b8b3f25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.219956 Aug 10 13:01:44.472190 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1351/2717] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:44 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:44.476703 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-93ca6e2b-9134-48a4-90e3-8e47de109932 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:44.477336 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-93ca6e2b-9134-48a4-90e3-8e47de109932 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:44.483313 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:44.483480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93ca6e2b-9134-48a4-90e3-8e47de109932 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:44.484254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93ca6e2b-9134-48a4-90e3-8e47de109932 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:44.484698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93ca6e2b-9134-48a4-90e3-8e47de109932 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:44.485394 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93ca6e2b-9134-48a4-90e3-8e47de109932 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:44.485825 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93ca6e2b-9134-48a4-90e3-8e47de109932 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:44.486244 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93ca6e2b-9134-48a4-90e3-8e47de109932 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:44.490646 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b1e7fb1c-a7b5-4bc9-9807-51990c9cd776 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.213565 Aug 10 13:01:44.491715 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1367/2718] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:44 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:44.498726 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-70356bf0-54f8-45fc-9589-01793a71dcfd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:44.499397 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-70356bf0-54f8-45fc-9589-01793a71dcfd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:44.505158 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70356bf0-54f8-45fc-9589-01793a71dcfd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:44.506212 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70356bf0-54f8-45fc-9589-01793a71dcfd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:44.506590 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70356bf0-54f8-45fc-9589-01793a71dcfd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:44.507303 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70356bf0-54f8-45fc-9589-01793a71dcfd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:44.507754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70356bf0-54f8-45fc-9589-01793a71dcfd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:44.508191 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70356bf0-54f8-45fc-9589-01793a71dcfd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:44.686553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-93ca6e2b-9134-48a4-90e3-8e47de109932 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:44.693252 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-70356bf0-54f8-45fc-9589-01793a71dcfd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:44.694775 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-93ca6e2b-9134-48a4-90e3-8e47de109932 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.221612 Aug 10 13:01:44.695375 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1352/2719] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:44 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:44.701800 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-70356bf0-54f8-45fc-9589-01793a71dcfd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:44.703332 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-70356bf0-54f8-45fc-9589-01793a71dcfd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:44.704504 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-70356bf0-54f8-45fc-9589-01793a71dcfd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.209456 Aug 10 13:01:44.705062 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1368/2720] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:44 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:01:45.495303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e1aa7d87-375f-416d-abd9-0596c75b619d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:45.495954 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e1aa7d87-375f-416d-abd9-0596c75b619d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:45.502200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e1aa7d87-375f-416d-abd9-0596c75b619d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:45.502670 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e1aa7d87-375f-416d-abd9-0596c75b619d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:45.503099 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e1aa7d87-375f-416d-abd9-0596c75b619d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:45.503795 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e1aa7d87-375f-416d-abd9-0596c75b619d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:45.504241 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e1aa7d87-375f-416d-abd9-0596c75b619d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:45.504658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e1aa7d87-375f-416d-abd9-0596c75b619d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:45.513697 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-64e410d5-a39c-42e5-97aa-6b2a835d4896 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:45.514318 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-64e410d5-a39c-42e5-97aa-6b2a835d4896 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:45.520647 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-64e410d5-a39c-42e5-97aa-6b2a835d4896 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:45.521135 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-64e410d5-a39c-42e5-97aa-6b2a835d4896 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:45.521567 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-64e410d5-a39c-42e5-97aa-6b2a835d4896 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:45.522251 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-64e410d5-a39c-42e5-97aa-6b2a835d4896 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:45.522699 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-64e410d5-a39c-42e5-97aa-6b2a835d4896 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:45.523120 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-64e410d5-a39c-42e5-97aa-6b2a835d4896 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:45.706075 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e1aa7d87-375f-416d-abd9-0596c75b619d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:45.713871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e1aa7d87-375f-416d-abd9-0596c75b619d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.222263 Aug 10 13:01:45.714558 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1353/2721] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:45 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:45.721919 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ccd5f8ac-d0e7-41b2-b5d2-93f373640bd8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:45.721919 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ccd5f8ac-d0e7-41b2-b5d2-93f373640bd8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:45.729570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-64e410d5-a39c-42e5-97aa-6b2a835d4896 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:45.731759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ccd5f8ac-d0e7-41b2-b5d2-93f373640bd8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:45.732319 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ccd5f8ac-d0e7-41b2-b5d2-93f373640bd8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:45.732829 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ccd5f8ac-d0e7-41b2-b5d2-93f373640bd8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:45.733754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ccd5f8ac-d0e7-41b2-b5d2-93f373640bd8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:45.734283 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ccd5f8ac-d0e7-41b2-b5d2-93f373640bd8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:45.734773 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ccd5f8ac-d0e7-41b2-b5d2-93f373640bd8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:45.737862 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-64e410d5-a39c-42e5-97aa-6b2a835d4896 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.227984 Aug 10 13:01:45.738431 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1369/2722] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:45 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:45.744144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-29a8d863-1643-4264-9cc3-2ba6c5819a07 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:45.744751 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-29a8d863-1643-4264-9cc3-2ba6c5819a07 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:45.750420 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-29a8d863-1643-4264-9cc3-2ba6c5819a07 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:45.750833 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-29a8d863-1643-4264-9cc3-2ba6c5819a07 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:45.751316 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-29a8d863-1643-4264-9cc3-2ba6c5819a07 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:45.752003 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-29a8d863-1643-4264-9cc3-2ba6c5819a07 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:45.752451 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-29a8d863-1643-4264-9cc3-2ba6c5819a07 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:45.752864 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-29a8d863-1643-4264-9cc3-2ba6c5819a07 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:45.927028 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ccd5f8ac-d0e7-41b2-b5d2-93f373640bd8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:45.935291 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ccd5f8ac-d0e7-41b2-b5d2-93f373640bd8 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.219467 Aug 10 13:01:45.935714 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1354/2723] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:45 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:45.938122 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-29a8d863-1643-4264-9cc3-2ba6c5819a07 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:45.951599 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-29a8d863-1643-4264-9cc3-2ba6c5819a07 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:45.953099 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-29a8d863-1643-4264-9cc3-2ba6c5819a07 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:45.954408 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-29a8d863-1643-4264-9cc3-2ba6c5819a07 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.214996 Aug 10 13:01:45.954953 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1370/2724] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:45 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:01:46.736455 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-627f6458-3676-4fa9-98de-0f41b7f04135 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:46.737010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-627f6458-3676-4fa9-98de-0f41b7f04135 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:46.743623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-627f6458-3676-4fa9-98de-0f41b7f04135 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:46.744100 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-627f6458-3676-4fa9-98de-0f41b7f04135 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:46.744526 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-627f6458-3676-4fa9-98de-0f41b7f04135 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:46.745202 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-627f6458-3676-4fa9-98de-0f41b7f04135 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:46.745648 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-627f6458-3676-4fa9-98de-0f41b7f04135 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:46.746064 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-627f6458-3676-4fa9-98de-0f41b7f04135 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:46.760720 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-56b1d867-0981-42db-8f99-6f032af661c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:46.761393 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-56b1d867-0981-42db-8f99-6f032af661c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:46.767783 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56b1d867-0981-42db-8f99-6f032af661c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:46.768267 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56b1d867-0981-42db-8f99-6f032af661c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:46.768704 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56b1d867-0981-42db-8f99-6f032af661c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:46.769397 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56b1d867-0981-42db-8f99-6f032af661c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:46.769851 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56b1d867-0981-42db-8f99-6f032af661c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:46.770277 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56b1d867-0981-42db-8f99-6f032af661c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:46.946263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-627f6458-3676-4fa9-98de-0f41b7f04135 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:46.949418 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-56b1d867-0981-42db-8f99-6f032af661c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:46.954390 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-627f6458-3676-4fa9-98de-0f41b7f04135 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.221831 Aug 10 13:01:46.954963 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1355/2725] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:46 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:46.957503 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-56b1d867-0981-42db-8f99-6f032af661c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.200674 Aug 10 13:01:46.963555 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1371/2726] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:46 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:46.963738 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f1a66d9d-e321-42bb-b2ab-e031e29fbe0b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:46.963738 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f1a66d9d-e321-42bb-b2ab-e031e29fbe0b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:46.966361 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f1a66d9d-e321-42bb-b2ab-e031e29fbe0b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:46.967020 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f1a66d9d-e321-42bb-b2ab-e031e29fbe0b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:46.967601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f1a66d9d-e321-42bb-b2ab-e031e29fbe0b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:46.968280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f1a66d9d-e321-42bb-b2ab-e031e29fbe0b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:46.968726 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f1a66d9d-e321-42bb-b2ab-e031e29fbe0b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:46.969152 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f1a66d9d-e321-42bb-b2ab-e031e29fbe0b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:46.979334 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f4743d22-87fb-4cf3-9996-39b15ab9bf70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:46.979977 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f4743d22-87fb-4cf3-9996-39b15ab9bf70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:46.985862 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f4743d22-87fb-4cf3-9996-39b15ab9bf70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:46.986334 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f4743d22-87fb-4cf3-9996-39b15ab9bf70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:46.986840 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f4743d22-87fb-4cf3-9996-39b15ab9bf70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:46.987485 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f4743d22-87fb-4cf3-9996-39b15ab9bf70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:46.987939 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f4743d22-87fb-4cf3-9996-39b15ab9bf70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:46.988351 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f4743d22-87fb-4cf3-9996-39b15ab9bf70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:47.171499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f1a66d9d-e321-42bb-b2ab-e031e29fbe0b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:47.173670 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:47.175473 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f4743d22-87fb-4cf3-9996-39b15ab9bf70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:47.180403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f1a66d9d-e321-42bb-b2ab-e031e29fbe0b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.224209 Aug 10 13:01:47.181061 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1356/2727] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:46 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:47.184263 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f4743d22-87fb-4cf3-9996-39b15ab9bf70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:47.185812 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f4743d22-87fb-4cf3-9996-39b15ab9bf70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:47.186974 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f4743d22-87fb-4cf3-9996-39b15ab9bf70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.213142 Aug 10 13:01:47.187712 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1372/2728] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:46 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:01:47.980130 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d901bd5f-b391-43f6-96f0-b6d423663887 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:47.980739 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d901bd5f-b391-43f6-96f0-b6d423663887 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:47.987322 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d901bd5f-b391-43f6-96f0-b6d423663887 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:47.987794 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d901bd5f-b391-43f6-96f0-b6d423663887 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:47.988220 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d901bd5f-b391-43f6-96f0-b6d423663887 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:47.988932 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d901bd5f-b391-43f6-96f0-b6d423663887 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:47.989377 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d901bd5f-b391-43f6-96f0-b6d423663887 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:47.989845 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d901bd5f-b391-43f6-96f0-b6d423663887 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:48.042694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f7874f15-ac8e-4853-884e-fdc5bcb6f8ba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:48.043372 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f7874f15-ac8e-4853-884e-fdc5bcb6f8ba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:48.049212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f7874f15-ac8e-4853-884e-fdc5bcb6f8ba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:48.049688 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f7874f15-ac8e-4853-884e-fdc5bcb6f8ba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:48.050119 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f7874f15-ac8e-4853-884e-fdc5bcb6f8ba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:48.050798 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f7874f15-ac8e-4853-884e-fdc5bcb6f8ba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:48.051272 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f7874f15-ac8e-4853-884e-fdc5bcb6f8ba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:48.051694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f7874f15-ac8e-4853-884e-fdc5bcb6f8ba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:48.175064 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d901bd5f-b391-43f6-96f0-b6d423663887 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:48.183352 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d901bd5f-b391-43f6-96f0-b6d423663887 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.207221 Aug 10 13:01:48.183929 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1373/2729] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:47 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:48.201904 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-dadf8c1d-be77-462a-b77d-44a17477e588 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:48.202506 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-dadf8c1d-be77-462a-b77d-44a17477e588 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:48.208441 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dadf8c1d-be77-462a-b77d-44a17477e588 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:48.209477 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dadf8c1d-be77-462a-b77d-44a17477e588 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:48.209909 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dadf8c1d-be77-462a-b77d-44a17477e588 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:48.210591 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dadf8c1d-be77-462a-b77d-44a17477e588 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:48.211032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dadf8c1d-be77-462a-b77d-44a17477e588 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:48.211473 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dadf8c1d-be77-462a-b77d-44a17477e588 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:48.215540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f7874f15-ac8e-4853-884e-fdc5bcb6f8ba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:48.223849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f7874f15-ac8e-4853-884e-fdc5bcb6f8ba tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.251621 Aug 10 13:01:48.225589 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1357/2730] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:47 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:48.230307 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-eb905b60-6404-4512-8e97-53ac142fd0c7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:48.230859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-eb905b60-6404-4512-8e97-53ac142fd0c7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:48.236517 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb905b60-6404-4512-8e97-53ac142fd0c7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:48.237003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb905b60-6404-4512-8e97-53ac142fd0c7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:48.237599 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb905b60-6404-4512-8e97-53ac142fd0c7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:48.238285 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb905b60-6404-4512-8e97-53ac142fd0c7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:48.238738 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb905b60-6404-4512-8e97-53ac142fd0c7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:48.239164 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb905b60-6404-4512-8e97-53ac142fd0c7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:48.402155 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-dadf8c1d-be77-462a-b77d-44a17477e588 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:48.410337 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-dadf8c1d-be77-462a-b77d-44a17477e588 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.212153 Aug 10 13:01:48.419441 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1374/2731] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:48 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:48.419758 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-eb905b60-6404-4512-8e97-53ac142fd0c7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:48.425970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-eb905b60-6404-4512-8e97-53ac142fd0c7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:48.427985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-eb905b60-6404-4512-8e97-53ac142fd0c7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:48.429175 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-eb905b60-6404-4512-8e97-53ac142fd0c7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.202840 Aug 10 13:01:48.429733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1358/2732] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:48 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:01:49.204982 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-58848c45-ec1b-4e55-98bb-fc5d09c134f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:49.205556 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-58848c45-ec1b-4e55-98bb-fc5d09c134f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:49.212588 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-58848c45-ec1b-4e55-98bb-fc5d09c134f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:49.213064 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-58848c45-ec1b-4e55-98bb-fc5d09c134f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:49.213517 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-58848c45-ec1b-4e55-98bb-fc5d09c134f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:49.214196 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-58848c45-ec1b-4e55-98bb-fc5d09c134f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:49.214637 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-58848c45-ec1b-4e55-98bb-fc5d09c134f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:49.215052 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-58848c45-ec1b-4e55-98bb-fc5d09c134f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:49.245757 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-47c7b861-c2c9-4990-bf9f-d4a2db38e577 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:49.246372 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-47c7b861-c2c9-4990-bf9f-d4a2db38e577 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:49.252487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-47c7b861-c2c9-4990-bf9f-d4a2db38e577 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:49.253158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-47c7b861-c2c9-4990-bf9f-d4a2db38e577 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:49.253602 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-47c7b861-c2c9-4990-bf9f-d4a2db38e577 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:49.254299 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-47c7b861-c2c9-4990-bf9f-d4a2db38e577 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:49.254753 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-47c7b861-c2c9-4990-bf9f-d4a2db38e577 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:49.255198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-47c7b861-c2c9-4990-bf9f-d4a2db38e577 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:49.397797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-58848c45-ec1b-4e55-98bb-fc5d09c134f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:49.405868 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-58848c45-ec1b-4e55-98bb-fc5d09c134f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.204760 Aug 10 13:01:49.406520 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1375/2733] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:49 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:49.423913 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-47c7b861-c2c9-4990-bf9f-d4a2db38e577 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:49.432114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-47c7b861-c2c9-4990-bf9f-d4a2db38e577 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.190126 Aug 10 13:01:49.432689 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1359/2734] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:49 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:49.433357 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-92c244a0-0375-4e35-a0ae-3d32efd5194c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:49.433965 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-92c244a0-0375-4e35-a0ae-3d32efd5194c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:49.439785 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-92c244a0-0375-4e35-a0ae-3d32efd5194c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:49.440261 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-92c244a0-0375-4e35-a0ae-3d32efd5194c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:49.440691 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-92c244a0-0375-4e35-a0ae-3d32efd5194c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:49.441362 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-92c244a0-0375-4e35-a0ae-3d32efd5194c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:49.441806 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-92c244a0-0375-4e35-a0ae-3d32efd5194c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:49.442222 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-92c244a0-0375-4e35-a0ae-3d32efd5194c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:49.452341 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0e552fac-189a-4159-8c82-485b429ce053 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:49.452949 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0e552fac-189a-4159-8c82-485b429ce053 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:49.459756 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e552fac-189a-4159-8c82-485b429ce053 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:49.460182 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e552fac-189a-4159-8c82-485b429ce053 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:49.460626 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e552fac-189a-4159-8c82-485b429ce053 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:49.461320 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e552fac-189a-4159-8c82-485b429ce053 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:49.461770 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e552fac-189a-4159-8c82-485b429ce053 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:49.462194 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0e552fac-189a-4159-8c82-485b429ce053 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:49.636529 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-92c244a0-0375-4e35-a0ae-3d32efd5194c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:49.644664 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-92c244a0-0375-4e35-a0ae-3d32efd5194c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.215070 Aug 10 13:01:49.645242 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1376/2735] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:49 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:49.653370 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0e552fac-189a-4159-8c82-485b429ce053 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:49.661689 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0e552fac-189a-4159-8c82-485b429ce053 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:49.663170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0e552fac-189a-4159-8c82-485b429ce053 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:49.664327 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0e552fac-189a-4159-8c82-485b429ce053 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.215789 Aug 10 13:01:49.664872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1360/2736] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:49 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:50.428300 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1add330d-6659-4944-be12-30fc73b116e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:50.428882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1add330d-6659-4944-be12-30fc73b116e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:50.435243 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1add330d-6659-4944-be12-30fc73b116e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:50.435719 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1add330d-6659-4944-be12-30fc73b116e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:50.436148 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1add330d-6659-4944-be12-30fc73b116e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:50.436837 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1add330d-6659-4944-be12-30fc73b116e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:50.437267 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1add330d-6659-4944-be12-30fc73b116e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:50.437679 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1add330d-6659-4944-be12-30fc73b116e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:50.453522 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d47a8de3-910f-45d0-8982-b669da371c69 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:50.454135 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d47a8de3-910f-45d0-8982-b669da371c69 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:50.461081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d47a8de3-910f-45d0-8982-b669da371c69 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:50.461560 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d47a8de3-910f-45d0-8982-b669da371c69 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:50.461990 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d47a8de3-910f-45d0-8982-b669da371c69 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:50.462677 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d47a8de3-910f-45d0-8982-b669da371c69 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:50.463123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d47a8de3-910f-45d0-8982-b669da371c69 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:50.463578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d47a8de3-910f-45d0-8982-b669da371c69 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:50.649315 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-1add330d-6659-4944-be12-30fc73b116e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:50.652732 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d47a8de3-910f-45d0-8982-b669da371c69 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:50.657877 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1add330d-6659-4944-be12-30fc73b116e7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.233680 Aug 10 13:01:50.658537 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1377/2737] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:50 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:50.660935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d47a8de3-910f-45d0-8982-b669da371c69 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.211039 Aug 10 13:01:50.661387 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1361/2738] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:50 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:50.668731 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3e09ee29-63a7-4eed-bb97-956bbd93f38f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:50.669551 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3e09ee29-63a7-4eed-bb97-956bbd93f38f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:50.675689 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e09ee29-63a7-4eed-bb97-956bbd93f38f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:50.676163 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e09ee29-63a7-4eed-bb97-956bbd93f38f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:50.676638 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e09ee29-63a7-4eed-bb97-956bbd93f38f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:50.677371 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e09ee29-63a7-4eed-bb97-956bbd93f38f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:50.678102 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e09ee29-63a7-4eed-bb97-956bbd93f38f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:50.678651 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e09ee29-63a7-4eed-bb97-956bbd93f38f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:50.687372 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-38ab083c-7996-4676-81da-59fa23be84ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:50.687986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-38ab083c-7996-4676-81da-59fa23be84ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:50.693814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38ab083c-7996-4676-81da-59fa23be84ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:50.695742 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38ab083c-7996-4676-81da-59fa23be84ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:50.695742 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38ab083c-7996-4676-81da-59fa23be84ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:50.695742 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38ab083c-7996-4676-81da-59fa23be84ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:50.696068 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38ab083c-7996-4676-81da-59fa23be84ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:50.696408 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38ab083c-7996-4676-81da-59fa23be84ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:50.879700 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3e09ee29-63a7-4eed-bb97-956bbd93f38f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:50.883590 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-38ab083c-7996-4676-81da-59fa23be84ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:50.888820 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3e09ee29-63a7-4eed-bb97-956bbd93f38f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.225255 Aug 10 13:01:50.889736 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1378/2739] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:50 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:50.893231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-38ab083c-7996-4676-81da-59fa23be84ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:50.894900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-38ab083c-7996-4676-81da-59fa23be84ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:50.896091 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-38ab083c-7996-4676-81da-59fa23be84ca tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.213510 Aug 10 13:01:50.897212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1362/2740] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:50 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:51.680828 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6f8da764-aeb6-4b6d-aced-fca064b8514f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:51.681561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6f8da764-aeb6-4b6d-aced-fca064b8514f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:51.684108 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1108a760-6955-4b95-81a6-8f90f612bff8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:51.684725 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1108a760-6955-4b95-81a6-8f90f612bff8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:51.688140 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f8da764-aeb6-4b6d-aced-fca064b8514f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:51.688686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f8da764-aeb6-4b6d-aced-fca064b8514f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:51.689214 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f8da764-aeb6-4b6d-aced-fca064b8514f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:51.689972 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f8da764-aeb6-4b6d-aced-fca064b8514f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:51.690496 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f8da764-aeb6-4b6d-aced-fca064b8514f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:51.690982 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f8da764-aeb6-4b6d-aced-fca064b8514f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:51.691091 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1108a760-6955-4b95-81a6-8f90f612bff8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:51.691497 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1108a760-6955-4b95-81a6-8f90f612bff8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:51.691933 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1108a760-6955-4b95-81a6-8f90f612bff8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:51.692615 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1108a760-6955-4b95-81a6-8f90f612bff8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:51.693817 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1108a760-6955-4b95-81a6-8f90f612bff8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:51.694245 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1108a760-6955-4b95-81a6-8f90f612bff8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:51.884706 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6f8da764-aeb6-4b6d-aced-fca064b8514f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:51.887882 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1108a760-6955-4b95-81a6-8f90f612bff8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:51.892697 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6f8da764-aeb6-4b6d-aced-fca064b8514f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.216497 Aug 10 13:01:51.893361 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1379/2741] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:51 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:51.895646 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1108a760-6955-4b95-81a6-8f90f612bff8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.215245 Aug 10 13:01:51.906281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1363/2742] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:51 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:51.911030 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3b794cb5-e6c6-493c-b8fa-ce822774ea9f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:51.911758 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3b794cb5-e6c6-493c-b8fa-ce822774ea9f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:51.918165 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3b794cb5-e6c6-493c-b8fa-ce822774ea9f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:51.918651 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3b794cb5-e6c6-493c-b8fa-ce822774ea9f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:51.919082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3b794cb5-e6c6-493c-b8fa-ce822774ea9f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:51.919794 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3b794cb5-e6c6-493c-b8fa-ce822774ea9f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:51.919998 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-10f6f632-7427-4bba-ac5f-615d0413b83c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:51.920241 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3b794cb5-e6c6-493c-b8fa-ce822774ea9f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:51.920606 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-10f6f632-7427-4bba-ac5f-615d0413b83c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:51.920715 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3b794cb5-e6c6-493c-b8fa-ce822774ea9f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:51.926346 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-10f6f632-7427-4bba-ac5f-615d0413b83c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:51.926826 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-10f6f632-7427-4bba-ac5f-615d0413b83c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:51.927304 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-10f6f632-7427-4bba-ac5f-615d0413b83c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:51.928067 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-10f6f632-7427-4bba-ac5f-615d0413b83c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:51.928444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-10f6f632-7427-4bba-ac5f-615d0413b83c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:51.928865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-10f6f632-7427-4bba-ac5f-615d0413b83c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:52.115137 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3b794cb5-e6c6-493c-b8fa-ce822774ea9f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:52.119302 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-10f6f632-7427-4bba-ac5f-615d0413b83c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:52.123248 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3b794cb5-e6c6-493c-b8fa-ce822774ea9f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.215837 Aug 10 13:01:52.123827 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1380/2743] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:51 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:52.127754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-10f6f632-7427-4bba-ac5f-615d0413b83c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:52.129266 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-10f6f632-7427-4bba-ac5f-615d0413b83c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:52.130538 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-10f6f632-7427-4bba-ac5f-615d0413b83c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.214208 Aug 10 13:01:52.131065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1364/2744] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:51 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:52.915577 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e3ff567d-9bab-490e-a39e-8af92024da28 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:52.916125 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e3ff567d-9bab-490e-a39e-8af92024da28 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:52.917020 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2fe16ee4-8ec2-4c34-9d92-474421134559 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:52.917633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2fe16ee4-8ec2-4c34-9d92-474421134559 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:52.922509 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e3ff567d-9bab-490e-a39e-8af92024da28 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:52.923020 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e3ff567d-9bab-490e-a39e-8af92024da28 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:52.923489 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e3ff567d-9bab-490e-a39e-8af92024da28 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:52.924176 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e3ff567d-9bab-490e-a39e-8af92024da28 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:52.924386 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2fe16ee4-8ec2-4c34-9d92-474421134559 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:52.924623 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e3ff567d-9bab-490e-a39e-8af92024da28 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:52.924864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2fe16ee4-8ec2-4c34-9d92-474421134559 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:52.925040 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e3ff567d-9bab-490e-a39e-8af92024da28 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:52.926684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2fe16ee4-8ec2-4c34-9d92-474421134559 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:52.928045 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2fe16ee4-8ec2-4c34-9d92-474421134559 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:52.928809 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2fe16ee4-8ec2-4c34-9d92-474421134559 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:52.929252 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2fe16ee4-8ec2-4c34-9d92-474421134559 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:53.117873 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e3ff567d-9bab-490e-a39e-8af92024da28 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:53.122118 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2fe16ee4-8ec2-4c34-9d92-474421134559 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:53.125959 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e3ff567d-9bab-490e-a39e-8af92024da28 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.214226 Aug 10 13:01:53.126538 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1381/2745] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:52 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:53.130268 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2fe16ee4-8ec2-4c34-9d92-474421134559 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.217117 Aug 10 13:01:53.131728 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1365/2746] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:52 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:53.144057 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-dc46ecef-6fd6-4834-a1e1-6e89860e8561 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:53.144666 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-dc46ecef-6fd6-4834-a1e1-6e89860e8561 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:53.151574 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc46ecef-6fd6-4834-a1e1-6e89860e8561 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:53.152054 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc46ecef-6fd6-4834-a1e1-6e89860e8561 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:53.152516 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc46ecef-6fd6-4834-a1e1-6e89860e8561 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:53.153204 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc46ecef-6fd6-4834-a1e1-6e89860e8561 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:53.153321 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-16597d3d-8a83-4b4e-b53c-35a0262f99af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:53.153655 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc46ecef-6fd6-4834-a1e1-6e89860e8561 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:53.153944 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-16597d3d-8a83-4b4e-b53c-35a0262f99af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:53.154072 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc46ecef-6fd6-4834-a1e1-6e89860e8561 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:53.159956 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-16597d3d-8a83-4b4e-b53c-35a0262f99af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:53.160439 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-16597d3d-8a83-4b4e-b53c-35a0262f99af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:53.160875 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-16597d3d-8a83-4b4e-b53c-35a0262f99af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:53.161643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-16597d3d-8a83-4b4e-b53c-35a0262f99af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:53.162700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-16597d3d-8a83-4b4e-b53c-35a0262f99af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:53.163213 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-16597d3d-8a83-4b4e-b53c-35a0262f99af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:53.350419 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-dc46ecef-6fd6-4834-a1e1-6e89860e8561 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:53.353550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-16597d3d-8a83-4b4e-b53c-35a0262f99af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:53.358700 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-dc46ecef-6fd6-4834-a1e1-6e89860e8561 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.218549 Aug 10 13:01:53.359289 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1382/2747] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:53 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:53.362153 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-16597d3d-8a83-4b4e-b53c-35a0262f99af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:53.363730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-16597d3d-8a83-4b4e-b53c-35a0262f99af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:53.365341 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-16597d3d-8a83-4b4e-b53c-35a0262f99af tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.215550 Aug 10 13:01:53.366016 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1366/2748] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:53 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:54.149019 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-75c91589-f29d-4c9a-b0c4-ad204f5fc736 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:54.149627 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-75c91589-f29d-4c9a-b0c4-ad204f5fc736 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:54.151766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fe7726ca-4188-46e9-9873-0626561dc0ed tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:54.157457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fe7726ca-4188-46e9-9873-0626561dc0ed tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:54.157582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-75c91589-f29d-4c9a-b0c4-ad204f5fc736 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:54.157582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-75c91589-f29d-4c9a-b0c4-ad204f5fc736 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:54.157582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-75c91589-f29d-4c9a-b0c4-ad204f5fc736 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:54.157903 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-75c91589-f29d-4c9a-b0c4-ad204f5fc736 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:54.158073 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-75c91589-f29d-4c9a-b0c4-ad204f5fc736 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:54.158492 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-75c91589-f29d-4c9a-b0c4-ad204f5fc736 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:54.158874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe7726ca-4188-46e9-9873-0626561dc0ed tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:54.159388 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe7726ca-4188-46e9-9873-0626561dc0ed tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:54.159823 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe7726ca-4188-46e9-9873-0626561dc0ed tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:54.160507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe7726ca-4188-46e9-9873-0626561dc0ed tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:54.161133 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe7726ca-4188-46e9-9873-0626561dc0ed tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:54.161371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe7726ca-4188-46e9-9873-0626561dc0ed tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:54.351700 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-75c91589-f29d-4c9a-b0c4-ad204f5fc736 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:54.355646 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fe7726ca-4188-46e9-9873-0626561dc0ed tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:54.362335 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-75c91589-f29d-4c9a-b0c4-ad204f5fc736 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.215314 Aug 10 13:01:54.362335 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1383/2749] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:54 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:54.363868 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fe7726ca-4188-46e9-9873-0626561dc0ed tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.216124 Aug 10 13:01:54.364514 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1367/2750] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:54 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:54.379771 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3a1372ab-1d0e-49bb-b01b-593698e68742 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:54.384939 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3a1372ab-1d0e-49bb-b01b-593698e68742 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:54.386803 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3a1372ab-1d0e-49bb-b01b-593698e68742 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:54.387318 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3a1372ab-1d0e-49bb-b01b-593698e68742 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:54.387743 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3a1372ab-1d0e-49bb-b01b-593698e68742 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:54.388448 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3a1372ab-1d0e-49bb-b01b-593698e68742 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:54.388890 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3a1372ab-1d0e-49bb-b01b-593698e68742 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:54.389178 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8f0ca5f6-a2ad-4f86-b6c2-d3ad059bc8fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:54.389307 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3a1372ab-1d0e-49bb-b01b-593698e68742 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:54.389793 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8f0ca5f6-a2ad-4f86-b6c2-d3ad059bc8fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:54.395813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f0ca5f6-a2ad-4f86-b6c2-d3ad059bc8fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:54.396497 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f0ca5f6-a2ad-4f86-b6c2-d3ad059bc8fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:54.396939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f0ca5f6-a2ad-4f86-b6c2-d3ad059bc8fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:54.397661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f0ca5f6-a2ad-4f86-b6c2-d3ad059bc8fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:54.398119 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f0ca5f6-a2ad-4f86-b6c2-d3ad059bc8fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:54.398549 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f0ca5f6-a2ad-4f86-b6c2-d3ad059bc8fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:54.404027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:54.584332 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3a1372ab-1d0e-49bb-b01b-593698e68742 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:54.588462 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8f0ca5f6-a2ad-4f86-b6c2-d3ad059bc8fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:54.592374 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3a1372ab-1d0e-49bb-b01b-593698e68742 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.216252 Aug 10 13:01:54.592948 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1384/2751] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:54 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:54.596916 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8f0ca5f6-a2ad-4f86-b6c2-d3ad059bc8fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:54.598415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8f0ca5f6-a2ad-4f86-b6c2-d3ad059bc8fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:54.599725 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8f0ca5f6-a2ad-4f86-b6c2-d3ad059bc8fc tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.214429 Aug 10 13:01:54.600704 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1368/2752] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:54 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:55.382117 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0fec78b9-40dc-4ab0-8835-1f0159e55498 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:55.382736 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0fec78b9-40dc-4ab0-8835-1f0159e55498 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:55.385359 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-21877890-cf44-4449-aeb4-d83e5d80a34e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:55.385963 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-21877890-cf44-4449-aeb4-d83e5d80a34e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:55.389254 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0fec78b9-40dc-4ab0-8835-1f0159e55498 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:55.389734 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0fec78b9-40dc-4ab0-8835-1f0159e55498 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:55.390167 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0fec78b9-40dc-4ab0-8835-1f0159e55498 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:55.390851 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0fec78b9-40dc-4ab0-8835-1f0159e55498 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:55.391332 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0fec78b9-40dc-4ab0-8835-1f0159e55498 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:55.391850 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0fec78b9-40dc-4ab0-8835-1f0159e55498 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:55.392214 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-21877890-cf44-4449-aeb4-d83e5d80a34e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:55.392687 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-21877890-cf44-4449-aeb4-d83e5d80a34e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:55.393118 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-21877890-cf44-4449-aeb4-d83e5d80a34e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:55.393797 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-21877890-cf44-4449-aeb4-d83e5d80a34e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:55.394244 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-21877890-cf44-4449-aeb4-d83e5d80a34e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:55.394656 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-21877890-cf44-4449-aeb4-d83e5d80a34e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:55.526681 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:01:55.526902 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Wed Aug 10 13:01:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 (ip 10.222.0.49) !!! Aug 10 13:01:55.590822 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-21877890-cf44-4449-aeb4-d83e5d80a34e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:55.594816 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0fec78b9-40dc-4ab0-8835-1f0159e55498 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:55.598940 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-21877890-cf44-4449-aeb4-d83e5d80a34e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.217311 Aug 10 13:01:55.600116 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1369/2753] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:55 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:55.604722 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0fec78b9-40dc-4ab0-8835-1f0159e55498 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.226604 Aug 10 13:01:55.605299 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1385/2754] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:55 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:55.614186 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e573f09b-6c84-4e1c-a098-72046993d223 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:55.615777 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e573f09b-6c84-4e1c-a098-72046993d223 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:55.622221 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e573f09b-6c84-4e1c-a098-72046993d223 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:55.622709 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e573f09b-6c84-4e1c-a098-72046993d223 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:55.623150 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e573f09b-6c84-4e1c-a098-72046993d223 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:55.623881 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e573f09b-6c84-4e1c-a098-72046993d223 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:55.624332 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e573f09b-6c84-4e1c-a098-72046993d223 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:55.624760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e573f09b-6c84-4e1c-a098-72046993d223 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:55.628515 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4f830e10-6934-41fa-9eb4-367988f12a61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:55.629137 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4f830e10-6934-41fa-9eb4-367988f12a61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:55.635104 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4f830e10-6934-41fa-9eb4-367988f12a61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:55.635621 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4f830e10-6934-41fa-9eb4-367988f12a61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:55.636053 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4f830e10-6934-41fa-9eb4-367988f12a61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:55.636777 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4f830e10-6934-41fa-9eb4-367988f12a61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:55.637239 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4f830e10-6934-41fa-9eb4-367988f12a61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:55.637656 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4f830e10-6934-41fa-9eb4-367988f12a61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:55.820790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e573f09b-6c84-4e1c-a098-72046993d223 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:55.824166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4f830e10-6934-41fa-9eb4-367988f12a61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:55.829150 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e573f09b-6c84-4e1c-a098-72046993d223 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.219169 Aug 10 13:01:55.829875 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1370/2755] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:55 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:55.832711 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4f830e10-6934-41fa-9eb4-367988f12a61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:55.835068 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4f830e10-6934-41fa-9eb4-367988f12a61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:55.836157 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4f830e10-6934-41fa-9eb4-367988f12a61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.216994 Aug 10 13:01:55.836847 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1386/2756] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:55 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:01:56.231081 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:01:56.231279 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Wed Aug 10 13:01:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:01:56.621196 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-db72c731-446d-4434-b590-906084e62ce1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:56.621929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-db72c731-446d-4434-b590-906084e62ce1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:56.628085 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-db72c731-446d-4434-b590-906084e62ce1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:56.628565 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-db72c731-446d-4434-b590-906084e62ce1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:56.628710 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f685edaf-ef8f-40f0-973b-0be79eb41a30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:56.629139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-db72c731-446d-4434-b590-906084e62ce1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:56.629511 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f685edaf-ef8f-40f0-973b-0be79eb41a30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:56.629677 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-db72c731-446d-4434-b590-906084e62ce1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:56.630130 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-db72c731-446d-4434-b590-906084e62ce1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:56.630819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-db72c731-446d-4434-b590-906084e62ce1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:56.635747 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f685edaf-ef8f-40f0-973b-0be79eb41a30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:56.636229 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f685edaf-ef8f-40f0-973b-0be79eb41a30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:56.636666 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f685edaf-ef8f-40f0-973b-0be79eb41a30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:56.637355 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f685edaf-ef8f-40f0-973b-0be79eb41a30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:56.637808 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f685edaf-ef8f-40f0-973b-0be79eb41a30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:56.638272 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f685edaf-ef8f-40f0-973b-0be79eb41a30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:56.825423 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-db72c731-446d-4434-b590-906084e62ce1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:56.829267 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f685edaf-ef8f-40f0-973b-0be79eb41a30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:56.835731 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-db72c731-446d-4434-b590-906084e62ce1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.218436 Aug 10 13:01:56.836366 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1371/2757] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:56 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:56.837687 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f685edaf-ef8f-40f0-973b-0be79eb41a30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.212930 Aug 10 13:01:56.838256 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1387/2758] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:56 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:56.852934 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-352a6671-c282-482d-b7cd-a9e51b94f7be tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:56.853538 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-352a6671-c282-482d-b7cd-a9e51b94f7be tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:56.859077 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f0486bf0-8e05-4a32-96ff-8dae35b4b310 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:56.859867 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f0486bf0-8e05-4a32-96ff-8dae35b4b310 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:56.860011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-352a6671-c282-482d-b7cd-a9e51b94f7be tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:56.860407 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-352a6671-c282-482d-b7cd-a9e51b94f7be tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:56.860842 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-352a6671-c282-482d-b7cd-a9e51b94f7be tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:56.861528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-352a6671-c282-482d-b7cd-a9e51b94f7be tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:56.861977 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-352a6671-c282-482d-b7cd-a9e51b94f7be tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:56.862396 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-352a6671-c282-482d-b7cd-a9e51b94f7be tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:56.866253 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f0486bf0-8e05-4a32-96ff-8dae35b4b310 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:56.866802 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f0486bf0-8e05-4a32-96ff-8dae35b4b310 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:56.867381 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f0486bf0-8e05-4a32-96ff-8dae35b4b310 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:56.868132 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f0486bf0-8e05-4a32-96ff-8dae35b4b310 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:56.868650 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f0486bf0-8e05-4a32-96ff-8dae35b4b310 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:56.869151 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f0486bf0-8e05-4a32-96ff-8dae35b4b310 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:57.054407 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-352a6671-c282-482d-b7cd-a9e51b94f7be tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:57.062388 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-352a6671-c282-482d-b7cd-a9e51b94f7be tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.213960 Aug 10 13:01:57.062973 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1372/2759] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:56 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:57.065213 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f0486bf0-8e05-4a32-96ff-8dae35b4b310 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:57.073653 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f0486bf0-8e05-4a32-96ff-8dae35b4b310 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:57.075135 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f0486bf0-8e05-4a32-96ff-8dae35b4b310 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:57.076303 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f0486bf0-8e05-4a32-96ff-8dae35b4b310 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.221007 Aug 10 13:01:57.076844 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1388/2760] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:56 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:57.857333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bd7be32b-5893-4003-a745-e69994deff50 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:57.857964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bd7be32b-5893-4003-a745-e69994deff50 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:57.859571 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-543a97ed-8c79-49ee-92d4-4ec3a789b1e6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:57.859982 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-543a97ed-8c79-49ee-92d4-4ec3a789b1e6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:57.864603 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd7be32b-5893-4003-a745-e69994deff50 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:57.865090 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd7be32b-5893-4003-a745-e69994deff50 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:57.865525 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd7be32b-5893-4003-a745-e69994deff50 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:57.866218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd7be32b-5893-4003-a745-e69994deff50 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:57.866398 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-543a97ed-8c79-49ee-92d4-4ec3a789b1e6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:57.866673 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd7be32b-5893-4003-a745-e69994deff50 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:57.866880 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-543a97ed-8c79-49ee-92d4-4ec3a789b1e6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:57.867092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd7be32b-5893-4003-a745-e69994deff50 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:57.867342 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-543a97ed-8c79-49ee-92d4-4ec3a789b1e6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:57.868030 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-543a97ed-8c79-49ee-92d4-4ec3a789b1e6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:57.868479 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-543a97ed-8c79-49ee-92d4-4ec3a789b1e6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:57.868944 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-543a97ed-8c79-49ee-92d4-4ec3a789b1e6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:57.882615 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:01:58.065119 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-bd7be32b-5893-4003-a745-e69994deff50 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:58.069878 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-543a97ed-8c79-49ee-92d4-4ec3a789b1e6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:58.074291 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bd7be32b-5893-4003-a745-e69994deff50 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.221067 Aug 10 13:01:58.074948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1373/2761] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:57 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:58.078026 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-543a97ed-8c79-49ee-92d4-4ec3a789b1e6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.222297 Aug 10 13:01:58.078538 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1389/2762] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:57 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:58.083258 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-127545d5-35be-46de-b132-3f022d37a28c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:58.083992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-127545d5-35be-46de-b132-3f022d37a28c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:58.089851 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-127545d5-35be-46de-b132-3f022d37a28c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:58.090390 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-127545d5-35be-46de-b132-3f022d37a28c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:58.090887 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-127545d5-35be-46de-b132-3f022d37a28c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:58.091655 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-127545d5-35be-46de-b132-3f022d37a28c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:58.092099 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-127545d5-35be-46de-b132-3f022d37a28c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:58.092515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-127545d5-35be-46de-b132-3f022d37a28c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:58.098847 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fb3d793f-d5dc-4b8c-b158-962ae2322478 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:58.099617 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fb3d793f-d5dc-4b8c-b158-962ae2322478 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:58.105713 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fb3d793f-d5dc-4b8c-b158-962ae2322478 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:58.106201 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fb3d793f-d5dc-4b8c-b158-962ae2322478 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:58.106633 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fb3d793f-d5dc-4b8c-b158-962ae2322478 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:58.107407 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fb3d793f-d5dc-4b8c-b158-962ae2322478 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:58.107805 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fb3d793f-d5dc-4b8c-b158-962ae2322478 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:58.108227 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fb3d793f-d5dc-4b8c-b158-962ae2322478 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:58.506465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-127545d5-35be-46de-b132-3f022d37a28c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:58.513776 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fb3d793f-d5dc-4b8c-b158-962ae2322478 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:58.514401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-127545d5-35be-46de-b132-3f022d37a28c tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.434647 Aug 10 13:01:58.514974 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1374/2763] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:58 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:58.522862 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fb3d793f-d5dc-4b8c-b158-962ae2322478 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:58.524382 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fb3d793f-d5dc-4b8c-b158-962ae2322478 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:58.525578 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fb3d793f-d5dc-4b8c-b158-962ae2322478 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.430538 Aug 10 13:01:58.526134 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1390/2764] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:58 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:01:59.095771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6e7fd15b-35ab-4862-b60e-921c497d0001 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:59.096384 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6e7fd15b-35ab-4862-b60e-921c497d0001 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:59.098604 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-efd2b7f0-0108-48f0-9d41-202b85d688c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:59.099239 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-efd2b7f0-0108-48f0-9d41-202b85d688c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:59.103033 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6e7fd15b-35ab-4862-b60e-921c497d0001 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:59.103551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6e7fd15b-35ab-4862-b60e-921c497d0001 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:59.103978 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6e7fd15b-35ab-4862-b60e-921c497d0001 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:59.104928 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6e7fd15b-35ab-4862-b60e-921c497d0001 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:59.105395 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6e7fd15b-35ab-4862-b60e-921c497d0001 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:59.105818 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-efd2b7f0-0108-48f0-9d41-202b85d688c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:59.105936 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6e7fd15b-35ab-4862-b60e-921c497d0001 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:59.106225 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-efd2b7f0-0108-48f0-9d41-202b85d688c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:59.106653 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-efd2b7f0-0108-48f0-9d41-202b85d688c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:59.107377 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-efd2b7f0-0108-48f0-9d41-202b85d688c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:59.107829 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-efd2b7f0-0108-48f0-9d41-202b85d688c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:59.108251 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-efd2b7f0-0108-48f0-9d41-202b85d688c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:59.299737 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6e7fd15b-35ab-4862-b60e-921c497d0001 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:59.303548 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-efd2b7f0-0108-48f0-9d41-202b85d688c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:59.308307 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6e7fd15b-35ab-4862-b60e-921c497d0001 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.216422 Aug 10 13:01:59.308970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1375/2765] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:59 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:59.311381 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-efd2b7f0-0108-48f0-9d41-202b85d688c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.216552 Aug 10 13:01:59.311945 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1391/2766] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:59 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:01:59.535782 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-55fa7b88-1504-42a3-8200-dfa39bbbd03a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:59.536388 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-55fa7b88-1504-42a3-8200-dfa39bbbd03a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:59.542524 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55fa7b88-1504-42a3-8200-dfa39bbbd03a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:59.542995 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55fa7b88-1504-42a3-8200-dfa39bbbd03a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:59.543534 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55fa7b88-1504-42a3-8200-dfa39bbbd03a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:59.544204 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55fa7b88-1504-42a3-8200-dfa39bbbd03a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:59.544647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55fa7b88-1504-42a3-8200-dfa39bbbd03a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:59.545068 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55fa7b88-1504-42a3-8200-dfa39bbbd03a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:59.548284 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9e7d4b58-b84e-4185-a264-3d2b379eea63 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:01:59.550008 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9e7d4b58-b84e-4185-a264-3d2b379eea63 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:01:59.555304 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e7d4b58-b84e-4185-a264-3d2b379eea63 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:59.555783 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e7d4b58-b84e-4185-a264-3d2b379eea63 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:59.556216 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e7d4b58-b84e-4185-a264-3d2b379eea63 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:59.556900 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e7d4b58-b84e-4185-a264-3d2b379eea63 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:01:59.557351 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e7d4b58-b84e-4185-a264-3d2b379eea63 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:01:59.557772 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9e7d4b58-b84e-4185-a264-3d2b379eea63 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:01:59.744252 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-55fa7b88-1504-42a3-8200-dfa39bbbd03a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:59.748135 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9e7d4b58-b84e-4185-a264-3d2b379eea63 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:59.752250 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-55fa7b88-1504-42a3-8200-dfa39bbbd03a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.220220 Aug 10 13:01:59.752825 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1376/2767] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:01:59 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:01:59.756801 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9e7d4b58-b84e-4185-a264-3d2b379eea63 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:59.758303 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9e7d4b58-b84e-4185-a264-3d2b379eea63 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:01:59.759480 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9e7d4b58-b84e-4185-a264-3d2b379eea63 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.215065 Aug 10 13:01:59.760029 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1392/2768] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:01:59 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:00.329746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f6cdf9bb-ea06-4cd5-8047-cb7b6907d34c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:00.330288 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f6cdf9bb-ea06-4cd5-8047-cb7b6907d34c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:00.331224 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-133c61f4-e4f5-4c05-bd62-4d9132dd61c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:00.331845 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-133c61f4-e4f5-4c05-bd62-4d9132dd61c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:00.336862 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6cdf9bb-ea06-4cd5-8047-cb7b6907d34c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:00.337345 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6cdf9bb-ea06-4cd5-8047-cb7b6907d34c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:00.337775 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6cdf9bb-ea06-4cd5-8047-cb7b6907d34c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:00.338145 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-133c61f4-e4f5-4c05-bd62-4d9132dd61c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:00.338463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6cdf9bb-ea06-4cd5-8047-cb7b6907d34c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:00.338647 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-133c61f4-e4f5-4c05-bd62-4d9132dd61c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:00.338913 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6cdf9bb-ea06-4cd5-8047-cb7b6907d34c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:00.339049 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-133c61f4-e4f5-4c05-bd62-4d9132dd61c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:00.339373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6cdf9bb-ea06-4cd5-8047-cb7b6907d34c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:00.339779 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-133c61f4-e4f5-4c05-bd62-4d9132dd61c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:00.340230 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-133c61f4-e4f5-4c05-bd62-4d9132dd61c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:00.340656 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-133c61f4-e4f5-4c05-bd62-4d9132dd61c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:00.526949 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f6cdf9bb-ea06-4cd5-8047-cb7b6907d34c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:00.533487 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-133c61f4-e4f5-4c05-bd62-4d9132dd61c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:00.535087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f6cdf9bb-ea06-4cd5-8047-cb7b6907d34c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.209481 Aug 10 13:02:00.535707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1377/2769] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:00 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:00.541399 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-133c61f4-e4f5-4c05-bd62-4d9132dd61c1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.213912 Aug 10 13:02:00.541961 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1393/2770] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:00 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:00.775093 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-164a35b9-80f7-4b12-9801-02afdcf692f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:00.775763 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-164a35b9-80f7-4b12-9801-02afdcf692f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:00.777624 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=96 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:00.781740 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-137a6f46-6e22-4aee-9031-d7b281c78804 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:00.782350 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-137a6f46-6e22-4aee-9031-d7b281c78804 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:00.782467 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-164a35b9-80f7-4b12-9801-02afdcf692f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:00.782873 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-164a35b9-80f7-4b12-9801-02afdcf692f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:00.783336 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-164a35b9-80f7-4b12-9801-02afdcf692f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:00.784033 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-164a35b9-80f7-4b12-9801-02afdcf692f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:00.788854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-164a35b9-80f7-4b12-9801-02afdcf692f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:00.788854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-164a35b9-80f7-4b12-9801-02afdcf692f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:00.789077 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-137a6f46-6e22-4aee-9031-d7b281c78804 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:00.789205 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-137a6f46-6e22-4aee-9031-d7b281c78804 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:00.789629 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-137a6f46-6e22-4aee-9031-d7b281c78804 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:00.790315 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-137a6f46-6e22-4aee-9031-d7b281c78804 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:00.790788 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-137a6f46-6e22-4aee-9031-d7b281c78804 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:00.791213 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-137a6f46-6e22-4aee-9031-d7b281c78804 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:00.981817 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-164a35b9-80f7-4b12-9801-02afdcf692f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:00.989000 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-137a6f46-6e22-4aee-9031-d7b281c78804 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:00.989819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-164a35b9-80f7-4b12-9801-02afdcf692f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.219907 Aug 10 13:02:00.990537 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1378/2771] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:00 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:00.997732 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-137a6f46-6e22-4aee-9031-d7b281c78804 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:00.999354 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-137a6f46-6e22-4aee-9031-d7b281c78804 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:01.000591 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-137a6f46-6e22-4aee-9031-d7b281c78804 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.222770 Aug 10 13:02:01.001257 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1394/2772] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:00 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:01.556477 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0ac6a3fb-f51e-4bd9-b5b7-a31fdedb4f22 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:01.557033 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0ac6a3fb-f51e-4bd9-b5b7-a31fdedb4f22 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:01.562914 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f59b3a12-1b64-49fc-ac73-4e093de2a649 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:01.563416 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ac6a3fb-f51e-4bd9-b5b7-a31fdedb4f22 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:01.563555 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f59b3a12-1b64-49fc-ac73-4e093de2a649 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:01.563894 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ac6a3fb-f51e-4bd9-b5b7-a31fdedb4f22 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:01.564323 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ac6a3fb-f51e-4bd9-b5b7-a31fdedb4f22 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:01.565004 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ac6a3fb-f51e-4bd9-b5b7-a31fdedb4f22 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:01.565450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ac6a3fb-f51e-4bd9-b5b7-a31fdedb4f22 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:01.565871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ac6a3fb-f51e-4bd9-b5b7-a31fdedb4f22 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:01.570727 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f59b3a12-1b64-49fc-ac73-4e093de2a649 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:01.571226 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f59b3a12-1b64-49fc-ac73-4e093de2a649 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:01.571662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f59b3a12-1b64-49fc-ac73-4e093de2a649 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:01.572374 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f59b3a12-1b64-49fc-ac73-4e093de2a649 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:01.572818 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f59b3a12-1b64-49fc-ac73-4e093de2a649 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:01.573236 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f59b3a12-1b64-49fc-ac73-4e093de2a649 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:01.762058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0ac6a3fb-f51e-4bd9-b5b7-a31fdedb4f22 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:01.765280 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f59b3a12-1b64-49fc-ac73-4e093de2a649 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:01.770066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0ac6a3fb-f51e-4bd9-b5b7-a31fdedb4f22 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.218097 Aug 10 13:02:01.770641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1379/2773] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:01 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:01.774412 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f59b3a12-1b64-49fc-ac73-4e093de2a649 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.215388 Aug 10 13:02:01.775155 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1395/2774] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:01 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:02.011356 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-251a3952-bbbb-4fc1-8518-d5422afb36c0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:02.014183 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-251a3952-bbbb-4fc1-8518-d5422afb36c0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:02.017822 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-251a3952-bbbb-4fc1-8518-d5422afb36c0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:02.018313 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-251a3952-bbbb-4fc1-8518-d5422afb36c0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:02.018745 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-251a3952-bbbb-4fc1-8518-d5422afb36c0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:02.019460 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-251a3952-bbbb-4fc1-8518-d5422afb36c0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:02.019911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-251a3952-bbbb-4fc1-8518-d5422afb36c0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:02.020336 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-251a3952-bbbb-4fc1-8518-d5422afb36c0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:02.024717 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-47607ec1-5253-4709-882a-3aea74b43c70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:02.025356 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-47607ec1-5253-4709-882a-3aea74b43c70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:02.031121 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-47607ec1-5253-4709-882a-3aea74b43c70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:02.031628 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-47607ec1-5253-4709-882a-3aea74b43c70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:02.032058 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-47607ec1-5253-4709-882a-3aea74b43c70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:02.032735 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-47607ec1-5253-4709-882a-3aea74b43c70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:02.033180 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-47607ec1-5253-4709-882a-3aea74b43c70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:02.033595 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-47607ec1-5253-4709-882a-3aea74b43c70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:02.221322 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-47607ec1-5253-4709-882a-3aea74b43c70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:02.225821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-251a3952-bbbb-4fc1-8518-d5422afb36c0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:02.231531 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-47607ec1-5253-4709-882a-3aea74b43c70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:02.233021 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-47607ec1-5253-4709-882a-3aea74b43c70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:02.234260 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-47607ec1-5253-4709-882a-3aea74b43c70 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.214160 Aug 10 13:02:02.234935 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1396/2775] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:02 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:02.242636 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-251a3952-bbbb-4fc1-8518-d5422afb36c0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.235068 Aug 10 13:02:02.243416 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1380/2776] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:02 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:02.791470 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-797eff9d-eed6-4c5f-a36d-fdb9a0237815 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:02.792080 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-797eff9d-eed6-4c5f-a36d-fdb9a0237815 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:02.796160 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-137c247f-78a0-49f9-9e6e-49ea8dda2635 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:02.796772 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-137c247f-78a0-49f9-9e6e-49ea8dda2635 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:02.798633 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-797eff9d-eed6-4c5f-a36d-fdb9a0237815 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:02.799115 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-797eff9d-eed6-4c5f-a36d-fdb9a0237815 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:02.799578 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-797eff9d-eed6-4c5f-a36d-fdb9a0237815 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:02.800266 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-797eff9d-eed6-4c5f-a36d-fdb9a0237815 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:02.800721 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-797eff9d-eed6-4c5f-a36d-fdb9a0237815 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:02.801145 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-797eff9d-eed6-4c5f-a36d-fdb9a0237815 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:02.803486 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-137c247f-78a0-49f9-9e6e-49ea8dda2635 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:02.803971 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-137c247f-78a0-49f9-9e6e-49ea8dda2635 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:02.804406 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-137c247f-78a0-49f9-9e6e-49ea8dda2635 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:02.805107 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-137c247f-78a0-49f9-9e6e-49ea8dda2635 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:02.805557 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-137c247f-78a0-49f9-9e6e-49ea8dda2635 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:02.805986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-137c247f-78a0-49f9-9e6e-49ea8dda2635 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:02.996237 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-797eff9d-eed6-4c5f-a36d-fdb9a0237815 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:02.998986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-137c247f-78a0-49f9-9e6e-49ea8dda2635 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:03.005081 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-797eff9d-eed6-4c5f-a36d-fdb9a0237815 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.217472 Aug 10 13:02:03.006498 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1397/2777] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:02 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:03.008231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-137c247f-78a0-49f9-9e6e-49ea8dda2635 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.215829 Aug 10 13:02:03.008794 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1381/2778] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:02 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:03.261507 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-915b8f7d-e2db-4b05-b7bb-fe0dfd725057 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:03.261507 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-915b8f7d-e2db-4b05-b7bb-fe0dfd725057 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:03.265346 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-915b8f7d-e2db-4b05-b7bb-fe0dfd725057 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:03.265833 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-915b8f7d-e2db-4b05-b7bb-fe0dfd725057 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:03.266261 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-915b8f7d-e2db-4b05-b7bb-fe0dfd725057 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:03.266948 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-915b8f7d-e2db-4b05-b7bb-fe0dfd725057 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:03.267380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-eb6de948-11f5-4ad7-ba85-fcaa4552c733 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:03.267507 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-915b8f7d-e2db-4b05-b7bb-fe0dfd725057 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:03.267823 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-915b8f7d-e2db-4b05-b7bb-fe0dfd725057 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:03.268120 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-eb6de948-11f5-4ad7-ba85-fcaa4552c733 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:03.279407 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb6de948-11f5-4ad7-ba85-fcaa4552c733 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:03.279934 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb6de948-11f5-4ad7-ba85-fcaa4552c733 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:03.280379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb6de948-11f5-4ad7-ba85-fcaa4552c733 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:03.281081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb6de948-11f5-4ad7-ba85-fcaa4552c733 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:03.281530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb6de948-11f5-4ad7-ba85-fcaa4552c733 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:03.282005 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb6de948-11f5-4ad7-ba85-fcaa4552c733 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:03.474597 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-915b8f7d-e2db-4b05-b7bb-fe0dfd725057 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:03.482005 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-eb6de948-11f5-4ad7-ba85-fcaa4552c733 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:03.483467 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-915b8f7d-e2db-4b05-b7bb-fe0dfd725057 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:03.485428 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-915b8f7d-e2db-4b05-b7bb-fe0dfd725057 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:03.486151 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-915b8f7d-e2db-4b05-b7bb-fe0dfd725057 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.232974 Aug 10 13:02:03.486703 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1398/2779] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:03 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:02:03.490730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-eb6de948-11f5-4ad7-ba85-fcaa4552c733 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.226639 Aug 10 13:02:03.491563 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1382/2780] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:03 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:04.026570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6a621c4e-d843-4399-be50-843134c5181e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:04.027303 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6a621c4e-d843-4399-be50-843134c5181e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:04.029682 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b3714ac1-ccc7-46f3-bc59-d196c6d65228 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:04.030726 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b3714ac1-ccc7-46f3-bc59-d196c6d65228 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:04.033838 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a621c4e-d843-4399-be50-843134c5181e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:04.034320 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a621c4e-d843-4399-be50-843134c5181e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:04.034752 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a621c4e-d843-4399-be50-843134c5181e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:04.035462 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a621c4e-d843-4399-be50-843134c5181e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:04.035912 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a621c4e-d843-4399-be50-843134c5181e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:04.036333 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a621c4e-d843-4399-be50-843134c5181e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:04.037104 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b3714ac1-ccc7-46f3-bc59-d196c6d65228 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:04.037582 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b3714ac1-ccc7-46f3-bc59-d196c6d65228 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:04.038013 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b3714ac1-ccc7-46f3-bc59-d196c6d65228 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:04.038696 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b3714ac1-ccc7-46f3-bc59-d196c6d65228 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:04.039145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b3714ac1-ccc7-46f3-bc59-d196c6d65228 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:04.039593 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b3714ac1-ccc7-46f3-bc59-d196c6d65228 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:04.228888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b3714ac1-ccc7-46f3-bc59-d196c6d65228 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:04.235962 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6a621c4e-d843-4399-be50-843134c5181e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:04.237242 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b3714ac1-ccc7-46f3-bc59-d196c6d65228 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.211327 Aug 10 13:02:04.237825 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1383/2781] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:04 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:04.244371 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6a621c4e-d843-4399-be50-843134c5181e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.221624 Aug 10 13:02:04.244922 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1399/2782] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:04 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:04.510414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-28739a8c-5773-4d8c-a52e-10203d34b3f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:04.511021 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-28739a8c-5773-4d8c-a52e-10203d34b3f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:04.512158 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7bda29ce-c0fe-432e-a5b3-777422556778 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:04.512780 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7bda29ce-c0fe-432e-a5b3-777422556778 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:04.517070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28739a8c-5773-4d8c-a52e-10203d34b3f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:04.517551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28739a8c-5773-4d8c-a52e-10203d34b3f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:04.517982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28739a8c-5773-4d8c-a52e-10203d34b3f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:04.518531 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7bda29ce-c0fe-432e-a5b3-777422556778 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:04.518671 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28739a8c-5773-4d8c-a52e-10203d34b3f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:04.519012 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7bda29ce-c0fe-432e-a5b3-777422556778 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:04.519150 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28739a8c-5773-4d8c-a52e-10203d34b3f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:04.519487 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7bda29ce-c0fe-432e-a5b3-777422556778 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:04.519599 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28739a8c-5773-4d8c-a52e-10203d34b3f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:04.520177 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7bda29ce-c0fe-432e-a5b3-777422556778 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:04.520630 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7bda29ce-c0fe-432e-a5b3-777422556778 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:04.521775 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7bda29ce-c0fe-432e-a5b3-777422556778 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:04.713516 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-28739a8c-5773-4d8c-a52e-10203d34b3f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:04.716992 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-7bda29ce-c0fe-432e-a5b3-777422556778 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:04.722016 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-28739a8c-5773-4d8c-a52e-10203d34b3f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:04.723543 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-28739a8c-5773-4d8c-a52e-10203d34b3f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:04.724777 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-28739a8c-5773-4d8c-a52e-10203d34b3f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.218208 Aug 10 13:02:04.725335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1384/2783] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:04 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:02:04.725471 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7bda29ce-c0fe-432e-a5b3-777422556778 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.217163 Aug 10 13:02:04.725890 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1400/2784] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:04 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:05.257885 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e07d2d5b-21f5-4a42-ab6b-f8cf9bd93c1b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:05.258497 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e07d2d5b-21f5-4a42-ab6b-f8cf9bd93c1b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:05.265066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e07d2d5b-21f5-4a42-ab6b-f8cf9bd93c1b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:05.265509 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e07d2d5b-21f5-4a42-ab6b-f8cf9bd93c1b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:05.265839 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fc9a2d18-160a-402c-b34f-2623c5a8772c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:05.266301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e07d2d5b-21f5-4a42-ab6b-f8cf9bd93c1b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:05.266434 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fc9a2d18-160a-402c-b34f-2623c5a8772c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:05.266619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e07d2d5b-21f5-4a42-ab6b-f8cf9bd93c1b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:05.267070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e07d2d5b-21f5-4a42-ab6b-f8cf9bd93c1b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:05.267528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e07d2d5b-21f5-4a42-ab6b-f8cf9bd93c1b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:05.273063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fc9a2d18-160a-402c-b34f-2623c5a8772c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:05.273579 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fc9a2d18-160a-402c-b34f-2623c5a8772c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:05.274020 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fc9a2d18-160a-402c-b34f-2623c5a8772c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:05.274720 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fc9a2d18-160a-402c-b34f-2623c5a8772c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:05.275240 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fc9a2d18-160a-402c-b34f-2623c5a8772c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:05.275800 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fc9a2d18-160a-402c-b34f-2623c5a8772c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:05.278560 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:05.466809 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e07d2d5b-21f5-4a42-ab6b-f8cf9bd93c1b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:05.475541 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e07d2d5b-21f5-4a42-ab6b-f8cf9bd93c1b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.221539 Aug 10 13:02:05.476164 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1385/2785] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:05 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:05.478195 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fc9a2d18-160a-402c-b34f-2623c5a8772c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:05.486456 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fc9a2d18-160a-402c-b34f-2623c5a8772c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.224723 Aug 10 13:02:05.487014 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1401/2786] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:05 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:05.747496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-989859a3-33b7-411c-a2cc-448e7c498f8f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:05.747796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9b69543f-e027-48c8-90d5-a0273a794b26 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:05.748028 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-989859a3-33b7-411c-a2cc-448e7c498f8f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:05.748403 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9b69543f-e027-48c8-90d5-a0273a794b26 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:05.754390 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-989859a3-33b7-411c-a2cc-448e7c498f8f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:05.754586 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b69543f-e027-48c8-90d5-a0273a794b26 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:05.754867 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-989859a3-33b7-411c-a2cc-448e7c498f8f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:05.755069 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b69543f-e027-48c8-90d5-a0273a794b26 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:05.756232 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b69543f-e027-48c8-90d5-a0273a794b26 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:05.756391 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-989859a3-33b7-411c-a2cc-448e7c498f8f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:05.756924 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b69543f-e027-48c8-90d5-a0273a794b26 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:05.757206 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-989859a3-33b7-411c-a2cc-448e7c498f8f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:05.757374 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b69543f-e027-48c8-90d5-a0273a794b26 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:05.757657 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-989859a3-33b7-411c-a2cc-448e7c498f8f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:05.757780 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9b69543f-e027-48c8-90d5-a0273a794b26 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:05.758078 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-989859a3-33b7-411c-a2cc-448e7c498f8f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:05.952955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-989859a3-33b7-411c-a2cc-448e7c498f8f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:05.956862 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9b69543f-e027-48c8-90d5-a0273a794b26 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:05.962002 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-989859a3-33b7-411c-a2cc-448e7c498f8f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.218467 Aug 10 13:02:05.962581 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1386/2787] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:05 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:05.965694 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9b69543f-e027-48c8-90d5-a0273a794b26 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:05.967202 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9b69543f-e027-48c8-90d5-a0273a794b26 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:05.968359 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9b69543f-e027-48c8-90d5-a0273a794b26 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.224726 Aug 10 13:02:05.968892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1402/2788] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:05 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:06.497611 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-41f3c363-2255-4da4-8d41-b00ea5b6be75 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:06.498326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-41f3c363-2255-4da4-8d41-b00ea5b6be75 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:06.507150 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41f3c363-2255-4da4-8d41-b00ea5b6be75 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:06.507673 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41f3c363-2255-4da4-8d41-b00ea5b6be75 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:06.508104 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41f3c363-2255-4da4-8d41-b00ea5b6be75 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:06.508799 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41f3c363-2255-4da4-8d41-b00ea5b6be75 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:06.509270 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bef68c13-1472-4fd2-b751-4bb22a187752 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:06.510007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41f3c363-2255-4da4-8d41-b00ea5b6be75 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:06.510007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41f3c363-2255-4da4-8d41-b00ea5b6be75 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:06.510338 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bef68c13-1472-4fd2-b751-4bb22a187752 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:06.516615 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bef68c13-1472-4fd2-b751-4bb22a187752 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:06.517095 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bef68c13-1472-4fd2-b751-4bb22a187752 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:06.517530 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bef68c13-1472-4fd2-b751-4bb22a187752 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:06.518225 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bef68c13-1472-4fd2-b751-4bb22a187752 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:06.518675 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bef68c13-1472-4fd2-b751-4bb22a187752 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:06.519101 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bef68c13-1472-4fd2-b751-4bb22a187752 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:06.733438 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-41f3c363-2255-4da4-8d41-b00ea5b6be75 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:06.736940 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-bef68c13-1472-4fd2-b751-4bb22a187752 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:06.744273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-41f3c363-2255-4da4-8d41-b00ea5b6be75 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.250422 Aug 10 13:02:06.744948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1387/2789] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:06 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:06.745975 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bef68c13-1472-4fd2-b751-4bb22a187752 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.242403 Aug 10 13:02:06.746489 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1403/2790] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:06 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:06.984552 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ff27ab17-420f-4299-81d0-5c48ecd111e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:06.985113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ff27ab17-420f-4299-81d0-5c48ecd111e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:06.992922 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff27ab17-420f-4299-81d0-5c48ecd111e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:06.993408 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff27ab17-420f-4299-81d0-5c48ecd111e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:06.993842 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff27ab17-420f-4299-81d0-5c48ecd111e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:06.994537 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff27ab17-420f-4299-81d0-5c48ecd111e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:06.994981 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff27ab17-420f-4299-81d0-5c48ecd111e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:06.995421 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff27ab17-420f-4299-81d0-5c48ecd111e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:07.001284 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6ef4cfb9-221d-4b62-8e82-a6046d8c1d92 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:07.001946 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6ef4cfb9-221d-4b62-8e82-a6046d8c1d92 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:07.008480 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6ef4cfb9-221d-4b62-8e82-a6046d8c1d92 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:07.009320 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6ef4cfb9-221d-4b62-8e82-a6046d8c1d92 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:07.009920 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6ef4cfb9-221d-4b62-8e82-a6046d8c1d92 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:07.010621 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6ef4cfb9-221d-4b62-8e82-a6046d8c1d92 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:07.011163 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6ef4cfb9-221d-4b62-8e82-a6046d8c1d92 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:07.011605 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6ef4cfb9-221d-4b62-8e82-a6046d8c1d92 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:07.212577 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ff27ab17-420f-4299-81d0-5c48ecd111e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:07.216678 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6ef4cfb9-221d-4b62-8e82-a6046d8c1d92 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:07.220618 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ff27ab17-420f-4299-81d0-5c48ecd111e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.240463 Aug 10 13:02:07.221183 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1388/2791] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:06 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:07.225666 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6ef4cfb9-221d-4b62-8e82-a6046d8c1d92 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:07.227166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6ef4cfb9-221d-4b62-8e82-a6046d8c1d92 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:07.228342 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6ef4cfb9-221d-4b62-8e82-a6046d8c1d92 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.241186 Aug 10 13:02:07.228896 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1404/2792] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:06 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:07.770251 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-67be478b-c84b-4cbb-9006-fde0fa4a66a8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:07.770692 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-93f0e65b-e424-420e-bf06-267e26ec48a5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:07.771778 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-67be478b-c84b-4cbb-9006-fde0fa4a66a8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:07.772042 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-93f0e65b-e424-420e-bf06-267e26ec48a5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:07.777828 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-93f0e65b-e424-420e-bf06-267e26ec48a5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:07.778118 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-67be478b-c84b-4cbb-9006-fde0fa4a66a8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:07.778309 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-93f0e65b-e424-420e-bf06-267e26ec48a5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:07.778594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-67be478b-c84b-4cbb-9006-fde0fa4a66a8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:07.778775 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-93f0e65b-e424-420e-bf06-267e26ec48a5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:07.779410 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-67be478b-c84b-4cbb-9006-fde0fa4a66a8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:07.779596 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-93f0e65b-e424-420e-bf06-267e26ec48a5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:07.779948 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-93f0e65b-e424-420e-bf06-267e26ec48a5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:07.780107 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-67be478b-c84b-4cbb-9006-fde0fa4a66a8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:07.780281 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-93f0e65b-e424-420e-bf06-267e26ec48a5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:07.780707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-67be478b-c84b-4cbb-9006-fde0fa4a66a8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:07.780943 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-67be478b-c84b-4cbb-9006-fde0fa4a66a8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:07.966398 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-67be478b-c84b-4cbb-9006-fde0fa4a66a8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:07.974477 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-67be478b-c84b-4cbb-9006-fde0fa4a66a8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.209001 Aug 10 13:02:07.975140 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1389/2793] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:07 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:07.980570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-93f0e65b-e424-420e-bf06-267e26ec48a5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:07.988642 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-93f0e65b-e424-420e-bf06-267e26ec48a5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.223180 Aug 10 13:02:07.989204 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1405/2794] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:07 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:08.242417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-89ab165f-f668-4e22-8af9-f011d6f4c356 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:08.243019 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-89ab165f-f668-4e22-8af9-f011d6f4c356 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:08.249199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-89ab165f-f668-4e22-8af9-f011d6f4c356 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:08.249743 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-89ab165f-f668-4e22-8af9-f011d6f4c356 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:08.250177 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-89ab165f-f668-4e22-8af9-f011d6f4c356 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:08.250854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-89ab165f-f668-4e22-8af9-f011d6f4c356 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:08.251050 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5b4995ed-ed82-46b8-bcd2-ef30a9db7959 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:08.251386 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-89ab165f-f668-4e22-8af9-f011d6f4c356 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:08.251803 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-89ab165f-f668-4e22-8af9-f011d6f4c356 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:08.251928 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5b4995ed-ed82-46b8-bcd2-ef30a9db7959 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:08.253756 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=96 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:08.256550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:08.260442 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b4995ed-ed82-46b8-bcd2-ef30a9db7959 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:08.260928 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b4995ed-ed82-46b8-bcd2-ef30a9db7959 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:08.261357 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b4995ed-ed82-46b8-bcd2-ef30a9db7959 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:08.262048 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b4995ed-ed82-46b8-bcd2-ef30a9db7959 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:08.262492 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b4995ed-ed82-46b8-bcd2-ef30a9db7959 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:08.262909 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b4995ed-ed82-46b8-bcd2-ef30a9db7959 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:08.448502 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-89ab165f-f668-4e22-8af9-f011d6f4c356 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:08.452818 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5b4995ed-ed82-46b8-bcd2-ef30a9db7959 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:08.456547 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-89ab165f-f668-4e22-8af9-f011d6f4c356 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.217925 Aug 10 13:02:08.457112 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1390/2795] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:08 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:08.461608 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5b4995ed-ed82-46b8-bcd2-ef30a9db7959 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:08.463227 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5b4995ed-ed82-46b8-bcd2-ef30a9db7959 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:08.464377 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5b4995ed-ed82-46b8-bcd2-ef30a9db7959 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.217191 Aug 10 13:02:08.464923 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1406/2796] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:08 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:08.996373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0ac06608-1371-41ee-babf-ee25ea450f81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:08.996984 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0ac06608-1371-41ee-babf-ee25ea450f81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:09.003425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ac06608-1371-41ee-babf-ee25ea450f81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:09.003933 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ac06608-1371-41ee-babf-ee25ea450f81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:09.004369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ac06608-1371-41ee-babf-ee25ea450f81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:09.005056 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ac06608-1371-41ee-babf-ee25ea450f81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:09.006007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ac06608-1371-41ee-babf-ee25ea450f81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:09.006428 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ac06608-1371-41ee-babf-ee25ea450f81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:09.010797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8b1dd417-ca63-415e-b448-e0bc17af6acf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:09.011447 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8b1dd417-ca63-415e-b448-e0bc17af6acf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:09.017703 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b1dd417-ca63-415e-b448-e0bc17af6acf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:09.018167 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b1dd417-ca63-415e-b448-e0bc17af6acf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:09.018596 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b1dd417-ca63-415e-b448-e0bc17af6acf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:09.019440 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b1dd417-ca63-415e-b448-e0bc17af6acf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:09.019889 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b1dd417-ca63-415e-b448-e0bc17af6acf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:09.020303 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8b1dd417-ca63-415e-b448-e0bc17af6acf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:09.206203 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0ac06608-1371-41ee-babf-ee25ea450f81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:09.218519 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-8b1dd417-ca63-415e-b448-e0bc17af6acf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:09.218688 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0ac06608-1371-41ee-babf-ee25ea450f81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.221921 Aug 10 13:02:09.218688 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1391/2797] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:08 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:09.218894 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8b1dd417-ca63-415e-b448-e0bc17af6acf tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.211350 Aug 10 13:02:09.218992 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1407/2798] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:09 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:09.478736 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0adb4ba8-b802-4471-8768-c42852519dd1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:09.479625 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0adb4ba8-b802-4471-8768-c42852519dd1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:09.485643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0adb4ba8-b802-4471-8768-c42852519dd1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:09.486120 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0adb4ba8-b802-4471-8768-c42852519dd1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:09.486546 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0adb4ba8-b802-4471-8768-c42852519dd1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:09.486884 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-813e4f5a-8b86-4eac-abe3-3713ba7c2f88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:09.487244 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0adb4ba8-b802-4471-8768-c42852519dd1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:09.487533 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-813e4f5a-8b86-4eac-abe3-3713ba7c2f88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:09.487690 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0adb4ba8-b802-4471-8768-c42852519dd1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:09.488109 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0adb4ba8-b802-4471-8768-c42852519dd1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:09.493443 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-813e4f5a-8b86-4eac-abe3-3713ba7c2f88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:09.493923 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-813e4f5a-8b86-4eac-abe3-3713ba7c2f88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:09.494364 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-813e4f5a-8b86-4eac-abe3-3713ba7c2f88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:09.495053 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-813e4f5a-8b86-4eac-abe3-3713ba7c2f88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:09.495603 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-813e4f5a-8b86-4eac-abe3-3713ba7c2f88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:09.496032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-813e4f5a-8b86-4eac-abe3-3713ba7c2f88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:09.689000 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0adb4ba8-b802-4471-8768-c42852519dd1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:09.692119 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-813e4f5a-8b86-4eac-abe3-3713ba7c2f88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:09.697220 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0adb4ba8-b802-4471-8768-c42852519dd1 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.223202 Aug 10 13:02:09.697795 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1392/2799] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:09 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:09.700544 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-813e4f5a-8b86-4eac-abe3-3713ba7c2f88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:09.702061 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-813e4f5a-8b86-4eac-abe3-3713ba7c2f88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:09.703239 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-813e4f5a-8b86-4eac-abe3-3713ba7c2f88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.220165 Aug 10 13:02:09.703797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1408/2800] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:09 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:10.238237 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7bd72a00-7800-4f18-9236-343dc288290e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:10.238852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7bd72a00-7800-4f18-9236-343dc288290e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:10.239451 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d006c030-fbc3-4d73-9f5c-4895f90923f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:10.240076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d006c030-fbc3-4d73-9f5c-4895f90923f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:10.245511 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7bd72a00-7800-4f18-9236-343dc288290e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:10.245997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7bd72a00-7800-4f18-9236-343dc288290e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:10.246437 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7bd72a00-7800-4f18-9236-343dc288290e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:10.246646 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d006c030-fbc3-4d73-9f5c-4895f90923f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:10.246975 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d006c030-fbc3-4d73-9f5c-4895f90923f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:10.247131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7bd72a00-7800-4f18-9236-343dc288290e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:10.247442 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d006c030-fbc3-4d73-9f5c-4895f90923f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:10.247611 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7bd72a00-7800-4f18-9236-343dc288290e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:10.248038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7bd72a00-7800-4f18-9236-343dc288290e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:10.248148 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d006c030-fbc3-4d73-9f5c-4895f90923f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:10.248563 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d006c030-fbc3-4d73-9f5c-4895f90923f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:10.248983 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d006c030-fbc3-4d73-9f5c-4895f90923f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:10.439975 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7bd72a00-7800-4f18-9236-343dc288290e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:10.447943 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d006c030-fbc3-4d73-9f5c-4895f90923f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:10.448643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7bd72a00-7800-4f18-9236-343dc288290e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.214213 Aug 10 13:02:10.449252 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1393/2801] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:10 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:10.455889 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d006c030-fbc3-4d73-9f5c-4895f90923f0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.220275 Aug 10 13:02:10.456450 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1409/2802] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:10 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:10.717746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5c938a38-a577-479d-88c8-97daa8190eee tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:10.718355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5c938a38-a577-479d-88c8-97daa8190eee tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:10.724924 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5c938a38-a577-479d-88c8-97daa8190eee tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:10.725401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5c938a38-a577-479d-88c8-97daa8190eee tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:10.725832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5c938a38-a577-479d-88c8-97daa8190eee tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:10.726193 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2777e32a-86cd-47a0-8051-aa3c5b71eb93 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:10.726517 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5c938a38-a577-479d-88c8-97daa8190eee tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:10.726919 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2777e32a-86cd-47a0-8051-aa3c5b71eb93 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:10.727040 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5c938a38-a577-479d-88c8-97daa8190eee tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:10.727404 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5c938a38-a577-479d-88c8-97daa8190eee tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:10.733245 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2777e32a-86cd-47a0-8051-aa3c5b71eb93 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:10.733724 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2777e32a-86cd-47a0-8051-aa3c5b71eb93 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:10.734160 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2777e32a-86cd-47a0-8051-aa3c5b71eb93 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:10.734841 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2777e32a-86cd-47a0-8051-aa3c5b71eb93 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:10.735314 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2777e32a-86cd-47a0-8051-aa3c5b71eb93 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:10.735736 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2777e32a-86cd-47a0-8051-aa3c5b71eb93 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:10.929845 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5c938a38-a577-479d-88c8-97daa8190eee tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:10.933103 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2777e32a-86cd-47a0-8051-aa3c5b71eb93 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:10.938954 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5c938a38-a577-479d-88c8-97daa8190eee tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.225010 Aug 10 13:02:10.939616 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1394/2803] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:10 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:10.944743 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2777e32a-86cd-47a0-8051-aa3c5b71eb93 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:10.946291 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2777e32a-86cd-47a0-8051-aa3c5b71eb93 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:10.947485 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2777e32a-86cd-47a0-8051-aa3c5b71eb93 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.225629 Aug 10 13:02:10.948043 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1410/2804] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:10 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:11.470704 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-afe7dc1b-d0b6-46a9-88e7-1cab222247fe tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:11.471336 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-afe7dc1b-d0b6-46a9-88e7-1cab222247fe tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:11.477665 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-01fd695a-6e96-4081-b572-2ca7360c9fb8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:11.478183 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-afe7dc1b-d0b6-46a9-88e7-1cab222247fe tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:11.478323 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-01fd695a-6e96-4081-b572-2ca7360c9fb8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:11.478663 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-afe7dc1b-d0b6-46a9-88e7-1cab222247fe tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:11.479371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-afe7dc1b-d0b6-46a9-88e7-1cab222247fe tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:11.480067 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-afe7dc1b-d0b6-46a9-88e7-1cab222247fe tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:11.480511 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-afe7dc1b-d0b6-46a9-88e7-1cab222247fe tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:11.480926 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-afe7dc1b-d0b6-46a9-88e7-1cab222247fe tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:11.484862 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01fd695a-6e96-4081-b572-2ca7360c9fb8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:11.485345 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01fd695a-6e96-4081-b572-2ca7360c9fb8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:11.485782 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01fd695a-6e96-4081-b572-2ca7360c9fb8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:11.486473 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01fd695a-6e96-4081-b572-2ca7360c9fb8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:11.486926 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01fd695a-6e96-4081-b572-2ca7360c9fb8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:11.487386 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-01fd695a-6e96-4081-b572-2ca7360c9fb8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:11.674192 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-afe7dc1b-d0b6-46a9-88e7-1cab222247fe tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:11.678541 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-01fd695a-6e96-4081-b572-2ca7360c9fb8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:11.683267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-afe7dc1b-d0b6-46a9-88e7-1cab222247fe tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.216348 Aug 10 13:02:11.683943 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1395/2805] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:11 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:11.686611 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-01fd695a-6e96-4081-b572-2ca7360c9fb8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.212824 Aug 10 13:02:11.687202 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1411/2806] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:11 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:11.971212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4f0a884d-8252-4404-b380-d97fecd710e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:11.971820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4f0a884d-8252-4404-b380-d97fecd710e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:11.972793 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-88be59a2-44a3-4f4b-ac27-7b19ce88ecab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:11.973413 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-88be59a2-44a3-4f4b-ac27-7b19ce88ecab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:11.977982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f0a884d-8252-4404-b380-d97fecd710e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:11.978465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f0a884d-8252-4404-b380-d97fecd710e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:11.978897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f0a884d-8252-4404-b380-d97fecd710e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:11.979876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f0a884d-8252-4404-b380-d97fecd710e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:11.980001 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-88be59a2-44a3-4f4b-ac27-7b19ce88ecab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:11.980326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f0a884d-8252-4404-b380-d97fecd710e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:11.980506 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-88be59a2-44a3-4f4b-ac27-7b19ce88ecab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:11.980747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f0a884d-8252-4404-b380-d97fecd710e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:11.980946 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-88be59a2-44a3-4f4b-ac27-7b19ce88ecab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:11.981643 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-88be59a2-44a3-4f4b-ac27-7b19ce88ecab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:11.982097 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-88be59a2-44a3-4f4b-ac27-7b19ce88ecab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:11.982522 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-88be59a2-44a3-4f4b-ac27-7b19ce88ecab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:12.190221 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4f0a884d-8252-4404-b380-d97fecd710e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:12.193890 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-88be59a2-44a3-4f4b-ac27-7b19ce88ecab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:12.199527 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4f0a884d-8252-4404-b380-d97fecd710e6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.232168 Aug 10 13:02:12.200113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1396/2807] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:11 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:12.202524 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-88be59a2-44a3-4f4b-ac27-7b19ce88ecab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:12.204066 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-88be59a2-44a3-4f4b-ac27-7b19ce88ecab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:12.205368 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-88be59a2-44a3-4f4b-ac27-7b19ce88ecab tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.236427 Aug 10 13:02:12.205918 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1412/2808] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:11 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:12.705008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f4d103b6-5162-4c08-bc41-6a47d763a2e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:12.705708 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f4d103b6-5162-4c08-bc41-6a47d763a2e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:12.708428 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f17747bb-b32b-4884-9cb2-3dcfd8717b1c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:12.709038 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f17747bb-b32b-4884-9cb2-3dcfd8717b1c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:12.712519 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f4d103b6-5162-4c08-bc41-6a47d763a2e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:12.713084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f4d103b6-5162-4c08-bc41-6a47d763a2e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:12.713534 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f4d103b6-5162-4c08-bc41-6a47d763a2e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:12.714205 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f4d103b6-5162-4c08-bc41-6a47d763a2e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:12.714647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f4d103b6-5162-4c08-bc41-6a47d763a2e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:12.715064 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f4d103b6-5162-4c08-bc41-6a47d763a2e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:12.715320 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f17747bb-b32b-4884-9cb2-3dcfd8717b1c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:12.715793 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f17747bb-b32b-4884-9cb2-3dcfd8717b1c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:12.716223 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f17747bb-b32b-4884-9cb2-3dcfd8717b1c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:12.716923 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f17747bb-b32b-4884-9cb2-3dcfd8717b1c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:12.717352 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f17747bb-b32b-4884-9cb2-3dcfd8717b1c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:12.717767 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f17747bb-b32b-4884-9cb2-3dcfd8717b1c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:12.915458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f4d103b6-5162-4c08-bc41-6a47d763a2e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:12.919103 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f17747bb-b32b-4884-9cb2-3dcfd8717b1c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:12.923433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f4d103b6-5162-4c08-bc41-6a47d763a2e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.222386 Aug 10 13:02:12.924000 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1397/2809] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:12 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:12.927677 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f17747bb-b32b-4884-9cb2-3dcfd8717b1c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.222710 Aug 10 13:02:12.928329 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1413/2810] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:12 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:13.221634 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fb833d9d-00bb-433e-9153-8775d2630e13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:13.222245 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fb833d9d-00bb-433e-9153-8775d2630e13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:13.228801 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fb833d9d-00bb-433e-9153-8775d2630e13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:13.228972 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bde613b7-8bda-496a-bdd9-ab3c145de36a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:13.229539 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fb833d9d-00bb-433e-9153-8775d2630e13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:13.229724 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bde613b7-8bda-496a-bdd9-ab3c145de36a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:13.229977 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fb833d9d-00bb-433e-9153-8775d2630e13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:13.230684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fb833d9d-00bb-433e-9153-8775d2630e13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:13.231290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fb833d9d-00bb-433e-9153-8775d2630e13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:13.231577 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fb833d9d-00bb-433e-9153-8775d2630e13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:13.235464 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bde613b7-8bda-496a-bdd9-ab3c145de36a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:13.235933 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bde613b7-8bda-496a-bdd9-ab3c145de36a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:13.236362 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bde613b7-8bda-496a-bdd9-ab3c145de36a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:13.237036 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bde613b7-8bda-496a-bdd9-ab3c145de36a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:13.237478 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bde613b7-8bda-496a-bdd9-ab3c145de36a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:13.237892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bde613b7-8bda-496a-bdd9-ab3c145de36a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:13.423013 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fb833d9d-00bb-433e-9153-8775d2630e13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:13.426879 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-bde613b7-8bda-496a-bdd9-ab3c145de36a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:13.431144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fb833d9d-00bb-433e-9153-8775d2630e13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.213383 Aug 10 13:02:13.431746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1398/2811] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:13 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:13.435526 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-bde613b7-8bda-496a-bdd9-ab3c145de36a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:13.437027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-bde613b7-8bda-496a-bdd9-ab3c145de36a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:13.438181 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bde613b7-8bda-496a-bdd9-ab3c145de36a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.213098 Aug 10 13:02:13.438725 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1414/2812] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:13 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:13.943865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-255eaffb-6fa8-40c4-a987-f7cf2be4bc6a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:13.944535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-255eaffb-6fa8-40c4-a987-f7cf2be4bc6a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:13.948569 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-601384b6-8fc0-464c-b2e2-0ea02670b92d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:13.949263 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-601384b6-8fc0-464c-b2e2-0ea02670b92d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:13.950896 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-255eaffb-6fa8-40c4-a987-f7cf2be4bc6a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:13.951420 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-255eaffb-6fa8-40c4-a987-f7cf2be4bc6a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:13.951859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-255eaffb-6fa8-40c4-a987-f7cf2be4bc6a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:13.952550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-255eaffb-6fa8-40c4-a987-f7cf2be4bc6a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:13.953001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-255eaffb-6fa8-40c4-a987-f7cf2be4bc6a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:13.953421 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-255eaffb-6fa8-40c4-a987-f7cf2be4bc6a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:13.955892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-601384b6-8fc0-464c-b2e2-0ea02670b92d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:13.956376 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-601384b6-8fc0-464c-b2e2-0ea02670b92d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:13.956810 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-601384b6-8fc0-464c-b2e2-0ea02670b92d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:13.957500 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-601384b6-8fc0-464c-b2e2-0ea02670b92d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:13.957952 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-601384b6-8fc0-464c-b2e2-0ea02670b92d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:13.958386 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-601384b6-8fc0-464c-b2e2-0ea02670b92d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:14.148879 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-255eaffb-6fa8-40c4-a987-f7cf2be4bc6a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:14.153304 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-601384b6-8fc0-464c-b2e2-0ea02670b92d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:14.156966 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-255eaffb-6fa8-40c4-a987-f7cf2be4bc6a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.217514 Aug 10 13:02:14.157547 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1399/2813] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:13 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:14.161269 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-601384b6-8fc0-464c-b2e2-0ea02670b92d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.216643 Aug 10 13:02:14.162645 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1415/2814] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:13 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:14.452820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-40b098af-d765-4313-9b1b-1f19950e0d2e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:14.453379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-40b098af-d765-4313-9b1b-1f19950e0d2e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:14.460132 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40b098af-d765-4313-9b1b-1f19950e0d2e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:14.460612 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40b098af-d765-4313-9b1b-1f19950e0d2e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:14.461041 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40b098af-d765-4313-9b1b-1f19950e0d2e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:14.461731 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40b098af-d765-4313-9b1b-1f19950e0d2e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:14.462176 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40b098af-d765-4313-9b1b-1f19950e0d2e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:14.462353 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-96351cb3-9e4d-470a-b202-802ae56cff39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:14.462600 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40b098af-d765-4313-9b1b-1f19950e0d2e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:14.462987 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-96351cb3-9e4d-470a-b202-802ae56cff39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:14.468848 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-96351cb3-9e4d-470a-b202-802ae56cff39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:14.469315 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-96351cb3-9e4d-470a-b202-802ae56cff39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:14.469748 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-96351cb3-9e4d-470a-b202-802ae56cff39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:14.470436 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-96351cb3-9e4d-470a-b202-802ae56cff39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:14.470882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-96351cb3-9e4d-470a-b202-802ae56cff39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:14.471336 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-96351cb3-9e4d-470a-b202-802ae56cff39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:14.649593 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-96351cb3-9e4d-470a-b202-802ae56cff39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:14.657860 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-96351cb3-9e4d-470a-b202-802ae56cff39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:14.659381 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-96351cb3-9e4d-470a-b202-802ae56cff39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:14.660151 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-40b098af-d765-4313-9b1b-1f19950e0d2e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:14.660539 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-96351cb3-9e4d-470a-b202-802ae56cff39 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.202847 Aug 10 13:02:14.661166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1416/2815] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:14 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:14.668592 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-40b098af-d765-4313-9b1b-1f19950e0d2e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.219699 Aug 10 13:02:14.669260 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1400/2816] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:14 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:15.180127 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4d7551e7-02cc-4856-9989-512049cf70ad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:15.180685 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4d7551e7-02cc-4856-9989-512049cf70ad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:15.183213 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ff82549a-6862-4fa4-82d1-8d26cb11265b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:15.183857 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ff82549a-6862-4fa4-82d1-8d26cb11265b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:15.187115 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d7551e7-02cc-4856-9989-512049cf70ad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:15.187618 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d7551e7-02cc-4856-9989-512049cf70ad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:15.188046 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d7551e7-02cc-4856-9989-512049cf70ad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:15.188733 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d7551e7-02cc-4856-9989-512049cf70ad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:15.189177 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d7551e7-02cc-4856-9989-512049cf70ad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:15.189595 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d7551e7-02cc-4856-9989-512049cf70ad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:15.190292 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff82549a-6862-4fa4-82d1-8d26cb11265b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:15.190767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff82549a-6862-4fa4-82d1-8d26cb11265b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:15.191278 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff82549a-6862-4fa4-82d1-8d26cb11265b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:15.191995 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff82549a-6862-4fa4-82d1-8d26cb11265b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:15.192586 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff82549a-6862-4fa4-82d1-8d26cb11265b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:15.193007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff82549a-6862-4fa4-82d1-8d26cb11265b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:15.391808 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4d7551e7-02cc-4856-9989-512049cf70ad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:15.394003 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:15.395755 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ff82549a-6862-4fa4-82d1-8d26cb11265b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:15.401133 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4d7551e7-02cc-4856-9989-512049cf70ad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.226070 Aug 10 13:02:15.405693 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1417/2817] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:15 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:15.405823 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ff82549a-6862-4fa4-82d1-8d26cb11265b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.224880 Aug 10 13:02:15.405823 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1401/2818] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:15 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:15.683928 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4d0af27b-8141-41a6-a472-1dcce838994c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:15.684540 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4d0af27b-8141-41a6-a472-1dcce838994c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:15.689668 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1bd2494a-ac2b-43d2-856c-014345eb9e1e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:15.690284 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1bd2494a-ac2b-43d2-856c-014345eb9e1e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:15.690728 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d0af27b-8141-41a6-a472-1dcce838994c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:15.691234 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d0af27b-8141-41a6-a472-1dcce838994c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:15.691673 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d0af27b-8141-41a6-a472-1dcce838994c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:15.692366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d0af27b-8141-41a6-a472-1dcce838994c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:15.692819 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d0af27b-8141-41a6-a472-1dcce838994c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:15.693241 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d0af27b-8141-41a6-a472-1dcce838994c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:15.696763 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1bd2494a-ac2b-43d2-856c-014345eb9e1e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:15.697245 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1bd2494a-ac2b-43d2-856c-014345eb9e1e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:15.697683 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1bd2494a-ac2b-43d2-856c-014345eb9e1e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:15.698374 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1bd2494a-ac2b-43d2-856c-014345eb9e1e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:15.698828 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1bd2494a-ac2b-43d2-856c-014345eb9e1e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:15.699276 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1bd2494a-ac2b-43d2-856c-014345eb9e1e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:16.106246 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4d0af27b-8141-41a6-a472-1dcce838994c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:16.109388 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1bd2494a-ac2b-43d2-856c-014345eb9e1e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:16.114871 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4d0af27b-8141-41a6-a472-1dcce838994c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:16.116977 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4d0af27b-8141-41a6-a472-1dcce838994c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:16.118148 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4d0af27b-8141-41a6-a472-1dcce838994c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.438511 Aug 10 13:02:16.118278 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1bd2494a-ac2b-43d2-856c-014345eb9e1e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.432270 Aug 10 13:02:16.119061 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1402/2820] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:15 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:16.119223 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1418/2820] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:15 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:02:16.423469 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f2b5edf0-42d4-40a2-b18e-83a06b24a337 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:16.424149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f2b5edf0-42d4-40a2-b18e-83a06b24a337 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:16.428070 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5cfcd8bf-5f83-4cf6-81f5-3c42e57074dd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:16.429466 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5cfcd8bf-5f83-4cf6-81f5-3c42e57074dd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:16.431516 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2b5edf0-42d4-40a2-b18e-83a06b24a337 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:16.432020 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2b5edf0-42d4-40a2-b18e-83a06b24a337 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:16.432482 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2b5edf0-42d4-40a2-b18e-83a06b24a337 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:16.433172 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2b5edf0-42d4-40a2-b18e-83a06b24a337 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:16.433615 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2b5edf0-42d4-40a2-b18e-83a06b24a337 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:16.434124 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2b5edf0-42d4-40a2-b18e-83a06b24a337 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:16.437538 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5cfcd8bf-5f83-4cf6-81f5-3c42e57074dd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:16.438192 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5cfcd8bf-5f83-4cf6-81f5-3c42e57074dd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:16.438990 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5cfcd8bf-5f83-4cf6-81f5-3c42e57074dd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:16.439943 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5cfcd8bf-5f83-4cf6-81f5-3c42e57074dd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:16.440513 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5cfcd8bf-5f83-4cf6-81f5-3c42e57074dd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:16.440986 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5cfcd8bf-5f83-4cf6-81f5-3c42e57074dd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:16.627980 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f2b5edf0-42d4-40a2-b18e-83a06b24a337 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:16.630982 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5cfcd8bf-5f83-4cf6-81f5-3c42e57074dd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:16.637298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f2b5edf0-42d4-40a2-b18e-83a06b24a337 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.218149 Aug 10 13:02:16.640509 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1403/2821] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:16 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:16.640637 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5cfcd8bf-5f83-4cf6-81f5-3c42e57074dd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.217355 Aug 10 13:02:16.644195 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1419/2822] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:16 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:17.140415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-57d0eaab-c0ee-4c6a-9b00-262451edc170 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:17.140947 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-57d0eaab-c0ee-4c6a-9b00-262451edc170 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:17.141555 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-56bff4ce-613c-4496-a858-894930c72b87 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:17.142166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-56bff4ce-613c-4496-a858-894930c72b87 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:17.147095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-57d0eaab-c0ee-4c6a-9b00-262451edc170 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:17.147611 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-57d0eaab-c0ee-4c6a-9b00-262451edc170 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:17.148043 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-57d0eaab-c0ee-4c6a-9b00-262451edc170 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:17.148174 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56bff4ce-613c-4496-a858-894930c72b87 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:17.148638 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56bff4ce-613c-4496-a858-894930c72b87 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:17.148770 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-57d0eaab-c0ee-4c6a-9b00-262451edc170 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:17.149075 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56bff4ce-613c-4496-a858-894930c72b87 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:17.149192 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-57d0eaab-c0ee-4c6a-9b00-262451edc170 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:17.149613 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-57d0eaab-c0ee-4c6a-9b00-262451edc170 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:17.149804 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56bff4ce-613c-4496-a858-894930c72b87 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:17.150206 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56bff4ce-613c-4496-a858-894930c72b87 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:17.150627 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-56bff4ce-613c-4496-a858-894930c72b87 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:17.335148 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-56bff4ce-613c-4496-a858-894930c72b87 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:17.343586 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-56bff4ce-613c-4496-a858-894930c72b87 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:17.345093 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-56bff4ce-613c-4496-a858-894930c72b87 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:17.346269 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-56bff4ce-613c-4496-a858-894930c72b87 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.208513 Aug 10 13:02:17.346838 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1420/2823] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:17 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:17.365295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-57d0eaab-c0ee-4c6a-9b00-262451edc170 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:17.373906 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-57d0eaab-c0ee-4c6a-9b00-262451edc170 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.237413 Aug 10 13:02:17.374668 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1404/2824] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:17 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:17.658800 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-958a7533-b329-47a1-b288-604cbd05eee9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:17.659434 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-958a7533-b329-47a1-b288-604cbd05eee9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:17.661751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-36029c1e-4cde-45ea-bdda-c7cb1687d36e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:17.662429 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-36029c1e-4cde-45ea-bdda-c7cb1687d36e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:17.666806 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-958a7533-b329-47a1-b288-604cbd05eee9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:17.667319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-958a7533-b329-47a1-b288-604cbd05eee9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:17.667748 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-958a7533-b329-47a1-b288-604cbd05eee9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:17.668433 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-958a7533-b329-47a1-b288-604cbd05eee9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:17.668998 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-958a7533-b329-47a1-b288-604cbd05eee9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:17.669422 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-958a7533-b329-47a1-b288-604cbd05eee9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:17.669643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36029c1e-4cde-45ea-bdda-c7cb1687d36e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:17.670120 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36029c1e-4cde-45ea-bdda-c7cb1687d36e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:17.670545 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36029c1e-4cde-45ea-bdda-c7cb1687d36e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:17.671315 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36029c1e-4cde-45ea-bdda-c7cb1687d36e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:17.671758 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36029c1e-4cde-45ea-bdda-c7cb1687d36e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:17.672175 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36029c1e-4cde-45ea-bdda-c7cb1687d36e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:17.867883 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-958a7533-b329-47a1-b288-604cbd05eee9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:17.871227 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-36029c1e-4cde-45ea-bdda-c7cb1687d36e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:17.876045 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-958a7533-b329-47a1-b288-604cbd05eee9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.221152 Aug 10 13:02:17.876708 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1421/2825] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:17 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:17.879504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-36029c1e-4cde-45ea-bdda-c7cb1687d36e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.221504 Aug 10 13:02:17.880065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1405/2826] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:17 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:18.370482 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2baf4382-82be-45a1-9997-a927fbfded9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:18.371062 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2baf4382-82be-45a1-9997-a927fbfded9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:18.377042 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2baf4382-82be-45a1-9997-a927fbfded9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:18.377519 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2baf4382-82be-45a1-9997-a927fbfded9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:18.377955 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2baf4382-82be-45a1-9997-a927fbfded9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:18.378641 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2baf4382-82be-45a1-9997-a927fbfded9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:18.379092 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2baf4382-82be-45a1-9997-a927fbfded9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:18.379542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2baf4382-82be-45a1-9997-a927fbfded9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:18.393968 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-83624817-d833-4e79-ac53-62c5d874b979 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:18.394575 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-83624817-d833-4e79-ac53-62c5d874b979 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:18.400632 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83624817-d833-4e79-ac53-62c5d874b979 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:18.401108 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83624817-d833-4e79-ac53-62c5d874b979 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:18.401658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83624817-d833-4e79-ac53-62c5d874b979 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:18.402342 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83624817-d833-4e79-ac53-62c5d874b979 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:18.402783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83624817-d833-4e79-ac53-62c5d874b979 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:18.403225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83624817-d833-4e79-ac53-62c5d874b979 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:18.600021 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-83624817-d833-4e79-ac53-62c5d874b979 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:18.602344 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:18.606951 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2baf4382-82be-45a1-9997-a927fbfded9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:18.609129 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-83624817-d833-4e79-ac53-62c5d874b979 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.219104 Aug 10 13:02:18.611225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1406/2827] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:18 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:18.615513 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2baf4382-82be-45a1-9997-a927fbfded9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:18.618160 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2baf4382-82be-45a1-9997-a927fbfded9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:18.619382 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2baf4382-82be-45a1-9997-a927fbfded9c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.253347 Aug 10 13:02:18.619934 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1422/2828] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:18 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:02:18.898071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ac4c90c9-b22d-455d-97db-535c8ae2a456 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:18.898690 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ac4c90c9-b22d-455d-97db-535c8ae2a456 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:18.901072 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-46e505ab-23b8-4f9b-9b68-ba0572b20501 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:18.901763 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-46e505ab-23b8-4f9b-9b68-ba0572b20501 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:18.904748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac4c90c9-b22d-455d-97db-535c8ae2a456 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:18.905230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac4c90c9-b22d-455d-97db-535c8ae2a456 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:18.905669 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac4c90c9-b22d-455d-97db-535c8ae2a456 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:18.906364 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac4c90c9-b22d-455d-97db-535c8ae2a456 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:18.906822 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac4c90c9-b22d-455d-97db-535c8ae2a456 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:18.907275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac4c90c9-b22d-455d-97db-535c8ae2a456 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:18.908238 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46e505ab-23b8-4f9b-9b68-ba0572b20501 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:18.908712 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46e505ab-23b8-4f9b-9b68-ba0572b20501 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:18.909145 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46e505ab-23b8-4f9b-9b68-ba0572b20501 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:18.909830 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46e505ab-23b8-4f9b-9b68-ba0572b20501 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:18.910325 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46e505ab-23b8-4f9b-9b68-ba0572b20501 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:18.910715 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46e505ab-23b8-4f9b-9b68-ba0572b20501 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:19.099911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ac4c90c9-b22d-455d-97db-535c8ae2a456 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:19.104752 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-46e505ab-23b8-4f9b-9b68-ba0572b20501 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:19.108966 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ac4c90c9-b22d-455d-97db-535c8ae2a456 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.215316 Aug 10 13:02:19.109539 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1407/2829] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:18 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:19.112721 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-46e505ab-23b8-4f9b-9b68-ba0572b20501 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.215681 Aug 10 13:02:19.120309 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1423/2830] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:18 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:19.630954 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-18e97046-1a5e-42c0-a24b-ceeabfdaf9c7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:19.632240 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-18e97046-1a5e-42c0-a24b-ceeabfdaf9c7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:19.638862 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-18e97046-1a5e-42c0-a24b-ceeabfdaf9c7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:19.639376 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-18e97046-1a5e-42c0-a24b-ceeabfdaf9c7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:19.639807 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-18e97046-1a5e-42c0-a24b-ceeabfdaf9c7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:19.640489 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-18e97046-1a5e-42c0-a24b-ceeabfdaf9c7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:19.640934 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-18e97046-1a5e-42c0-a24b-ceeabfdaf9c7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:19.641353 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-18e97046-1a5e-42c0-a24b-ceeabfdaf9c7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:19.642252 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-253f7b1e-8a7a-402d-b519-6d4f378bc98a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:19.642894 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-253f7b1e-8a7a-402d-b519-6d4f378bc98a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:19.650087 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-253f7b1e-8a7a-402d-b519-6d4f378bc98a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:19.650558 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-253f7b1e-8a7a-402d-b519-6d4f378bc98a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:19.650978 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-253f7b1e-8a7a-402d-b519-6d4f378bc98a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:19.651694 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-253f7b1e-8a7a-402d-b519-6d4f378bc98a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:19.652139 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-253f7b1e-8a7a-402d-b519-6d4f378bc98a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:19.652556 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-253f7b1e-8a7a-402d-b519-6d4f378bc98a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:19.838230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-18e97046-1a5e-42c0-a24b-ceeabfdaf9c7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:19.841185 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-253f7b1e-8a7a-402d-b519-6d4f378bc98a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:19.846285 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-18e97046-1a5e-42c0-a24b-ceeabfdaf9c7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.219178 Aug 10 13:02:19.846859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1408/2831] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:19 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:19.849561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-253f7b1e-8a7a-402d-b519-6d4f378bc98a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:19.851060 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-253f7b1e-8a7a-402d-b519-6d4f378bc98a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:19.852253 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-253f7b1e-8a7a-402d-b519-6d4f378bc98a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.213972 Aug 10 13:02:19.852804 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1424/2832] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:19 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:20.129898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7350df32-e702-41d3-91ab-5cd86811aa58 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:20.130543 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7350df32-e702-41d3-91ab-5cd86811aa58 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:20.134163 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b1a74cae-a0f3-4b18-908b-cefa517ce197 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:20.134777 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b1a74cae-a0f3-4b18-908b-cefa517ce197 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:20.137125 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7350df32-e702-41d3-91ab-5cd86811aa58 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:20.137611 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7350df32-e702-41d3-91ab-5cd86811aa58 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:20.138051 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7350df32-e702-41d3-91ab-5cd86811aa58 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:20.138752 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7350df32-e702-41d3-91ab-5cd86811aa58 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:20.139223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7350df32-e702-41d3-91ab-5cd86811aa58 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:20.139651 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7350df32-e702-41d3-91ab-5cd86811aa58 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:20.141145 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1a74cae-a0f3-4b18-908b-cefa517ce197 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:20.141621 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1a74cae-a0f3-4b18-908b-cefa517ce197 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:20.142055 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1a74cae-a0f3-4b18-908b-cefa517ce197 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:20.142747 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1a74cae-a0f3-4b18-908b-cefa517ce197 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:20.144592 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1a74cae-a0f3-4b18-908b-cefa517ce197 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:20.144592 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1a74cae-a0f3-4b18-908b-cefa517ce197 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:20.336279 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b1a74cae-a0f3-4b18-908b-cefa517ce197 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:20.340248 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7350df32-e702-41d3-91ab-5cd86811aa58 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:20.344567 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b1a74cae-a0f3-4b18-908b-cefa517ce197 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.214947 Aug 10 13:02:20.345415 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1425/2833] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:20 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:20.348338 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7350df32-e702-41d3-91ab-5cd86811aa58 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.222386 Aug 10 13:02:20.348908 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1409/2834] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:20 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:20.867553 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-aad3cdf6-11e7-49b5-9e38-5b1d13d4e901 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:20.868098 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-aad3cdf6-11e7-49b5-9e38-5b1d13d4e901 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:20.874111 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aad3cdf6-11e7-49b5-9e38-5b1d13d4e901 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:20.874591 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aad3cdf6-11e7-49b5-9e38-5b1d13d4e901 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:20.875032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aad3cdf6-11e7-49b5-9e38-5b1d13d4e901 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:20.875349 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1ab12df0-d9e4-4a67-83b6-225f9cac0541 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:20.875792 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aad3cdf6-11e7-49b5-9e38-5b1d13d4e901 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:20.875961 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1ab12df0-d9e4-4a67-83b6-225f9cac0541 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:20.876253 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aad3cdf6-11e7-49b5-9e38-5b1d13d4e901 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:20.876678 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aad3cdf6-11e7-49b5-9e38-5b1d13d4e901 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:20.883081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1ab12df0-d9e4-4a67-83b6-225f9cac0541 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:20.883609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1ab12df0-d9e4-4a67-83b6-225f9cac0541 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:20.884060 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1ab12df0-d9e4-4a67-83b6-225f9cac0541 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:20.884754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1ab12df0-d9e4-4a67-83b6-225f9cac0541 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:20.885366 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1ab12df0-d9e4-4a67-83b6-225f9cac0541 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:20.885825 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1ab12df0-d9e4-4a67-83b6-225f9cac0541 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:21.076606 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-aad3cdf6-11e7-49b5-9e38-5b1d13d4e901 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:21.080651 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1ab12df0-d9e4-4a67-83b6-225f9cac0541 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:21.085370 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-aad3cdf6-11e7-49b5-9e38-5b1d13d4e901 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.221219 Aug 10 13:02:21.085949 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1426/2835] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:20 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:21.090138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1ab12df0-d9e4-4a67-83b6-225f9cac0541 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:21.091724 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1ab12df0-d9e4-4a67-83b6-225f9cac0541 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:21.092878 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1ab12df0-d9e4-4a67-83b6-225f9cac0541 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.221496 Aug 10 13:02:21.093432 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1410/2836] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:20 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:21.368580 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ab124a82-73de-4284-8cf5-d3a10b0c5e99 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:21.369332 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ab124a82-73de-4284-8cf5-d3a10b0c5e99 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:21.370604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e33debda-f282-4896-ba45-3760c90b7292 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:21.371231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e33debda-f282-4896-ba45-3760c90b7292 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:21.375657 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab124a82-73de-4284-8cf5-d3a10b0c5e99 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:21.376026 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab124a82-73de-4284-8cf5-d3a10b0c5e99 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:21.376452 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab124a82-73de-4284-8cf5-d3a10b0c5e99 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:21.377120 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e33debda-f282-4896-ba45-3760c90b7292 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:21.377253 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab124a82-73de-4284-8cf5-d3a10b0c5e99 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:21.377563 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab124a82-73de-4284-8cf5-d3a10b0c5e99 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:21.377685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e33debda-f282-4896-ba45-3760c90b7292 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:21.377982 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ab124a82-73de-4284-8cf5-d3a10b0c5e99 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:21.378111 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e33debda-f282-4896-ba45-3760c90b7292 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:21.378667 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e33debda-f282-4896-ba45-3760c90b7292 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:21.379114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e33debda-f282-4896-ba45-3760c90b7292 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:21.379557 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e33debda-f282-4896-ba45-3760c90b7292 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:21.567247 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ab124a82-73de-4284-8cf5-d3a10b0c5e99 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:21.574878 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e33debda-f282-4896-ba45-3760c90b7292 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:21.575976 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ab124a82-73de-4284-8cf5-d3a10b0c5e99 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.211774 Aug 10 13:02:21.576557 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1427/2837] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:21 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:21.582882 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e33debda-f282-4896-ba45-3760c90b7292 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.217172 Aug 10 13:02:21.583478 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1411/2838] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:21 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:22.105923 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2ac8c6e1-c90b-4a30-b21c-982ef9d9e9d6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:22.106530 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2ac8c6e1-c90b-4a30-b21c-982ef9d9e9d6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:22.112482 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2ac8c6e1-c90b-4a30-b21c-982ef9d9e9d6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:22.112952 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2ac8c6e1-c90b-4a30-b21c-982ef9d9e9d6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:22.113378 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2ac8c6e1-c90b-4a30-b21c-982ef9d9e9d6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:22.114057 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2ac8c6e1-c90b-4a30-b21c-982ef9d9e9d6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:22.114502 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2ac8c6e1-c90b-4a30-b21c-982ef9d9e9d6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:22.114951 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2ac8c6e1-c90b-4a30-b21c-982ef9d9e9d6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:22.116201 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-579c8a9f-5d01-478c-95c9-7f427b60b76f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:22.116806 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-579c8a9f-5d01-478c-95c9-7f427b60b76f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:22.123250 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-579c8a9f-5d01-478c-95c9-7f427b60b76f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:22.123730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-579c8a9f-5d01-478c-95c9-7f427b60b76f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:22.124157 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-579c8a9f-5d01-478c-95c9-7f427b60b76f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:22.124844 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-579c8a9f-5d01-478c-95c9-7f427b60b76f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:22.125286 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-579c8a9f-5d01-478c-95c9-7f427b60b76f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:22.125703 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-579c8a9f-5d01-478c-95c9-7f427b60b76f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:22.314416 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-579c8a9f-5d01-478c-95c9-7f427b60b76f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:22.317237 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2ac8c6e1-c90b-4a30-b21c-982ef9d9e9d6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:22.323789 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-579c8a9f-5d01-478c-95c9-7f427b60b76f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:22.325472 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-579c8a9f-5d01-478c-95c9-7f427b60b76f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:22.326636 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-579c8a9f-5d01-478c-95c9-7f427b60b76f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.214891 Aug 10 13:02:22.327493 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2ac8c6e1-c90b-4a30-b21c-982ef9d9e9d6 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.225332 Aug 10 13:02:22.327658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1412/2839] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:22 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:22.327790 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1428/2840] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:22 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:22.597812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f51468c5-de89-4b01-9291-02320183ead0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:22.598427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f51468c5-de89-4b01-9291-02320183ead0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:22.604487 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8a50776f-a818-469f-9702-e68967561322 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:22.605102 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8a50776f-a818-469f-9702-e68967561322 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:22.605259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f51468c5-de89-4b01-9291-02320183ead0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:22.605692 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f51468c5-de89-4b01-9291-02320183ead0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:22.606128 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f51468c5-de89-4b01-9291-02320183ead0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:22.606872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f51468c5-de89-4b01-9291-02320183ead0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:22.607297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f51468c5-de89-4b01-9291-02320183ead0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:22.607723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f51468c5-de89-4b01-9291-02320183ead0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:22.611497 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a50776f-a818-469f-9702-e68967561322 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:22.611943 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a50776f-a818-469f-9702-e68967561322 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:22.612372 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a50776f-a818-469f-9702-e68967561322 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:22.613066 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a50776f-a818-469f-9702-e68967561322 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:22.613519 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a50776f-a818-469f-9702-e68967561322 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:22.613950 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a50776f-a818-469f-9702-e68967561322 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:22.806299 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-8a50776f-a818-469f-9702-e68967561322 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:22.810104 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f51468c5-de89-4b01-9291-02320183ead0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:22.814624 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8a50776f-a818-469f-9702-e68967561322 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.214767 Aug 10 13:02:22.815292 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1429/2841] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:22 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:22.818065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f51468c5-de89-4b01-9291-02320183ead0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.224092 Aug 10 13:02:22.818631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1413/2842] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:22 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:23.350595 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ce42542b-e76a-4be3-86d4-911cb2874413 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:23.351255 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ce42542b-e76a-4be3-86d4-911cb2874413 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:23.357564 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce42542b-e76a-4be3-86d4-911cb2874413 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:23.358599 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce42542b-e76a-4be3-86d4-911cb2874413 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:23.358599 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce42542b-e76a-4be3-86d4-911cb2874413 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:23.359152 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce42542b-e76a-4be3-86d4-911cb2874413 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:23.359625 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce42542b-e76a-4be3-86d4-911cb2874413 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:23.360051 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce42542b-e76a-4be3-86d4-911cb2874413 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:23.361731 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-218850b3-3a46-4069-b6de-a85d197e75a0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:23.362436 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-218850b3-3a46-4069-b6de-a85d197e75a0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:23.370502 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-218850b3-3a46-4069-b6de-a85d197e75a0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:23.370993 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-218850b3-3a46-4069-b6de-a85d197e75a0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:23.371452 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-218850b3-3a46-4069-b6de-a85d197e75a0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:23.372155 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-218850b3-3a46-4069-b6de-a85d197e75a0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:23.372599 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-218850b3-3a46-4069-b6de-a85d197e75a0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:23.373019 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-218850b3-3a46-4069-b6de-a85d197e75a0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:23.561410 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ce42542b-e76a-4be3-86d4-911cb2874413 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:23.569336 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-218850b3-3a46-4069-b6de-a85d197e75a0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:23.570844 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ce42542b-e76a-4be3-86d4-911cb2874413 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:23.572390 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ce42542b-e76a-4be3-86d4-911cb2874413 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:23.573558 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ce42542b-e76a-4be3-86d4-911cb2874413 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.226946 Aug 10 13:02:23.583250 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1430/2843] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:23 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:02:23.583387 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-218850b3-3a46-4069-b6de-a85d197e75a0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.219822 Aug 10 13:02:23.583387 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1414/2844] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:23 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:23.835776 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-dc2f3319-1acb-45c0-b605-7802df99abb0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:23.836326 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-dc2f3319-1acb-45c0-b605-7802df99abb0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:23.839184 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f3acec4c-eb99-47e5-8f04-5c1fbba7fcca tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:23.839823 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f3acec4c-eb99-47e5-8f04-5c1fbba7fcca tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:23.842810 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc2f3319-1acb-45c0-b605-7802df99abb0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:23.843321 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc2f3319-1acb-45c0-b605-7802df99abb0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:23.843757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc2f3319-1acb-45c0-b605-7802df99abb0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:23.844447 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc2f3319-1acb-45c0-b605-7802df99abb0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:23.844896 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc2f3319-1acb-45c0-b605-7802df99abb0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:23.845316 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dc2f3319-1acb-45c0-b605-7802df99abb0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:23.845709 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3acec4c-eb99-47e5-8f04-5c1fbba7fcca tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:23.846191 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3acec4c-eb99-47e5-8f04-5c1fbba7fcca tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:23.846630 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3acec4c-eb99-47e5-8f04-5c1fbba7fcca tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:23.847343 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3acec4c-eb99-47e5-8f04-5c1fbba7fcca tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:23.847799 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3acec4c-eb99-47e5-8f04-5c1fbba7fcca tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:23.848226 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3acec4c-eb99-47e5-8f04-5c1fbba7fcca tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:24.034401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-dc2f3319-1acb-45c0-b605-7802df99abb0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:24.041665 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f3acec4c-eb99-47e5-8f04-5c1fbba7fcca tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:24.042853 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-dc2f3319-1acb-45c0-b605-7802df99abb0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.210943 Aug 10 13:02:24.043651 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1431/2845] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:23 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:24.049868 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f3acec4c-eb99-47e5-8f04-5c1fbba7fcca tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.214454 Aug 10 13:02:24.050424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1415/2846] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:23 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:24.603611 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-02c2e18b-d09f-49e4-a9e0-a92832a7a91e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:24.604493 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-02c2e18b-d09f-49e4-a9e0-a92832a7a91e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:24.606041 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-eab941c7-2915-4603-a376-cd00d4028f61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:24.606647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-eab941c7-2915-4603-a376-cd00d4028f61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:24.610578 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-02c2e18b-d09f-49e4-a9e0-a92832a7a91e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:24.611058 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-02c2e18b-d09f-49e4-a9e0-a92832a7a91e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:24.611526 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-02c2e18b-d09f-49e4-a9e0-a92832a7a91e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:24.612220 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-02c2e18b-d09f-49e4-a9e0-a92832a7a91e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:24.612672 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-02c2e18b-d09f-49e4-a9e0-a92832a7a91e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:24.613099 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-02c2e18b-d09f-49e4-a9e0-a92832a7a91e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:24.613235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eab941c7-2915-4603-a376-cd00d4028f61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:24.613654 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eab941c7-2915-4603-a376-cd00d4028f61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:24.614079 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eab941c7-2915-4603-a376-cd00d4028f61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:24.614754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eab941c7-2915-4603-a376-cd00d4028f61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:24.615223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eab941c7-2915-4603-a376-cd00d4028f61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:24.616183 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eab941c7-2915-4603-a376-cd00d4028f61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:24.805268 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-02c2e18b-d09f-49e4-a9e0-a92832a7a91e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:24.809171 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-eab941c7-2915-4603-a376-cd00d4028f61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:24.813501 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-02c2e18b-d09f-49e4-a9e0-a92832a7a91e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.214569 Aug 10 13:02:24.814082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1432/2847] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:24 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:24.817405 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-eab941c7-2915-4603-a376-cd00d4028f61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:24.819439 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-eab941c7-2915-4603-a376-cd00d4028f61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:24.820571 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-eab941c7-2915-4603-a376-cd00d4028f61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.218674 Aug 10 13:02:24.821121 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1416/2848] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:24 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:25.064132 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-913fd793-acd9-4afe-be16-11990ca00a31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:25.064721 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-913fd793-acd9-4afe-be16-11990ca00a31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:25.071142 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-913fd793-acd9-4afe-be16-11990ca00a31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:25.071646 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-913fd793-acd9-4afe-be16-11990ca00a31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:25.071941 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fd979b69-c02a-4dba-8675-39d291094e9c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:25.072390 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-913fd793-acd9-4afe-be16-11990ca00a31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:25.072548 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fd979b69-c02a-4dba-8675-39d291094e9c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:25.072750 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-913fd793-acd9-4afe-be16-11990ca00a31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:25.073194 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-913fd793-acd9-4afe-be16-11990ca00a31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:25.073623 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-913fd793-acd9-4afe-be16-11990ca00a31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:25.079124 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fd979b69-c02a-4dba-8675-39d291094e9c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:25.079638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fd979b69-c02a-4dba-8675-39d291094e9c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:25.080074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fd979b69-c02a-4dba-8675-39d291094e9c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:25.080762 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fd979b69-c02a-4dba-8675-39d291094e9c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:25.081211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fd979b69-c02a-4dba-8675-39d291094e9c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:25.081633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fd979b69-c02a-4dba-8675-39d291094e9c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:25.271186 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-913fd793-acd9-4afe-be16-11990ca00a31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:25.274799 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fd979b69-c02a-4dba-8675-39d291094e9c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:25.279922 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-913fd793-acd9-4afe-be16-11990ca00a31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.219527 Aug 10 13:02:25.280817 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1433/2849] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:25 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:25.283170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fd979b69-c02a-4dba-8675-39d291094e9c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.214865 Aug 10 13:02:25.287219 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1417/2850] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:25 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:25.836249 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b65fedc0-de81-4c04-b0c5-934bd4430a4a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:25.836860 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b65fedc0-de81-4c04-b0c5-934bd4430a4a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:25.842772 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b65fedc0-de81-4c04-b0c5-934bd4430a4a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:25.843277 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b65fedc0-de81-4c04-b0c5-934bd4430a4a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:25.843431 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-226ac69a-1985-4794-9657-a48d523b8116 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:25.843710 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b65fedc0-de81-4c04-b0c5-934bd4430a4a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:25.844015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-226ac69a-1985-4794-9657-a48d523b8116 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:25.844389 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b65fedc0-de81-4c04-b0c5-934bd4430a4a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:25.844861 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b65fedc0-de81-4c04-b0c5-934bd4430a4a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:25.845279 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b65fedc0-de81-4c04-b0c5-934bd4430a4a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:25.850996 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-226ac69a-1985-4794-9657-a48d523b8116 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:25.851515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-226ac69a-1985-4794-9657-a48d523b8116 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:25.851941 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-226ac69a-1985-4794-9657-a48d523b8116 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:25.852622 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-226ac69a-1985-4794-9657-a48d523b8116 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:25.853062 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-226ac69a-1985-4794-9657-a48d523b8116 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:25.853479 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-226ac69a-1985-4794-9657-a48d523b8116 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:25.861389 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:26.041972 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b65fedc0-de81-4c04-b0c5-934bd4430a4a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:26.045040 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-226ac69a-1985-4794-9657-a48d523b8116 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:26.050102 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b65fedc0-de81-4c04-b0c5-934bd4430a4a tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.218650 Aug 10 13:02:26.050682 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1434/2851] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:25 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:26.053516 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-226ac69a-1985-4794-9657-a48d523b8116 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:26.055306 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-226ac69a-1985-4794-9657-a48d523b8116 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:26.056458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-226ac69a-1985-4794-9657-a48d523b8116 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.217012 Aug 10 13:02:26.057147 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1418/2852] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:25 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:26.301235 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-131fd716-80d4-40b7-8f10-95eeaa89ece5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:26.301850 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-131fd716-80d4-40b7-8f10-95eeaa89ece5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:26.305147 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-63e567be-cee3-41d4-b096-200ac95d6931 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:26.305755 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-63e567be-cee3-41d4-b096-200ac95d6931 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:26.308362 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-131fd716-80d4-40b7-8f10-95eeaa89ece5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:26.308843 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-131fd716-80d4-40b7-8f10-95eeaa89ece5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:26.309277 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-131fd716-80d4-40b7-8f10-95eeaa89ece5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:26.309964 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-131fd716-80d4-40b7-8f10-95eeaa89ece5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:26.310414 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-131fd716-80d4-40b7-8f10-95eeaa89ece5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:26.310841 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-131fd716-80d4-40b7-8f10-95eeaa89ece5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:26.311591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-63e567be-cee3-41d4-b096-200ac95d6931 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:26.312065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-63e567be-cee3-41d4-b096-200ac95d6931 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:26.312495 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-63e567be-cee3-41d4-b096-200ac95d6931 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:26.313171 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-63e567be-cee3-41d4-b096-200ac95d6931 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:26.313612 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-63e567be-cee3-41d4-b096-200ac95d6931 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:26.314029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-63e567be-cee3-41d4-b096-200ac95d6931 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:26.507024 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-131fd716-80d4-40b7-8f10-95eeaa89ece5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:26.511543 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-63e567be-cee3-41d4-b096-200ac95d6931 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:26.515147 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-131fd716-80d4-40b7-8f10-95eeaa89ece5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.217849 Aug 10 13:02:26.515741 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1435/2853] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:26 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:26.519705 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-63e567be-cee3-41d4-b096-200ac95d6931 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.218803 Aug 10 13:02:26.520262 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1419/2854] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:26 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:27.071664 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1bb71d90-022c-4184-aae3-03ac90817d84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:27.072300 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1bb71d90-022c-4184-aae3-03ac90817d84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:27.078641 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1bb71d90-022c-4184-aae3-03ac90817d84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:27.078982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-707230f3-0c35-487d-887d-590bcc736345 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:27.079123 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1bb71d90-022c-4184-aae3-03ac90817d84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:27.079558 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1bb71d90-022c-4184-aae3-03ac90817d84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:27.079697 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-707230f3-0c35-487d-887d-590bcc736345 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:27.080242 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1bb71d90-022c-4184-aae3-03ac90817d84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:27.080686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1bb71d90-022c-4184-aae3-03ac90817d84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:27.081103 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1bb71d90-022c-4184-aae3-03ac90817d84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:27.086443 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-707230f3-0c35-487d-887d-590bcc736345 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:27.086918 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-707230f3-0c35-487d-887d-590bcc736345 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:27.087385 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-707230f3-0c35-487d-887d-590bcc736345 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:27.088066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-707230f3-0c35-487d-887d-590bcc736345 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:27.088518 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-707230f3-0c35-487d-887d-590bcc736345 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:27.088933 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-707230f3-0c35-487d-887d-590bcc736345 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:27.278554 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-707230f3-0c35-487d-887d-590bcc736345 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:27.281896 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-1bb71d90-022c-4184-aae3-03ac90817d84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:27.287070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-707230f3-0c35-487d-887d-590bcc736345 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:27.289363 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-707230f3-0c35-487d-887d-590bcc736345 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:27.290614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-707230f3-0c35-487d-887d-590bcc736345 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.215535 Aug 10 13:02:27.290739 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1bb71d90-022c-4184-aae3-03ac90817d84 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.223065 Aug 10 13:02:27.291257 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1436/2855] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:27 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:27.292031 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1420/2856] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:27 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:02:27.536963 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6915ee17-d4e8-48fd-b908-ecb490405f8e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:27.538218 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6915ee17-d4e8-48fd-b908-ecb490405f8e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:27.541677 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b5f15b1b-133f-4036-9b6e-363161f2a91c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:27.542287 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b5f15b1b-133f-4036-9b6e-363161f2a91c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:27.544614 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6915ee17-d4e8-48fd-b908-ecb490405f8e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:27.545093 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6915ee17-d4e8-48fd-b908-ecb490405f8e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:27.545531 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6915ee17-d4e8-48fd-b908-ecb490405f8e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:27.546218 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6915ee17-d4e8-48fd-b908-ecb490405f8e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:27.546702 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6915ee17-d4e8-48fd-b908-ecb490405f8e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:27.547203 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6915ee17-d4e8-48fd-b908-ecb490405f8e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:27.548301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b5f15b1b-133f-4036-9b6e-363161f2a91c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:27.548776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b5f15b1b-133f-4036-9b6e-363161f2a91c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:27.549207 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b5f15b1b-133f-4036-9b6e-363161f2a91c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:27.549883 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b5f15b1b-133f-4036-9b6e-363161f2a91c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:27.550325 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b5f15b1b-133f-4036-9b6e-363161f2a91c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:27.550740 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b5f15b1b-133f-4036-9b6e-363161f2a91c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:27.750626 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6915ee17-d4e8-48fd-b908-ecb490405f8e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:27.752716 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b5f15b1b-133f-4036-9b6e-363161f2a91c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:27.757824 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6915ee17-d4e8-48fd-b908-ecb490405f8e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.224517 Aug 10 13:02:27.758402 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1437/2857] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:27 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:27.761433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b5f15b1b-133f-4036-9b6e-363161f2a91c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.224280 Aug 10 13:02:27.762009 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1421/2858] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:27 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:28.312034 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-54b71320-386d-46f7-b4fa-1de36437c5ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:28.312651 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-54b71320-386d-46f7-b4fa-1de36437c5ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:28.313212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5f77efe8-b969-43ac-b7e3-2605b9b4f1b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:28.313815 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5f77efe8-b969-43ac-b7e3-2605b9b4f1b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:28.318868 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54b71320-386d-46f7-b4fa-1de36437c5ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:28.319546 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54b71320-386d-46f7-b4fa-1de36437c5ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:28.319989 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54b71320-386d-46f7-b4fa-1de36437c5ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:28.320126 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5f77efe8-b969-43ac-b7e3-2605b9b4f1b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:28.320593 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5f77efe8-b969-43ac-b7e3-2605b9b4f1b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:28.320723 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54b71320-386d-46f7-b4fa-1de36437c5ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:28.321034 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5f77efe8-b969-43ac-b7e3-2605b9b4f1b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:28.321144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54b71320-386d-46f7-b4fa-1de36437c5ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:28.321529 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-54b71320-386d-46f7-b4fa-1de36437c5ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:28.321698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5f77efe8-b969-43ac-b7e3-2605b9b4f1b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:28.322138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5f77efe8-b969-43ac-b7e3-2605b9b4f1b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:28.322554 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5f77efe8-b969-43ac-b7e3-2605b9b4f1b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:28.517215 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-54b71320-386d-46f7-b4fa-1de36437c5ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:28.520007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5f77efe8-b969-43ac-b7e3-2605b9b4f1b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:28.525899 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-54b71320-386d-46f7-b4fa-1de36437c5ad tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.217831 Aug 10 13:02:28.526476 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1438/2859] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:28 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:28.529358 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5f77efe8-b969-43ac-b7e3-2605b9b4f1b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:28.530887 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5f77efe8-b969-43ac-b7e3-2605b9b4f1b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:28.532059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5f77efe8-b969-43ac-b7e3-2605b9b4f1b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.222862 Aug 10 13:02:28.532614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1422/2860] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:28 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:28.778926 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-766aeccc-bb13-4fe3-8f66-5be704289670 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:28.779642 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-766aeccc-bb13-4fe3-8f66-5be704289670 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:28.783368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a7005e3c-54bf-44f7-b1c3-cece4e6d2029 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:28.783875 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a7005e3c-54bf-44f7-b1c3-cece4e6d2029 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:28.786032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-766aeccc-bb13-4fe3-8f66-5be704289670 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:28.786510 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-766aeccc-bb13-4fe3-8f66-5be704289670 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:28.786942 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-766aeccc-bb13-4fe3-8f66-5be704289670 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:28.787906 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-766aeccc-bb13-4fe3-8f66-5be704289670 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:28.788426 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-766aeccc-bb13-4fe3-8f66-5be704289670 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:28.788658 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-766aeccc-bb13-4fe3-8f66-5be704289670 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:28.789912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a7005e3c-54bf-44f7-b1c3-cece4e6d2029 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:28.790399 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a7005e3c-54bf-44f7-b1c3-cece4e6d2029 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:28.790837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a7005e3c-54bf-44f7-b1c3-cece4e6d2029 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:28.791558 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a7005e3c-54bf-44f7-b1c3-cece4e6d2029 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:28.792012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a7005e3c-54bf-44f7-b1c3-cece4e6d2029 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:28.792438 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a7005e3c-54bf-44f7-b1c3-cece4e6d2029 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:28.807707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:28.985642 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-766aeccc-bb13-4fe3-8f66-5be704289670 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:28.988629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a7005e3c-54bf-44f7-b1c3-cece4e6d2029 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:28.994513 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-766aeccc-bb13-4fe3-8f66-5be704289670 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.219356 Aug 10 13:02:28.995105 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1439/2861] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:28 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:28.997110 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a7005e3c-54bf-44f7-b1c3-cece4e6d2029 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.217818 Aug 10 13:02:28.997665 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1423/2862] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:28 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:29.547015 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b1b249a2-337e-4a32-b81c-0417f11330f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:29.548986 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b1b249a2-337e-4a32-b81c-0417f11330f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:29.553614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4d22f288-1dd9-491a-b7ef-caa9742a9f01 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:29.554237 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4d22f288-1dd9-491a-b7ef-caa9742a9f01 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:29.555026 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1b249a2-337e-4a32-b81c-0417f11330f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:29.555539 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1b249a2-337e-4a32-b81c-0417f11330f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:29.555973 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1b249a2-337e-4a32-b81c-0417f11330f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:29.556663 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1b249a2-337e-4a32-b81c-0417f11330f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:29.557114 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1b249a2-337e-4a32-b81c-0417f11330f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:29.557564 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1b249a2-337e-4a32-b81c-0417f11330f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:29.560275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d22f288-1dd9-491a-b7ef-caa9742a9f01 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:29.560740 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d22f288-1dd9-491a-b7ef-caa9742a9f01 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:29.561173 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d22f288-1dd9-491a-b7ef-caa9742a9f01 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:29.561867 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d22f288-1dd9-491a-b7ef-caa9742a9f01 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:29.562321 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d22f288-1dd9-491a-b7ef-caa9742a9f01 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:29.562746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d22f288-1dd9-491a-b7ef-caa9742a9f01 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:29.751434 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b1b249a2-337e-4a32-b81c-0417f11330f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:29.755683 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4d22f288-1dd9-491a-b7ef-caa9742a9f01 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:29.761023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b1b249a2-337e-4a32-b81c-0417f11330f2 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.217873 Aug 10 13:02:29.761783 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1440/2863] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:29 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:29.769920 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4d22f288-1dd9-491a-b7ef-caa9742a9f01 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:29.771439 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4d22f288-1dd9-491a-b7ef-caa9742a9f01 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:29.773802 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4d22f288-1dd9-491a-b7ef-caa9742a9f01 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.224002 Aug 10 13:02:29.774540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1424/2864] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:29 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:30.017152 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-293bd939-8cad-4885-915f-cdcb274459e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:30.017776 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-293bd939-8cad-4885-915f-cdcb274459e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:30.018520 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-28907e81-3517-4124-9b17-68a87c8047c8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:30.019203 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-28907e81-3517-4124-9b17-68a87c8047c8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:30.024863 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-293bd939-8cad-4885-915f-cdcb274459e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:30.025341 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-293bd939-8cad-4885-915f-cdcb274459e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:30.025774 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-293bd939-8cad-4885-915f-cdcb274459e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:30.026461 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-293bd939-8cad-4885-915f-cdcb274459e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:30.026573 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28907e81-3517-4124-9b17-68a87c8047c8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:30.026911 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-293bd939-8cad-4885-915f-cdcb274459e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:30.027027 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28907e81-3517-4124-9b17-68a87c8047c8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:30.027362 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-293bd939-8cad-4885-915f-cdcb274459e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:30.027486 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28907e81-3517-4124-9b17-68a87c8047c8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:30.028077 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28907e81-3517-4124-9b17-68a87c8047c8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:30.028529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28907e81-3517-4124-9b17-68a87c8047c8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:30.028945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-28907e81-3517-4124-9b17-68a87c8047c8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:30.231229 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-28907e81-3517-4124-9b17-68a87c8047c8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:30.234476 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-293bd939-8cad-4885-915f-cdcb274459e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:30.239812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-28907e81-3517-4124-9b17-68a87c8047c8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.224969 Aug 10 13:02:30.240393 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1425/2865] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:30 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:30.243118 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-293bd939-8cad-4885-915f-cdcb274459e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.229790 Aug 10 13:02:30.243713 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1441/2866] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:30 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:30.781692 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8bded6de-161d-4e4a-9fcc-74bc44fb0a13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:30.782461 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8bded6de-161d-4e4a-9fcc-74bc44fb0a13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:30.789262 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8bded6de-161d-4e4a-9fcc-74bc44fb0a13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:30.789744 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8bded6de-161d-4e4a-9fcc-74bc44fb0a13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:30.790169 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8bded6de-161d-4e4a-9fcc-74bc44fb0a13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:30.792410 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8bded6de-161d-4e4a-9fcc-74bc44fb0a13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:30.792860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8bded6de-161d-4e4a-9fcc-74bc44fb0a13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:30.793287 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8bded6de-161d-4e4a-9fcc-74bc44fb0a13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:30.796689 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3e76ed7a-413c-4e64-aca2-366641fb0107 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:30.798327 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3e76ed7a-413c-4e64-aca2-366641fb0107 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:30.803561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e76ed7a-413c-4e64-aca2-366641fb0107 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:30.804060 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e76ed7a-413c-4e64-aca2-366641fb0107 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:30.804495 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e76ed7a-413c-4e64-aca2-366641fb0107 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:30.805195 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e76ed7a-413c-4e64-aca2-366641fb0107 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:30.805650 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e76ed7a-413c-4e64-aca2-366641fb0107 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:30.806071 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3e76ed7a-413c-4e64-aca2-366641fb0107 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:30.995442 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8bded6de-161d-4e4a-9fcc-74bc44fb0a13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:30.998424 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3e76ed7a-413c-4e64-aca2-366641fb0107 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:31.003505 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8bded6de-161d-4e4a-9fcc-74bc44fb0a13 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.225707 Aug 10 13:02:31.004097 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1426/2867] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:30 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:31.007607 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3e76ed7a-413c-4e64-aca2-366641fb0107 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:31.009149 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3e76ed7a-413c-4e64-aca2-366641fb0107 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:31.010295 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3e76ed7a-413c-4e64-aca2-366641fb0107 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.217457 Aug 10 13:02:31.010871 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1442/2868] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:30 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:02:31.262117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-90bba4d2-14d0-4687-8bb7-9418dd68b21c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:31.262721 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-90bba4d2-14d0-4687-8bb7-9418dd68b21c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:31.264712 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d106ae35-fb78-4cc8-a254-fa75ab42c5a4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:31.265164 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=98 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:31.265399 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d106ae35-fb78-4cc8-a254-fa75ab42c5a4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:31.269510 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90bba4d2-14d0-4687-8bb7-9418dd68b21c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:31.269988 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90bba4d2-14d0-4687-8bb7-9418dd68b21c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:31.270419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90bba4d2-14d0-4687-8bb7-9418dd68b21c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:31.271103 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90bba4d2-14d0-4687-8bb7-9418dd68b21c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:31.271572 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90bba4d2-14d0-4687-8bb7-9418dd68b21c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:31.271766 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d106ae35-fb78-4cc8-a254-fa75ab42c5a4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:31.272047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90bba4d2-14d0-4687-8bb7-9418dd68b21c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:31.272750 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d106ae35-fb78-4cc8-a254-fa75ab42c5a4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:31.273500 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d106ae35-fb78-4cc8-a254-fa75ab42c5a4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:31.274516 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d106ae35-fb78-4cc8-a254-fa75ab42c5a4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:31.274974 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d106ae35-fb78-4cc8-a254-fa75ab42c5a4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:31.275474 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d106ae35-fb78-4cc8-a254-fa75ab42c5a4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:31.464661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-90bba4d2-14d0-4687-8bb7-9418dd68b21c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:31.468776 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d106ae35-fb78-4cc8-a254-fa75ab42c5a4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:31.472811 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-90bba4d2-14d0-4687-8bb7-9418dd68b21c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.215165 Aug 10 13:02:31.473398 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1427/2869] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:31 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:31.477236 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d106ae35-fb78-4cc8-a254-fa75ab42c5a4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.216722 Aug 10 13:02:31.477807 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1443/2870] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:31 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:32.025232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-15ba1484-4a2a-492b-82af-82ae48254704 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:32.025838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-15ba1484-4a2a-492b-82af-82ae48254704 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:32.032340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-15ba1484-4a2a-492b-82af-82ae48254704 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:32.032639 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9cd92fa6-1819-410c-9674-300999ffd912 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:32.032816 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-15ba1484-4a2a-492b-82af-82ae48254704 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:32.033245 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-15ba1484-4a2a-492b-82af-82ae48254704 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:32.033363 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9cd92fa6-1819-410c-9674-300999ffd912 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:32.033933 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-15ba1484-4a2a-492b-82af-82ae48254704 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:32.034372 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-15ba1484-4a2a-492b-82af-82ae48254704 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:32.034946 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-15ba1484-4a2a-492b-82af-82ae48254704 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:32.039835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9cd92fa6-1819-410c-9674-300999ffd912 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:32.040310 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9cd92fa6-1819-410c-9674-300999ffd912 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:32.040742 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9cd92fa6-1819-410c-9674-300999ffd912 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:32.041432 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9cd92fa6-1819-410c-9674-300999ffd912 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:32.041894 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9cd92fa6-1819-410c-9674-300999ffd912 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:32.042296 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9cd92fa6-1819-410c-9674-300999ffd912 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:32.227460 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-15ba1484-4a2a-492b-82af-82ae48254704 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:32.230530 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9cd92fa6-1819-410c-9674-300999ffd912 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:32.235768 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-15ba1484-4a2a-492b-82af-82ae48254704 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.215288 Aug 10 13:02:32.236349 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1428/2871] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:32 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:32.238881 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9cd92fa6-1819-410c-9674-300999ffd912 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:32.240434 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9cd92fa6-1819-410c-9674-300999ffd912 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:32.241580 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9cd92fa6-1819-410c-9674-300999ffd912 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.212853 Aug 10 13:02:32.242128 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1444/2872] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:32 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:32.496098 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5e06d408-88d2-4fea-a513-f85b47874987 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:32.496643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5e06d408-88d2-4fea-a513-f85b47874987 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:32.497488 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-dafe5a7a-f9e6-4bbc-9a7a-649d8bd7e7e0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:32.498100 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-dafe5a7a-f9e6-4bbc-9a7a-649d8bd7e7e0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:32.502676 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e06d408-88d2-4fea-a513-f85b47874987 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:32.503164 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e06d408-88d2-4fea-a513-f85b47874987 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:32.503619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e06d408-88d2-4fea-a513-f85b47874987 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:32.504309 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e06d408-88d2-4fea-a513-f85b47874987 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:32.504423 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dafe5a7a-f9e6-4bbc-9a7a-649d8bd7e7e0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:32.504757 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e06d408-88d2-4fea-a513-f85b47874987 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:32.504899 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dafe5a7a-f9e6-4bbc-9a7a-649d8bd7e7e0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:32.505178 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e06d408-88d2-4fea-a513-f85b47874987 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:32.505361 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dafe5a7a-f9e6-4bbc-9a7a-649d8bd7e7e0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:32.506041 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dafe5a7a-f9e6-4bbc-9a7a-649d8bd7e7e0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:32.507618 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dafe5a7a-f9e6-4bbc-9a7a-649d8bd7e7e0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:32.508057 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dafe5a7a-f9e6-4bbc-9a7a-649d8bd7e7e0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:32.702665 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5e06d408-88d2-4fea-a513-f85b47874987 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:32.706702 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-dafe5a7a-f9e6-4bbc-9a7a-649d8bd7e7e0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:32.711413 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5e06d408-88d2-4fea-a513-f85b47874987 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.219055 Aug 10 13:02:32.712005 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1429/2873] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:32 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:32.714711 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-dafe5a7a-f9e6-4bbc-9a7a-649d8bd7e7e0 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.220907 Aug 10 13:02:32.715311 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1445/2874] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:32 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:33.256729 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4ba5801f-8c36-4864-87f7-b4ebabed7f88 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:33.257357 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4ba5801f-8c36-4864-87f7-b4ebabed7f88 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:33.263857 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ba5801f-8c36-4864-87f7-b4ebabed7f88 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:33.264330 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ba5801f-8c36-4864-87f7-b4ebabed7f88 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:33.264516 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-476614ad-5a65-4db5-b40d-dd91afdee1cf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:33.264757 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ba5801f-8c36-4864-87f7-b4ebabed7f88 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:33.265129 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-476614ad-5a65-4db5-b40d-dd91afdee1cf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:33.265440 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ba5801f-8c36-4864-87f7-b4ebabed7f88 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:33.265888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ba5801f-8c36-4864-87f7-b4ebabed7f88 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:33.266305 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ba5801f-8c36-4864-87f7-b4ebabed7f88 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:33.270940 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-476614ad-5a65-4db5-b40d-dd91afdee1cf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:33.271436 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-476614ad-5a65-4db5-b40d-dd91afdee1cf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:33.272496 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-476614ad-5a65-4db5-b40d-dd91afdee1cf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:33.273199 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-476614ad-5a65-4db5-b40d-dd91afdee1cf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:33.273657 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-476614ad-5a65-4db5-b40d-dd91afdee1cf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:33.274089 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-476614ad-5a65-4db5-b40d-dd91afdee1cf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:33.453440 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4ba5801f-8c36-4864-87f7-b4ebabed7f88 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:33.461888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4ba5801f-8c36-4864-87f7-b4ebabed7f88 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.208993 Aug 10 13:02:33.462653 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1430/2875] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:33 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:33.465446 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-476614ad-5a65-4db5-b40d-dd91afdee1cf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:33.473898 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-476614ad-5a65-4db5-b40d-dd91afdee1cf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:33.476097 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-476614ad-5a65-4db5-b40d-dd91afdee1cf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:33.477242 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-476614ad-5a65-4db5-b40d-dd91afdee1cf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.216556 Aug 10 13:02:33.477799 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1446/2876] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:33 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:33.732732 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d438b32d-7acb-4286-b032-f54c350e4524 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:33.733376 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d438b32d-7acb-4286-b032-f54c350e4524 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:33.735327 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e2382408-51ae-4bed-9491-1cd3cf0dcd53 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:33.735976 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e2382408-51ae-4bed-9491-1cd3cf0dcd53 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:33.739282 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d438b32d-7acb-4286-b032-f54c350e4524 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:33.739760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d438b32d-7acb-4286-b032-f54c350e4524 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:33.740189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d438b32d-7acb-4286-b032-f54c350e4524 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:33.741522 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d438b32d-7acb-4286-b032-f54c350e4524 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:33.741978 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d438b32d-7acb-4286-b032-f54c350e4524 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:33.742292 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e2382408-51ae-4bed-9491-1cd3cf0dcd53 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:33.742400 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d438b32d-7acb-4286-b032-f54c350e4524 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:33.742773 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e2382408-51ae-4bed-9491-1cd3cf0dcd53 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:33.743227 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e2382408-51ae-4bed-9491-1cd3cf0dcd53 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:33.743917 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e2382408-51ae-4bed-9491-1cd3cf0dcd53 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:33.744369 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e2382408-51ae-4bed-9491-1cd3cf0dcd53 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:33.744799 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e2382408-51ae-4bed-9491-1cd3cf0dcd53 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:33.937333 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e2382408-51ae-4bed-9491-1cd3cf0dcd53 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:33.941212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d438b32d-7acb-4286-b032-f54c350e4524 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:33.948137 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e2382408-51ae-4bed-9491-1cd3cf0dcd53 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.216414 Aug 10 13:02:33.948732 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1447/2877] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:33 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:33.949793 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d438b32d-7acb-4286-b032-f54c350e4524 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.221196 Aug 10 13:02:33.950486 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1431/2878] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:33 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:34.482816 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d95c069e-c9ca-4f6f-9da8-8626292117bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:34.483447 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d95c069e-c9ca-4f6f-9da8-8626292117bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:34.489332 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d95c069e-c9ca-4f6f-9da8-8626292117bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:34.489802 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d95c069e-c9ca-4f6f-9da8-8626292117bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:34.490229 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d95c069e-c9ca-4f6f-9da8-8626292117bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:34.490906 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d95c069e-c9ca-4f6f-9da8-8626292117bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:34.491375 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d95c069e-c9ca-4f6f-9da8-8626292117bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:34.491791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d95c069e-c9ca-4f6f-9da8-8626292117bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:34.500402 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-912e3a58-73e0-4a11-99ce-76feb814b2e5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:34.501003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-912e3a58-73e0-4a11-99ce-76feb814b2e5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:34.508216 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-912e3a58-73e0-4a11-99ce-76feb814b2e5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:34.508704 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-912e3a58-73e0-4a11-99ce-76feb814b2e5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:34.509140 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-912e3a58-73e0-4a11-99ce-76feb814b2e5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:34.509834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-912e3a58-73e0-4a11-99ce-76feb814b2e5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:34.510288 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-912e3a58-73e0-4a11-99ce-76feb814b2e5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:34.510766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-912e3a58-73e0-4a11-99ce-76feb814b2e5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:34.685345 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d95c069e-c9ca-4f6f-9da8-8626292117bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:34.692273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-912e3a58-73e0-4a11-99ce-76feb814b2e5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:34.693123 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d95c069e-c9ca-4f6f-9da8-8626292117bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.214393 Aug 10 13:02:34.694922 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1448/2879] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:34 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:34.701477 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-912e3a58-73e0-4a11-99ce-76feb814b2e5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:34.702988 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-912e3a58-73e0-4a11-99ce-76feb814b2e5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:34.704171 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-912e3a58-73e0-4a11-99ce-76feb814b2e5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.207668 Aug 10 13:02:34.704722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1432/2880] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:34 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:34.969991 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2da12015-8dd5-47d7-b687-79d94e43d945 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:34.970545 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2da12015-8dd5-47d7-b687-79d94e43d945 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:34.970671 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-acfd81c2-8028-474c-b7f3-eb2e4f8b4c30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:34.971276 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-acfd81c2-8028-474c-b7f3-eb2e4f8b4c30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:34.977184 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-acfd81c2-8028-474c-b7f3-eb2e4f8b4c30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:34.977382 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2da12015-8dd5-47d7-b687-79d94e43d945 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:34.977656 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-acfd81c2-8028-474c-b7f3-eb2e4f8b4c30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:34.977784 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2da12015-8dd5-47d7-b687-79d94e43d945 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:34.978081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-acfd81c2-8028-474c-b7f3-eb2e4f8b4c30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:34.978218 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2da12015-8dd5-47d7-b687-79d94e43d945 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:34.978766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-acfd81c2-8028-474c-b7f3-eb2e4f8b4c30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:34.978886 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2da12015-8dd5-47d7-b687-79d94e43d945 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:34.979493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-acfd81c2-8028-474c-b7f3-eb2e4f8b4c30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:34.979674 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2da12015-8dd5-47d7-b687-79d94e43d945 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:34.979918 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-acfd81c2-8028-474c-b7f3-eb2e4f8b4c30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:34.980046 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2da12015-8dd5-47d7-b687-79d94e43d945 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:35.389207 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-acfd81c2-8028-474c-b7f3-eb2e4f8b4c30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:35.395924 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2da12015-8dd5-47d7-b687-79d94e43d945 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:35.397912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-acfd81c2-8028-474c-b7f3-eb2e4f8b4c30 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.430076 Aug 10 13:02:35.398498 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1433/2881] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:34 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:35.404819 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2da12015-8dd5-47d7-b687-79d94e43d945 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.439010 Aug 10 13:02:35.405378 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1449/2882] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:34 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:35.714541 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-25118256-6a6e-4b39-8c0d-b04f9ebb5561 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:35.715150 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-25118256-6a6e-4b39-8c0d-b04f9ebb5561 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:35.721485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25118256-6a6e-4b39-8c0d-b04f9ebb5561 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:35.722020 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25118256-6a6e-4b39-8c0d-b04f9ebb5561 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:35.722403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25118256-6a6e-4b39-8c0d-b04f9ebb5561 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:35.723088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25118256-6a6e-4b39-8c0d-b04f9ebb5561 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:35.723563 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25118256-6a6e-4b39-8c0d-b04f9ebb5561 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:35.723985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-25118256-6a6e-4b39-8c0d-b04f9ebb5561 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:35.727203 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-dda4e190-4c46-442c-bd97-c9beb9f27a36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:35.727817 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-dda4e190-4c46-442c-bd97-c9beb9f27a36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:35.733819 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dda4e190-4c46-442c-bd97-c9beb9f27a36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:35.734290 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dda4e190-4c46-442c-bd97-c9beb9f27a36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:35.734717 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dda4e190-4c46-442c-bd97-c9beb9f27a36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:35.735419 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dda4e190-4c46-442c-bd97-c9beb9f27a36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:35.735862 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dda4e190-4c46-442c-bd97-c9beb9f27a36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:35.736276 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dda4e190-4c46-442c-bd97-c9beb9f27a36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:35.926607 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-25118256-6a6e-4b39-8c0d-b04f9ebb5561 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:35.930748 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-dda4e190-4c46-442c-bd97-c9beb9f27a36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:35.935431 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-25118256-6a6e-4b39-8c0d-b04f9ebb5561 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.224801 Aug 10 13:02:35.936012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1434/2883] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:35 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:35.938975 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-dda4e190-4c46-442c-bd97-c9beb9f27a36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:35.940499 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-dda4e190-4c46-442c-bd97-c9beb9f27a36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:35.941639 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-dda4e190-4c46-442c-bd97-c9beb9f27a36 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.218190 Aug 10 13:02:35.942183 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1450/2884] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:35 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:36.419846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f0fd50b4-8c7b-4c18-9e05-481221e31a03 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:36.420437 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f0fd50b4-8c7b-4c18-9e05-481221e31a03 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:36.425239 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-083e1ee5-0f43-47f6-a32e-c55a14450a4a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:36.425849 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-083e1ee5-0f43-47f6-a32e-c55a14450a4a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:36.426313 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f0fd50b4-8c7b-4c18-9e05-481221e31a03 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:36.426789 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f0fd50b4-8c7b-4c18-9e05-481221e31a03 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:36.427248 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f0fd50b4-8c7b-4c18-9e05-481221e31a03 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:36.427936 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f0fd50b4-8c7b-4c18-9e05-481221e31a03 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:36.428539 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f0fd50b4-8c7b-4c18-9e05-481221e31a03 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:36.429049 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f0fd50b4-8c7b-4c18-9e05-481221e31a03 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:36.432149 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-083e1ee5-0f43-47f6-a32e-c55a14450a4a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:36.432634 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-083e1ee5-0f43-47f6-a32e-c55a14450a4a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:36.433065 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-083e1ee5-0f43-47f6-a32e-c55a14450a4a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:36.433753 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-083e1ee5-0f43-47f6-a32e-c55a14450a4a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:36.434205 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-083e1ee5-0f43-47f6-a32e-c55a14450a4a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:36.434627 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-083e1ee5-0f43-47f6-a32e-c55a14450a4a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:36.438528 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:36.621012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f0fd50b4-8c7b-4c18-9e05-481221e31a03 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:36.625444 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-083e1ee5-0f43-47f6-a32e-c55a14450a4a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:36.629537 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f0fd50b4-8c7b-4c18-9e05-481221e31a03 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.213673 Aug 10 13:02:36.630204 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1435/2885] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:36 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:36.633869 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-083e1ee5-0f43-47f6-a32e-c55a14450a4a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.212386 Aug 10 13:02:36.634429 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1451/2886] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:36 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:36.956465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9fd5f415-a40d-450a-aed0-f089d29d911f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:36.957105 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9fd5f415-a40d-450a-aed0-f089d29d911f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:36.964300 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9fd5f415-a40d-450a-aed0-f089d29d911f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:36.964786 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d1cad52d-beb1-4d67-abaf-3b5ef65c0248 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:36.964909 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9fd5f415-a40d-450a-aed0-f089d29d911f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:36.965221 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9fd5f415-a40d-450a-aed0-f089d29d911f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:36.965395 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d1cad52d-beb1-4d67-abaf-3b5ef65c0248 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:36.965916 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9fd5f415-a40d-450a-aed0-f089d29d911f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:36.966374 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9fd5f415-a40d-450a-aed0-f089d29d911f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:36.966952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9fd5f415-a40d-450a-aed0-f089d29d911f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:36.971276 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1cad52d-beb1-4d67-abaf-3b5ef65c0248 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:36.971760 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1cad52d-beb1-4d67-abaf-3b5ef65c0248 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:36.972191 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1cad52d-beb1-4d67-abaf-3b5ef65c0248 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:36.972942 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1cad52d-beb1-4d67-abaf-3b5ef65c0248 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:36.973393 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1cad52d-beb1-4d67-abaf-3b5ef65c0248 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:36.973842 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d1cad52d-beb1-4d67-abaf-3b5ef65c0248 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:37.160497 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9fd5f415-a40d-450a-aed0-f089d29d911f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:37.168252 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d1cad52d-beb1-4d67-abaf-3b5ef65c0248 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:37.170248 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9fd5f415-a40d-450a-aed0-f089d29d911f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.217658 Aug 10 13:02:37.171266 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1436/2887] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:36 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:37.179464 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d1cad52d-beb1-4d67-abaf-3b5ef65c0248 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:37.183223 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d1cad52d-beb1-4d67-abaf-3b5ef65c0248 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:37.183223 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d1cad52d-beb1-4d67-abaf-3b5ef65c0248 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.221205 Aug 10 13:02:37.183223 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1452/2888] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:36 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:37.652149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b718cd67-020c-49b7-a1b9-bc049df7ce01 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:37.652686 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b718cd67-020c-49b7-a1b9-bc049df7ce01 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:37.658783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b718cd67-020c-49b7-a1b9-bc049df7ce01 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:37.659400 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b718cd67-020c-49b7-a1b9-bc049df7ce01 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:37.659655 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2e8c35da-28ce-4766-8033-e0e4d9ea8dcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:37.660072 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b718cd67-020c-49b7-a1b9-bc049df7ce01 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:37.660265 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2e8c35da-28ce-4766-8033-e0e4d9ea8dcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:37.660529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b718cd67-020c-49b7-a1b9-bc049df7ce01 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:37.660986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b718cd67-020c-49b7-a1b9-bc049df7ce01 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:37.661413 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b718cd67-020c-49b7-a1b9-bc049df7ce01 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:37.667764 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2e8c35da-28ce-4766-8033-e0e4d9ea8dcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:37.668260 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2e8c35da-28ce-4766-8033-e0e4d9ea8dcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:37.668719 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2e8c35da-28ce-4766-8033-e0e4d9ea8dcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:37.669406 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2e8c35da-28ce-4766-8033-e0e4d9ea8dcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:37.669853 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2e8c35da-28ce-4766-8033-e0e4d9ea8dcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:37.670271 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2e8c35da-28ce-4766-8033-e0e4d9ea8dcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:37.855268 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b718cd67-020c-49b7-a1b9-bc049df7ce01 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:37.861914 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2e8c35da-28ce-4766-8033-e0e4d9ea8dcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:37.863141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b718cd67-020c-49b7-a1b9-bc049df7ce01 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.214974 Aug 10 13:02:37.863852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1437/2889] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:37 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:37.870199 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2e8c35da-28ce-4766-8033-e0e4d9ea8dcc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.214286 Aug 10 13:02:37.870771 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1453/2890] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:37 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:38.193281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fa4a3648-e643-436f-88e0-06f5774245ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:38.194390 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fa4a3648-e643-436f-88e0-06f5774245ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:38.202743 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fa4a3648-e643-436f-88e0-06f5774245ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:38.203248 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fa4a3648-e643-436f-88e0-06f5774245ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:38.203683 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fa4a3648-e643-436f-88e0-06f5774245ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:38.204373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fa4a3648-e643-436f-88e0-06f5774245ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:38.204819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fa4a3648-e643-436f-88e0-06f5774245ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:38.205236 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fa4a3648-e643-436f-88e0-06f5774245ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:38.206836 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1c39e71d-47a9-417d-9f14-4f7d0de84be2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:38.207563 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1c39e71d-47a9-417d-9f14-4f7d0de84be2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:38.214292 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c39e71d-47a9-417d-9f14-4f7d0de84be2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:38.214779 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c39e71d-47a9-417d-9f14-4f7d0de84be2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:38.215242 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c39e71d-47a9-417d-9f14-4f7d0de84be2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:38.215931 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c39e71d-47a9-417d-9f14-4f7d0de84be2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:38.216381 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c39e71d-47a9-417d-9f14-4f7d0de84be2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:38.216801 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1c39e71d-47a9-417d-9f14-4f7d0de84be2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:38.406597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fa4a3648-e643-436f-88e0-06f5774245ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:38.410601 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-1c39e71d-47a9-417d-9f14-4f7d0de84be2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:38.414785 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fa4a3648-e643-436f-88e0-06f5774245ca tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.225117 Aug 10 13:02:38.415395 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1438/2891] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:38 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:38.420383 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-1c39e71d-47a9-417d-9f14-4f7d0de84be2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:38.421911 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-1c39e71d-47a9-417d-9f14-4f7d0de84be2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:38.423096 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1c39e71d-47a9-417d-9f14-4f7d0de84be2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.220007 Aug 10 13:02:38.423685 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1454/2892] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:38 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:02:38.885182 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2dd19aee-a606-4f1a-825e-b4a876df1980 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:38.885933 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2dd19aee-a606-4f1a-825e-b4a876df1980 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:38.890760 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a91efc59-175f-4c19-96dd-ef68a454cccd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:38.891419 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a91efc59-175f-4c19-96dd-ef68a454cccd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:38.891935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2dd19aee-a606-4f1a-825e-b4a876df1980 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:38.892420 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2dd19aee-a606-4f1a-825e-b4a876df1980 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:38.892860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2dd19aee-a606-4f1a-825e-b4a876df1980 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:38.893561 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2dd19aee-a606-4f1a-825e-b4a876df1980 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:38.893754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=98 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:38.894014 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2dd19aee-a606-4f1a-825e-b4a876df1980 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:38.894586 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2dd19aee-a606-4f1a-825e-b4a876df1980 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:38.898523 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a91efc59-175f-4c19-96dd-ef68a454cccd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:38.899012 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a91efc59-175f-4c19-96dd-ef68a454cccd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:38.899477 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a91efc59-175f-4c19-96dd-ef68a454cccd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:38.900173 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a91efc59-175f-4c19-96dd-ef68a454cccd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:38.900626 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a91efc59-175f-4c19-96dd-ef68a454cccd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:38.901054 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a91efc59-175f-4c19-96dd-ef68a454cccd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:39.087844 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2dd19aee-a606-4f1a-825e-b4a876df1980 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:39.092029 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a91efc59-175f-4c19-96dd-ef68a454cccd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:39.095811 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2dd19aee-a606-4f1a-825e-b4a876df1980 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.215087 Aug 10 13:02:39.096379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1439/2893] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:38 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:39.100778 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a91efc59-175f-4c19-96dd-ef68a454cccd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.213164 Aug 10 13:02:39.101356 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1455/2894] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:38 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:39.435580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-de9c829b-4a51-4211-aad4-a33b2ce73c93 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:39.436183 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-de9c829b-4a51-4211-aad4-a33b2ce73c93 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:39.442416 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-de9c829b-4a51-4211-aad4-a33b2ce73c93 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:39.442936 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-de9c829b-4a51-4211-aad4-a33b2ce73c93 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:39.443398 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-de9c829b-4a51-4211-aad4-a33b2ce73c93 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:39.444096 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-de9c829b-4a51-4211-aad4-a33b2ce73c93 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:39.444541 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-de9c829b-4a51-4211-aad4-a33b2ce73c93 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:39.444956 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-de9c829b-4a51-4211-aad4-a33b2ce73c93 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:39.445863 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-85ece89f-3c55-40a8-bebb-6e0d441a0753 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:39.446507 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-85ece89f-3c55-40a8-bebb-6e0d441a0753 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:39.447538 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:39.452488 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-85ece89f-3c55-40a8-bebb-6e0d441a0753 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:39.452967 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-85ece89f-3c55-40a8-bebb-6e0d441a0753 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:39.453404 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-85ece89f-3c55-40a8-bebb-6e0d441a0753 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:39.454113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-85ece89f-3c55-40a8-bebb-6e0d441a0753 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:39.454561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-85ece89f-3c55-40a8-bebb-6e0d441a0753 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:39.454981 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-85ece89f-3c55-40a8-bebb-6e0d441a0753 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:39.643319 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-de9c829b-4a51-4211-aad4-a33b2ce73c93 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:39.646387 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-85ece89f-3c55-40a8-bebb-6e0d441a0753 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:39.652105 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-de9c829b-4a51-4211-aad4-a33b2ce73c93 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.220374 Aug 10 13:02:39.653623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1440/2895] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:39 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:39.655755 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-85ece89f-3c55-40a8-bebb-6e0d441a0753 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:39.657258 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-85ece89f-3c55-40a8-bebb-6e0d441a0753 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:39.658415 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-85ece89f-3c55-40a8-bebb-6e0d441a0753 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.216437 Aug 10 13:02:39.658969 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1456/2896] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:39 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:40.118056 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bf19e576-8ce4-498b-92f5-4758cce6e0c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:40.118661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bf19e576-8ce4-498b-92f5-4758cce6e0c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:40.122176 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7a35927d-db81-4cd7-b26b-e429d72c1b94 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:40.122792 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7a35927d-db81-4cd7-b26b-e429d72c1b94 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:40.124749 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf19e576-8ce4-498b-92f5-4758cce6e0c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:40.125233 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf19e576-8ce4-498b-92f5-4758cce6e0c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:40.125665 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf19e576-8ce4-498b-92f5-4758cce6e0c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:40.126354 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf19e576-8ce4-498b-92f5-4758cce6e0c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:40.126807 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf19e576-8ce4-498b-92f5-4758cce6e0c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:40.127249 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf19e576-8ce4-498b-92f5-4758cce6e0c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:40.129090 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7a35927d-db81-4cd7-b26b-e429d72c1b94 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:40.129574 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7a35927d-db81-4cd7-b26b-e429d72c1b94 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:40.130007 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7a35927d-db81-4cd7-b26b-e429d72c1b94 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:40.130698 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7a35927d-db81-4cd7-b26b-e429d72c1b94 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:40.131153 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7a35927d-db81-4cd7-b26b-e429d72c1b94 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:40.131952 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7a35927d-db81-4cd7-b26b-e429d72c1b94 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:40.320457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-bf19e576-8ce4-498b-92f5-4758cce6e0c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:40.324528 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-7a35927d-db81-4cd7-b26b-e429d72c1b94 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:40.328906 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bf19e576-8ce4-498b-92f5-4758cce6e0c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.215116 Aug 10 13:02:40.329693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1441/2897] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:40 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:40.333556 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7a35927d-db81-4cd7-b26b-e429d72c1b94 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.215181 Aug 10 13:02:40.335283 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1457/2898] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:40 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:40.673509 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7bf345d7-d503-4fcc-9198-eeb9d704a8f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:40.674309 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7bf345d7-d503-4fcc-9198-eeb9d704a8f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:40.681342 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7bf345d7-d503-4fcc-9198-eeb9d704a8f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:40.681825 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7bf345d7-d503-4fcc-9198-eeb9d704a8f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:40.681959 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a2bae138-5001-4fab-b6c5-6e59b284746b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:40.682262 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7bf345d7-d503-4fcc-9198-eeb9d704a8f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:40.682565 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a2bae138-5001-4fab-b6c5-6e59b284746b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:40.682986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7bf345d7-d503-4fcc-9198-eeb9d704a8f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:40.683466 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7bf345d7-d503-4fcc-9198-eeb9d704a8f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:40.683896 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7bf345d7-d503-4fcc-9198-eeb9d704a8f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:40.688453 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2bae138-5001-4fab-b6c5-6e59b284746b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:40.688929 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2bae138-5001-4fab-b6c5-6e59b284746b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:40.689387 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2bae138-5001-4fab-b6c5-6e59b284746b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:40.690062 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2bae138-5001-4fab-b6c5-6e59b284746b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:40.690504 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2bae138-5001-4fab-b6c5-6e59b284746b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:40.690918 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2bae138-5001-4fab-b6c5-6e59b284746b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:40.883885 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7bf345d7-d503-4fcc-9198-eeb9d704a8f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:40.887660 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a2bae138-5001-4fab-b6c5-6e59b284746b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:40.892041 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7bf345d7-d503-4fcc-9198-eeb9d704a8f0 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.222385 Aug 10 13:02:40.892622 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1442/2899] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:40 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:40.896161 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a2bae138-5001-4fab-b6c5-6e59b284746b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:40.897817 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a2bae138-5001-4fab-b6c5-6e59b284746b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:40.898998 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a2bae138-5001-4fab-b6c5-6e59b284746b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.221520 Aug 10 13:02:40.899689 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1458/2900] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:40 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:41.350730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-baafb8b1-98cc-4676-9675-bc872696f0ae tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:41.351366 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-baafb8b1-98cc-4676-9675-bc872696f0ae tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:41.355684 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-97a18d9c-6576-4e18-bf49-ea9af0ea919b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:41.356300 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-97a18d9c-6576-4e18-bf49-ea9af0ea919b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:41.357626 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-baafb8b1-98cc-4676-9675-bc872696f0ae tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:41.358114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-baafb8b1-98cc-4676-9675-bc872696f0ae tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:41.358544 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-baafb8b1-98cc-4676-9675-bc872696f0ae tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:41.359253 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-baafb8b1-98cc-4676-9675-bc872696f0ae tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:41.359704 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-baafb8b1-98cc-4676-9675-bc872696f0ae tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:41.360130 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-baafb8b1-98cc-4676-9675-bc872696f0ae tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:41.363995 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-97a18d9c-6576-4e18-bf49-ea9af0ea919b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:41.363995 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-97a18d9c-6576-4e18-bf49-ea9af0ea919b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:41.363995 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-97a18d9c-6576-4e18-bf49-ea9af0ea919b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:41.364356 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-97a18d9c-6576-4e18-bf49-ea9af0ea919b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:41.364569 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-97a18d9c-6576-4e18-bf49-ea9af0ea919b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:41.364990 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-97a18d9c-6576-4e18-bf49-ea9af0ea919b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:41.549929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-baafb8b1-98cc-4676-9675-bc872696f0ae tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:41.558148 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-baafb8b1-98cc-4676-9675-bc872696f0ae tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.211306 Aug 10 13:02:41.558636 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1443/2901] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:41 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:41.560887 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-97a18d9c-6576-4e18-bf49-ea9af0ea919b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:41.568844 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-97a18d9c-6576-4e18-bf49-ea9af0ea919b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.217191 Aug 10 13:02:41.569540 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1459/2902] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:41 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:41.913909 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0b3982bd-f32e-4cef-ac07-81a691885833 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:41.914157 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0b3982bd-f32e-4cef-ac07-81a691885833 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:41.920619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b3982bd-f32e-4cef-ac07-81a691885833 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:41.921113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b3982bd-f32e-4cef-ac07-81a691885833 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:41.921445 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-efa11733-7038-4c0d-a580-ba012fc2f841 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:41.921564 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b3982bd-f32e-4cef-ac07-81a691885833 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:41.922054 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-efa11733-7038-4c0d-a580-ba012fc2f841 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:41.922221 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b3982bd-f32e-4cef-ac07-81a691885833 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:41.922671 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b3982bd-f32e-4cef-ac07-81a691885833 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:41.923091 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b3982bd-f32e-4cef-ac07-81a691885833 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:41.927886 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-efa11733-7038-4c0d-a580-ba012fc2f841 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:41.929241 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-efa11733-7038-4c0d-a580-ba012fc2f841 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:41.929680 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-efa11733-7038-4c0d-a580-ba012fc2f841 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:41.930361 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-efa11733-7038-4c0d-a580-ba012fc2f841 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:41.930831 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-efa11733-7038-4c0d-a580-ba012fc2f841 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:41.931271 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-efa11733-7038-4c0d-a580-ba012fc2f841 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:42.120333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0b3982bd-f32e-4cef-ac07-81a691885833 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:42.124245 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-efa11733-7038-4c0d-a580-ba012fc2f841 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:42.128763 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0b3982bd-f32e-4cef-ac07-81a691885833 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.219625 Aug 10 13:02:42.129349 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1444/2903] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:41 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:42.132128 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-efa11733-7038-4c0d-a580-ba012fc2f841 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:42.134276 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-efa11733-7038-4c0d-a580-ba012fc2f841 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:42.135448 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-efa11733-7038-4c0d-a580-ba012fc2f841 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.218128 Aug 10 13:02:42.135996 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1460/2904] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:41 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:42.578682 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-194b9bcb-2d03-4302-b0f0-af7553a1297a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:42.579319 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-194b9bcb-2d03-4302-b0f0-af7553a1297a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:42.585199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-194b9bcb-2d03-4302-b0f0-af7553a1297a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:42.585683 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-194b9bcb-2d03-4302-b0f0-af7553a1297a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:42.586639 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-194b9bcb-2d03-4302-b0f0-af7553a1297a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:42.587355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-194b9bcb-2d03-4302-b0f0-af7553a1297a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:42.587808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-194b9bcb-2d03-4302-b0f0-af7553a1297a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:42.588228 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-194b9bcb-2d03-4302-b0f0-af7553a1297a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:42.589920 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-85bc6a67-f02a-4ed4-8d76-c6a146791b8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:42.590685 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-85bc6a67-f02a-4ed4-8d76-c6a146791b8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:42.597138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-85bc6a67-f02a-4ed4-8d76-c6a146791b8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:42.597645 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-85bc6a67-f02a-4ed4-8d76-c6a146791b8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:42.598078 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-85bc6a67-f02a-4ed4-8d76-c6a146791b8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:42.598764 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-85bc6a67-f02a-4ed4-8d76-c6a146791b8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:42.599238 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-85bc6a67-f02a-4ed4-8d76-c6a146791b8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:42.599662 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-85bc6a67-f02a-4ed4-8d76-c6a146791b8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:42.786445 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-194b9bcb-2d03-4302-b0f0-af7553a1297a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:42.790994 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-85bc6a67-f02a-4ed4-8d76-c6a146791b8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:42.794539 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-194b9bcb-2d03-4302-b0f0-af7553a1297a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.219589 Aug 10 13:02:42.795123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1445/2905] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:42 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:42.799385 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-85bc6a67-f02a-4ed4-8d76-c6a146791b8b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.214131 Aug 10 13:02:42.799958 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1461/2906] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:42 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:43.149897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e02efd4c-37af-417b-8759-51cedd563fbf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:43.150499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e02efd4c-37af-417b-8759-51cedd563fbf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:43.156959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e02efd4c-37af-417b-8759-51cedd563fbf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:43.157431 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e02efd4c-37af-417b-8759-51cedd563fbf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:43.157858 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e02efd4c-37af-417b-8759-51cedd563fbf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:43.158540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e02efd4c-37af-417b-8759-51cedd563fbf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:43.158652 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5486c6bf-ce4a-4f3f-949c-3a9d4e48b0a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:43.159109 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e02efd4c-37af-417b-8759-51cedd563fbf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:43.159243 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5486c6bf-ce4a-4f3f-949c-3a9d4e48b0a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:43.159554 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e02efd4c-37af-417b-8759-51cedd563fbf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:43.165761 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5486c6bf-ce4a-4f3f-949c-3a9d4e48b0a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:43.166259 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5486c6bf-ce4a-4f3f-949c-3a9d4e48b0a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:43.166694 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5486c6bf-ce4a-4f3f-949c-3a9d4e48b0a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:43.167414 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5486c6bf-ce4a-4f3f-949c-3a9d4e48b0a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:43.167864 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5486c6bf-ce4a-4f3f-949c-3a9d4e48b0a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:43.168288 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5486c6bf-ce4a-4f3f-949c-3a9d4e48b0a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:43.360091 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e02efd4c-37af-417b-8759-51cedd563fbf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:43.364112 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5486c6bf-ce4a-4f3f-949c-3a9d4e48b0a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:43.368881 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e02efd4c-37af-417b-8759-51cedd563fbf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.222684 Aug 10 13:02:43.369460 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1446/2907] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:43 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:43.373381 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5486c6bf-ce4a-4f3f-949c-3a9d4e48b0a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:43.374866 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5486c6bf-ce4a-4f3f-949c-3a9d4e48b0a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:43.376050 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5486c6bf-ce4a-4f3f-949c-3a9d4e48b0a6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.221341 Aug 10 13:02:43.376588 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1462/2908] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:43 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:43.816210 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-060e8cfc-7d27-4899-a081-ca1ec5edbe0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:43.816822 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-060e8cfc-7d27-4899-a081-ca1ec5edbe0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:43.819915 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9681f198-37f6-490a-86ed-ce51c937ee44 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:43.821107 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9681f198-37f6-490a-86ed-ce51c937ee44 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:43.823654 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-060e8cfc-7d27-4899-a081-ca1ec5edbe0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:43.824132 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-060e8cfc-7d27-4899-a081-ca1ec5edbe0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:43.824565 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-060e8cfc-7d27-4899-a081-ca1ec5edbe0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:43.825249 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-060e8cfc-7d27-4899-a081-ca1ec5edbe0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:43.825690 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-060e8cfc-7d27-4899-a081-ca1ec5edbe0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:43.826108 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-060e8cfc-7d27-4899-a081-ca1ec5edbe0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:43.827750 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9681f198-37f6-490a-86ed-ce51c937ee44 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:43.828225 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9681f198-37f6-490a-86ed-ce51c937ee44 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:43.828660 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9681f198-37f6-490a-86ed-ce51c937ee44 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:43.829338 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9681f198-37f6-490a-86ed-ce51c937ee44 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:43.829789 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9681f198-37f6-490a-86ed-ce51c937ee44 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:43.830210 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9681f198-37f6-490a-86ed-ce51c937ee44 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:44.021705 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9681f198-37f6-490a-86ed-ce51c937ee44 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:44.025703 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-060e8cfc-7d27-4899-a081-ca1ec5edbe0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:44.030629 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9681f198-37f6-490a-86ed-ce51c937ee44 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.214419 Aug 10 13:02:44.031232 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1463/2909] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:43 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:44.033581 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-060e8cfc-7d27-4899-a081-ca1ec5edbe0b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.221220 Aug 10 13:02:44.034286 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1447/2910] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:43 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:44.390165 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-17d6cf9d-6eb3-4606-baca-86188c7e0e55 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:44.390886 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-17d6cf9d-6eb3-4606-baca-86188c7e0e55 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:44.397148 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17d6cf9d-6eb3-4606-baca-86188c7e0e55 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:44.397541 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17d6cf9d-6eb3-4606-baca-86188c7e0e55 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:44.397995 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17d6cf9d-6eb3-4606-baca-86188c7e0e55 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:44.399384 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17d6cf9d-6eb3-4606-baca-86188c7e0e55 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:44.399841 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17d6cf9d-6eb3-4606-baca-86188c7e0e55 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:44.400221 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e72d6ebc-7808-427f-a9ed-18e68cdbc147 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:44.400354 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-17d6cf9d-6eb3-4606-baca-86188c7e0e55 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:44.400940 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e72d6ebc-7808-427f-a9ed-18e68cdbc147 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:44.408545 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e72d6ebc-7808-427f-a9ed-18e68cdbc147 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:44.409044 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e72d6ebc-7808-427f-a9ed-18e68cdbc147 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:44.409481 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e72d6ebc-7808-427f-a9ed-18e68cdbc147 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:44.410181 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e72d6ebc-7808-427f-a9ed-18e68cdbc147 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:44.410635 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e72d6ebc-7808-427f-a9ed-18e68cdbc147 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:44.411064 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e72d6ebc-7808-427f-a9ed-18e68cdbc147 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:44.594622 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-17d6cf9d-6eb3-4606-baca-86188c7e0e55 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:44.601711 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e72d6ebc-7808-427f-a9ed-18e68cdbc147 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:44.602571 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-17d6cf9d-6eb3-4606-baca-86188c7e0e55 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.216070 Aug 10 13:02:44.611225 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1464/2911] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:44 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:44.611687 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e72d6ebc-7808-427f-a9ed-18e68cdbc147 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:44.612672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e72d6ebc-7808-427f-a9ed-18e68cdbc147 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:44.613852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e72d6ebc-7808-427f-a9ed-18e68cdbc147 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.218664 Aug 10 13:02:44.614402 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1448/2912] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:44 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:45.053184 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bc2d9284-48b0-480d-ad2c-6cb798d4780f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:45.053822 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bc2d9284-48b0-480d-ad2c-6cb798d4780f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:45.055738 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2faad9a5-c5bb-41b6-9e66-1525442b52a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:45.056386 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2faad9a5-c5bb-41b6-9e66-1525442b52a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:45.061635 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc2d9284-48b0-480d-ad2c-6cb798d4780f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:45.062084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2faad9a5-c5bb-41b6-9e66-1525442b52a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:45.062226 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc2d9284-48b0-480d-ad2c-6cb798d4780f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:45.062538 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc2d9284-48b0-480d-ad2c-6cb798d4780f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:45.062658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2faad9a5-c5bb-41b6-9e66-1525442b52a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:45.062972 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2faad9a5-c5bb-41b6-9e66-1525442b52a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:45.063271 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc2d9284-48b0-480d-ad2c-6cb798d4780f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:45.063683 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2faad9a5-c5bb-41b6-9e66-1525442b52a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:45.063846 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc2d9284-48b0-480d-ad2c-6cb798d4780f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:45.064128 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2faad9a5-c5bb-41b6-9e66-1525442b52a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:45.064274 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc2d9284-48b0-480d-ad2c-6cb798d4780f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:45.064549 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2faad9a5-c5bb-41b6-9e66-1525442b52a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:45.263016 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2faad9a5-c5bb-41b6-9e66-1525442b52a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:45.269270 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-bc2d9284-48b0-480d-ad2c-6cb798d4780f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:45.271603 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2faad9a5-c5bb-41b6-9e66-1525442b52a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.220204 Aug 10 13:02:45.272187 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1449/2913] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:45 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:45.281002 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bc2d9284-48b0-480d-ad2c-6cb798d4780f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.228409 Aug 10 13:02:45.282492 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1465/2914] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:45 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:45.624366 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-84ae7559-1cc8-4b71-b667-f6271a4ea62f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:45.624856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-84ae7559-1cc8-4b71-b667-f6271a4ea62f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:45.631218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84ae7559-1cc8-4b71-b667-f6271a4ea62f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:45.631626 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84ae7559-1cc8-4b71-b667-f6271a4ea62f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:45.632249 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84ae7559-1cc8-4b71-b667-f6271a4ea62f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:45.632957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84ae7559-1cc8-4b71-b667-f6271a4ea62f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:45.633433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84ae7559-1cc8-4b71-b667-f6271a4ea62f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:45.633855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84ae7559-1cc8-4b71-b667-f6271a4ea62f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:45.637809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-62f56a03-f446-431d-8de7-16397cd32330 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:45.638429 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-62f56a03-f446-431d-8de7-16397cd32330 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:45.655641 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-62f56a03-f446-431d-8de7-16397cd32330 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:45.655641 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-62f56a03-f446-431d-8de7-16397cd32330 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:45.655641 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-62f56a03-f446-431d-8de7-16397cd32330 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:45.655641 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-62f56a03-f446-431d-8de7-16397cd32330 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:45.656076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-62f56a03-f446-431d-8de7-16397cd32330 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:45.656076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-62f56a03-f446-431d-8de7-16397cd32330 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:45.833848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-84ae7559-1cc8-4b71-b667-f6271a4ea62f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:45.841798 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-62f56a03-f446-431d-8de7-16397cd32330 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:45.842667 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-84ae7559-1cc8-4b71-b667-f6271a4ea62f tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.222174 Aug 10 13:02:45.843264 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1450/2915] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:45 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:45.850396 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-62f56a03-f446-431d-8de7-16397cd32330 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:45.852510 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-62f56a03-f446-431d-8de7-16397cd32330 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:45.853680 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-62f56a03-f446-431d-8de7-16397cd32330 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.220102 Aug 10 13:02:45.854235 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1466/2916] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:45 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:02:46.293216 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e19648ec-6616-49a9-899e-e543a71ed0ad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:46.293829 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e19648ec-6616-49a9-899e-e543a71ed0ad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:46.299865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e19648ec-6616-49a9-899e-e543a71ed0ad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:46.300348 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e19648ec-6616-49a9-899e-e543a71ed0ad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:46.300783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e19648ec-6616-49a9-899e-e543a71ed0ad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:46.301469 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e19648ec-6616-49a9-899e-e543a71ed0ad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:46.301588 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e9021e1e-7ddf-4133-a0cf-dd5395589718 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:46.301994 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e19648ec-6616-49a9-899e-e543a71ed0ad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:46.302111 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e9021e1e-7ddf-4133-a0cf-dd5395589718 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:46.302329 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e19648ec-6616-49a9-899e-e543a71ed0ad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:46.308752 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e9021e1e-7ddf-4133-a0cf-dd5395589718 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:46.309229 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e9021e1e-7ddf-4133-a0cf-dd5395589718 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:46.309659 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e9021e1e-7ddf-4133-a0cf-dd5395589718 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:46.310342 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e9021e1e-7ddf-4133-a0cf-dd5395589718 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:46.310789 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e9021e1e-7ddf-4133-a0cf-dd5395589718 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:46.311235 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e9021e1e-7ddf-4133-a0cf-dd5395589718 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:46.488821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e19648ec-6616-49a9-899e-e543a71ed0ad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:46.496785 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e19648ec-6616-49a9-899e-e543a71ed0ad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.208075 Aug 10 13:02:46.500776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1451/2917] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:46 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:46.500905 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e9021e1e-7ddf-4133-a0cf-dd5395589718 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:46.502108 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:46.509541 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e9021e1e-7ddf-4133-a0cf-dd5395589718 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.211787 Aug 10 13:02:46.510113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1467/2918] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:46 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:46.864876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-11b37db1-b956-4214-9bf9-50adaad1e60b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:46.865485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-11b37db1-b956-4214-9bf9-50adaad1e60b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:46.872662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11b37db1-b956-4214-9bf9-50adaad1e60b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:46.873140 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11b37db1-b956-4214-9bf9-50adaad1e60b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:46.873566 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11b37db1-b956-4214-9bf9-50adaad1e60b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:46.874249 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11b37db1-b956-4214-9bf9-50adaad1e60b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:46.874696 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11b37db1-b956-4214-9bf9-50adaad1e60b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:46.875115 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-11b37db1-b956-4214-9bf9-50adaad1e60b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:46.876371 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-876e3c5e-45e2-4053-9cbd-67ce417efeaa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:46.877014 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-876e3c5e-45e2-4053-9cbd-67ce417efeaa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:46.884101 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-876e3c5e-45e2-4053-9cbd-67ce417efeaa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:46.884602 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-876e3c5e-45e2-4053-9cbd-67ce417efeaa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:46.885037 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-876e3c5e-45e2-4053-9cbd-67ce417efeaa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:46.885724 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-876e3c5e-45e2-4053-9cbd-67ce417efeaa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:46.886171 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-876e3c5e-45e2-4053-9cbd-67ce417efeaa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:46.886594 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-876e3c5e-45e2-4053-9cbd-67ce417efeaa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:47.069381 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-11b37db1-b956-4214-9bf9-50adaad1e60b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:47.213991 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-876e3c5e-45e2-4053-9cbd-67ce417efeaa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:47.214252 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-11b37db1-b956-4214-9bf9-50adaad1e60b tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.217932 Aug 10 13:02:47.214252 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1452/2919] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:46 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:47.214525 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-876e3c5e-45e2-4053-9cbd-67ce417efeaa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:47.214525 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-876e3c5e-45e2-4053-9cbd-67ce417efeaa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:47.214525 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-876e3c5e-45e2-4053-9cbd-67ce417efeaa tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.217244 Aug 10 13:02:47.215133 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1468/2920] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:46 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:47.520508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f8aeecfe-33da-4648-bb18-432e494062f1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:47.521138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f8aeecfe-33da-4648-bb18-432e494062f1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:47.527691 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f8aeecfe-33da-4648-bb18-432e494062f1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:47.528165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f8aeecfe-33da-4648-bb18-432e494062f1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:47.528591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f8aeecfe-33da-4648-bb18-432e494062f1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:47.529268 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f8aeecfe-33da-4648-bb18-432e494062f1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:47.529710 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f8aeecfe-33da-4648-bb18-432e494062f1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:47.530136 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f8aeecfe-33da-4648-bb18-432e494062f1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:47.530474 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bf883297-1a85-45fd-b3d9-757c5bca427e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:47.531088 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bf883297-1a85-45fd-b3d9-757c5bca427e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:47.537437 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf883297-1a85-45fd-b3d9-757c5bca427e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:47.537918 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf883297-1a85-45fd-b3d9-757c5bca427e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:47.538351 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf883297-1a85-45fd-b3d9-757c5bca427e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:47.539709 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf883297-1a85-45fd-b3d9-757c5bca427e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:47.540456 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf883297-1a85-45fd-b3d9-757c5bca427e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:47.540883 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf883297-1a85-45fd-b3d9-757c5bca427e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:47.726239 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f8aeecfe-33da-4648-bb18-432e494062f1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:47.735353 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f8aeecfe-33da-4648-bb18-432e494062f1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.218587 Aug 10 13:02:47.737272 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1453/2921] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:47 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:47.739491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-bf883297-1a85-45fd-b3d9-757c5bca427e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:47.748298 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bf883297-1a85-45fd-b3d9-757c5bca427e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.221515 Aug 10 13:02:47.749062 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1469/2922] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:47 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:48.235247 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-754e93d3-623d-49a0-9058-e6b9bda80cec tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:48.235867 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-754e93d3-623d-49a0-9058-e6b9bda80cec tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:48.239797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-57fea732-0ddd-4ca9-8869-65d7d6281859 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:48.240401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-57fea732-0ddd-4ca9-8869-65d7d6281859 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:48.243063 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-754e93d3-623d-49a0-9058-e6b9bda80cec tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:48.243584 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-754e93d3-623d-49a0-9058-e6b9bda80cec tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:48.244024 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-754e93d3-623d-49a0-9058-e6b9bda80cec tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:48.244722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-754e93d3-623d-49a0-9058-e6b9bda80cec tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:48.245176 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-754e93d3-623d-49a0-9058-e6b9bda80cec tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:48.245607 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-754e93d3-623d-49a0-9058-e6b9bda80cec tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:48.246933 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57fea732-0ddd-4ca9-8869-65d7d6281859 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:48.247443 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57fea732-0ddd-4ca9-8869-65d7d6281859 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:48.247870 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57fea732-0ddd-4ca9-8869-65d7d6281859 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:48.248548 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57fea732-0ddd-4ca9-8869-65d7d6281859 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:48.248993 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57fea732-0ddd-4ca9-8869-65d7d6281859 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:48.249415 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-57fea732-0ddd-4ca9-8869-65d7d6281859 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:48.438373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-754e93d3-623d-49a0-9058-e6b9bda80cec tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:48.441590 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-57fea732-0ddd-4ca9-8869-65d7d6281859 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:48.446599 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-754e93d3-623d-49a0-9058-e6b9bda80cec tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.215200 Aug 10 13:02:48.447359 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1454/2923] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:48 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:48.450231 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-57fea732-0ddd-4ca9-8869-65d7d6281859 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:48.451829 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-57fea732-0ddd-4ca9-8869-65d7d6281859 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:48.452908 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-57fea732-0ddd-4ca9-8869-65d7d6281859 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.217079 Aug 10 13:02:48.453454 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1470/2924] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:48 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:48.758199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1bb0c0b3-325a-48c4-966c-ddebffde1787 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:48.758885 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1bb0c0b3-325a-48c4-966c-ddebffde1787 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:48.764755 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1bb0c0b3-325a-48c4-966c-ddebffde1787 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:48.765229 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1bb0c0b3-325a-48c4-966c-ddebffde1787 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:48.765657 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1bb0c0b3-325a-48c4-966c-ddebffde1787 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:48.766330 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1bb0c0b3-325a-48c4-966c-ddebffde1787 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:48.766771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1bb0c0b3-325a-48c4-966c-ddebffde1787 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:48.767197 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1bb0c0b3-325a-48c4-966c-ddebffde1787 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:48.784179 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-09ddca16-3da7-4f0a-b495-8e062cb82a75 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:48.784806 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-09ddca16-3da7-4f0a-b495-8e062cb82a75 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:48.796103 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09ddca16-3da7-4f0a-b495-8e062cb82a75 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:48.796103 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09ddca16-3da7-4f0a-b495-8e062cb82a75 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:48.796103 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09ddca16-3da7-4f0a-b495-8e062cb82a75 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:48.796103 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09ddca16-3da7-4f0a-b495-8e062cb82a75 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:48.796514 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09ddca16-3da7-4f0a-b495-8e062cb82a75 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:48.796514 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-09ddca16-3da7-4f0a-b495-8e062cb82a75 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:48.972413 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1bb0c0b3-325a-48c4-966c-ddebffde1787 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:48.976349 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-09ddca16-3da7-4f0a-b495-8e062cb82a75 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:48.981447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1bb0c0b3-325a-48c4-966c-ddebffde1787 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.227589 Aug 10 13:02:48.982029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1455/2925] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:48 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:48.985141 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-09ddca16-3da7-4f0a-b495-8e062cb82a75 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.205412 Aug 10 13:02:48.985712 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1471/2926] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:48 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:49.468179 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0578924f-4ca5-4033-99f6-efea7303a80d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:49.468794 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0578924f-4ca5-4033-99f6-efea7303a80d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:49.475319 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0578924f-4ca5-4033-99f6-efea7303a80d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:49.475638 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f8f62398-f4d9-417a-8517-0bf4c46af526 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:49.475803 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0578924f-4ca5-4033-99f6-efea7303a80d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:49.476237 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0578924f-4ca5-4033-99f6-efea7303a80d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:49.476369 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f8f62398-f4d9-417a-8517-0bf4c46af526 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:49.477165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0578924f-4ca5-4033-99f6-efea7303a80d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:49.477621 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0578924f-4ca5-4033-99f6-efea7303a80d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:49.478048 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0578924f-4ca5-4033-99f6-efea7303a80d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:49.482526 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f8f62398-f4d9-417a-8517-0bf4c46af526 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:49.482999 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f8f62398-f4d9-417a-8517-0bf4c46af526 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:49.483461 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f8f62398-f4d9-417a-8517-0bf4c46af526 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:49.484136 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f8f62398-f4d9-417a-8517-0bf4c46af526 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:49.484577 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f8f62398-f4d9-417a-8517-0bf4c46af526 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:49.484994 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f8f62398-f4d9-417a-8517-0bf4c46af526 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:49.670874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0578924f-4ca5-4033-99f6-efea7303a80d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:49.673260 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:49.673954 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f8f62398-f4d9-417a-8517-0bf4c46af526 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:49.679863 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0578924f-4ca5-4033-99f6-efea7303a80d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.215483 Aug 10 13:02:49.680535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1456/2927] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:49 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:49.682663 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f8f62398-f4d9-417a-8517-0bf4c46af526 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:49.684214 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f8f62398-f4d9-417a-8517-0bf4c46af526 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:49.690705 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f8f62398-f4d9-417a-8517-0bf4c46af526 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.213605 Aug 10 13:02:49.690705 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1472/2928] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:49 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:50.003629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-254da055-9980-4681-b2f8-027734d556c3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:50.004248 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-254da055-9980-4681-b2f8-027734d556c3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:50.005514 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-356f32ca-1fb5-4a1d-b7b1-87cbdba7de84 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:50.006125 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-356f32ca-1fb5-4a1d-b7b1-87cbdba7de84 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:50.010976 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-254da055-9980-4681-b2f8-027734d556c3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:50.011475 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-254da055-9980-4681-b2f8-027734d556c3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:50.011911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-254da055-9980-4681-b2f8-027734d556c3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:50.012596 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-254da055-9980-4681-b2f8-027734d556c3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:50.013047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-254da055-9980-4681-b2f8-027734d556c3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:50.013248 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-356f32ca-1fb5-4a1d-b7b1-87cbdba7de84 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:50.013470 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-254da055-9980-4681-b2f8-027734d556c3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:50.013725 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-356f32ca-1fb5-4a1d-b7b1-87cbdba7de84 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:50.014156 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-356f32ca-1fb5-4a1d-b7b1-87cbdba7de84 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:50.014832 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-356f32ca-1fb5-4a1d-b7b1-87cbdba7de84 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:50.015304 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-356f32ca-1fb5-4a1d-b7b1-87cbdba7de84 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:50.015720 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-356f32ca-1fb5-4a1d-b7b1-87cbdba7de84 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:50.210697 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-254da055-9980-4681-b2f8-027734d556c3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:50.217106 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-356f32ca-1fb5-4a1d-b7b1-87cbdba7de84 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:50.220112 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-254da055-9980-4681-b2f8-027734d556c3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.220604 Aug 10 13:02:50.220700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1457/2929] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:49 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:50.222159 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-356f32ca-1fb5-4a1d-b7b1-87cbdba7de84 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.220394 Aug 10 13:02:50.222720 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1473/2930] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:50 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:50.712798 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ef4791e2-7340-4055-ba31-e6bb06950c1a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:50.713416 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ef4791e2-7340-4055-ba31-e6bb06950c1a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:50.717061 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c7e64941-d0ac-4df9-8a2d-e03128cff4fc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:50.720423 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c7e64941-d0ac-4df9-8a2d-e03128cff4fc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:50.720551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef4791e2-7340-4055-ba31-e6bb06950c1a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:50.720551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef4791e2-7340-4055-ba31-e6bb06950c1a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:50.720551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef4791e2-7340-4055-ba31-e6bb06950c1a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:50.721221 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef4791e2-7340-4055-ba31-e6bb06950c1a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:50.721672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef4791e2-7340-4055-ba31-e6bb06950c1a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:50.722095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef4791e2-7340-4055-ba31-e6bb06950c1a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:50.724233 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c7e64941-d0ac-4df9-8a2d-e03128cff4fc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:50.724706 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c7e64941-d0ac-4df9-8a2d-e03128cff4fc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:50.725138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c7e64941-d0ac-4df9-8a2d-e03128cff4fc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:50.725820 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c7e64941-d0ac-4df9-8a2d-e03128cff4fc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:50.726535 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c7e64941-d0ac-4df9-8a2d-e03128cff4fc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:50.727726 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c7e64941-d0ac-4df9-8a2d-e03128cff4fc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:51.224390 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ef4791e2-7340-4055-ba31-e6bb06950c1a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:51.234072 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ef4791e2-7340-4055-ba31-e6bb06950c1a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:51.236016 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ef4791e2-7340-4055-ba31-e6bb06950c1a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:51.237168 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ef4791e2-7340-4055-ba31-e6bb06950c1a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.528990 Aug 10 13:02:51.239482 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1458/2931] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:50 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:02:51.240824 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c7e64941-d0ac-4df9-8a2d-e03128cff4fc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:51.249789 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c7e64941-d0ac-4df9-8a2d-e03128cff4fc tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.536530 Aug 10 13:02:51.264181 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1474/2932] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:50 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:51.264181 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8a1c69e4-78ed-46bd-866a-07ea46e0016a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:51.264181 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8a1c69e4-78ed-46bd-866a-07ea46e0016a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:51.264600 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-265e7840-1bfd-42bf-8f80-01cb4382529f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:51.264600 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-265e7840-1bfd-42bf-8f80-01cb4382529f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:51.270151 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a1c69e4-78ed-46bd-866a-07ea46e0016a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:51.270646 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a1c69e4-78ed-46bd-866a-07ea46e0016a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:51.271243 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a1c69e4-78ed-46bd-866a-07ea46e0016a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:51.271386 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-265e7840-1bfd-42bf-8f80-01cb4382529f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:51.271688 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-265e7840-1bfd-42bf-8f80-01cb4382529f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:51.271881 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a1c69e4-78ed-46bd-866a-07ea46e0016a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:51.272127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-265e7840-1bfd-42bf-8f80-01cb4382529f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:51.272323 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a1c69e4-78ed-46bd-866a-07ea46e0016a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:51.272754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8a1c69e4-78ed-46bd-866a-07ea46e0016a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:51.272855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-265e7840-1bfd-42bf-8f80-01cb4382529f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:51.273283 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-265e7840-1bfd-42bf-8f80-01cb4382529f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:51.274384 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-265e7840-1bfd-42bf-8f80-01cb4382529f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:51.572178 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-8a1c69e4-78ed-46bd-866a-07ea46e0016a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:51.576963 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-265e7840-1bfd-42bf-8f80-01cb4382529f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:51.580371 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8a1c69e4-78ed-46bd-866a-07ea46e0016a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.329020 Aug 10 13:02:51.581179 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1475/2933] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:51 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:51.584964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-265e7840-1bfd-42bf-8f80-01cb4382529f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.332646 Aug 10 13:02:51.585524 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1459/2934] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:51 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:52.266660 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-71c0b71f-b768-4fa3-a28c-8b1574fbb696 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:52.267294 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-71c0b71f-b768-4fa3-a28c-8b1574fbb696 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:52.272652 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-eb90b888-f5b2-489c-8e18-081df08f1d14 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:52.273275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-eb90b888-f5b2-489c-8e18-081df08f1d14 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:52.273435 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-71c0b71f-b768-4fa3-a28c-8b1574fbb696 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:52.274181 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-71c0b71f-b768-4fa3-a28c-8b1574fbb696 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:52.274677 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-71c0b71f-b768-4fa3-a28c-8b1574fbb696 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:52.275317 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-71c0b71f-b768-4fa3-a28c-8b1574fbb696 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:52.276149 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-71c0b71f-b768-4fa3-a28c-8b1574fbb696 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:52.276290 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-71c0b71f-b768-4fa3-a28c-8b1574fbb696 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:52.279579 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb90b888-f5b2-489c-8e18-081df08f1d14 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:52.280904 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb90b888-f5b2-489c-8e18-081df08f1d14 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:52.280904 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb90b888-f5b2-489c-8e18-081df08f1d14 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:52.281270 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb90b888-f5b2-489c-8e18-081df08f1d14 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:52.281731 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb90b888-f5b2-489c-8e18-081df08f1d14 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:52.282159 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-eb90b888-f5b2-489c-8e18-081df08f1d14 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:52.472720 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-71c0b71f-b768-4fa3-a28c-8b1574fbb696 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:52.477289 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-eb90b888-f5b2-489c-8e18-081df08f1d14 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:52.482067 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-71c0b71f-b768-4fa3-a28c-8b1574fbb696 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:52.483598 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-71c0b71f-b768-4fa3-a28c-8b1574fbb696 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:52.484768 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-71c0b71f-b768-4fa3-a28c-8b1574fbb696 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.221993 Aug 10 13:02:52.485330 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1476/2935] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:52 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:02:52.485580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-eb90b888-f5b2-489c-8e18-081df08f1d14 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.216897 Aug 10 13:02:52.486290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1460/2936] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:52 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:52.602686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1ca14506-b39d-44a6-a26b-3928e9f47998 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:52.603328 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1ca14506-b39d-44a6-a26b-3928e9f47998 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:52.607798 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-08458574-1b29-4888-b603-f0a2310f13c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:52.608410 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-08458574-1b29-4888-b603-f0a2310f13c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:52.609507 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1ca14506-b39d-44a6-a26b-3928e9f47998 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:52.609986 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1ca14506-b39d-44a6-a26b-3928e9f47998 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:52.610413 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1ca14506-b39d-44a6-a26b-3928e9f47998 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:52.611098 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1ca14506-b39d-44a6-a26b-3928e9f47998 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:52.611573 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1ca14506-b39d-44a6-a26b-3928e9f47998 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:52.611987 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1ca14506-b39d-44a6-a26b-3928e9f47998 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:52.614254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08458574-1b29-4888-b603-f0a2310f13c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:52.614692 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08458574-1b29-4888-b603-f0a2310f13c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:52.615125 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08458574-1b29-4888-b603-f0a2310f13c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:52.615836 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08458574-1b29-4888-b603-f0a2310f13c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:52.616283 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08458574-1b29-4888-b603-f0a2310f13c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:52.616704 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08458574-1b29-4888-b603-f0a2310f13c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:52.807584 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-1ca14506-b39d-44a6-a26b-3928e9f47998 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:52.811647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-08458574-1b29-4888-b603-f0a2310f13c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:52.815618 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1ca14506-b39d-44a6-a26b-3928e9f47998 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.217314 Aug 10 13:02:52.816204 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1477/2937] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:52 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:52.819690 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-08458574-1b29-4888-b603-f0a2310f13c4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.216304 Aug 10 13:02:52.820267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1461/2938] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:52 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:53.507161 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-08cfb69d-ee08-4acc-a7e0-57a55a67cef9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:53.507894 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-08cfb69d-ee08-4acc-a7e0-57a55a67cef9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:53.508043 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9e872f68-dec2-49c3-abf9-09a8014b1eb7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:53.508833 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9e872f68-dec2-49c3-abf9-09a8014b1eb7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:53.514441 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08cfb69d-ee08-4acc-a7e0-57a55a67cef9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:53.514922 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08cfb69d-ee08-4acc-a7e0-57a55a67cef9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:53.515087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e872f68-dec2-49c3-abf9-09a8014b1eb7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:53.515406 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08cfb69d-ee08-4acc-a7e0-57a55a67cef9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:53.515599 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e872f68-dec2-49c3-abf9-09a8014b1eb7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:53.516030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e872f68-dec2-49c3-abf9-09a8014b1eb7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:53.516138 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08cfb69d-ee08-4acc-a7e0-57a55a67cef9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:53.516535 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08cfb69d-ee08-4acc-a7e0-57a55a67cef9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:53.516708 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e872f68-dec2-49c3-abf9-09a8014b1eb7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:53.516954 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-08cfb69d-ee08-4acc-a7e0-57a55a67cef9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:53.517153 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e872f68-dec2-49c3-abf9-09a8014b1eb7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:53.517574 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e872f68-dec2-49c3-abf9-09a8014b1eb7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:53.708197 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-08cfb69d-ee08-4acc-a7e0-57a55a67cef9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:53.715444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9e872f68-dec2-49c3-abf9-09a8014b1eb7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:53.716991 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-08cfb69d-ee08-4acc-a7e0-57a55a67cef9 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.213559 Aug 10 13:02:53.717918 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1478/2939] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:53 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:53.730998 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9e872f68-dec2-49c3-abf9-09a8014b1eb7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:53.732526 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9e872f68-dec2-49c3-abf9-09a8014b1eb7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:53.733710 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9e872f68-dec2-49c3-abf9-09a8014b1eb7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.229634 Aug 10 13:02:53.734262 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1462/2940] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:53 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:53.837434 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4d81833b-971e-40bf-8b5e-d3cb34e8f9d1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:53.837984 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4d81833b-971e-40bf-8b5e-d3cb34e8f9d1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:53.841364 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a9daf3f4-7cf1-4094-9e7d-23d22ab389ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:53.841966 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a9daf3f4-7cf1-4094-9e7d-23d22ab389ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:53.843953 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d81833b-971e-40bf-8b5e-d3cb34e8f9d1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:53.844435 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d81833b-971e-40bf-8b5e-d3cb34e8f9d1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:53.844877 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d81833b-971e-40bf-8b5e-d3cb34e8f9d1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:53.845569 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d81833b-971e-40bf-8b5e-d3cb34e8f9d1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:53.846021 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d81833b-971e-40bf-8b5e-d3cb34e8f9d1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:53.846445 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4d81833b-971e-40bf-8b5e-d3cb34e8f9d1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:53.847815 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9daf3f4-7cf1-4094-9e7d-23d22ab389ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:53.848289 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9daf3f4-7cf1-4094-9e7d-23d22ab389ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:53.848753 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9daf3f4-7cf1-4094-9e7d-23d22ab389ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:53.849432 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9daf3f4-7cf1-4094-9e7d-23d22ab389ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:53.849879 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9daf3f4-7cf1-4094-9e7d-23d22ab389ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:53.850299 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9daf3f4-7cf1-4094-9e7d-23d22ab389ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:54.039159 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4d81833b-971e-40bf-8b5e-d3cb34e8f9d1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:54.046019 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a9daf3f4-7cf1-4094-9e7d-23d22ab389ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:54.047156 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4d81833b-971e-40bf-8b5e-d3cb34e8f9d1 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.214213 Aug 10 13:02:54.047756 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1479/2941] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:53 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:54.053961 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a9daf3f4-7cf1-4094-9e7d-23d22ab389ab tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.216430 Aug 10 13:02:54.054522 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1463/2942] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:53 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:54.738412 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-13da001b-074d-4063-a031-b151d1b48f6e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:54.739028 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-13da001b-074d-4063-a031-b151d1b48f6e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:54.745690 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-13da001b-074d-4063-a031-b151d1b48f6e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:54.746163 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-13da001b-074d-4063-a031-b151d1b48f6e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:54.746586 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-13da001b-074d-4063-a031-b151d1b48f6e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:54.747281 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-13da001b-074d-4063-a031-b151d1b48f6e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:54.747726 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-13da001b-074d-4063-a031-b151d1b48f6e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:54.748143 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-13da001b-074d-4063-a031-b151d1b48f6e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:54.756664 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b951bb78-1532-4fd2-8a44-ddf3774641f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:54.757279 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b951bb78-1532-4fd2-8a44-ddf3774641f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:54.764010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b951bb78-1532-4fd2-8a44-ddf3774641f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:54.764497 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b951bb78-1532-4fd2-8a44-ddf3774641f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:54.764953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b951bb78-1532-4fd2-8a44-ddf3774641f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:54.765636 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b951bb78-1532-4fd2-8a44-ddf3774641f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:54.766090 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b951bb78-1532-4fd2-8a44-ddf3774641f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:54.766807 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b951bb78-1532-4fd2-8a44-ddf3774641f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:54.946740 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-13da001b-074d-4063-a031-b151d1b48f6e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:54.951115 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b951bb78-1532-4fd2-8a44-ddf3774641f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:54.955000 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-13da001b-074d-4063-a031-b151d1b48f6e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.220379 Aug 10 13:02:54.955613 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1480/2943] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:54 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:54.959535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b951bb78-1532-4fd2-8a44-ddf3774641f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:54.961780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b951bb78-1532-4fd2-8a44-ddf3774641f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:54.963252 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b951bb78-1532-4fd2-8a44-ddf3774641f6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.210493 Aug 10 13:02:54.963810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1464/2944] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:54 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:55.068557 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c8e48105-fe49-4816-85fc-d6577db37fa6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:55.069171 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c8e48105-fe49-4816-85fc-d6577db37fa6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:55.075776 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c8e48105-fe49-4816-85fc-d6577db37fa6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:55.075962 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5465dffa-8a35-47c6-bf66-9582c7ccda99 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:55.076259 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c8e48105-fe49-4816-85fc-d6577db37fa6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:55.076450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5465dffa-8a35-47c6-bf66-9582c7ccda99 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:55.076691 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c8e48105-fe49-4816-85fc-d6577db37fa6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:55.077380 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c8e48105-fe49-4816-85fc-d6577db37fa6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:55.077973 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c8e48105-fe49-4816-85fc-d6577db37fa6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:55.078250 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c8e48105-fe49-4816-85fc-d6577db37fa6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:55.082290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5465dffa-8a35-47c6-bf66-9582c7ccda99 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:55.082772 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5465dffa-8a35-47c6-bf66-9582c7ccda99 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:55.083244 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5465dffa-8a35-47c6-bf66-9582c7ccda99 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:55.083940 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5465dffa-8a35-47c6-bf66-9582c7ccda99 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:55.084395 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5465dffa-8a35-47c6-bf66-9582c7ccda99 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:55.084824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5465dffa-8a35-47c6-bf66-9582c7ccda99 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:55.281941 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5465dffa-8a35-47c6-bf66-9582c7ccda99 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:55.285147 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c8e48105-fe49-4816-85fc-d6577db37fa6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:55.287912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5465dffa-8a35-47c6-bf66-9582c7ccda99 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.215842 Aug 10 13:02:55.289719 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1465/2945] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:55 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:55.294773 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c8e48105-fe49-4816-85fc-d6577db37fa6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.230053 Aug 10 13:02:55.295356 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1481/2946] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:55 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:55.976789 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-49671ffa-add8-4237-b88b-7bdea5a04faa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:55.977436 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-49671ffa-add8-4237-b88b-7bdea5a04faa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:55.984144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49671ffa-add8-4237-b88b-7bdea5a04faa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:55.984625 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49671ffa-add8-4237-b88b-7bdea5a04faa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:55.985064 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49671ffa-add8-4237-b88b-7bdea5a04faa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:55.985623 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bea6edb5-478e-45d6-98b9-a8b84a3a1016 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:55.986045 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49671ffa-add8-4237-b88b-7bdea5a04faa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:55.986164 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49671ffa-add8-4237-b88b-7bdea5a04faa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:55.986274 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bea6edb5-478e-45d6-98b9-a8b84a3a1016 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:55.986588 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49671ffa-add8-4237-b88b-7bdea5a04faa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:55.993500 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bea6edb5-478e-45d6-98b9-a8b84a3a1016 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:55.994033 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bea6edb5-478e-45d6-98b9-a8b84a3a1016 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:55.994461 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bea6edb5-478e-45d6-98b9-a8b84a3a1016 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:55.995147 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bea6edb5-478e-45d6-98b9-a8b84a3a1016 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:55.995611 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bea6edb5-478e-45d6-98b9-a8b84a3a1016 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:55.996031 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bea6edb5-478e-45d6-98b9-a8b84a3a1016 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:56.174474 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-49671ffa-add8-4237-b88b-7bdea5a04faa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:56.183041 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-49671ffa-add8-4237-b88b-7bdea5a04faa tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.210315 Aug 10 13:02:56.183831 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1466/2947] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:55 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:56.186028 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-bea6edb5-478e-45d6-98b9-a8b84a3a1016 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:56.194584 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-bea6edb5-478e-45d6-98b9-a8b84a3a1016 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:56.196881 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-bea6edb5-478e-45d6-98b9-a8b84a3a1016 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:56.198050 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bea6edb5-478e-45d6-98b9-a8b84a3a1016 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.216775 Aug 10 13:02:56.198599 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1482/2948] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:55 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:56.310862 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-277d153a-445f-4201-a9c7-faddc6692cf9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:56.311514 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-277d153a-445f-4201-a9c7-faddc6692cf9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:56.315267 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7b83f304-3ea0-4b5a-95ba-19bcb9c733e8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:56.315884 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7b83f304-3ea0-4b5a-95ba-19bcb9c733e8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:56.317418 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-277d153a-445f-4201-a9c7-faddc6692cf9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:56.317836 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-277d153a-445f-4201-a9c7-faddc6692cf9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:56.318284 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-277d153a-445f-4201-a9c7-faddc6692cf9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:56.318967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-277d153a-445f-4201-a9c7-faddc6692cf9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:56.319441 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-277d153a-445f-4201-a9c7-faddc6692cf9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:56.319863 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-277d153a-445f-4201-a9c7-faddc6692cf9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:56.321907 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7b83f304-3ea0-4b5a-95ba-19bcb9c733e8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:56.322392 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7b83f304-3ea0-4b5a-95ba-19bcb9c733e8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:56.322827 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7b83f304-3ea0-4b5a-95ba-19bcb9c733e8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:56.323673 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7b83f304-3ea0-4b5a-95ba-19bcb9c733e8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:56.324132 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7b83f304-3ea0-4b5a-95ba-19bcb9c733e8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:56.324560 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7b83f304-3ea0-4b5a-95ba-19bcb9c733e8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:56.513348 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-7b83f304-3ea0-4b5a-95ba-19bcb9c733e8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:56.516854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-277d153a-445f-4201-a9c7-faddc6692cf9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:56.521487 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7b83f304-3ea0-4b5a-95ba-19bcb9c733e8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.209979 Aug 10 13:02:56.522062 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1483/2949] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:56 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:56.525973 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-277d153a-445f-4201-a9c7-faddc6692cf9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.218961 Aug 10 13:02:56.526530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1467/2950] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:56 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:57.206120 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-06f60a20-317a-4b2b-99d4-0c59b2ec7f8d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:57.206755 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-06f60a20-317a-4b2b-99d4-0c59b2ec7f8d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:57.213341 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06f60a20-317a-4b2b-99d4-0c59b2ec7f8d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:57.213819 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06f60a20-317a-4b2b-99d4-0c59b2ec7f8d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:57.214248 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06f60a20-317a-4b2b-99d4-0c59b2ec7f8d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:57.214923 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06f60a20-317a-4b2b-99d4-0c59b2ec7f8d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:57.215406 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06f60a20-317a-4b2b-99d4-0c59b2ec7f8d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:57.215825 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-06f60a20-317a-4b2b-99d4-0c59b2ec7f8d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:57.221578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0da86da4-7aca-4175-8d04-0310b78c083e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:57.222220 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0da86da4-7aca-4175-8d04-0310b78c083e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:57.229035 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0da86da4-7aca-4175-8d04-0310b78c083e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:57.229768 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0da86da4-7aca-4175-8d04-0310b78c083e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:57.230198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0da86da4-7aca-4175-8d04-0310b78c083e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:57.230882 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0da86da4-7aca-4175-8d04-0310b78c083e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:57.231362 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0da86da4-7aca-4175-8d04-0310b78c083e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:57.231513 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:02:57.231786 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0da86da4-7aca-4175-8d04-0310b78c083e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:57.419906 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-06f60a20-317a-4b2b-99d4-0c59b2ec7f8d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:57.423296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0da86da4-7aca-4175-8d04-0310b78c083e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:57.427927 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-06f60a20-317a-4b2b-99d4-0c59b2ec7f8d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.225657 Aug 10 13:02:57.428686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1484/2951] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:57 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:57.432739 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0da86da4-7aca-4175-8d04-0310b78c083e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:57.434227 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0da86da4-7aca-4175-8d04-0310b78c083e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:57.435464 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0da86da4-7aca-4175-8d04-0310b78c083e tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.217696 Aug 10 13:02:57.436008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1468/2952] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:57 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:57.542693 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-51bb200a-c613-455c-9aa0-faa75d43dd1e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:57.543327 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-51bb200a-c613-455c-9aa0-faa75d43dd1e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:57.547275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-64a6e6c5-6685-4079-b281-cc959cdab6ce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:57.547882 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-64a6e6c5-6685-4079-b281-cc959cdab6ce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:57.549691 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51bb200a-c613-455c-9aa0-faa75d43dd1e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:57.550165 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51bb200a-c613-455c-9aa0-faa75d43dd1e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:57.550596 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51bb200a-c613-455c-9aa0-faa75d43dd1e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:57.551340 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51bb200a-c613-455c-9aa0-faa75d43dd1e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:57.551794 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51bb200a-c613-455c-9aa0-faa75d43dd1e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:57.552215 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-51bb200a-c613-455c-9aa0-faa75d43dd1e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:57.553683 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64a6e6c5-6685-4079-b281-cc959cdab6ce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:57.554178 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64a6e6c5-6685-4079-b281-cc959cdab6ce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:57.555168 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64a6e6c5-6685-4079-b281-cc959cdab6ce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:57.555880 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64a6e6c5-6685-4079-b281-cc959cdab6ce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:57.556327 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64a6e6c5-6685-4079-b281-cc959cdab6ce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:57.556749 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64a6e6c5-6685-4079-b281-cc959cdab6ce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:57.748821 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-51bb200a-c613-455c-9aa0-faa75d43dd1e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:57.751732 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-64a6e6c5-6685-4079-b281-cc959cdab6ce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:57.756976 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-51bb200a-c613-455c-9aa0-faa75d43dd1e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.218002 Aug 10 13:02:57.757556 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1485/2953] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:57 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:57.760457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-64a6e6c5-6685-4079-b281-cc959cdab6ce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.217053 Aug 10 13:02:57.761016 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1469/2954] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:57 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:58.449875 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a478b152-88a9-4b89-a75c-332a8e602fcf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:58.450487 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a478b152-88a9-4b89-a75c-332a8e602fcf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:58.456845 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a478b152-88a9-4b89-a75c-332a8e602fcf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:58.457260 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a478b152-88a9-4b89-a75c-332a8e602fcf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:58.457685 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a478b152-88a9-4b89-a75c-332a8e602fcf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:58.458371 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a478b152-88a9-4b89-a75c-332a8e602fcf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:58.458573 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e646c42e-86aa-4f47-9490-c892cca43023 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:58.458974 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a478b152-88a9-4b89-a75c-332a8e602fcf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:58.459209 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e646c42e-86aa-4f47-9490-c892cca43023 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:58.459325 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a478b152-88a9-4b89-a75c-332a8e602fcf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:58.465682 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e646c42e-86aa-4f47-9490-c892cca43023 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:58.466157 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e646c42e-86aa-4f47-9490-c892cca43023 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:58.466588 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e646c42e-86aa-4f47-9490-c892cca43023 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:58.467300 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e646c42e-86aa-4f47-9490-c892cca43023 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:58.467748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e646c42e-86aa-4f47-9490-c892cca43023 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:58.468170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e646c42e-86aa-4f47-9490-c892cca43023 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:58.659703 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a478b152-88a9-4b89-a75c-332a8e602fcf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:58.662810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e646c42e-86aa-4f47-9490-c892cca43023 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:58.668444 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a478b152-88a9-4b89-a75c-332a8e602fcf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.223041 Aug 10 13:02:58.669262 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1486/2955] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:58 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:58.675468 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e646c42e-86aa-4f47-9490-c892cca43023 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:58.677142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e646c42e-86aa-4f47-9490-c892cca43023 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:58.678335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e646c42e-86aa-4f47-9490-c892cca43023 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.223598 Aug 10 13:02:58.678881 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1470/2956] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:58 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:02:58.778468 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d453ce50-543e-49a0-b4ea-d19b951aa0bc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:58.779104 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d453ce50-543e-49a0-b4ea-d19b951aa0bc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:58.781377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-91af42e4-5e77-423c-b89c-56ef43e93fb9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:58.781982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-91af42e4-5e77-423c-b89c-56ef43e93fb9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:58.785091 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d453ce50-543e-49a0-b4ea-d19b951aa0bc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:58.785578 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d453ce50-543e-49a0-b4ea-d19b951aa0bc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:58.786009 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d453ce50-543e-49a0-b4ea-d19b951aa0bc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:58.786696 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d453ce50-543e-49a0-b4ea-d19b951aa0bc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:58.787145 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d453ce50-543e-49a0-b4ea-d19b951aa0bc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:58.787594 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d453ce50-543e-49a0-b4ea-d19b951aa0bc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:58.787770 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91af42e4-5e77-423c-b89c-56ef43e93fb9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:58.788244 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91af42e4-5e77-423c-b89c-56ef43e93fb9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:58.788672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91af42e4-5e77-423c-b89c-56ef43e93fb9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:58.790132 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91af42e4-5e77-423c-b89c-56ef43e93fb9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:58.790703 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91af42e4-5e77-423c-b89c-56ef43e93fb9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:58.791125 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-91af42e4-5e77-423c-b89c-56ef43e93fb9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:58.981294 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d453ce50-543e-49a0-b4ea-d19b951aa0bc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:58.987891 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-91af42e4-5e77-423c-b89c-56ef43e93fb9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:58.989477 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d453ce50-543e-49a0-b4ea-d19b951aa0bc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.215148 Aug 10 13:02:58.990167 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1487/2957] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:58 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:58.995875 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-91af42e4-5e77-423c-b89c-56ef43e93fb9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.218078 Aug 10 13:02:58.996631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1471/2958] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:58 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:02:59.689735 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d7511a9c-194b-490f-9de0-f3ba57863a35 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:59.690311 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d7511a9c-194b-490f-9de0-f3ba57863a35 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:59.697555 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7511a9c-194b-490f-9de0-f3ba57863a35 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:59.698037 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7511a9c-194b-490f-9de0-f3ba57863a35 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:59.698471 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7511a9c-194b-490f-9de0-f3ba57863a35 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:59.699157 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7511a9c-194b-490f-9de0-f3ba57863a35 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:59.699641 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7511a9c-194b-490f-9de0-f3ba57863a35 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:59.700064 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d7511a9c-194b-490f-9de0-f3ba57863a35 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:59.702167 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b7cb5b39-a910-4ff7-bee2-535f061b5d12 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:02:59.702802 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b7cb5b39-a910-4ff7-bee2-535f061b5d12 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:02:59.709080 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b7cb5b39-a910-4ff7-bee2-535f061b5d12 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:59.709563 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b7cb5b39-a910-4ff7-bee2-535f061b5d12 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:59.710001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b7cb5b39-a910-4ff7-bee2-535f061b5d12 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:59.710701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b7cb5b39-a910-4ff7-bee2-535f061b5d12 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:02:59.711154 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b7cb5b39-a910-4ff7-bee2-535f061b5d12 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:02:59.711603 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b7cb5b39-a910-4ff7-bee2-535f061b5d12 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:02:59.907414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b7cb5b39-a910-4ff7-bee2-535f061b5d12 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:59.910722 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d7511a9c-194b-490f-9de0-f3ba57863a35 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:59.917306 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b7cb5b39-a910-4ff7-bee2-535f061b5d12 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:59.918819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b7cb5b39-a910-4ff7-bee2-535f061b5d12 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:02:59.919302 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d7511a9c-194b-490f-9de0-f3ba57863a35 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.233363 Aug 10 13:02:59.919973 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1488/2959] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:02:59 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:02:59.920106 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b7cb5b39-a910-4ff7-bee2-535f061b5d12 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.221653 Aug 10 13:02:59.920610 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1472/2960] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:02:59 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:03:00.010518 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b1c45923-3357-4b20-998f-59bc97349d16 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:00.011160 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b1c45923-3357-4b20-998f-59bc97349d16 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:00.017086 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1c45923-3357-4b20-998f-59bc97349d16 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:00.017566 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1c45923-3357-4b20-998f-59bc97349d16 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:00.017691 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a4e45deb-867e-4410-a158-79b2f29f28b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:00.018000 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1c45923-3357-4b20-998f-59bc97349d16 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:00.018230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a4e45deb-867e-4410-a158-79b2f29f28b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:00.018689 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1c45923-3357-4b20-998f-59bc97349d16 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:00.019142 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1c45923-3357-4b20-998f-59bc97349d16 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:00.019591 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b1c45923-3357-4b20-998f-59bc97349d16 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:00.024993 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4e45deb-867e-4410-a158-79b2f29f28b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:00.025481 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4e45deb-867e-4410-a158-79b2f29f28b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:00.025918 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4e45deb-867e-4410-a158-79b2f29f28b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:00.026614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4e45deb-867e-4410-a158-79b2f29f28b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:00.027066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4e45deb-867e-4410-a158-79b2f29f28b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:00.027522 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4e45deb-867e-4410-a158-79b2f29f28b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:00.042054 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:00.209667 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b1c45923-3357-4b20-998f-59bc97349d16 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:00.214541 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a4e45deb-867e-4410-a158-79b2f29f28b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:00.218753 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b1c45923-3357-4b20-998f-59bc97349d16 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.212869 Aug 10 13:03:00.219353 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1489/2961] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:00 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:00.222694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a4e45deb-867e-4410-a158-79b2f29f28b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.208850 Aug 10 13:03:00.223284 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1473/2962] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:00 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:00.941201 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b864ca90-71e7-43c1-b0dd-df4294dffdf4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:00.941940 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b864ca90-71e7-43c1-b0dd-df4294dffdf4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:00.942867 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-df8fcf0c-6ab9-404e-a485-058e0458efeb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:00.943492 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-df8fcf0c-6ab9-404e-a485-058e0458efeb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:00.949950 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b864ca90-71e7-43c1-b0dd-df4294dffdf4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:00.955607 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-df8fcf0c-6ab9-404e-a485-058e0458efeb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:00.955749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b864ca90-71e7-43c1-b0dd-df4294dffdf4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:00.955881 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-df8fcf0c-6ab9-404e-a485-058e0458efeb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:00.955991 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b864ca90-71e7-43c1-b0dd-df4294dffdf4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:00.956103 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-df8fcf0c-6ab9-404e-a485-058e0458efeb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:00.956211 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b864ca90-71e7-43c1-b0dd-df4294dffdf4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:00.956312 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-df8fcf0c-6ab9-404e-a485-058e0458efeb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:00.956412 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b864ca90-71e7-43c1-b0dd-df4294dffdf4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:00.956535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-df8fcf0c-6ab9-404e-a485-058e0458efeb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:00.956645 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b864ca90-71e7-43c1-b0dd-df4294dffdf4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:00.956757 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-df8fcf0c-6ab9-404e-a485-058e0458efeb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:01.154896 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b864ca90-71e7-43c1-b0dd-df4294dffdf4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:01.158286 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-df8fcf0c-6ab9-404e-a485-058e0458efeb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:01.163010 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b864ca90-71e7-43c1-b0dd-df4294dffdf4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.225827 Aug 10 13:03:01.165415 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1490/2963] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:00 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:01.167190 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-df8fcf0c-6ab9-404e-a485-058e0458efeb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:01.168779 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-df8fcf0c-6ab9-404e-a485-058e0458efeb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:01.169930 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-df8fcf0c-6ab9-404e-a485-058e0458efeb tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.230996 Aug 10 13:03:01.170474 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1474/2964] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:00 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:03:01.240184 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e639289c-cce4-46ee-bb5a-585665190a14 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:01.240798 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e639289c-cce4-46ee-bb5a-585665190a14 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:01.243367 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7da1c2de-2dfb-4eeb-b3af-df7fb4be06c7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:01.243976 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7da1c2de-2dfb-4eeb-b3af-df7fb4be06c7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:01.247325 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e639289c-cce4-46ee-bb5a-585665190a14 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:01.247804 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e639289c-cce4-46ee-bb5a-585665190a14 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:01.248240 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e639289c-cce4-46ee-bb5a-585665190a14 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:01.248933 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e639289c-cce4-46ee-bb5a-585665190a14 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:01.249384 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e639289c-cce4-46ee-bb5a-585665190a14 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:01.249809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e639289c-cce4-46ee-bb5a-585665190a14 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:01.249935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7da1c2de-2dfb-4eeb-b3af-df7fb4be06c7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:01.250283 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7da1c2de-2dfb-4eeb-b3af-df7fb4be06c7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:01.250719 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7da1c2de-2dfb-4eeb-b3af-df7fb4be06c7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:01.251429 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7da1c2de-2dfb-4eeb-b3af-df7fb4be06c7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:01.251902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7da1c2de-2dfb-4eeb-b3af-df7fb4be06c7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:01.252325 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7da1c2de-2dfb-4eeb-b3af-df7fb4be06c7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:01.447637 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e639289c-cce4-46ee-bb5a-585665190a14 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:01.451820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7da1c2de-2dfb-4eeb-b3af-df7fb4be06c7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:01.455729 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e639289c-cce4-46ee-bb5a-585665190a14 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.219438 Aug 10 13:03:01.456316 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1491/2965] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:01 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:01.459687 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7da1c2de-2dfb-4eeb-b3af-df7fb4be06c7 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.220140 Aug 10 13:03:01.460247 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1475/2966] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:01 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:02.185987 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-596b68e6-9c88-4c0b-a329-209991047193 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:02.186596 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-596b68e6-9c88-4c0b-a329-209991047193 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:02.192272 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-50ce593c-bd0a-4d83-b6a6-409cbba9b6b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:02.192874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-50ce593c-bd0a-4d83-b6a6-409cbba9b6b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:02.193106 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-596b68e6-9c88-4c0b-a329-209991047193 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:02.193592 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-596b68e6-9c88-4c0b-a329-209991047193 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:02.194026 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-596b68e6-9c88-4c0b-a329-209991047193 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:02.194719 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-596b68e6-9c88-4c0b-a329-209991047193 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:02.195197 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-596b68e6-9c88-4c0b-a329-209991047193 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:02.195387 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=98 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:02.195604 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-596b68e6-9c88-4c0b-a329-209991047193 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:02.200424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50ce593c-bd0a-4d83-b6a6-409cbba9b6b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:02.200900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50ce593c-bd0a-4d83-b6a6-409cbba9b6b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:02.201329 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50ce593c-bd0a-4d83-b6a6-409cbba9b6b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:02.202035 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50ce593c-bd0a-4d83-b6a6-409cbba9b6b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:02.202508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50ce593c-bd0a-4d83-b6a6-409cbba9b6b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:02.202937 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50ce593c-bd0a-4d83-b6a6-409cbba9b6b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:02.388562 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-50ce593c-bd0a-4d83-b6a6-409cbba9b6b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:02.395398 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-596b68e6-9c88-4c0b-a329-209991047193 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:02.397196 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-50ce593c-bd0a-4d83-b6a6-409cbba9b6b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:02.398727 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-50ce593c-bd0a-4d83-b6a6-409cbba9b6b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:02.399902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-50ce593c-bd0a-4d83-b6a6-409cbba9b6b3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.211426 Aug 10 13:03:02.400466 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1476/2967] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:02 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:03:02.403852 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-596b68e6-9c88-4c0b-a329-209991047193 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.221689 Aug 10 13:03:02.404414 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1492/2968] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:02 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:02.478275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5605ef63-1174-43b4-b409-b7d466ac707a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:02.478879 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5605ef63-1174-43b4-b409-b7d466ac707a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:02.481404 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c5da1d0d-ca00-48e5-ba8f-a5475bf22df5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:02.482020 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c5da1d0d-ca00-48e5-ba8f-a5475bf22df5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:02.485170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5605ef63-1174-43b4-b409-b7d466ac707a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:02.485650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5605ef63-1174-43b4-b409-b7d466ac707a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:02.486084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5605ef63-1174-43b4-b409-b7d466ac707a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:02.486775 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5605ef63-1174-43b4-b409-b7d466ac707a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:02.487272 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5605ef63-1174-43b4-b409-b7d466ac707a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:02.487681 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5605ef63-1174-43b4-b409-b7d466ac707a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:02.487847 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c5da1d0d-ca00-48e5-ba8f-a5475bf22df5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:02.488331 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c5da1d0d-ca00-48e5-ba8f-a5475bf22df5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:02.488763 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c5da1d0d-ca00-48e5-ba8f-a5475bf22df5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:02.489444 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c5da1d0d-ca00-48e5-ba8f-a5475bf22df5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:02.489898 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c5da1d0d-ca00-48e5-ba8f-a5475bf22df5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:02.490318 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c5da1d0d-ca00-48e5-ba8f-a5475bf22df5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:02.687000 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5605ef63-1174-43b4-b409-b7d466ac707a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:02.690965 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c5da1d0d-ca00-48e5-ba8f-a5475bf22df5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:02.695034 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5605ef63-1174-43b4-b409-b7d466ac707a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.221093 Aug 10 13:03:02.696211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1477/2969] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:02 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:02.699723 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c5da1d0d-ca00-48e5-ba8f-a5475bf22df5 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.222324 Aug 10 13:03:02.700469 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1493/2970] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:02 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:03.424021 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bc4dfcfb-f21d-47fe-ba0a-fb7ffb6fbcda tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:03.424585 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a3429964-3cdc-474b-b5ad-6578f718840d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:03.424999 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bc4dfcfb-f21d-47fe-ba0a-fb7ffb6fbcda tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:03.425117 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a3429964-3cdc-474b-b5ad-6578f718840d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:03.432000 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a3429964-3cdc-474b-b5ad-6578f718840d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:03.432243 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc4dfcfb-f21d-47fe-ba0a-fb7ffb6fbcda tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:03.432481 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a3429964-3cdc-474b-b5ad-6578f718840d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:03.432720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc4dfcfb-f21d-47fe-ba0a-fb7ffb6fbcda tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:03.432913 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a3429964-3cdc-474b-b5ad-6578f718840d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:03.433149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc4dfcfb-f21d-47fe-ba0a-fb7ffb6fbcda tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:03.433606 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a3429964-3cdc-474b-b5ad-6578f718840d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:03.433829 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc4dfcfb-f21d-47fe-ba0a-fb7ffb6fbcda tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:03.434058 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a3429964-3cdc-474b-b5ad-6578f718840d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:03.434275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc4dfcfb-f21d-47fe-ba0a-fb7ffb6fbcda tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:03.434483 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a3429964-3cdc-474b-b5ad-6578f718840d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:03.434690 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bc4dfcfb-f21d-47fe-ba0a-fb7ffb6fbcda tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:03.627829 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-bc4dfcfb-f21d-47fe-ba0a-fb7ffb6fbcda tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:03.633230 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a3429964-3cdc-474b-b5ad-6578f718840d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:03.636937 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-bc4dfcfb-f21d-47fe-ba0a-fb7ffb6fbcda tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:03.638436 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-bc4dfcfb-f21d-47fe-ba0a-fb7ffb6fbcda tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:03.639622 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bc4dfcfb-f21d-47fe-ba0a-fb7ffb6fbcda tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.219477 Aug 10 13:03:03.640179 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1478/2971] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:03 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:03:03.641953 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a3429964-3cdc-474b-b5ad-6578f718840d tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.221049 Aug 10 13:03:03.647492 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1494/2972] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:03 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:03.717186 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bf8782c9-df88-4203-b414-afc38747cbdd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:03.717885 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bf8782c9-df88-4203-b414-afc38747cbdd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:03.720438 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-495087bf-85e2-410a-a7ca-0139eabe4749 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:03.721113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-495087bf-85e2-410a-a7ca-0139eabe4749 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:03.724193 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf8782c9-df88-4203-b414-afc38747cbdd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:03.724748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf8782c9-df88-4203-b414-afc38747cbdd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:03.725253 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf8782c9-df88-4203-b414-afc38747cbdd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:03.726007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf8782c9-df88-4203-b414-afc38747cbdd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:03.727056 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf8782c9-df88-4203-b414-afc38747cbdd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:03.727508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bf8782c9-df88-4203-b414-afc38747cbdd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:03.727645 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-495087bf-85e2-410a-a7ca-0139eabe4749 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:03.728154 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-495087bf-85e2-410a-a7ca-0139eabe4749 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:03.728583 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-495087bf-85e2-410a-a7ca-0139eabe4749 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:03.729258 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-495087bf-85e2-410a-a7ca-0139eabe4749 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:03.729958 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-495087bf-85e2-410a-a7ca-0139eabe4749 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:03.730375 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-495087bf-85e2-410a-a7ca-0139eabe4749 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:03.871410 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-bf8782c9-df88-4203-b414-afc38747cbdd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:03.879705 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bf8782c9-df88-4203-b414-afc38747cbdd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.166384 Aug 10 13:03:03.880495 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1479/2973] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:03 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:04.007534 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-495087bf-85e2-410a-a7ca-0139eabe4749 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:04.015568 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-495087bf-85e2-410a-a7ca-0139eabe4749 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.298849 Aug 10 13:03:04.016137 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1495/2974] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:03 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:04.662775 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3fe962ec-5fa8-4263-bae3-3251a4c6e4ba tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:04.663430 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3fe962ec-5fa8-4263-bae3-3251a4c6e4ba tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:04.663700 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-595fea83-8473-4932-813f-13bd7c6a35d4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:04.664328 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-595fea83-8473-4932-813f-13bd7c6a35d4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:04.670058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3fe962ec-5fa8-4263-bae3-3251a4c6e4ba tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:04.670540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3fe962ec-5fa8-4263-bae3-3251a4c6e4ba tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:04.670937 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-595fea83-8473-4932-813f-13bd7c6a35d4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:04.671082 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3fe962ec-5fa8-4263-bae3-3251a4c6e4ba tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:04.671567 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-595fea83-8473-4932-813f-13bd7c6a35d4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:04.671777 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3fe962ec-5fa8-4263-bae3-3251a4c6e4ba tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:04.672131 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-595fea83-8473-4932-813f-13bd7c6a35d4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:04.672249 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3fe962ec-5fa8-4263-bae3-3251a4c6e4ba tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:04.672635 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3fe962ec-5fa8-4263-bae3-3251a4c6e4ba tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:04.672821 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-595fea83-8473-4932-813f-13bd7c6a35d4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:04.673269 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-595fea83-8473-4932-813f-13bd7c6a35d4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:04.673713 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-595fea83-8473-4932-813f-13bd7c6a35d4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:04.872214 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3fe962ec-5fa8-4263-bae3-3251a4c6e4ba tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:04.875099 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-595fea83-8473-4932-813f-13bd7c6a35d4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:04.880700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3fe962ec-5fa8-4263-bae3-3251a4c6e4ba tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:04.882192 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3fe962ec-5fa8-4263-bae3-3251a4c6e4ba tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:04.883695 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-595fea83-8473-4932-813f-13bd7c6a35d4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.223235 Aug 10 13:03:04.884274 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1496/2975] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:04 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:04.884480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3fe962ec-5fa8-4263-bae3-3251a4c6e4ba tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.225600 Aug 10 13:03:04.885031 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1480/2976] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:04 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:03:04.902107 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e2dbd9a0-8e79-4ee2-871f-59cda5ea2161 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:04.902717 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e2dbd9a0-8e79-4ee2-871f-59cda5ea2161 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:04.908454 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e2dbd9a0-8e79-4ee2-871f-59cda5ea2161 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:04.908946 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e2dbd9a0-8e79-4ee2-871f-59cda5ea2161 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:04.909385 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e2dbd9a0-8e79-4ee2-871f-59cda5ea2161 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:04.910074 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e2dbd9a0-8e79-4ee2-871f-59cda5ea2161 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:04.910531 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e2dbd9a0-8e79-4ee2-871f-59cda5ea2161 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:04.910958 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e2dbd9a0-8e79-4ee2-871f-59cda5ea2161 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:05.037123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2a54ff3d-6a9a-4901-b47e-1095443f9a63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:05.037741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2a54ff3d-6a9a-4901-b47e-1095443f9a63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:05.037901 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e2dbd9a0-8e79-4ee2-871f-59cda5ea2161 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:05.043617 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a54ff3d-6a9a-4901-b47e-1095443f9a63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:05.044098 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a54ff3d-6a9a-4901-b47e-1095443f9a63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:05.044529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a54ff3d-6a9a-4901-b47e-1095443f9a63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:05.045216 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a54ff3d-6a9a-4901-b47e-1095443f9a63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:05.045664 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a54ff3d-6a9a-4901-b47e-1095443f9a63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:05.045791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e2dbd9a0-8e79-4ee2-871f-59cda5ea2161 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.147501 Aug 10 13:03:05.046090 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a54ff3d-6a9a-4901-b47e-1095443f9a63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:05.046340 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1497/2977] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:04 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:05.177503 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2a54ff3d-6a9a-4901-b47e-1095443f9a63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:05.186499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2a54ff3d-6a9a-4901-b47e-1095443f9a63 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.153250 Aug 10 13:03:05.187063 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1481/2978] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:05 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:05.905383 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-31222164-f63f-4486-a73c-8dc3edc95fa3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:05.905992 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-31222164-f63f-4486-a73c-8dc3edc95fa3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:05.907189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e08714fd-6cdf-49e1-9b67-6e8af7130431 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:05.907801 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e08714fd-6cdf-49e1-9b67-6e8af7130431 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:05.912401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-31222164-f63f-4486-a73c-8dc3edc95fa3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:05.912883 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-31222164-f63f-4486-a73c-8dc3edc95fa3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:05.913377 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-31222164-f63f-4486-a73c-8dc3edc95fa3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:05.914093 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-31222164-f63f-4486-a73c-8dc3edc95fa3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:05.914235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e08714fd-6cdf-49e1-9b67-6e8af7130431 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:05.914624 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-31222164-f63f-4486-a73c-8dc3edc95fa3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:05.914739 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e08714fd-6cdf-49e1-9b67-6e8af7130431 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:05.915049 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-31222164-f63f-4486-a73c-8dc3edc95fa3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:05.915160 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e08714fd-6cdf-49e1-9b67-6e8af7130431 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:05.915792 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e08714fd-6cdf-49e1-9b67-6e8af7130431 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:05.916240 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e08714fd-6cdf-49e1-9b67-6e8af7130431 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:05.916659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e08714fd-6cdf-49e1-9b67-6e8af7130431 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:06.108201 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-31222164-f63f-4486-a73c-8dc3edc95fa3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:06.112231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e08714fd-6cdf-49e1-9b67-6e8af7130431 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:06.116551 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-31222164-f63f-4486-a73c-8dc3edc95fa3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.214935 Aug 10 13:03:06.123210 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1498/2979] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:05 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:06.123374 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e08714fd-6cdf-49e1-9b67-6e8af7130431 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:06.123516 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-96ca3a87-c190-4059-8073-fe8b6b5b135a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:06.123619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e08714fd-6cdf-49e1-9b67-6e8af7130431 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:06.123717 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-96ca3a87-c190-4059-8073-fe8b6b5b135a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:06.123811 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e08714fd-6cdf-49e1-9b67-6e8af7130431 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.220172 Aug 10 13:03:06.128525 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-96ca3a87-c190-4059-8073-fe8b6b5b135a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:06.129009 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-96ca3a87-c190-4059-8073-fe8b6b5b135a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:06.129447 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-96ca3a87-c190-4059-8073-fe8b6b5b135a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:06.130256 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-96ca3a87-c190-4059-8073-fe8b6b5b135a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:06.130713 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-96ca3a87-c190-4059-8073-fe8b6b5b135a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:06.131148 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-96ca3a87-c190-4059-8073-fe8b6b5b135a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:06.134395 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1482/2980] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:05 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:03:06.208479 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-aa6bf2bb-290f-4a08-b93e-c1a879211cdb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:06.209501 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-aa6bf2bb-290f-4a08-b93e-c1a879211cdb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:06.217986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa6bf2bb-290f-4a08-b93e-c1a879211cdb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:06.218562 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa6bf2bb-290f-4a08-b93e-c1a879211cdb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:06.219144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa6bf2bb-290f-4a08-b93e-c1a879211cdb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:06.219964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa6bf2bb-290f-4a08-b93e-c1a879211cdb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:06.220474 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa6bf2bb-290f-4a08-b93e-c1a879211cdb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:06.221038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa6bf2bb-290f-4a08-b93e-c1a879211cdb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:06.271458 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-96ca3a87-c190-4059-8073-fe8b6b5b135a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:06.279975 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-96ca3a87-c190-4059-8073-fe8b6b5b135a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.161384 Aug 10 13:03:06.280622 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1499/2981] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:06 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:06.356413 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-aa6bf2bb-290f-4a08-b93e-c1a879211cdb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:06.364297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-aa6bf2bb-290f-4a08-b93e-c1a879211cdb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.160182 Aug 10 13:03:06.364870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1483/2982] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:06 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:07.138193 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7f7e2f27-335c-442f-bd9b-88de1b20fd2e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:07.138825 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7f7e2f27-335c-442f-bd9b-88de1b20fd2e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:07.145236 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7f7e2f27-335c-442f-bd9b-88de1b20fd2e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:07.145713 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7f7e2f27-335c-442f-bd9b-88de1b20fd2e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:07.146140 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7f7e2f27-335c-442f-bd9b-88de1b20fd2e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:07.146511 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-24a2d046-43b2-4ab3-a142-e3b46b7bc681 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:07.146942 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7f7e2f27-335c-442f-bd9b-88de1b20fd2e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:07.147135 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-24a2d046-43b2-4ab3-a142-e3b46b7bc681 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:07.147281 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7f7e2f27-335c-442f-bd9b-88de1b20fd2e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:07.147678 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7f7e2f27-335c-442f-bd9b-88de1b20fd2e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:07.153972 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24a2d046-43b2-4ab3-a142-e3b46b7bc681 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:07.154456 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24a2d046-43b2-4ab3-a142-e3b46b7bc681 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:07.154895 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24a2d046-43b2-4ab3-a142-e3b46b7bc681 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:07.155610 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24a2d046-43b2-4ab3-a142-e3b46b7bc681 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:07.156065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24a2d046-43b2-4ab3-a142-e3b46b7bc681 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:07.156489 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24a2d046-43b2-4ab3-a142-e3b46b7bc681 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:07.339703 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-24a2d046-43b2-4ab3-a142-e3b46b7bc681 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:07.346169 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-7f7e2f27-335c-442f-bd9b-88de1b20fd2e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:07.348264 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-24a2d046-43b2-4ab3-a142-e3b46b7bc681 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:07.349759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-24a2d046-43b2-4ab3-a142-e3b46b7bc681 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:07.350900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-24a2d046-43b2-4ab3-a142-e3b46b7bc681 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.208251 Aug 10 13:03:07.352023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1484/2983] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:07 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:03:07.355454 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7f7e2f27-335c-442f-bd9b-88de1b20fd2e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.220984 Aug 10 13:03:07.356129 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1500/2984] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:07 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:07.357188 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c1c07409-5c41-4f94-bfa8-ab4b90b7d938 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:07.357796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c1c07409-5c41-4f94-bfa8-ab4b90b7d938 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:07.363483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c1c07409-5c41-4f94-bfa8-ab4b90b7d938 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:07.363960 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c1c07409-5c41-4f94-bfa8-ab4b90b7d938 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:07.364389 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c1c07409-5c41-4f94-bfa8-ab4b90b7d938 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:07.365062 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c1c07409-5c41-4f94-bfa8-ab4b90b7d938 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:07.365687 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c1c07409-5c41-4f94-bfa8-ab4b90b7d938 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:07.366109 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c1c07409-5c41-4f94-bfa8-ab4b90b7d938 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:07.385941 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9813b321-7e1c-4f3a-a36c-a647fa1095e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:07.386554 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9813b321-7e1c-4f3a-a36c-a647fa1095e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:07.392445 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9813b321-7e1c-4f3a-a36c-a647fa1095e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:07.392867 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9813b321-7e1c-4f3a-a36c-a647fa1095e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:07.393299 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9813b321-7e1c-4f3a-a36c-a647fa1095e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:07.394023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9813b321-7e1c-4f3a-a36c-a647fa1095e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:07.394473 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9813b321-7e1c-4f3a-a36c-a647fa1095e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:07.394895 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9813b321-7e1c-4f3a-a36c-a647fa1095e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:07.397498 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:07.560612 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c1c07409-5c41-4f94-bfa8-ab4b90b7d938 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:07.568481 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c1c07409-5c41-4f94-bfa8-ab4b90b7d938 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.215274 Aug 10 13:03:07.569199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1485/2985] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:07 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:07.571760 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9813b321-7e1c-4f3a-a36c-a647fa1095e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:07.579740 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9813b321-7e1c-4f3a-a36c-a647fa1095e0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.198889 Aug 10 13:03:07.580296 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1501/2986] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:07 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:08.374813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-80f98542-4102-4097-b05e-513495318c09 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:08.375483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-80f98542-4102-4097-b05e-513495318c09 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:08.377188 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9d14ec97-7334-4cd9-ac5e-3c4f5360cfaf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:08.377815 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9d14ec97-7334-4cd9-ac5e-3c4f5360cfaf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:08.382349 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80f98542-4102-4097-b05e-513495318c09 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:08.383496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80f98542-4102-4097-b05e-513495318c09 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:08.383496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80f98542-4102-4097-b05e-513495318c09 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:08.383980 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80f98542-4102-4097-b05e-513495318c09 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:08.384484 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80f98542-4102-4097-b05e-513495318c09 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:08.384959 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d14ec97-7334-4cd9-ac5e-3c4f5360cfaf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:08.385181 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80f98542-4102-4097-b05e-513495318c09 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:08.385463 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d14ec97-7334-4cd9-ac5e-3c4f5360cfaf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:08.385900 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d14ec97-7334-4cd9-ac5e-3c4f5360cfaf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:08.386713 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d14ec97-7334-4cd9-ac5e-3c4f5360cfaf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:08.387141 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d14ec97-7334-4cd9-ac5e-3c4f5360cfaf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:08.387595 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9d14ec97-7334-4cd9-ac5e-3c4f5360cfaf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:08.626837 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9d14ec97-7334-4cd9-ac5e-3c4f5360cfaf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:08.631704 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-80f98542-4102-4097-b05e-513495318c09 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:08.636161 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9d14ec97-7334-4cd9-ac5e-3c4f5360cfaf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.263895 Aug 10 13:03:08.636744 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1502/2987] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:08 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:08.641227 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6952e171-b589-4602-a457-4b1acc8c1ff8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:08.641839 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6952e171-b589-4602-a457-4b1acc8c1ff8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:08.643433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-80f98542-4102-4097-b05e-513495318c09 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:08.645260 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-80f98542-4102-4097-b05e-513495318c09 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:08.646608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-80f98542-4102-4097-b05e-513495318c09 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.275833 Aug 10 13:03:08.647417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1486/2988] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:08 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:03:08.650904 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6952e171-b589-4602-a457-4b1acc8c1ff8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:08.651441 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6952e171-b589-4602-a457-4b1acc8c1ff8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:08.651889 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6952e171-b589-4602-a457-4b1acc8c1ff8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:08.652609 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6952e171-b589-4602-a457-4b1acc8c1ff8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:08.653059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-52ea81cd-80af-47b8-a37c-f8547389149f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:08.653228 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6952e171-b589-4602-a457-4b1acc8c1ff8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:08.653543 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6952e171-b589-4602-a457-4b1acc8c1ff8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:08.654663 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-52ea81cd-80af-47b8-a37c-f8547389149f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:08.660925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-52ea81cd-80af-47b8-a37c-f8547389149f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:08.661690 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-52ea81cd-80af-47b8-a37c-f8547389149f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:08.662379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-52ea81cd-80af-47b8-a37c-f8547389149f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:08.663284 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-52ea81cd-80af-47b8-a37c-f8547389149f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:08.663736 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-52ea81cd-80af-47b8-a37c-f8547389149f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:08.664237 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-52ea81cd-80af-47b8-a37c-f8547389149f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:09.126220 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6952e171-b589-4602-a457-4b1acc8c1ff8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:09.130085 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-52ea81cd-80af-47b8-a37c-f8547389149f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:09.135261 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6952e171-b589-4602-a457-4b1acc8c1ff8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.497470 Aug 10 13:03:09.135941 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1503/2989] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:08 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:09.139146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-52ea81cd-80af-47b8-a37c-f8547389149f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.490388 Aug 10 13:03:09.139742 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1487/2990] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:08 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:09.658095 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bffaf9ab-0512-43ea-8a71-2e65ec3376b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:09.658677 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bffaf9ab-0512-43ea-8a71-2e65ec3376b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:09.660909 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=98 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:09.665606 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bffaf9ab-0512-43ea-8a71-2e65ec3376b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:09.666099 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bffaf9ab-0512-43ea-8a71-2e65ec3376b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:09.666535 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bffaf9ab-0512-43ea-8a71-2e65ec3376b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:09.667260 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bffaf9ab-0512-43ea-8a71-2e65ec3376b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:09.667720 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bffaf9ab-0512-43ea-8a71-2e65ec3376b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:09.668150 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bffaf9ab-0512-43ea-8a71-2e65ec3376b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:09.670429 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d4dd37fd-15bd-4772-bc52-ea059799eb46 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:09.671203 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d4dd37fd-15bd-4772-bc52-ea059799eb46 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:09.677510 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d4dd37fd-15bd-4772-bc52-ea059799eb46 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:09.677984 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d4dd37fd-15bd-4772-bc52-ea059799eb46 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:09.678411 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d4dd37fd-15bd-4772-bc52-ea059799eb46 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:09.679092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d4dd37fd-15bd-4772-bc52-ea059799eb46 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:09.679652 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d4dd37fd-15bd-4772-bc52-ea059799eb46 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:09.680191 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d4dd37fd-15bd-4772-bc52-ea059799eb46 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:09.877474 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-bffaf9ab-0512-43ea-8a71-2e65ec3376b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:09.879803 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d4dd37fd-15bd-4772-bc52-ea059799eb46 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:09.886909 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bffaf9ab-0512-43ea-8a71-2e65ec3376b7 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.232776 Aug 10 13:03:09.887521 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1504/2991] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:09 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:09.892517 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d4dd37fd-15bd-4772-bc52-ea059799eb46 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:09.892517 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d4dd37fd-15bd-4772-bc52-ea059799eb46 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:09.895729 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d4dd37fd-15bd-4772-bc52-ea059799eb46 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.226469 Aug 10 13:03:09.895729 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1488/2992] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:09 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:03:10.158085 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5bbab3fb-8e88-4239-9a82-c8ceb11b89f2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:10.158693 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5bbab3fb-8e88-4239-9a82-c8ceb11b89f2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:10.160940 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-589e32a4-7400-43c7-b32b-f2169361a1fe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:10.161557 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-589e32a4-7400-43c7-b32b-f2169361a1fe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:10.164934 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5bbab3fb-8e88-4239-9a82-c8ceb11b89f2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:10.165423 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5bbab3fb-8e88-4239-9a82-c8ceb11b89f2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:10.165857 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5bbab3fb-8e88-4239-9a82-c8ceb11b89f2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:10.166560 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5bbab3fb-8e88-4239-9a82-c8ceb11b89f2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:10.167012 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5bbab3fb-8e88-4239-9a82-c8ceb11b89f2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:10.167460 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5bbab3fb-8e88-4239-9a82-c8ceb11b89f2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:10.167634 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-589e32a4-7400-43c7-b32b-f2169361a1fe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:10.168115 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-589e32a4-7400-43c7-b32b-f2169361a1fe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:10.168554 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-589e32a4-7400-43c7-b32b-f2169361a1fe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:10.169274 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-589e32a4-7400-43c7-b32b-f2169361a1fe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:10.169723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-589e32a4-7400-43c7-b32b-f2169361a1fe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:10.170145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-589e32a4-7400-43c7-b32b-f2169361a1fe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:10.372521 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5bbab3fb-8e88-4239-9a82-c8ceb11b89f2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:10.376375 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-589e32a4-7400-43c7-b32b-f2169361a1fe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:10.380522 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5bbab3fb-8e88-4239-9a82-c8ceb11b89f2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.226223 Aug 10 13:03:10.381097 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1505/2993] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:10 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:10.384845 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-589e32a4-7400-43c7-b32b-f2169361a1fe tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.227840 Aug 10 13:03:10.385413 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1489/2994] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:10 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:10.908767 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b0c09ec9-d22c-4078-b97a-fa3b1b6ea5e4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:10.909386 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b0c09ec9-d22c-4078-b97a-fa3b1b6ea5e4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:10.915983 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b0c09ec9-d22c-4078-b97a-fa3b1b6ea5e4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:10.916468 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b0c09ec9-d22c-4078-b97a-fa3b1b6ea5e4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:10.916906 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b0c09ec9-d22c-4078-b97a-fa3b1b6ea5e4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:10.917593 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7debdcb8-dd77-45dc-8a88-92df14ff7b80 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:10.918018 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b0c09ec9-d22c-4078-b97a-fa3b1b6ea5e4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:10.918018 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b0c09ec9-d22c-4078-b97a-fa3b1b6ea5e4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:10.918219 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7debdcb8-dd77-45dc-8a88-92df14ff7b80 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:10.918584 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b0c09ec9-d22c-4078-b97a-fa3b1b6ea5e4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:10.924728 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7debdcb8-dd77-45dc-8a88-92df14ff7b80 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:10.932491 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7debdcb8-dd77-45dc-8a88-92df14ff7b80 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:10.932491 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7debdcb8-dd77-45dc-8a88-92df14ff7b80 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:10.932491 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7debdcb8-dd77-45dc-8a88-92df14ff7b80 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:10.932491 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7debdcb8-dd77-45dc-8a88-92df14ff7b80 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:10.932897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7debdcb8-dd77-45dc-8a88-92df14ff7b80 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:10.932897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:11.123045 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7debdcb8-dd77-45dc-8a88-92df14ff7b80 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:11.129256 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b0c09ec9-d22c-4078-b97a-fa3b1b6ea5e4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:11.131949 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7debdcb8-dd77-45dc-8a88-92df14ff7b80 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:11.134041 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7debdcb8-dd77-45dc-8a88-92df14ff7b80 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:11.135275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7debdcb8-dd77-45dc-8a88-92df14ff7b80 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.221754 Aug 10 13:03:11.138572 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1490/2995] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:10 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:03:11.138697 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b0c09ec9-d22c-4078-b97a-fa3b1b6ea5e4 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.232876 Aug 10 13:03:11.138697 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1506/2996] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:10 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:11.401368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-71c9a368-c5ed-49dd-9ba2-85492e5b0257 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:11.401982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-71c9a368-c5ed-49dd-9ba2-85492e5b0257 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:11.405439 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0c3d22cc-6bb4-456e-8f3b-b2496e084f9c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:11.406054 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0c3d22cc-6bb4-456e-8f3b-b2496e084f9c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:11.408005 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71c9a368-c5ed-49dd-9ba2-85492e5b0257 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:11.408486 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71c9a368-c5ed-49dd-9ba2-85492e5b0257 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:11.408919 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71c9a368-c5ed-49dd-9ba2-85492e5b0257 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:11.409602 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71c9a368-c5ed-49dd-9ba2-85492e5b0257 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:11.410052 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71c9a368-c5ed-49dd-9ba2-85492e5b0257 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:11.410470 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71c9a368-c5ed-49dd-9ba2-85492e5b0257 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:11.411917 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0c3d22cc-6bb4-456e-8f3b-b2496e084f9c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:11.412397 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0c3d22cc-6bb4-456e-8f3b-b2496e084f9c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:11.412831 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0c3d22cc-6bb4-456e-8f3b-b2496e084f9c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:11.413517 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0c3d22cc-6bb4-456e-8f3b-b2496e084f9c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:11.414529 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0c3d22cc-6bb4-456e-8f3b-b2496e084f9c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:11.415144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0c3d22cc-6bb4-456e-8f3b-b2496e084f9c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:11.603705 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-71c9a368-c5ed-49dd-9ba2-85492e5b0257 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:11.608082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0c3d22cc-6bb4-456e-8f3b-b2496e084f9c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:11.612421 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-71c9a368-c5ed-49dd-9ba2-85492e5b0257 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.214936 Aug 10 13:03:11.613008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1491/2997] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:11 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:11.616679 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0c3d22cc-6bb4-456e-8f3b-b2496e084f9c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.215011 Aug 10 13:03:11.617848 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1507/2998] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:11 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:12.158404 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d8a10637-edea-4ee8-ab76-e3d5c6506ceb tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:12.159072 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d8a10637-edea-4ee8-ab76-e3d5c6506ceb tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:12.163627 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7290a33a-0826-455b-9674-a77799637c88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:12.164797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7290a33a-0826-455b-9674-a77799637c88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:12.165493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d8a10637-edea-4ee8-ab76-e3d5c6506ceb tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:12.166043 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d8a10637-edea-4ee8-ab76-e3d5c6506ceb tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:12.166461 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d8a10637-edea-4ee8-ab76-e3d5c6506ceb tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:12.167168 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d8a10637-edea-4ee8-ab76-e3d5c6506ceb tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:12.167654 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d8a10637-edea-4ee8-ab76-e3d5c6506ceb tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:12.168084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d8a10637-edea-4ee8-ab76-e3d5c6506ceb tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:12.176236 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7290a33a-0826-455b-9674-a77799637c88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:12.176659 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7290a33a-0826-455b-9674-a77799637c88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:12.177093 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7290a33a-0826-455b-9674-a77799637c88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:12.177791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7290a33a-0826-455b-9674-a77799637c88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:12.178240 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7290a33a-0826-455b-9674-a77799637c88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:12.178663 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7290a33a-0826-455b-9674-a77799637c88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:12.362766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d8a10637-edea-4ee8-ab76-e3d5c6506ceb tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:12.366631 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-7290a33a-0826-455b-9674-a77799637c88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:12.371461 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d8a10637-edea-4ee8-ab76-e3d5c6506ceb tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.217565 Aug 10 13:03:12.372036 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1492/2999] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:12 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:12.375500 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-7290a33a-0826-455b-9674-a77799637c88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:12.377141 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-7290a33a-0826-455b-9674-a77799637c88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:12.378319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7290a33a-0826-455b-9674-a77799637c88 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.218565 Aug 10 13:03:12.378898 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1508/3000] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:12 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:03:12.634397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-dc77b26b-13bb-4f76-aedd-e2cfc23be00d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:12.635012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-dc77b26b-13bb-4f76-aedd-e2cfc23be00d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:12.638040 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6798d759-edd5-4275-bf00-09ff202a3ff9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:12.638545 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6798d759-edd5-4275-bf00-09ff202a3ff9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:12.641144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dc77b26b-13bb-4f76-aedd-e2cfc23be00d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:12.641617 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dc77b26b-13bb-4f76-aedd-e2cfc23be00d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:12.642054 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dc77b26b-13bb-4f76-aedd-e2cfc23be00d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:12.642742 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dc77b26b-13bb-4f76-aedd-e2cfc23be00d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:12.643281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dc77b26b-13bb-4f76-aedd-e2cfc23be00d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:12.643632 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dc77b26b-13bb-4f76-aedd-e2cfc23be00d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:12.644434 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6798d759-edd5-4275-bf00-09ff202a3ff9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:12.644910 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6798d759-edd5-4275-bf00-09ff202a3ff9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:12.645339 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6798d759-edd5-4275-bf00-09ff202a3ff9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:12.646015 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6798d759-edd5-4275-bf00-09ff202a3ff9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:12.646461 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6798d759-edd5-4275-bf00-09ff202a3ff9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:12.646878 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6798d759-edd5-4275-bf00-09ff202a3ff9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:12.835938 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-dc77b26b-13bb-4f76-aedd-e2cfc23be00d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:12.847669 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6798d759-edd5-4275-bf00-09ff202a3ff9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:12.847833 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-dc77b26b-13bb-4f76-aedd-e2cfc23be00d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.213885 Aug 10 13:03:12.847833 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1493/3001] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:12 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:12.851049 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6798d759-edd5-4275-bf00-09ff202a3ff9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.216895 Aug 10 13:03:12.852151 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1509/3002] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:12 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:13.392684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ff41d9c4-9fef-4fe3-9767-09771e94b5bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:13.393293 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ff41d9c4-9fef-4fe3-9767-09771e94b5bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:13.400263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff41d9c4-9fef-4fe3-9767-09771e94b5bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:13.400741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff41d9c4-9fef-4fe3-9767-09771e94b5bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:13.401115 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-baed0ebe-0c30-4f6a-8334-261bd0ae7db0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:13.401562 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff41d9c4-9fef-4fe3-9767-09771e94b5bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:13.401740 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-baed0ebe-0c30-4f6a-8334-261bd0ae7db0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:13.401904 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff41d9c4-9fef-4fe3-9767-09771e94b5bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:13.402265 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff41d9c4-9fef-4fe3-9767-09771e94b5bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:13.402682 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff41d9c4-9fef-4fe3-9767-09771e94b5bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:13.408091 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-baed0ebe-0c30-4f6a-8334-261bd0ae7db0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:13.408569 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-baed0ebe-0c30-4f6a-8334-261bd0ae7db0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:13.409005 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-baed0ebe-0c30-4f6a-8334-261bd0ae7db0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:13.409691 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-baed0ebe-0c30-4f6a-8334-261bd0ae7db0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:13.410141 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-baed0ebe-0c30-4f6a-8334-261bd0ae7db0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:13.410570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-baed0ebe-0c30-4f6a-8334-261bd0ae7db0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:13.603863 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ff41d9c4-9fef-4fe3-9767-09771e94b5bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:13.607369 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-baed0ebe-0c30-4f6a-8334-261bd0ae7db0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:13.612021 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ff41d9c4-9fef-4fe3-9767-09771e94b5bf tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.223146 Aug 10 13:03:13.612592 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1494/3003] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:13 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:13.615875 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-baed0ebe-0c30-4f6a-8334-261bd0ae7db0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:13.617552 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-baed0ebe-0c30-4f6a-8334-261bd0ae7db0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:13.618731 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-baed0ebe-0c30-4f6a-8334-261bd0ae7db0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.221806 Aug 10 13:03:13.619302 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1510/3004] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:13 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:03:13.866764 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b09513d7-b4ef-4ab6-b848-d844a3d25076 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:13.867948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b09513d7-b4ef-4ab6-b848-d844a3d25076 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:13.872746 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2afb0bb4-f8bb-413f-893c-41a89b288730 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:13.873365 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2afb0bb4-f8bb-413f-893c-41a89b288730 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:13.873849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b09513d7-b4ef-4ab6-b848-d844a3d25076 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:13.874329 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b09513d7-b4ef-4ab6-b848-d844a3d25076 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:13.874757 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b09513d7-b4ef-4ab6-b848-d844a3d25076 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:13.875462 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b09513d7-b4ef-4ab6-b848-d844a3d25076 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:13.875913 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b09513d7-b4ef-4ab6-b848-d844a3d25076 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:13.876331 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b09513d7-b4ef-4ab6-b848-d844a3d25076 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:13.879197 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2afb0bb4-f8bb-413f-893c-41a89b288730 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:13.879690 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2afb0bb4-f8bb-413f-893c-41a89b288730 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:13.880126 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2afb0bb4-f8bb-413f-893c-41a89b288730 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:13.880810 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2afb0bb4-f8bb-413f-893c-41a89b288730 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:13.881260 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2afb0bb4-f8bb-413f-893c-41a89b288730 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:13.881683 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2afb0bb4-f8bb-413f-893c-41a89b288730 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:14.072290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b09513d7-b4ef-4ab6-b848-d844a3d25076 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:14.075602 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2afb0bb4-f8bb-413f-893c-41a89b288730 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:14.080356 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b09513d7-b4ef-4ab6-b848-d844a3d25076 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.217491 Aug 10 13:03:14.080963 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1495/3005] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:13 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:14.083514 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2afb0bb4-f8bb-413f-893c-41a89b288730 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.214582 Aug 10 13:03:14.084077 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1511/3006] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:13 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:14.633434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d142ed3c-07a2-4aff-b755-6173abfb3ffd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:14.634075 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d142ed3c-07a2-4aff-b755-6173abfb3ffd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:14.641290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d142ed3c-07a2-4aff-b755-6173abfb3ffd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:14.641768 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d142ed3c-07a2-4aff-b755-6173abfb3ffd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:14.642191 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d142ed3c-07a2-4aff-b755-6173abfb3ffd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:14.642721 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-78312f2a-51b6-4326-b948-f89faf8e1254 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:14.643134 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d142ed3c-07a2-4aff-b755-6173abfb3ffd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:14.643332 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d142ed3c-07a2-4aff-b755-6173abfb3ffd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:14.643467 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-78312f2a-51b6-4326-b948-f89faf8e1254 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:14.643750 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d142ed3c-07a2-4aff-b755-6173abfb3ffd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:14.650000 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-78312f2a-51b6-4326-b948-f89faf8e1254 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:14.650480 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-78312f2a-51b6-4326-b948-f89faf8e1254 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:14.650916 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-78312f2a-51b6-4326-b948-f89faf8e1254 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:14.651643 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-78312f2a-51b6-4326-b948-f89faf8e1254 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:14.652099 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-78312f2a-51b6-4326-b948-f89faf8e1254 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:14.652528 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-78312f2a-51b6-4326-b948-f89faf8e1254 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:14.840468 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d142ed3c-07a2-4aff-b755-6173abfb3ffd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:14.843664 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-78312f2a-51b6-4326-b948-f89faf8e1254 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:14.848375 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d142ed3c-07a2-4aff-b755-6173abfb3ffd tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.218989 Aug 10 13:03:14.849022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1496/3007] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:14 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:14.852822 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-78312f2a-51b6-4326-b948-f89faf8e1254 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:14.854337 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-78312f2a-51b6-4326-b948-f89faf8e1254 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:14.855794 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-78312f2a-51b6-4326-b948-f89faf8e1254 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.216948 Aug 10 13:03:14.856353 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1512/3008] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:14 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:03:14.863956 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:03:14.864119 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Wed Aug 10 13:03:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:03:15.106232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-69a91ef6-6932-49b2-9bee-4ec1c090c0ea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:15.106846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-69a91ef6-6932-49b2-9bee-4ec1c090c0ea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:15.112730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-69a91ef6-6932-49b2-9bee-4ec1c090c0ea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:15.113212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-69a91ef6-6932-49b2-9bee-4ec1c090c0ea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:15.113649 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-69a91ef6-6932-49b2-9bee-4ec1c090c0ea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:15.114337 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-69a91ef6-6932-49b2-9bee-4ec1c090c0ea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:15.114792 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-69a91ef6-6932-49b2-9bee-4ec1c090c0ea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:15.115242 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-69a91ef6-6932-49b2-9bee-4ec1c090c0ea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:15.159927 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4594b3fa-1691-4211-97cc-3cbea7b35a79 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:15.160532 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4594b3fa-1691-4211-97cc-3cbea7b35a79 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:15.167564 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4594b3fa-1691-4211-97cc-3cbea7b35a79 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:15.168048 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4594b3fa-1691-4211-97cc-3cbea7b35a79 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:15.168481 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4594b3fa-1691-4211-97cc-3cbea7b35a79 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:15.169194 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4594b3fa-1691-4211-97cc-3cbea7b35a79 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:15.169643 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4594b3fa-1691-4211-97cc-3cbea7b35a79 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:15.170066 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4594b3fa-1691-4211-97cc-3cbea7b35a79 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:15.293004 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-69a91ef6-6932-49b2-9bee-4ec1c090c0ea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:15.299789 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-69a91ef6-6932-49b2-9bee-4ec1c090c0ea tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.198385 Aug 10 13:03:15.300927 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1497/3009] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:15 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:15.340394 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4594b3fa-1691-4211-97cc-3cbea7b35a79 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:15.349040 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4594b3fa-1691-4211-97cc-3cbea7b35a79 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.192704 Aug 10 13:03:15.350486 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1513/3010] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:15 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:15.351303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-faa3aa0e-bfe2-4500-b2d4-440a852020df tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:15.352364 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-faa3aa0e-bfe2-4500-b2d4-440a852020df tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:15.358784 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-faa3aa0e-bfe2-4500-b2d4-440a852020df tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:15.359326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-faa3aa0e-bfe2-4500-b2d4-440a852020df tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:15.359767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-faa3aa0e-bfe2-4500-b2d4-440a852020df tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:15.360462 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-faa3aa0e-bfe2-4500-b2d4-440a852020df tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:15.360917 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-faa3aa0e-bfe2-4500-b2d4-440a852020df tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:15.361346 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-faa3aa0e-bfe2-4500-b2d4-440a852020df tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:15.387906 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-faa3aa0e-bfe2-4500-b2d4-440a852020df tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Going to try to terminate instance {{(pid=124643) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:03:15.556810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR oslo.messaging._drivers.impl_rabbit [None req-faa3aa0e-bfe2-4500-b2d4-440a852020df tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [7e044c67-15e3-4fc7-bc18-3c975a9c203b] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 13:03:15.869999 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bc26d9d3-b8a0-4805-9367-3167d69d7db3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:15.870613 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bc26d9d3-b8a0-4805-9367-3167d69d7db3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:15.877036 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc26d9d3-b8a0-4805-9367-3167d69d7db3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:15.877516 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc26d9d3-b8a0-4805-9367-3167d69d7db3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:15.877950 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc26d9d3-b8a0-4805-9367-3167d69d7db3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:15.878637 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc26d9d3-b8a0-4805-9367-3167d69d7db3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:15.879090 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc26d9d3-b8a0-4805-9367-3167d69d7db3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:15.879536 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc26d9d3-b8a0-4805-9367-3167d69d7db3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:16.007510 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-bc26d9d3-b8a0-4805-9367-3167d69d7db3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:16.015931 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bc26d9d3-b8a0-4805-9367-3167d69d7db3 tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.149910 Aug 10 13:03:16.016495 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1514/3011] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:15 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:16.020832 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-29ca0c11-bebc-4884-abef-7b95839f1afe tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:16.021439 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-29ca0c11-bebc-4884-abef-7b95839f1afe tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:16.027129 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-29ca0c11-bebc-4884-abef-7b95839f1afe tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:16.027639 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-29ca0c11-bebc-4884-abef-7b95839f1afe tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:16.028072 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-29ca0c11-bebc-4884-abef-7b95839f1afe tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:16.028758 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-29ca0c11-bebc-4884-abef-7b95839f1afe tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:16.029208 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-29ca0c11-bebc-4884-abef-7b95839f1afe tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:16.029630 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-29ca0c11-bebc-4884-abef-7b95839f1afe tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:16.159029 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-29ca0c11-bebc-4884-abef-7b95839f1afe tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:16.168111 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-29ca0c11-bebc-4884-abef-7b95839f1afe tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:16.169600 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-29ca0c11-bebc-4884-abef-7b95839f1afe tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:16.170757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-29ca0c11-bebc-4884-abef-7b95839f1afe tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.153359 Aug 10 13:03:16.171338 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1515/3012] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:16 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:03:16.322203 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8eee89d0-437a-4f21-a943-cf1e3c95bbb0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:16.322814 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8eee89d0-437a-4f21-a943-cf1e3c95bbb0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:16.328650 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8eee89d0-437a-4f21-a943-cf1e3c95bbb0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:16.329125 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8eee89d0-437a-4f21-a943-cf1e3c95bbb0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:16.329554 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8eee89d0-437a-4f21-a943-cf1e3c95bbb0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:16.330227 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8eee89d0-437a-4f21-a943-cf1e3c95bbb0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:16.330671 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8eee89d0-437a-4f21-a943-cf1e3c95bbb0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:16.331089 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8eee89d0-437a-4f21-a943-cf1e3c95bbb0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:16.461464 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-8eee89d0-437a-4f21-a943-cf1e3c95bbb0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:16.469515 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8eee89d0-437a-4f21-a943-cf1e3c95bbb0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.151458 Aug 10 13:03:16.470083 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1516/3013] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:16 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:16.474530 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-82dca941-da15-44f7-a4a9-a41b556721e3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:16.475125 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-82dca941-da15-44f7-a4a9-a41b556721e3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:16.480921 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82dca941-da15-44f7-a4a9-a41b556721e3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:16.481398 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82dca941-da15-44f7-a4a9-a41b556721e3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:16.481824 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82dca941-da15-44f7-a4a9-a41b556721e3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:16.482501 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82dca941-da15-44f7-a4a9-a41b556721e3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:16.482943 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82dca941-da15-44f7-a4a9-a41b556721e3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:16.483393 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-82dca941-da15-44f7-a4a9-a41b556721e3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:16.564465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [None req-faa3aa0e-bfe2-4500-b2d4-440a852020df tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [7e044c67-15e3-4fc7-bc18-3c975a9c203b] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 49932. Aug 10 13:03:16.613540 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-82dca941-da15-44f7-a4a9-a41b556721e3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:16.617267 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:16.622396 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-82dca941-da15-44f7-a4a9-a41b556721e3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.151352 Aug 10 13:03:16.622970 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1517/3014] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:16 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:16.627894 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-faa3aa0e-bfe2-4500-b2d4-440a852020df tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "DELETE /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 204 len: 0 microversion: 2.1 time: 1.280465 Aug 10 13:03:16.628499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1498/3015] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 13:03:15 2022] DELETE /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 0 bytes in 1283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:03:16.640987 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-16de41b1-cb7b-4e03-8848-7215b01283d6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:16.641598 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-16de41b1-cb7b-4e03-8848-7215b01283d6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:16.652870 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-16de41b1-cb7b-4e03-8848-7215b01283d6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:16.653362 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-16de41b1-cb7b-4e03-8848-7215b01283d6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:16.653802 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-16de41b1-cb7b-4e03-8848-7215b01283d6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:16.654530 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-16de41b1-cb7b-4e03-8848-7215b01283d6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:16.654982 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-16de41b1-cb7b-4e03-8848-7215b01283d6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:16.655433 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-16de41b1-cb7b-4e03-8848-7215b01283d6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:16.787762 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-16de41b1-cb7b-4e03-8848-7215b01283d6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:16.795683 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-16de41b1-cb7b-4e03-8848-7215b01283d6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1716 microversion: 2.1 time: 0.158496 Aug 10 13:03:16.796253 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1518/3016] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:16 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:17.037153 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-022c3797-e68a-473f-85bc-e6aa8ea52c4e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:17.037855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-022c3797-e68a-473f-85bc-e6aa8ea52c4e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] [instance: 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:17.044279 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-022c3797-e68a-473f-85bc-e6aa8ea52c4e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:17.044763 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-022c3797-e68a-473f-85bc-e6aa8ea52c4e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:17.045202 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-022c3797-e68a-473f-85bc-e6aa8ea52c4e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:17.045895 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-022c3797-e68a-473f-85bc-e6aa8ea52c4e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:17.046350 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-022c3797-e68a-473f-85bc-e6aa8ea52c4e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:17.046779 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-022c3797-e68a-473f-85bc-e6aa8ea52c4e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:17.176304 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-022c3797-e68a-473f-85bc-e6aa8ea52c4e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e3d29dcfbc43a1aa2c26b676f5894c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4fa99fc6514cceb31af25c94623178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:17.184804 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-022c3797-e68a-473f-85bc-e6aa8ea52c4e tempest-VolumesSnapshotTestJSON-468414097 tempest-VolumesSnapshotTestJSON-468414097-project] 10.222.0.49 "GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a" status: 200 len: 1560 microversion: 2.1 time: 0.151918 Aug 10 13:03:17.185380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1499/3017] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:17 2022] GET /compute/v2.1/servers/8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:17.193635 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e1e07b0a-d5a9-4a46-b18b-24b86f783cb5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:17.194341 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e1e07b0a-d5a9-4a46-b18b-24b86f783cb5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:17.201763 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1e07b0a-d5a9-4a46-b18b-24b86f783cb5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:17.202518 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1e07b0a-d5a9-4a46-b18b-24b86f783cb5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:17.202962 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1e07b0a-d5a9-4a46-b18b-24b86f783cb5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:17.203685 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1e07b0a-d5a9-4a46-b18b-24b86f783cb5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:17.204142 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1e07b0a-d5a9-4a46-b18b-24b86f783cb5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:17.204571 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1e07b0a-d5a9-4a46-b18b-24b86f783cb5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:17.338361 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e1e07b0a-d5a9-4a46-b18b-24b86f783cb5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:17.347337 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e1e07b0a-d5a9-4a46-b18b-24b86f783cb5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:17.348849 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e1e07b0a-d5a9-4a46-b18b-24b86f783cb5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:17.350033 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e1e07b0a-d5a9-4a46-b18b-24b86f783cb5 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.160391 Aug 10 13:03:17.359510 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1519/3018] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:17 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:03:17.492875 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-dc0ca654-9852-49d7-b1db-8fbc3e51fd80 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:17.493454 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-dc0ca654-9852-49d7-b1db-8fbc3e51fd80 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:17.499326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dc0ca654-9852-49d7-b1db-8fbc3e51fd80 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:17.499813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dc0ca654-9852-49d7-b1db-8fbc3e51fd80 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:17.500273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dc0ca654-9852-49d7-b1db-8fbc3e51fd80 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:17.500974 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dc0ca654-9852-49d7-b1db-8fbc3e51fd80 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:17.501424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dc0ca654-9852-49d7-b1db-8fbc3e51fd80 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:17.501847 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dc0ca654-9852-49d7-b1db-8fbc3e51fd80 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:17.645834 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1571d2c6-92b2-4492-af2a-5d76bde5d5ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:17.647323 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1571d2c6-92b2-4492-af2a-5d76bde5d5ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:17.656057 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1571d2c6-92b2-4492-af2a-5d76bde5d5ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:17.657427 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1571d2c6-92b2-4492-af2a-5d76bde5d5ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:17.657943 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1571d2c6-92b2-4492-af2a-5d76bde5d5ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:17.658766 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1571d2c6-92b2-4492-af2a-5d76bde5d5ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:17.659433 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1571d2c6-92b2-4492-af2a-5d76bde5d5ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:17.662219 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1571d2c6-92b2-4492-af2a-5d76bde5d5ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:17.734041 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-dc0ca654-9852-49d7-b1db-8fbc3e51fd80 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:17.742161 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-dc0ca654-9852-49d7-b1db-8fbc3e51fd80 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.254414 Aug 10 13:03:17.742916 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1500/3019] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:17 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:17.816477 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d2997bb4-dc95-40bf-a833-8aa3493f52de tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:17.820007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d2997bb4-dc95-40bf-a833-8aa3493f52de tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:17.823277 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d2997bb4-dc95-40bf-a833-8aa3493f52de tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:17.823761 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d2997bb4-dc95-40bf-a833-8aa3493f52de tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:17.824193 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d2997bb4-dc95-40bf-a833-8aa3493f52de tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:17.824880 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d2997bb4-dc95-40bf-a833-8aa3493f52de tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:17.825483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d2997bb4-dc95-40bf-a833-8aa3493f52de tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:17.825925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d2997bb4-dc95-40bf-a833-8aa3493f52de tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:17.954587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-1571d2c6-92b2-4492-af2a-5d76bde5d5ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:17.963421 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1571d2c6-92b2-4492-af2a-5d76bde5d5ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.323008 Aug 10 13:03:17.964007 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1520/3020] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:17 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:18.077168 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d2997bb4-dc95-40bf-a833-8aa3493f52de tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:18.087514 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d2997bb4-dc95-40bf-a833-8aa3493f52de tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1716 microversion: 2.1 time: 0.273757 Aug 10 13:03:18.088113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1501/3021] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:17 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1716 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:18.374376 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6b675c15-4f3d-43fb-96e9-e286cfad107d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:18.375068 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6b675c15-4f3d-43fb-96e9-e286cfad107d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:18.381643 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6b675c15-4f3d-43fb-96e9-e286cfad107d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:18.387434 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6b675c15-4f3d-43fb-96e9-e286cfad107d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:18.387434 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6b675c15-4f3d-43fb-96e9-e286cfad107d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:18.387434 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6b675c15-4f3d-43fb-96e9-e286cfad107d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:18.387434 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6b675c15-4f3d-43fb-96e9-e286cfad107d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:18.387910 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6b675c15-4f3d-43fb-96e9-e286cfad107d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:18.528196 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:03:18.528196 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Wed Aug 10 13:03:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:03:18.763923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-24397dc6-197b-4c6d-8087-e727b5454820 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:18.764602 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-24397dc6-197b-4c6d-8087-e727b5454820 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:18.771569 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24397dc6-197b-4c6d-8087-e727b5454820 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:18.772073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24397dc6-197b-4c6d-8087-e727b5454820 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:18.772551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24397dc6-197b-4c6d-8087-e727b5454820 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:18.773309 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24397dc6-197b-4c6d-8087-e727b5454820 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:18.774486 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24397dc6-197b-4c6d-8087-e727b5454820 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:18.774922 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24397dc6-197b-4c6d-8087-e727b5454820 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:18.840708 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6b675c15-4f3d-43fb-96e9-e286cfad107d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:18.849351 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6b675c15-4f3d-43fb-96e9-e286cfad107d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:18.850845 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6b675c15-4f3d-43fb-96e9-e286cfad107d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:18.852254 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6b675c15-4f3d-43fb-96e9-e286cfad107d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.481896 Aug 10 13:03:18.852811 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1521/3022] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:18 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:03:18.977515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-24397dc6-197b-4c6d-8087-e727b5454820 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:18.987138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-24397dc6-197b-4c6d-8087-e727b5454820 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.227043 Aug 10 13:03:18.987998 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1502/3023] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:18 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:18.993691 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9a3e7735-2fd7-4504-b3d2-27d31268f038 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:18.994573 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9a3e7735-2fd7-4504-b3d2-27d31268f038 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:19.000625 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a3e7735-2fd7-4504-b3d2-27d31268f038 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:19.001390 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a3e7735-2fd7-4504-b3d2-27d31268f038 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:19.002099 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a3e7735-2fd7-4504-b3d2-27d31268f038 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:19.002871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a3e7735-2fd7-4504-b3d2-27d31268f038 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:19.003592 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a3e7735-2fd7-4504-b3d2-27d31268f038 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:19.004253 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a3e7735-2fd7-4504-b3d2-27d31268f038 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:19.026338 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [req-70b555c3-adf4-472e-a1f1-a2180ee3391c req-9c3bfff8-dec2-4e0e-9ffb-63d901d83a9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88f016f1-19e1-466c-9e03-5a125f281e25", "name": "network-vif-deleted", "tag": "d9a14494-c057-4e68-b287-dbdca61760ac"}]} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:03:19.036725 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-70b555c3-adf4-472e-a1f1-a2180ee3391c req-9c3bfff8-dec2-4e0e-9ffb-63d901d83a9b service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:19.037667 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-70b555c3-adf4-472e-a1f1-a2180ee3391c req-9c3bfff8-dec2-4e0e-9ffb-63d901d83a9b service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:19.038423 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-70b555c3-adf4-472e-a1f1-a2180ee3391c req-9c3bfff8-dec2-4e0e-9ffb-63d901d83a9b service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:19.055391 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.compute.server_external_events [req-70b555c3-adf4-472e-a1f1-a2180ee3391c req-9c3bfff8-dec2-4e0e-9ffb-63d901d83a9b service nova] Creating event network-vif-deleted:d9a14494-c057-4e68-b287-dbdca61760ac for instance 88f016f1-19e1-466c-9e03-5a125f281e25 on hv-cinder-85199 Aug 10 13:03:19.063207 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [req-70b555c3-adf4-472e-a1f1-a2180ee3391c req-9c3bfff8-dec2-4e0e-9ffb-63d901d83a9b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114900 Aug 10 13:03:19.063207 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1522/3024] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:03:19.110188 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fa712b3f-3427-47f9-b60d-8829b1b0d6ee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:19.111924 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fa712b3f-3427-47f9-b60d-8829b1b0d6ee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:19.118693 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa712b3f-3427-47f9-b60d-8829b1b0d6ee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:19.119317 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa712b3f-3427-47f9-b60d-8829b1b0d6ee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:19.119814 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa712b3f-3427-47f9-b60d-8829b1b0d6ee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:19.120575 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa712b3f-3427-47f9-b60d-8829b1b0d6ee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:19.121085 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa712b3f-3427-47f9-b60d-8829b1b0d6ee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:19.121738 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fa712b3f-3427-47f9-b60d-8829b1b0d6ee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:19.143994 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9a3e7735-2fd7-4504-b3d2-27d31268f038 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:19.154485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9a3e7735-2fd7-4504-b3d2-27d31268f038 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.165226 Aug 10 13:03:19.155191 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1503/3025] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:18 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:19.193314 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fa712b3f-3427-47f9-b60d-8829b1b0d6ee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:19.201637 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fa712b3f-3427-47f9-b60d-8829b1b0d6ee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.095827 Aug 10 13:03:19.202298 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1523/3026] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:19 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:19.876150 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b8f13695-e0d4-48c6-9e5f-dae198e6c7b2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:19.876736 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b8f13695-e0d4-48c6-9e5f-dae198e6c7b2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:19.884538 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8f13695-e0d4-48c6-9e5f-dae198e6c7b2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:19.885020 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8f13695-e0d4-48c6-9e5f-dae198e6c7b2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:19.885482 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8f13695-e0d4-48c6-9e5f-dae198e6c7b2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:19.886182 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8f13695-e0d4-48c6-9e5f-dae198e6c7b2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:19.886631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8f13695-e0d4-48c6-9e5f-dae198e6c7b2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:19.887045 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8f13695-e0d4-48c6-9e5f-dae198e6c7b2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:20.010041 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-81c87cb0-5b12-46c9-a2dc-31b95a3e0a9d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:20.010714 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-81c87cb0-5b12-46c9-a2dc-31b95a3e0a9d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:20.017163 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-81c87cb0-5b12-46c9-a2dc-31b95a3e0a9d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:20.017648 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-81c87cb0-5b12-46c9-a2dc-31b95a3e0a9d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:20.018082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-81c87cb0-5b12-46c9-a2dc-31b95a3e0a9d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:20.018784 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-81c87cb0-5b12-46c9-a2dc-31b95a3e0a9d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:20.019264 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-81c87cb0-5b12-46c9-a2dc-31b95a3e0a9d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:20.019755 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-81c87cb0-5b12-46c9-a2dc-31b95a3e0a9d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:20.023897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b8f13695-e0d4-48c6-9e5f-dae198e6c7b2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:20.032839 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b8f13695-e0d4-48c6-9e5f-dae198e6c7b2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:20.034338 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b8f13695-e0d4-48c6-9e5f-dae198e6c7b2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:20.035546 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b8f13695-e0d4-48c6-9e5f-dae198e6c7b2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.163445 Aug 10 13:03:20.036101 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1504/3027] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:19 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:03:20.152517 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-81c87cb0-5b12-46c9-a2dc-31b95a3e0a9d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:20.160471 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-81c87cb0-5b12-46c9-a2dc-31b95a3e0a9d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.154495 Aug 10 13:03:20.161038 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1524/3028] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:20 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:20.176459 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fcf280d1-5853-4c40-be68-cc56df1dfb87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:20.177069 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fcf280d1-5853-4c40-be68-cc56df1dfb87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:20.183021 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fcf280d1-5853-4c40-be68-cc56df1dfb87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:20.183527 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fcf280d1-5853-4c40-be68-cc56df1dfb87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:20.183959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fcf280d1-5853-4c40-be68-cc56df1dfb87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:20.184638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fcf280d1-5853-4c40-be68-cc56df1dfb87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:20.185087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fcf280d1-5853-4c40-be68-cc56df1dfb87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:20.185509 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fcf280d1-5853-4c40-be68-cc56df1dfb87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:20.188020 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:20.223049 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-353e2a41-b5bc-4c07-9174-f65d64655aee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:20.223766 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-353e2a41-b5bc-4c07-9174-f65d64655aee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:20.232483 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-353e2a41-b5bc-4c07-9174-f65d64655aee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:20.232483 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-353e2a41-b5bc-4c07-9174-f65d64655aee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:20.232483 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-353e2a41-b5bc-4c07-9174-f65d64655aee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:20.232878 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-353e2a41-b5bc-4c07-9174-f65d64655aee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:20.233301 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-353e2a41-b5bc-4c07-9174-f65d64655aee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:20.233659 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-353e2a41-b5bc-4c07-9174-f65d64655aee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:20.313009 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-353e2a41-b5bc-4c07-9174-f65d64655aee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:20.321699 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-353e2a41-b5bc-4c07-9174-f65d64655aee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.102513 Aug 10 13:03:20.322282 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1525/3029] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:20 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:20.343488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fcf280d1-5853-4c40-be68-cc56df1dfb87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:20.351311 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fcf280d1-5853-4c40-be68-cc56df1dfb87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.178704 Aug 10 13:03:20.351914 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1505/3030] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:20 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:21.059997 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9ff6e64d-b1ee-421a-8e98-5a4c0b5ba059 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:21.060609 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9ff6e64d-b1ee-421a-8e98-5a4c0b5ba059 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:21.067055 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ff6e64d-b1ee-421a-8e98-5a4c0b5ba059 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:21.067580 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ff6e64d-b1ee-421a-8e98-5a4c0b5ba059 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:21.068013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ff6e64d-b1ee-421a-8e98-5a4c0b5ba059 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:21.068725 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ff6e64d-b1ee-421a-8e98-5a4c0b5ba059 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:21.069176 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ff6e64d-b1ee-421a-8e98-5a4c0b5ba059 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:21.069598 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ff6e64d-b1ee-421a-8e98-5a4c0b5ba059 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:21.182415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-14a205fe-1442-4ca3-90a0-829c35ccfe28 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:21.183049 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-14a205fe-1442-4ca3-90a0-829c35ccfe28 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:21.189427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-14a205fe-1442-4ca3-90a0-829c35ccfe28 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:21.189913 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-14a205fe-1442-4ca3-90a0-829c35ccfe28 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:21.190350 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-14a205fe-1442-4ca3-90a0-829c35ccfe28 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:21.191041 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-14a205fe-1442-4ca3-90a0-829c35ccfe28 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:21.191515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-14a205fe-1442-4ca3-90a0-829c35ccfe28 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:21.191942 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-14a205fe-1442-4ca3-90a0-829c35ccfe28 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:21.198416 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9ff6e64d-b1ee-421a-8e98-5a4c0b5ba059 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:21.206933 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9ff6e64d-b1ee-421a-8e98-5a4c0b5ba059 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:21.208516 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9ff6e64d-b1ee-421a-8e98-5a4c0b5ba059 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:21.209690 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9ff6e64d-b1ee-421a-8e98-5a4c0b5ba059 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.154593 Aug 10 13:03:21.210246 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1526/3031] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:21 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:03:21.324333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-14a205fe-1442-4ca3-90a0-829c35ccfe28 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:21.332233 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-14a205fe-1442-4ca3-90a0-829c35ccfe28 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.154342 Aug 10 13:03:21.332808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1506/3032] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:21 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:21.342411 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8e8ed292-0969-4b30-94b0-41e5f2fbc5a6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:21.343024 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8e8ed292-0969-4b30-94b0-41e5f2fbc5a6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:21.348965 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8e8ed292-0969-4b30-94b0-41e5f2fbc5a6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:21.349446 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8e8ed292-0969-4b30-94b0-41e5f2fbc5a6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:21.349882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8e8ed292-0969-4b30-94b0-41e5f2fbc5a6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:21.350563 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8e8ed292-0969-4b30-94b0-41e5f2fbc5a6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:21.351013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8e8ed292-0969-4b30-94b0-41e5f2fbc5a6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:21.351468 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8e8ed292-0969-4b30-94b0-41e5f2fbc5a6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:21.371973 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0eccd8d9-286e-45dd-9542-f92649f2cd52 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:21.372577 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0eccd8d9-286e-45dd-9542-f92649f2cd52 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:21.378428 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0eccd8d9-286e-45dd-9542-f92649f2cd52 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:21.378903 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0eccd8d9-286e-45dd-9542-f92649f2cd52 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:21.379367 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0eccd8d9-286e-45dd-9542-f92649f2cd52 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:21.380045 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0eccd8d9-286e-45dd-9542-f92649f2cd52 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:21.380490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0eccd8d9-286e-45dd-9542-f92649f2cd52 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:21.380914 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0eccd8d9-286e-45dd-9542-f92649f2cd52 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:21.412725 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-8e8ed292-0969-4b30-94b0-41e5f2fbc5a6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:21.421703 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8e8ed292-0969-4b30-94b0-41e5f2fbc5a6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083263 Aug 10 13:03:21.422284 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1527/3033] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:21 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:21.486049 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:03:21.486284 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Wed Aug 10 13:03:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 (ip 10.222.0.49) !!! Aug 10 13:03:21.511676 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0eccd8d9-286e-45dd-9542-f92649f2cd52 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:21.519558 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0eccd8d9-286e-45dd-9542-f92649f2cd52 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.151496 Aug 10 13:03:21.520118 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1507/3034] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:21 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:22.234063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-46323744-19ae-40a0-a9a9-22cf46d9ef58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:22.234701 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-46323744-19ae-40a0-a9a9-22cf46d9ef58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:22.241087 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46323744-19ae-40a0-a9a9-22cf46d9ef58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:22.241563 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46323744-19ae-40a0-a9a9-22cf46d9ef58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:22.241990 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46323744-19ae-40a0-a9a9-22cf46d9ef58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:22.242664 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46323744-19ae-40a0-a9a9-22cf46d9ef58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:22.243141 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46323744-19ae-40a0-a9a9-22cf46d9ef58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:22.243582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46323744-19ae-40a0-a9a9-22cf46d9ef58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:22.355678 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bff690c7-d8d8-4d22-9830-11e247606415 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:22.356283 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bff690c7-d8d8-4d22-9830-11e247606415 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:22.362196 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bff690c7-d8d8-4d22-9830-11e247606415 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:22.362674 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bff690c7-d8d8-4d22-9830-11e247606415 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:22.363105 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bff690c7-d8d8-4d22-9830-11e247606415 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:22.363844 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bff690c7-d8d8-4d22-9830-11e247606415 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:22.364295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bff690c7-d8d8-4d22-9830-11e247606415 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:22.364720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bff690c7-d8d8-4d22-9830-11e247606415 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:22.374657 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-46323744-19ae-40a0-a9a9-22cf46d9ef58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:22.383898 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-46323744-19ae-40a0-a9a9-22cf46d9ef58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:22.386840 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-46323744-19ae-40a0-a9a9-22cf46d9ef58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:22.388088 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-46323744-19ae-40a0-a9a9-22cf46d9ef58 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.158946 Aug 10 13:03:22.388705 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1528/3035] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:22 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:03:22.442086 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-703bec1c-9156-440c-93d5-43bc03904dba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:22.442705 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-703bec1c-9156-440c-93d5-43bc03904dba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:22.450118 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-703bec1c-9156-440c-93d5-43bc03904dba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:22.450610 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-703bec1c-9156-440c-93d5-43bc03904dba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:22.451043 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-703bec1c-9156-440c-93d5-43bc03904dba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:22.451780 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-703bec1c-9156-440c-93d5-43bc03904dba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:22.452229 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-703bec1c-9156-440c-93d5-43bc03904dba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:22.452654 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-703bec1c-9156-440c-93d5-43bc03904dba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:22.518690 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-703bec1c-9156-440c-93d5-43bc03904dba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:22.527388 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-703bec1c-9156-440c-93d5-43bc03904dba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.089118 Aug 10 13:03:22.527962 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1529/3036] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:22 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:22.540518 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c491ef44-022e-43d2-91d5-ce8bb65fc62b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:22.541936 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c491ef44-022e-43d2-91d5-ce8bb65fc62b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:22.547754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c491ef44-022e-43d2-91d5-ce8bb65fc62b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:22.548233 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c491ef44-022e-43d2-91d5-ce8bb65fc62b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:22.548661 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c491ef44-022e-43d2-91d5-ce8bb65fc62b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:22.549343 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c491ef44-022e-43d2-91d5-ce8bb65fc62b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:22.549792 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c491ef44-022e-43d2-91d5-ce8bb65fc62b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:22.550216 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c491ef44-022e-43d2-91d5-ce8bb65fc62b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:22.694735 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-bff690c7-d8d8-4d22-9830-11e247606415 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:22.703454 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bff690c7-d8d8-4d22-9830-11e247606415 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.352296 Aug 10 13:03:22.704142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1508/3037] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:22 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:22.722959 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c491ef44-022e-43d2-91d5-ce8bb65fc62b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:22.731507 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c491ef44-022e-43d2-91d5-ce8bb65fc62b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.194490 Aug 10 13:03:22.732095 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1530/3038] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:22 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:23.412030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f21f23e4-e20a-4d18-af09-73c8d203ebe7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:23.412638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f21f23e4-e20a-4d18-af09-73c8d203ebe7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:23.419737 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f21f23e4-e20a-4d18-af09-73c8d203ebe7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:23.420217 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f21f23e4-e20a-4d18-af09-73c8d203ebe7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:23.420651 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f21f23e4-e20a-4d18-af09-73c8d203ebe7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:23.421331 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f21f23e4-e20a-4d18-af09-73c8d203ebe7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:23.421778 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f21f23e4-e20a-4d18-af09-73c8d203ebe7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:23.422202 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f21f23e4-e20a-4d18-af09-73c8d203ebe7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:23.548097 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f21f23e4-e20a-4d18-af09-73c8d203ebe7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:23.548810 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e87e4936-2ee2-44e9-bc1d-d542b52a4e5f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:23.549510 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e87e4936-2ee2-44e9-bc1d-d542b52a4e5f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:23.555828 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e87e4936-2ee2-44e9-bc1d-d542b52a4e5f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:23.556313 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e87e4936-2ee2-44e9-bc1d-d542b52a4e5f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:23.556474 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f21f23e4-e20a-4d18-af09-73c8d203ebe7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:23.556757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e87e4936-2ee2-44e9-bc1d-d542b52a4e5f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:23.558135 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e87e4936-2ee2-44e9-bc1d-d542b52a4e5f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:23.558599 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e87e4936-2ee2-44e9-bc1d-d542b52a4e5f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:23.558714 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f21f23e4-e20a-4d18-af09-73c8d203ebe7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:23.559028 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e87e4936-2ee2-44e9-bc1d-d542b52a4e5f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:23.559892 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f21f23e4-e20a-4d18-af09-73c8d203ebe7 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.151821 Aug 10 13:03:23.560443 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1509/3039] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:23 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:03:23.618843 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e87e4936-2ee2-44e9-bc1d-d542b52a4e5f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:23.627448 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e87e4936-2ee2-44e9-bc1d-d542b52a4e5f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082640 Aug 10 13:03:23.628021 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1531/3040] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:23 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:23.725079 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-dd3bf7f9-ab99-485f-ae7d-c7861ca78a3a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:23.725687 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-dd3bf7f9-ab99-485f-ae7d-c7861ca78a3a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:23.732475 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd3bf7f9-ab99-485f-ae7d-c7861ca78a3a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:23.732955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd3bf7f9-ab99-485f-ae7d-c7861ca78a3a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:23.733390 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd3bf7f9-ab99-485f-ae7d-c7861ca78a3a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:23.734074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd3bf7f9-ab99-485f-ae7d-c7861ca78a3a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:23.734522 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd3bf7f9-ab99-485f-ae7d-c7861ca78a3a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:23.734945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd3bf7f9-ab99-485f-ae7d-c7861ca78a3a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:23.752532 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-96c20085-63fc-4f60-84d0-718a1a02ebad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:23.753151 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-96c20085-63fc-4f60-84d0-718a1a02ebad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:23.758965 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-96c20085-63fc-4f60-84d0-718a1a02ebad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:23.759486 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-96c20085-63fc-4f60-84d0-718a1a02ebad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:23.759926 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-96c20085-63fc-4f60-84d0-718a1a02ebad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:23.761370 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-96c20085-63fc-4f60-84d0-718a1a02ebad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:23.761821 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-96c20085-63fc-4f60-84d0-718a1a02ebad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:23.762252 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-96c20085-63fc-4f60-84d0-718a1a02ebad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:23.936258 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-dd3bf7f9-ab99-485f-ae7d-c7861ca78a3a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:23.940272 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-96c20085-63fc-4f60-84d0-718a1a02ebad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:23.944383 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-dd3bf7f9-ab99-485f-ae7d-c7861ca78a3a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.223019 Aug 10 13:03:23.944951 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1510/3041] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:23 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:23.948829 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-96c20085-63fc-4f60-84d0-718a1a02ebad tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.199287 Aug 10 13:03:23.949388 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1532/3042] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:23 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:24.583195 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9b41df4c-7077-4c82-b8c3-d2b7f173abf2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:24.583800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9b41df4c-7077-4c82-b8c3-d2b7f173abf2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:24.590632 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9b41df4c-7077-4c82-b8c3-d2b7f173abf2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:24.591114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9b41df4c-7077-4c82-b8c3-d2b7f173abf2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:24.591581 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9b41df4c-7077-4c82-b8c3-d2b7f173abf2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:24.592265 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9b41df4c-7077-4c82-b8c3-d2b7f173abf2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:24.592749 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9b41df4c-7077-4c82-b8c3-d2b7f173abf2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:24.593173 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9b41df4c-7077-4c82-b8c3-d2b7f173abf2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:24.647245 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-aeb05dcc-b89b-4bc4-874c-043e78d5f4d7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:24.647851 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-aeb05dcc-b89b-4bc4-874c-043e78d5f4d7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:24.654462 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aeb05dcc-b89b-4bc4-874c-043e78d5f4d7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:24.654955 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aeb05dcc-b89b-4bc4-874c-043e78d5f4d7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:24.655480 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aeb05dcc-b89b-4bc4-874c-043e78d5f4d7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:24.656190 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aeb05dcc-b89b-4bc4-874c-043e78d5f4d7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:24.656651 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aeb05dcc-b89b-4bc4-874c-043e78d5f4d7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:24.657078 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-aeb05dcc-b89b-4bc4-874c-043e78d5f4d7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:24.730007 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-aeb05dcc-b89b-4bc4-874c-043e78d5f4d7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:24.737963 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-aeb05dcc-b89b-4bc4-874c-043e78d5f4d7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.094626 Aug 10 13:03:24.738538 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1533/3043] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:24 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:24.751496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9b41df4c-7077-4c82-b8c3-d2b7f173abf2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:24.759838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9b41df4c-7077-4c82-b8c3-d2b7f173abf2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:24.762121 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9b41df4c-7077-4c82-b8c3-d2b7f173abf2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:24.763295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9b41df4c-7077-4c82-b8c3-d2b7f173abf2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.184026 Aug 10 13:03:24.763845 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1511/3044] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:24 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:03:24.966869 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f77484b5-9c25-4935-8ef2-6a0abd0bdb97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:24.967438 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f77484b5-9c25-4935-8ef2-6a0abd0bdb97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:24.973262 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-483a9c26-66fb-4202-926c-201909454dd7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:24.973460 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f77484b5-9c25-4935-8ef2-6a0abd0bdb97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:24.973856 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f77484b5-9c25-4935-8ef2-6a0abd0bdb97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:24.973985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-483a9c26-66fb-4202-926c-201909454dd7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:24.974288 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f77484b5-9c25-4935-8ef2-6a0abd0bdb97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:24.974977 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f77484b5-9c25-4935-8ef2-6a0abd0bdb97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:24.975454 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f77484b5-9c25-4935-8ef2-6a0abd0bdb97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:24.975877 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f77484b5-9c25-4935-8ef2-6a0abd0bdb97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:24.980410 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-483a9c26-66fb-4202-926c-201909454dd7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:24.980884 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-483a9c26-66fb-4202-926c-201909454dd7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:24.981315 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-483a9c26-66fb-4202-926c-201909454dd7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:24.981999 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-483a9c26-66fb-4202-926c-201909454dd7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:24.982457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-483a9c26-66fb-4202-926c-201909454dd7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:24.982879 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-483a9c26-66fb-4202-926c-201909454dd7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:25.179448 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f77484b5-9c25-4935-8ef2-6a0abd0bdb97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:25.179580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-483a9c26-66fb-4202-926c-201909454dd7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:25.181013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f77484b5-9c25-4935-8ef2-6a0abd0bdb97 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.218055 Aug 10 13:03:25.181590 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1534/3045] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:24 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:25.185185 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-483a9c26-66fb-4202-926c-201909454dd7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.215859 Aug 10 13:03:25.185854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1512/3046] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:24 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:25.759518 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f245feec-aa0f-44e4-a051-b268dedddf1c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:25.760133 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f245feec-aa0f-44e4-a051-b268dedddf1c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:25.766972 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f245feec-aa0f-44e4-a051-b268dedddf1c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:25.767501 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f245feec-aa0f-44e4-a051-b268dedddf1c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:25.767937 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f245feec-aa0f-44e4-a051-b268dedddf1c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:25.768622 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f245feec-aa0f-44e4-a051-b268dedddf1c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:25.769078 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f245feec-aa0f-44e4-a051-b268dedddf1c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:25.769500 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f245feec-aa0f-44e4-a051-b268dedddf1c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:25.773437 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:25.785873 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-edca1981-40e0-4167-94b3-345927ef0144 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:25.786487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-edca1981-40e0-4167-94b3-345927ef0144 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:25.793544 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-edca1981-40e0-4167-94b3-345927ef0144 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:25.794018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-edca1981-40e0-4167-94b3-345927ef0144 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:25.794446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-edca1981-40e0-4167-94b3-345927ef0144 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:25.795128 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-edca1981-40e0-4167-94b3-345927ef0144 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:25.795604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-edca1981-40e0-4167-94b3-345927ef0144 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:25.796022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-edca1981-40e0-4167-94b3-345927ef0144 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:25.833262 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f245feec-aa0f-44e4-a051-b268dedddf1c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:25.841422 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f245feec-aa0f-44e4-a051-b268dedddf1c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.085750 Aug 10 13:03:25.842007 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1535/3047] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:25 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:25.930966 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-edca1981-40e0-4167-94b3-345927ef0144 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:25.939948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-edca1981-40e0-4167-94b3-345927ef0144 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:25.941456 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-edca1981-40e0-4167-94b3-345927ef0144 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:25.942597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-edca1981-40e0-4167-94b3-345927ef0144 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.160655 Aug 10 13:03:25.943149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1513/3048] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:25 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:03:26.203409 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a44c0e3b-c9db-4222-8c40-b4aafecd722b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:26.203947 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a44c0e3b-c9db-4222-8c40-b4aafecd722b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:26.205490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-59b0d674-15a1-4fe7-98e7-4ad67397e1d3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:26.206104 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-59b0d674-15a1-4fe7-98e7-4ad67397e1d3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:26.209863 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a44c0e3b-c9db-4222-8c40-b4aafecd722b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:26.210339 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a44c0e3b-c9db-4222-8c40-b4aafecd722b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:26.210762 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a44c0e3b-c9db-4222-8c40-b4aafecd722b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:26.211466 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a44c0e3b-c9db-4222-8c40-b4aafecd722b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:26.211909 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a44c0e3b-c9db-4222-8c40-b4aafecd722b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:26.212030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-59b0d674-15a1-4fe7-98e7-4ad67397e1d3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:26.212322 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a44c0e3b-c9db-4222-8c40-b4aafecd722b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:26.212429 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-59b0d674-15a1-4fe7-98e7-4ad67397e1d3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:26.212833 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-59b0d674-15a1-4fe7-98e7-4ad67397e1d3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:26.213782 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-59b0d674-15a1-4fe7-98e7-4ad67397e1d3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:26.214239 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-59b0d674-15a1-4fe7-98e7-4ad67397e1d3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:26.214657 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-59b0d674-15a1-4fe7-98e7-4ad67397e1d3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:26.401418 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a44c0e3b-c9db-4222-8c40-b4aafecd722b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:26.409634 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a44c0e3b-c9db-4222-8c40-b4aafecd722b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.210152 Aug 10 13:03:26.410020 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1536/3049] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:26 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:26.412232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-59b0d674-15a1-4fe7-98e7-4ad67397e1d3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:26.421163 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-59b0d674-15a1-4fe7-98e7-4ad67397e1d3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.219445 Aug 10 13:03:26.421721 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1514/3050] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:26 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:26.861942 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bf1bd265-ec55-42d3-8571-c99d7f78cf37 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:26.862529 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bf1bd265-ec55-42d3-8571-c99d7f78cf37 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:26.868570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf1bd265-ec55-42d3-8571-c99d7f78cf37 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:26.869045 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf1bd265-ec55-42d3-8571-c99d7f78cf37 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:26.869491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf1bd265-ec55-42d3-8571-c99d7f78cf37 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:26.871156 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf1bd265-ec55-42d3-8571-c99d7f78cf37 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:26.871629 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf1bd265-ec55-42d3-8571-c99d7f78cf37 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:26.872051 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf1bd265-ec55-42d3-8571-c99d7f78cf37 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:26.936382 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-bf1bd265-ec55-42d3-8571-c99d7f78cf37 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:26.944218 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bf1bd265-ec55-42d3-8571-c99d7f78cf37 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.086313 Aug 10 13:03:26.944787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1537/3051] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:26 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:26.966002 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9f3c194e-2d31-4e23-a7aa-4570cca05dc8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:26.966608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9f3c194e-2d31-4e23-a7aa-4570cca05dc8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:26.973060 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f3c194e-2d31-4e23-a7aa-4570cca05dc8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:26.973536 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f3c194e-2d31-4e23-a7aa-4570cca05dc8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:26.973974 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f3c194e-2d31-4e23-a7aa-4570cca05dc8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:26.974652 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f3c194e-2d31-4e23-a7aa-4570cca05dc8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:26.975101 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f3c194e-2d31-4e23-a7aa-4570cca05dc8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:26.975566 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f3c194e-2d31-4e23-a7aa-4570cca05dc8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:27.101639 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9f3c194e-2d31-4e23-a7aa-4570cca05dc8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:27.110151 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9f3c194e-2d31-4e23-a7aa-4570cca05dc8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:27.111663 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9f3c194e-2d31-4e23-a7aa-4570cca05dc8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:27.112844 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9f3c194e-2d31-4e23-a7aa-4570cca05dc8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.150947 Aug 10 13:03:27.113341 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1515/3052] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:26 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:03:27.431299 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-79e945f5-7805-4c84-b1c0-1bec8c50ba5b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:27.431847 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-79e945f5-7805-4c84-b1c0-1bec8c50ba5b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:27.438223 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-79e945f5-7805-4c84-b1c0-1bec8c50ba5b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:27.438699 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-79e945f5-7805-4c84-b1c0-1bec8c50ba5b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:27.439126 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-79e945f5-7805-4c84-b1c0-1bec8c50ba5b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:27.439834 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-79e945f5-7805-4c84-b1c0-1bec8c50ba5b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:27.440280 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-79e945f5-7805-4c84-b1c0-1bec8c50ba5b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:27.440701 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-79e945f5-7805-4c84-b1c0-1bec8c50ba5b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:27.441674 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-59882d93-1098-4fe1-b4d3-a05fc0e03cb5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:27.442272 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-59882d93-1098-4fe1-b4d3-a05fc0e03cb5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:27.448770 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-59882d93-1098-4fe1-b4d3-a05fc0e03cb5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:27.449417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-59882d93-1098-4fe1-b4d3-a05fc0e03cb5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:27.449848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-59882d93-1098-4fe1-b4d3-a05fc0e03cb5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:27.450535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-59882d93-1098-4fe1-b4d3-a05fc0e03cb5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:27.450981 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-59882d93-1098-4fe1-b4d3-a05fc0e03cb5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:27.451422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-59882d93-1098-4fe1-b4d3-a05fc0e03cb5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:27.636253 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-79e945f5-7805-4c84-b1c0-1bec8c50ba5b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:27.640008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-59882d93-1098-4fe1-b4d3-a05fc0e03cb5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:27.644301 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-79e945f5-7805-4c84-b1c0-1bec8c50ba5b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.216960 Aug 10 13:03:27.644883 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1538/3053] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:27 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:27.647963 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-59882d93-1098-4fe1-b4d3-a05fc0e03cb5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.210167 Aug 10 13:03:27.648518 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1516/3054] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:27 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:27.966744 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3328f801-82ce-4454-a42c-e2cab7a3e411 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:27.967386 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3328f801-82ce-4454-a42c-e2cab7a3e411 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:27.975946 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3328f801-82ce-4454-a42c-e2cab7a3e411 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:27.976426 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3328f801-82ce-4454-a42c-e2cab7a3e411 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:27.976856 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3328f801-82ce-4454-a42c-e2cab7a3e411 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:27.977541 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3328f801-82ce-4454-a42c-e2cab7a3e411 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:27.978091 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3328f801-82ce-4454-a42c-e2cab7a3e411 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:27.978517 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3328f801-82ce-4454-a42c-e2cab7a3e411 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:28.042208 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3328f801-82ce-4454-a42c-e2cab7a3e411 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:28.050292 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3328f801-82ce-4454-a42c-e2cab7a3e411 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.088269 Aug 10 13:03:28.053233 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1539/3055] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:27 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:28.136971 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8cbb1ac5-8630-4951-94da-28303bb41f59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:28.137602 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8cbb1ac5-8630-4951-94da-28303bb41f59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:28.144151 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8cbb1ac5-8630-4951-94da-28303bb41f59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:28.144631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8cbb1ac5-8630-4951-94da-28303bb41f59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:28.145063 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8cbb1ac5-8630-4951-94da-28303bb41f59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:28.145747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8cbb1ac5-8630-4951-94da-28303bb41f59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:28.146195 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8cbb1ac5-8630-4951-94da-28303bb41f59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:28.146614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8cbb1ac5-8630-4951-94da-28303bb41f59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:28.276940 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8cbb1ac5-8630-4951-94da-28303bb41f59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:28.285453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8cbb1ac5-8630-4951-94da-28303bb41f59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:28.286958 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8cbb1ac5-8630-4951-94da-28303bb41f59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:28.288152 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8cbb1ac5-8630-4951-94da-28303bb41f59 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.155639 Aug 10 13:03:28.288716 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1517/3056] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:28 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:03:28.665793 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a2e7e18a-c7ae-4995-90b6-ea2a2c9f9fce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:28.667046 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a2e7e18a-c7ae-4995-90b6-ea2a2c9f9fce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:28.669030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-999fe7bd-c99e-40a0-88ae-c20af6a6fc02 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:28.669639 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-999fe7bd-c99e-40a0-88ae-c20af6a6fc02 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:28.673142 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2e7e18a-c7ae-4995-90b6-ea2a2c9f9fce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:28.673614 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2e7e18a-c7ae-4995-90b6-ea2a2c9f9fce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:28.674047 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2e7e18a-c7ae-4995-90b6-ea2a2c9f9fce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:28.674730 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2e7e18a-c7ae-4995-90b6-ea2a2c9f9fce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:28.675197 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2e7e18a-c7ae-4995-90b6-ea2a2c9f9fce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:28.675592 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-999fe7bd-c99e-40a0-88ae-c20af6a6fc02 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:28.675719 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a2e7e18a-c7ae-4995-90b6-ea2a2c9f9fce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:28.676072 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-999fe7bd-c99e-40a0-88ae-c20af6a6fc02 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:28.676500 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-999fe7bd-c99e-40a0-88ae-c20af6a6fc02 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:28.677235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-999fe7bd-c99e-40a0-88ae-c20af6a6fc02 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:28.677701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-999fe7bd-c99e-40a0-88ae-c20af6a6fc02 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:28.678095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-999fe7bd-c99e-40a0-88ae-c20af6a6fc02 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:28.862588 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a2e7e18a-c7ae-4995-90b6-ea2a2c9f9fce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:28.869469 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-999fe7bd-c99e-40a0-88ae-c20af6a6fc02 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:28.870574 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a2e7e18a-c7ae-4995-90b6-ea2a2c9f9fce tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.208630 Aug 10 13:03:28.871156 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1540/3057] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:28 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:28.878026 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-999fe7bd-c99e-40a0-88ae-c20af6a6fc02 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.213267 Aug 10 13:03:28.878574 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1518/3058] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:28 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:29.071472 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-00e70baf-71f5-4521-8c55-d19f427be033 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:29.072088 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-00e70baf-71f5-4521-8c55-d19f427be033 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:29.079153 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-00e70baf-71f5-4521-8c55-d19f427be033 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:29.079724 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-00e70baf-71f5-4521-8c55-d19f427be033 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:29.080158 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-00e70baf-71f5-4521-8c55-d19f427be033 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:29.080843 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-00e70baf-71f5-4521-8c55-d19f427be033 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:29.081293 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-00e70baf-71f5-4521-8c55-d19f427be033 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:29.081718 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-00e70baf-71f5-4521-8c55-d19f427be033 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:29.148775 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-00e70baf-71f5-4521-8c55-d19f427be033 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:29.156655 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-00e70baf-71f5-4521-8c55-d19f427be033 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.089099 Aug 10 13:03:29.157221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1541/3059] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:29 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:29.311786 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7539db61-3e16-4feb-b16d-da8513576552 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:29.312401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7539db61-3e16-4feb-b16d-da8513576552 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:29.318724 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7539db61-3e16-4feb-b16d-da8513576552 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:29.319230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7539db61-3e16-4feb-b16d-da8513576552 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:29.319672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7539db61-3e16-4feb-b16d-da8513576552 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:29.320377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7539db61-3e16-4feb-b16d-da8513576552 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:29.320814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7539db61-3e16-4feb-b16d-da8513576552 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:29.321240 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7539db61-3e16-4feb-b16d-da8513576552 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:29.448663 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7539db61-3e16-4feb-b16d-da8513576552 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:29.457049 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7539db61-3e16-4feb-b16d-da8513576552 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:29.458551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7539db61-3e16-4feb-b16d-da8513576552 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:29.459738 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7539db61-3e16-4feb-b16d-da8513576552 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.152692 Aug 10 13:03:29.460293 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1519/3060] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:29 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:03:29.892187 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bea26e81-5751-4e7c-a6b8-e1e73013ade2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:29.892800 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bea26e81-5751-4e7c-a6b8-e1e73013ade2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:29.898682 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bea26e81-5751-4e7c-a6b8-e1e73013ade2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:29.899156 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bea26e81-5751-4e7c-a6b8-e1e73013ade2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:29.899626 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bea26e81-5751-4e7c-a6b8-e1e73013ade2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:29.899820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-843e2111-0758-4f31-b64c-fcee5d970fc8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:29.900309 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bea26e81-5751-4e7c-a6b8-e1e73013ade2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:29.900456 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-843e2111-0758-4f31-b64c-fcee5d970fc8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:29.901251 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bea26e81-5751-4e7c-a6b8-e1e73013ade2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:29.901684 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bea26e81-5751-4e7c-a6b8-e1e73013ade2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:29.907261 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-843e2111-0758-4f31-b64c-fcee5d970fc8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:29.907743 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-843e2111-0758-4f31-b64c-fcee5d970fc8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:29.908170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-843e2111-0758-4f31-b64c-fcee5d970fc8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:29.908862 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-843e2111-0758-4f31-b64c-fcee5d970fc8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:29.909306 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-843e2111-0758-4f31-b64c-fcee5d970fc8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:29.909724 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-843e2111-0758-4f31-b64c-fcee5d970fc8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:30.101358 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-bea26e81-5751-4e7c-a6b8-e1e73013ade2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:30.106518 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-843e2111-0758-4f31-b64c-fcee5d970fc8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:30.110448 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bea26e81-5751-4e7c-a6b8-e1e73013ade2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.222038 Aug 10 13:03:30.111039 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1542/3061] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:29 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:30.114488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-843e2111-0758-4f31-b64c-fcee5d970fc8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.218424 Aug 10 13:03:30.114990 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1520/3062] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:29 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:30.177087 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-dfad1b43-7726-42aa-9434-1235febc9896 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:30.177697 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-dfad1b43-7726-42aa-9434-1235febc9896 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:30.184102 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dfad1b43-7726-42aa-9434-1235febc9896 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:30.184578 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dfad1b43-7726-42aa-9434-1235febc9896 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:30.185009 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dfad1b43-7726-42aa-9434-1235febc9896 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:30.185685 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dfad1b43-7726-42aa-9434-1235febc9896 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:30.186132 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dfad1b43-7726-42aa-9434-1235febc9896 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:30.186550 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-dfad1b43-7726-42aa-9434-1235febc9896 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:30.247532 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-dfad1b43-7726-42aa-9434-1235febc9896 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:30.255433 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-dfad1b43-7726-42aa-9434-1235febc9896 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082041 Aug 10 13:03:30.256011 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1543/3063] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:30 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:30.483058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4d370744-1258-4850-97ce-ad51c0602357 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:30.483618 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4d370744-1258-4850-97ce-ad51c0602357 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:30.489939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d370744-1258-4850-97ce-ad51c0602357 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:30.490423 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d370744-1258-4850-97ce-ad51c0602357 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:30.490856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d370744-1258-4850-97ce-ad51c0602357 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:30.491568 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d370744-1258-4850-97ce-ad51c0602357 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:30.492015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d370744-1258-4850-97ce-ad51c0602357 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:30.492437 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d370744-1258-4850-97ce-ad51c0602357 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:30.622539 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4d370744-1258-4850-97ce-ad51c0602357 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:30.624702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:30.631334 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4d370744-1258-4850-97ce-ad51c0602357 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:30.632814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4d370744-1258-4850-97ce-ad51c0602357 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:30.633956 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4d370744-1258-4850-97ce-ad51c0602357 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.155303 Aug 10 13:03:30.634506 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1521/3064] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:30 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:03:31.131085 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-245a2571-af84-4011-806c-7ead865c569e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:31.131736 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-245a2571-af84-4011-806c-7ead865c569e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:31.135906 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d55cb0db-18c5-4047-943a-8178fa927a9d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:31.136531 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d55cb0db-18c5-4047-943a-8178fa927a9d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:31.138914 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-245a2571-af84-4011-806c-7ead865c569e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:31.139446 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-245a2571-af84-4011-806c-7ead865c569e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:31.139875 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-245a2571-af84-4011-806c-7ead865c569e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:31.140574 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-245a2571-af84-4011-806c-7ead865c569e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:31.141098 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-245a2571-af84-4011-806c-7ead865c569e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:31.141544 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-245a2571-af84-4011-806c-7ead865c569e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:31.142360 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d55cb0db-18c5-4047-943a-8178fa927a9d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:31.142839 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d55cb0db-18c5-4047-943a-8178fa927a9d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:31.143294 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d55cb0db-18c5-4047-943a-8178fa927a9d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:31.143978 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d55cb0db-18c5-4047-943a-8178fa927a9d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:31.144425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d55cb0db-18c5-4047-943a-8178fa927a9d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:31.144842 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d55cb0db-18c5-4047-943a-8178fa927a9d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:31.339720 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-245a2571-af84-4011-806c-7ead865c569e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:31.343089 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d55cb0db-18c5-4047-943a-8178fa927a9d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:31.348009 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-245a2571-af84-4011-806c-7ead865c569e tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.220856 Aug 10 13:03:31.348671 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1544/3065] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:31 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:31.351033 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d55cb0db-18c5-4047-943a-8178fa927a9d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.219798 Aug 10 13:03:31.351867 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1522/3066] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:31 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:31.353735 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0820dce6-868d-4b85-bd8a-c75e451976a2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:31.354923 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0820dce6-868d-4b85-bd8a-c75e451976a2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:31.360779 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0820dce6-868d-4b85-bd8a-c75e451976a2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:31.361391 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0820dce6-868d-4b85-bd8a-c75e451976a2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:31.361944 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0820dce6-868d-4b85-bd8a-c75e451976a2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:31.362716 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0820dce6-868d-4b85-bd8a-c75e451976a2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:31.363291 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0820dce6-868d-4b85-bd8a-c75e451976a2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:31.363730 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0820dce6-868d-4b85-bd8a-c75e451976a2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:31.423510 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0820dce6-868d-4b85-bd8a-c75e451976a2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:31.431239 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0820dce6-868d-4b85-bd8a-c75e451976a2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.081490 Aug 10 13:03:31.431803 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1545/3067] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:31 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:31.656564 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5039359f-6225-46f8-8890-73232744ea07 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:31.657166 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5039359f-6225-46f8-8890-73232744ea07 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:31.659485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:31.664087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5039359f-6225-46f8-8890-73232744ea07 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:31.664557 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5039359f-6225-46f8-8890-73232744ea07 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:31.664983 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5039359f-6225-46f8-8890-73232744ea07 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:31.665659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5039359f-6225-46f8-8890-73232744ea07 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:31.666101 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5039359f-6225-46f8-8890-73232744ea07 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:31.667287 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5039359f-6225-46f8-8890-73232744ea07 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:31.795535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5039359f-6225-46f8-8890-73232744ea07 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:31.804035 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5039359f-6225-46f8-8890-73232744ea07 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:31.805556 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5039359f-6225-46f8-8890-73232744ea07 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:31.806691 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5039359f-6225-46f8-8890-73232744ea07 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.154011 Aug 10 13:03:31.807990 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1523/3068] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:31 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:03:32.370395 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-63e35e86-4801-4857-8747-999bcf62d686 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:32.371029 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-63e35e86-4801-4857-8747-999bcf62d686 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:32.372851 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4a6595d6-3755-4167-9414-2e6bcf5842bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:32.373472 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4a6595d6-3755-4167-9414-2e6bcf5842bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:32.377421 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63e35e86-4801-4857-8747-999bcf62d686 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:32.377899 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63e35e86-4801-4857-8747-999bcf62d686 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:32.378332 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63e35e86-4801-4857-8747-999bcf62d686 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:32.379019 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63e35e86-4801-4857-8747-999bcf62d686 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:32.379284 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4a6595d6-3755-4167-9414-2e6bcf5842bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:32.379518 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63e35e86-4801-4857-8747-999bcf62d686 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:32.379766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4a6595d6-3755-4167-9414-2e6bcf5842bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:32.379925 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-63e35e86-4801-4857-8747-999bcf62d686 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:32.380197 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4a6595d6-3755-4167-9414-2e6bcf5842bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:32.380881 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4a6595d6-3755-4167-9414-2e6bcf5842bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:32.381326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4a6595d6-3755-4167-9414-2e6bcf5842bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:32.381745 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4a6595d6-3755-4167-9414-2e6bcf5842bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:32.574170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4a6595d6-3755-4167-9414-2e6bcf5842bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:32.578711 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-63e35e86-4801-4857-8747-999bcf62d686 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:32.582205 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4a6595d6-3755-4167-9414-2e6bcf5842bf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.213893 Aug 10 13:03:32.582769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1524/3069] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:32 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:32.586685 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-63e35e86-4801-4857-8747-999bcf62d686 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.220674 Aug 10 13:03:32.587268 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1546/3070] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:32 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:32.587434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e0bd1428-77f8-4882-9a85-8781dc893625 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:32.587871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e0bd1428-77f8-4882-9a85-8781dc893625 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:32.593807 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0bd1428-77f8-4882-9a85-8781dc893625 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:32.594289 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0bd1428-77f8-4882-9a85-8781dc893625 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:32.594730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0bd1428-77f8-4882-9a85-8781dc893625 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:32.595445 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0bd1428-77f8-4882-9a85-8781dc893625 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:32.595978 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0bd1428-77f8-4882-9a85-8781dc893625 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:32.596403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e0bd1428-77f8-4882-9a85-8781dc893625 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:32.661151 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e0bd1428-77f8-4882-9a85-8781dc893625 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:32.670122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e0bd1428-77f8-4882-9a85-8781dc893625 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.086379 Aug 10 13:03:32.670681 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1525/3071] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:32 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:32.829945 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2d3d25aa-eaf1-4263-825c-21401bc1db13 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:32.830481 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2d3d25aa-eaf1-4263-825c-21401bc1db13 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:32.836389 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2d3d25aa-eaf1-4263-825c-21401bc1db13 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:32.836921 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2d3d25aa-eaf1-4263-825c-21401bc1db13 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:32.837377 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2d3d25aa-eaf1-4263-825c-21401bc1db13 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:32.838073 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2d3d25aa-eaf1-4263-825c-21401bc1db13 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:32.839149 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2d3d25aa-eaf1-4263-825c-21401bc1db13 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:32.839627 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2d3d25aa-eaf1-4263-825c-21401bc1db13 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:32.966194 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2d3d25aa-eaf1-4263-825c-21401bc1db13 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:32.974488 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2d3d25aa-eaf1-4263-825c-21401bc1db13 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:32.976011 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2d3d25aa-eaf1-4263-825c-21401bc1db13 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:32.977175 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2d3d25aa-eaf1-4263-825c-21401bc1db13 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.151298 Aug 10 13:03:32.977730 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1547/3072] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:32 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:03:33.603794 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-19095274-be99-4e57-9504-35613886992b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:33.605180 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-19095274-be99-4e57-9504-35613886992b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:33.608692 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5b1a5448-ebc4-465a-afd8-63b60e272c6f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:33.609300 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5b1a5448-ebc4-465a-afd8-63b60e272c6f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:33.611441 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19095274-be99-4e57-9504-35613886992b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:33.611929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19095274-be99-4e57-9504-35613886992b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:33.612365 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19095274-be99-4e57-9504-35613886992b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:33.613058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19095274-be99-4e57-9504-35613886992b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:33.613544 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19095274-be99-4e57-9504-35613886992b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:33.613969 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19095274-be99-4e57-9504-35613886992b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:33.615276 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b1a5448-ebc4-465a-afd8-63b60e272c6f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:33.615757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b1a5448-ebc4-465a-afd8-63b60e272c6f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:33.616190 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b1a5448-ebc4-465a-afd8-63b60e272c6f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:33.616871 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b1a5448-ebc4-465a-afd8-63b60e272c6f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:33.617316 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b1a5448-ebc4-465a-afd8-63b60e272c6f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:33.617732 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5b1a5448-ebc4-465a-afd8-63b60e272c6f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:33.801699 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-19095274-be99-4e57-9504-35613886992b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:33.809114 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5b1a5448-ebc4-465a-afd8-63b60e272c6f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:33.810291 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-19095274-be99-4e57-9504-35613886992b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.210459 Aug 10 13:03:33.810863 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1526/3073] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:33 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:33.824162 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5b1a5448-ebc4-465a-afd8-63b60e272c6f tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.213471 Aug 10 13:03:33.824162 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1548/3074] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:33 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:33.824432 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3d35a5fb-6e8f-4352-b1d9-dbc70a527810 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:33.824432 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3d35a5fb-6e8f-4352-b1d9-dbc70a527810 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:33.825995 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3d35a5fb-6e8f-4352-b1d9-dbc70a527810 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:33.826477 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3d35a5fb-6e8f-4352-b1d9-dbc70a527810 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:33.827071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3d35a5fb-6e8f-4352-b1d9-dbc70a527810 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:33.827859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3d35a5fb-6e8f-4352-b1d9-dbc70a527810 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:33.828306 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3d35a5fb-6e8f-4352-b1d9-dbc70a527810 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:33.828724 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3d35a5fb-6e8f-4352-b1d9-dbc70a527810 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:33.891783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3d35a5fb-6e8f-4352-b1d9-dbc70a527810 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:33.899666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3d35a5fb-6e8f-4352-b1d9-dbc70a527810 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084984 Aug 10 13:03:33.900223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1527/3075] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:33 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:34.000357 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-716a226f-d6a8-4c49-949f-25e5ca915543 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:34.001024 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-716a226f-d6a8-4c49-949f-25e5ca915543 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:34.007101 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-716a226f-d6a8-4c49-949f-25e5ca915543 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:34.007628 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-716a226f-d6a8-4c49-949f-25e5ca915543 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:34.008068 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-716a226f-d6a8-4c49-949f-25e5ca915543 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:34.008759 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-716a226f-d6a8-4c49-949f-25e5ca915543 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:34.009214 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-716a226f-d6a8-4c49-949f-25e5ca915543 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:34.009638 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-716a226f-d6a8-4c49-949f-25e5ca915543 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:34.138319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-716a226f-d6a8-4c49-949f-25e5ca915543 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:34.146837 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-716a226f-d6a8-4c49-949f-25e5ca915543 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:34.148293 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-716a226f-d6a8-4c49-949f-25e5ca915543 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:34.149460 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-716a226f-d6a8-4c49-949f-25e5ca915543 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.153092 Aug 10 13:03:34.150022 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1549/3076] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:33 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:03:34.831798 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ad1c8ccc-17b0-47bb-af99-8074a193b1d5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:34.832457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ad1c8ccc-17b0-47bb-af99-8074a193b1d5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:34.837600 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3b73c667-27fc-43e5-adbe-4730eb575fdd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:34.838216 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3b73c667-27fc-43e5-adbe-4730eb575fdd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:34.839503 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ad1c8ccc-17b0-47bb-af99-8074a193b1d5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:34.839966 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ad1c8ccc-17b0-47bb-af99-8074a193b1d5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:34.840394 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ad1c8ccc-17b0-47bb-af99-8074a193b1d5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:34.841074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ad1c8ccc-17b0-47bb-af99-8074a193b1d5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:34.841517 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ad1c8ccc-17b0-47bb-af99-8074a193b1d5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:34.841935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ad1c8ccc-17b0-47bb-af99-8074a193b1d5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:34.845239 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3b73c667-27fc-43e5-adbe-4730eb575fdd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:34.845726 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3b73c667-27fc-43e5-adbe-4730eb575fdd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:34.846160 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3b73c667-27fc-43e5-adbe-4730eb575fdd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:34.846852 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3b73c667-27fc-43e5-adbe-4730eb575fdd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:34.847327 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3b73c667-27fc-43e5-adbe-4730eb575fdd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:34.847752 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3b73c667-27fc-43e5-adbe-4730eb575fdd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:35.029427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ad1c8ccc-17b0-47bb-af99-8074a193b1d5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:35.033590 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3b73c667-27fc-43e5-adbe-4730eb575fdd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:35.037404 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ad1c8ccc-17b0-47bb-af99-8074a193b1d5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.209435 Aug 10 13:03:35.037973 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1528/3077] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:34 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:35.041918 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3b73c667-27fc-43e5-adbe-4730eb575fdd tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.207958 Aug 10 13:03:35.042385 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4ac71083-4b30-4445-9c39-b6415d437a5c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:35.042746 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1550/3078] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:34 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:35.047873 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4ac71083-4b30-4445-9c39-b6415d437a5c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:35.053468 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ac71083-4b30-4445-9c39-b6415d437a5c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:35.053951 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ac71083-4b30-4445-9c39-b6415d437a5c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:35.054385 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ac71083-4b30-4445-9c39-b6415d437a5c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:35.055074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ac71083-4b30-4445-9c39-b6415d437a5c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:35.055566 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ac71083-4b30-4445-9c39-b6415d437a5c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:35.055989 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4ac71083-4b30-4445-9c39-b6415d437a5c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:35.120254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4ac71083-4b30-4445-9c39-b6415d437a5c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:35.128042 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4ac71083-4b30-4445-9c39-b6415d437a5c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.089135 Aug 10 13:03:35.128603 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1529/3079] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:35 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:35.171931 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4911b307-d70b-40f3-8622-50290f038949 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:35.172543 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4911b307-d70b-40f3-8622-50290f038949 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:35.178342 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4911b307-d70b-40f3-8622-50290f038949 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:35.178818 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4911b307-d70b-40f3-8622-50290f038949 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:35.179274 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4911b307-d70b-40f3-8622-50290f038949 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:35.179957 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4911b307-d70b-40f3-8622-50290f038949 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:35.180406 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4911b307-d70b-40f3-8622-50290f038949 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:35.180828 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4911b307-d70b-40f3-8622-50290f038949 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:35.310181 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4911b307-d70b-40f3-8622-50290f038949 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:35.312401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:35.319266 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4911b307-d70b-40f3-8622-50290f038949 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:35.320764 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4911b307-d70b-40f3-8622-50290f038949 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:35.321922 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4911b307-d70b-40f3-8622-50290f038949 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.153826 Aug 10 13:03:35.322483 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1551/3080] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:35 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:03:36.058570 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7c0fd3cf-823b-4846-9ccb-483560bdbfd2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:36.059169 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7c0fd3cf-823b-4846-9ccb-483560bdbfd2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:36.062974 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c995ec7e-b7cf-47fe-a956-fed394cbfa89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:36.063617 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c995ec7e-b7cf-47fe-a956-fed394cbfa89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:36.065540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c0fd3cf-823b-4846-9ccb-483560bdbfd2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:36.066015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c0fd3cf-823b-4846-9ccb-483560bdbfd2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:36.066445 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c0fd3cf-823b-4846-9ccb-483560bdbfd2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:36.067132 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c0fd3cf-823b-4846-9ccb-483560bdbfd2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:36.067619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c0fd3cf-823b-4846-9ccb-483560bdbfd2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:36.068018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c0fd3cf-823b-4846-9ccb-483560bdbfd2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:36.069946 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c995ec7e-b7cf-47fe-a956-fed394cbfa89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:36.070430 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c995ec7e-b7cf-47fe-a956-fed394cbfa89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:36.070866 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c995ec7e-b7cf-47fe-a956-fed394cbfa89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:36.071614 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c995ec7e-b7cf-47fe-a956-fed394cbfa89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:36.072075 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c995ec7e-b7cf-47fe-a956-fed394cbfa89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:36.072501 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c995ec7e-b7cf-47fe-a956-fed394cbfa89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:36.266626 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7c0fd3cf-823b-4846-9ccb-483560bdbfd2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:36.269676 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c995ec7e-b7cf-47fe-a956-fed394cbfa89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:36.275088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7c0fd3cf-823b-4846-9ccb-483560bdbfd2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.221094 Aug 10 13:03:36.276488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1530/3081] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:36 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:36.281141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-80a34d61-ebf1-4b5f-a26c-37685c54611d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:36.282073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-80a34d61-ebf1-4b5f-a26c-37685c54611d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:36.286256 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c995ec7e-b7cf-47fe-a956-fed394cbfa89 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.227696 Aug 10 13:03:36.287002 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1552/3082] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:36 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:36.287748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80a34d61-ebf1-4b5f-a26c-37685c54611d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:36.288239 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80a34d61-ebf1-4b5f-a26c-37685c54611d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:36.288681 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80a34d61-ebf1-4b5f-a26c-37685c54611d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:36.289372 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80a34d61-ebf1-4b5f-a26c-37685c54611d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:36.289822 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80a34d61-ebf1-4b5f-a26c-37685c54611d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:36.290246 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80a34d61-ebf1-4b5f-a26c-37685c54611d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:36.345831 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-752cd694-7615-4eb1-ac8e-dcce708e5bd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:36.346352 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-752cd694-7615-4eb1-ac8e-dcce708e5bd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:36.352179 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-752cd694-7615-4eb1-ac8e-dcce708e5bd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:36.352657 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-752cd694-7615-4eb1-ac8e-dcce708e5bd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:36.353084 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-752cd694-7615-4eb1-ac8e-dcce708e5bd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:36.353767 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-752cd694-7615-4eb1-ac8e-dcce708e5bd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:36.354042 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-80a34d61-ebf1-4b5f-a26c-37685c54611d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:36.354361 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-752cd694-7615-4eb1-ac8e-dcce708e5bd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:36.355051 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-752cd694-7615-4eb1-ac8e-dcce708e5bd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:36.362974 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-80a34d61-ebf1-4b5f-a26c-37685c54611d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.085453 Aug 10 13:03:36.363586 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1531/3083] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:36 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:36.484745 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-752cd694-7615-4eb1-ac8e-dcce708e5bd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:36.492997 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-752cd694-7615-4eb1-ac8e-dcce708e5bd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:36.494597 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-752cd694-7615-4eb1-ac8e-dcce708e5bd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:36.496469 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-752cd694-7615-4eb1-ac8e-dcce708e5bd6 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 200 len: 1801 microversion: 2.20 time: 0.154629 Aug 10 13:03:36.497031 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1553/3084] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:36 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:03:36.527508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6b13a1ee-0ceb-4cc4-87c2-895419dbd0b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '.version_select at 0x7fb82b2a4c10>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:36.610857 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6b13a1ee-0ceb-4cc4-87c2-895419dbd0b8 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-879954524" status: 204 len: 0 microversion: 2.20 time: 0.087389 Aug 10 13:03:36.611372 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1532/3085] 10.222.0.49 () {60 vars in 1259 bytes} [Wed Aug 10 13:03:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-879954524 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 13:03:37.297323 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-74bee5c7-da9e-4611-b018-080c280c7125 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:37.298058 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-74bee5c7-da9e-4611-b018-080c280c7125 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:37.300471 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:37.305678 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-74bee5c7-da9e-4611-b018-080c280c7125 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:37.306241 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-74bee5c7-da9e-4611-b018-080c280c7125 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:37.306773 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-74bee5c7-da9e-4611-b018-080c280c7125 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:37.308460 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-74bee5c7-da9e-4611-b018-080c280c7125 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:37.308957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3c919288-f372-4cb8-a191-fe34e7bf3ae0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:37.312202 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-74bee5c7-da9e-4611-b018-080c280c7125 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:37.312202 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-74bee5c7-da9e-4611-b018-080c280c7125 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:37.312423 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3c919288-f372-4cb8-a191-fe34e7bf3ae0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:37.317263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c919288-f372-4cb8-a191-fe34e7bf3ae0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:37.317897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c919288-f372-4cb8-a191-fe34e7bf3ae0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:37.318397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c919288-f372-4cb8-a191-fe34e7bf3ae0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:37.319161 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c919288-f372-4cb8-a191-fe34e7bf3ae0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:37.319701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c919288-f372-4cb8-a191-fe34e7bf3ae0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:37.320188 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3c919288-f372-4cb8-a191-fe34e7bf3ae0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:37.739386 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3c919288-f372-4cb8-a191-fe34e7bf3ae0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:37.748281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3c919288-f372-4cb8-a191-fe34e7bf3ae0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.444813 Aug 10 13:03:37.748849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1533/3086] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:37 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:37.753307 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4831ebf1-9c90-4c78-9c49-dd726397731c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:37.753898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4831ebf1-9c90-4c78-9c49-dd726397731c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:37.759411 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4831ebf1-9c90-4c78-9c49-dd726397731c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:37.759886 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4831ebf1-9c90-4c78-9c49-dd726397731c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:37.760930 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4831ebf1-9c90-4c78-9c49-dd726397731c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:37.761807 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4831ebf1-9c90-4c78-9c49-dd726397731c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:37.762295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4831ebf1-9c90-4c78-9c49-dd726397731c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:37.762775 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4831ebf1-9c90-4c78-9c49-dd726397731c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:37.775636 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-74bee5c7-da9e-4611-b018-080c280c7125 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:37.785217 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-74bee5c7-da9e-4611-b018-080c280c7125 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.491728 Aug 10 13:03:37.785983 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1554/3087] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:37 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:37.851128 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4831ebf1-9c90-4c78-9c49-dd726397731c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:37.859452 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4831ebf1-9c90-4c78-9c49-dd726397731c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.109586 Aug 10 13:03:37.860957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1534/3088] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:37 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:37.907593 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [req-f85df4d8-3d87-40fb-819b-aec52e0090b2 req-c815ca1b-bcb7-4bec-bebc-58877301fcc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "572a91d2-8a56-4616-97e4-b0d48cc57ea5", "tag": "5bdde102-3780-4fb4-a112-3f9af85f6b61"}]} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:03:37.917025 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-f85df4d8-3d87-40fb-819b-aec52e0090b2 req-c815ca1b-bcb7-4bec-bebc-58877301fcc5 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:37.917552 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-f85df4d8-3d87-40fb-819b-aec52e0090b2 req-c815ca1b-bcb7-4bec-bebc-58877301fcc5 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:37.933687 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-f85df4d8-3d87-40fb-819b-aec52e0090b2 req-c815ca1b-bcb7-4bec-bebc-58877301fcc5 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:37.933687 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.compute.server_external_events [req-f85df4d8-3d87-40fb-819b-aec52e0090b2 req-c815ca1b-bcb7-4bec-bebc-58877301fcc5 service nova] Creating event network-changed:5bdde102-3780-4fb4-a112-3f9af85f6b61 for instance 572a91d2-8a56-4616-97e4-b0d48cc57ea5 on hv-cinder-85199 Aug 10 13:03:37.934618 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [req-f85df4d8-3d87-40fb-819b-aec52e0090b2 req-c815ca1b-bcb7-4bec-bebc-58877301fcc5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030682 Aug 10 13:03:37.935452 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1555/3089] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:03:38.151735 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f076b468-397e-4e7f-b159-943291d867f0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Action: 'create', calling method: .version_select at 0x7fb82b2a4d30>, body: {"keypair": {"name": "tempest-keypair-1866697133", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwRaVpEvOnN/fZkiV320dZXoaqnbMrwJ4+SWgPmjqsB+X5BJc12PSn+K4kp+LPxnW0oKu6B6eGnAe/EMQs4SPyUKCn0yoMWYf/yh0qONyZzq6WzXLkdkQhZx/0T8YiThw=="}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:03:38.167909 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-f076b468-397e-4e7f-b159-943291d867f0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Getting quotas for project d6fe8b6c27e743eaad5fe6ffc8a40e81. Resources: {'key_pairs'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:03:38.172388 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-f076b468-397e-4e7f-b159-943291d867f0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Getting quotas for user 70010d27b7f44bc699ea5ad8093fec3b and project d6fe8b6c27e743eaad5fe6ffc8a40e81. Resources: {'key_pairs'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:03:38.269307 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f076b468-397e-4e7f-b159-943291d867f0 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.121941 Aug 10 13:03:38.270099 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1535/3090] 10.222.0.49 () {62 vars in 1200 bytes} [Wed Aug 10 13:03:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 123 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 10 13:03:38.771476 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-70efa6dd-6360-43b6-b75f-e893bcafca90 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:38.772419 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-70efa6dd-6360-43b6-b75f-e893bcafca90 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:38.780037 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70efa6dd-6360-43b6-b75f-e893bcafca90 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:38.780525 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70efa6dd-6360-43b6-b75f-e893bcafca90 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:38.783955 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70efa6dd-6360-43b6-b75f-e893bcafca90 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:38.783955 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70efa6dd-6360-43b6-b75f-e893bcafca90 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:38.783955 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70efa6dd-6360-43b6-b75f-e893bcafca90 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:38.783955 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70efa6dd-6360-43b6-b75f-e893bcafca90 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:38.806941 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4e0eb85c-7f25-40a1-b224-81f09d252e93 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:38.822118 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4e0eb85c-7f25-40a1-b224-81f09d252e93 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:38.822118 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e0eb85c-7f25-40a1-b224-81f09d252e93 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:38.822118 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e0eb85c-7f25-40a1-b224-81f09d252e93 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:38.822118 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e0eb85c-7f25-40a1-b224-81f09d252e93 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:38.822647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e0eb85c-7f25-40a1-b224-81f09d252e93 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:38.822647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e0eb85c-7f25-40a1-b224-81f09d252e93 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:38.822647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4e0eb85c-7f25-40a1-b224-81f09d252e93 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:39.045496 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-70efa6dd-6360-43b6-b75f-e893bcafca90 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:39.048576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4e0eb85c-7f25-40a1-b224-81f09d252e93 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:39.054032 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-70efa6dd-6360-43b6-b75f-e893bcafca90 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.287752 Aug 10 13:03:39.054611 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1556/3091] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:38 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:39.056644 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4e0eb85c-7f25-40a1-b224-81f09d252e93 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.254519 Aug 10 13:03:39.057715 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1536/3092] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:38 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:39.060139 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3110145b-4208-4c80-b6c5-8829b07522ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:39.060751 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3110145b-4208-4c80-b6c5-8829b07522ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:39.071360 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3110145b-4208-4c80-b6c5-8829b07522ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:39.071360 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3110145b-4208-4c80-b6c5-8829b07522ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:39.071360 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3110145b-4208-4c80-b6c5-8829b07522ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:39.071360 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3110145b-4208-4c80-b6c5-8829b07522ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:39.071763 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3110145b-4208-4c80-b6c5-8829b07522ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:39.071763 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3110145b-4208-4c80-b6c5-8829b07522ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:39.142870 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3110145b-4208-4c80-b6c5-8829b07522ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:39.151319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3110145b-4208-4c80-b6c5-8829b07522ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.095208 Aug 10 13:03:39.152061 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1557/3093] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:39 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:40.077189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2de9ac05-dfc9-4dfc-acb8-71ba881df19b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:40.077734 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2de9ac05-dfc9-4dfc-acb8-71ba881df19b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:40.084047 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3ec8d358-618c-4ea6-8a29-8342e8fe305e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:40.084655 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3ec8d358-618c-4ea6-8a29-8342e8fe305e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:40.086480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2de9ac05-dfc9-4dfc-acb8-71ba881df19b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:40.087303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2de9ac05-dfc9-4dfc-acb8-71ba881df19b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:40.089335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2de9ac05-dfc9-4dfc-acb8-71ba881df19b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:40.090240 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2de9ac05-dfc9-4dfc-acb8-71ba881df19b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:40.090866 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2de9ac05-dfc9-4dfc-acb8-71ba881df19b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:40.091689 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2de9ac05-dfc9-4dfc-acb8-71ba881df19b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:40.092005 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ec8d358-618c-4ea6-8a29-8342e8fe305e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:40.093266 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ec8d358-618c-4ea6-8a29-8342e8fe305e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:40.093684 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ec8d358-618c-4ea6-8a29-8342e8fe305e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:40.094548 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ec8d358-618c-4ea6-8a29-8342e8fe305e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:40.094984 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ec8d358-618c-4ea6-8a29-8342e8fe305e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:40.095427 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ec8d358-618c-4ea6-8a29-8342e8fe305e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:40.344823 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3ec8d358-618c-4ea6-8a29-8342e8fe305e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:40.350892 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2de9ac05-dfc9-4dfc-acb8-71ba881df19b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:40.353512 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3ec8d358-618c-4ea6-8a29-8342e8fe305e tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.273346 Aug 10 13:03:40.355543 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1558/3094] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:40 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:40.360254 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c05af928-228d-417c-8476-099b57e0ef26 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:40.360839 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c05af928-228d-417c-8476-099b57e0ef26 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:40.364821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2de9ac05-dfc9-4dfc-acb8-71ba881df19b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.291942 Aug 10 13:03:40.366561 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1537/3095] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:40 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:40.379584 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c05af928-228d-417c-8476-099b57e0ef26 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:40.380076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c05af928-228d-417c-8476-099b57e0ef26 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:40.380510 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c05af928-228d-417c-8476-099b57e0ef26 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:40.381211 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c05af928-228d-417c-8476-099b57e0ef26 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:40.381664 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c05af928-228d-417c-8476-099b57e0ef26 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:40.382086 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c05af928-228d-417c-8476-099b57e0ef26 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:40.480602 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c05af928-228d-417c-8476-099b57e0ef26 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:40.488388 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c05af928-228d-417c-8476-099b57e0ef26 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.131765 Aug 10 13:03:40.488961 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1559/3096] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:40 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:40.743858 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a35145a8-077b-4481-8cd7-8ac4840cd0f3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1943783376", "imageRef": "674dcf76-6c38-40de-b204-ad2842738058", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "04562acd-1c0c-42a3-a31a-45ae32b7cf29"}], "security_groups": [{"name": "tempest-securitygroup--2016062725"}], "key_name": "tempest-keypair-1866697133", "user_data": "}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:03:40.846452 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.network.neutron [None req-a35145a8-077b-4481-8cd7-8ac4840cd0f3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] validate_networks() for [('04562acd-1c0c-42a3-a31a-45ae32b7cf29', None, None, None, None, None)] {{(pid=124643) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:03:41.264764 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-a35145a8-077b-4481-8cd7-8ac4840cd0f3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Flavor limits 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:03:41.265338 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-a35145a8-077b-4481-8cd7-8ac4840cd0f3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Image limits 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:03:41.265653 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-a35145a8-077b-4481-8cd7-8ac4840cd0f3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Flavor pref 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:03:41.266060 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-a35145a8-077b-4481-8cd7-8ac4840cd0f3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Image pref 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:03:41.266498 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-a35145a8-077b-4481-8cd7-8ac4840cd0f3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:03:41.275344 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a35145a8-077b-4481-8cd7-8ac4840cd0f3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:41.276448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a35145a8-077b-4481-8cd7-8ac4840cd0f3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:41.276879 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a35145a8-077b-4481-8cd7-8ac4840cd0f3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:41.277605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a35145a8-077b-4481-8cd7-8ac4840cd0f3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:41.278051 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a35145a8-077b-4481-8cd7-8ac4840cd0f3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:41.278469 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a35145a8-077b-4481-8cd7-8ac4840cd0f3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:41.295952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-a35145a8-077b-4481-8cd7-8ac4840cd0f3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Getting quotas for project d6fe8b6c27e743eaad5fe6ffc8a40e81. Resources: {'cores', 'ram', 'instances'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:03:41.299938 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-a35145a8-077b-4481-8cd7-8ac4840cd0f3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Getting quotas for user 70010d27b7f44bc699ea5ad8093fec3b and project d6fe8b6c27e743eaad5fe6ffc8a40e81. Resources: {'cores', 'ram', 'instances'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:03:41.310994 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a35145a8-077b-4481-8cd7-8ac4840cd0f3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Going to run 1 instances... {{(pid=124643) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:03:41.313257 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a35145a8-077b-4481-8cd7-8ac4840cd0f3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 2f8e2b4f-5870-46a3-b826-1b80fb322c73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='674dcf76-6c38-40de-b204-ad2842738058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:03:41.375717 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-797af978-06fc-4395-975d-bb7967a2a0d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:41.376338 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-797af978-06fc-4395-975d-bb7967a2a0d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:41.382835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-797af978-06fc-4395-975d-bb7967a2a0d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:41.383346 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-797af978-06fc-4395-975d-bb7967a2a0d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:41.383782 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-797af978-06fc-4395-975d-bb7967a2a0d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:41.384471 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-797af978-06fc-4395-975d-bb7967a2a0d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:41.384951 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-797af978-06fc-4395-975d-bb7967a2a0d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:41.385402 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-797af978-06fc-4395-975d-bb7967a2a0d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:41.436897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a35145a8-077b-4481-8cd7-8ac4840cd0f3 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.697144 Aug 10 13:03:41.443582 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1538/3097] 10.222.0.49 () {62 vars in 1188 bytes} [Wed Aug 10 13:03:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 13:03:41.443582 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-845633cf-76cf-4384-8d55-4c946053e5f3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:41.443582 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-845633cf-76cf-4384-8d55-4c946053e5f3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:41.450658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-845633cf-76cf-4384-8d55-4c946053e5f3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:41.451146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-845633cf-76cf-4384-8d55-4c946053e5f3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:41.452134 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-845633cf-76cf-4384-8d55-4c946053e5f3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:41.452326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-845633cf-76cf-4384-8d55-4c946053e5f3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:41.453078 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-845633cf-76cf-4384-8d55-4c946053e5f3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:41.453231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-845633cf-76cf-4384-8d55-4c946053e5f3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:41.557112 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-797af978-06fc-4395-975d-bb7967a2a0d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:41.565428 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-797af978-06fc-4395-975d-bb7967a2a0d8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.193317 Aug 10 13:03:41.566084 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1560/3098] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:41 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:41.570915 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-11e87fd0-ad6b-467a-a800-91de8c47d4da tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:41.571619 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-11e87fd0-ad6b-467a-a800-91de8c47d4da tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 2f8e2b4f-5870-46a3-b826-1b80fb322c73] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:41.640587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-11e87fd0-ad6b-467a-a800-91de8c47d4da tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:41.651834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-845633cf-76cf-4384-8d55-4c946053e5f3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:41.652533 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-11e87fd0-ad6b-467a-a800-91de8c47d4da tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:41.654091 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-11e87fd0-ad6b-467a-a800-91de8c47d4da tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:41.655292 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-11e87fd0-ad6b-467a-a800-91de8c47d4da tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73" status: 200 len: 1282 microversion: 2.20 time: 0.087983 Aug 10 13:03:41.657027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1561/3099] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:41 2022] GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73 => generated 1282 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:03:41.661528 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5531a377-8191-4402-b600-40e1ab0622a7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:41.662072 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5531a377-8191-4402-b600-40e1ab0622a7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:41.670539 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5531a377-8191-4402-b600-40e1ab0622a7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:41.670999 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-845633cf-76cf-4384-8d55-4c946053e5f3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.232347 Aug 10 13:03:41.671144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5531a377-8191-4402-b600-40e1ab0622a7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:41.671510 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5531a377-8191-4402-b600-40e1ab0622a7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:41.671955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1539/3100] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:41 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:41.672275 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5531a377-8191-4402-b600-40e1ab0622a7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:41.672799 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5531a377-8191-4402-b600-40e1ab0622a7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:41.673235 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5531a377-8191-4402-b600-40e1ab0622a7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:41.739312 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5531a377-8191-4402-b600-40e1ab0622a7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:41.748246 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5531a377-8191-4402-b600-40e1ab0622a7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.090239 Aug 10 13:03:41.749110 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1562/3101] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:41 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:42.586460 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-469ae276-51e1-494a-9b20-7c233eabe805 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:42.587074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-469ae276-51e1-494a-9b20-7c233eabe805 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:42.594178 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-469ae276-51e1-494a-9b20-7c233eabe805 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:42.594666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-469ae276-51e1-494a-9b20-7c233eabe805 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:42.595103 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-469ae276-51e1-494a-9b20-7c233eabe805 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:42.595830 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-469ae276-51e1-494a-9b20-7c233eabe805 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:42.596349 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-469ae276-51e1-494a-9b20-7c233eabe805 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:42.596889 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-469ae276-51e1-494a-9b20-7c233eabe805 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:42.677442 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fd1fd7a6-64f6-4aed-903f-81417427184b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:42.678057 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fd1fd7a6-64f6-4aed-903f-81417427184b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 2f8e2b4f-5870-46a3-b826-1b80fb322c73] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:42.685354 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fd1fd7a6-64f6-4aed-903f-81417427184b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:42.685856 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fd1fd7a6-64f6-4aed-903f-81417427184b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:42.686272 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fd1fd7a6-64f6-4aed-903f-81417427184b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:42.686963 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fd1fd7a6-64f6-4aed-903f-81417427184b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:42.687627 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fd1fd7a6-64f6-4aed-903f-81417427184b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:42.688052 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fd1fd7a6-64f6-4aed-903f-81417427184b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:42.741162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-469ae276-51e1-494a-9b20-7c233eabe805 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:42.750304 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-469ae276-51e1-494a-9b20-7c233eabe805 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.167578 Aug 10 13:03:42.753550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1540/3102] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:42 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:42.756008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c3839cc4-51c2-401f-a62d-f0b78c9f3d75 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:42.756150 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fd1fd7a6-64f6-4aed-903f-81417427184b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:42.756648 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c3839cc4-51c2-401f-a62d-f0b78c9f3d75 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:42.764794 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c3839cc4-51c2-401f-a62d-f0b78c9f3d75 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:42.765361 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c3839cc4-51c2-401f-a62d-f0b78c9f3d75 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:42.765803 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c3839cc4-51c2-401f-a62d-f0b78c9f3d75 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:42.766302 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fd1fd7a6-64f6-4aed-903f-81417427184b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:42.766508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c3839cc4-51c2-401f-a62d-f0b78c9f3d75 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:42.766993 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c3839cc4-51c2-401f-a62d-f0b78c9f3d75 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:42.767472 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c3839cc4-51c2-401f-a62d-f0b78c9f3d75 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:42.767952 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fd1fd7a6-64f6-4aed-903f-81417427184b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:42.769566 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fd1fd7a6-64f6-4aed-903f-81417427184b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73" status: 200 len: 1278 microversion: 2.20 time: 0.096450 Aug 10 13:03:42.769783 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1563/3103] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:42 2022] GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73 => generated 1278 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:03:42.774036 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:42.774360 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-740dd345-a9c0-4e1d-80de-d193f5f7bf13 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:42.774976 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-740dd345-a9c0-4e1d-80de-d193f5f7bf13 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:42.782689 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-740dd345-a9c0-4e1d-80de-d193f5f7bf13 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:42.783735 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-740dd345-a9c0-4e1d-80de-d193f5f7bf13 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:42.784530 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-740dd345-a9c0-4e1d-80de-d193f5f7bf13 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:42.786936 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-740dd345-a9c0-4e1d-80de-d193f5f7bf13 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:42.786936 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-740dd345-a9c0-4e1d-80de-d193f5f7bf13 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:42.786936 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-740dd345-a9c0-4e1d-80de-d193f5f7bf13 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:42.874652 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-740dd345-a9c0-4e1d-80de-d193f5f7bf13 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:42.883670 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-740dd345-a9c0-4e1d-80de-d193f5f7bf13 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.112094 Aug 10 13:03:42.883670 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1564/3104] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:42 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:42.936309 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c3839cc4-51c2-401f-a62d-f0b78c9f3d75 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:42.942453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c3839cc4-51c2-401f-a62d-f0b78c9f3d75 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.190331 Aug 10 13:03:42.943027 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1541/3105] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:42 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:43.775509 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-26419a5a-97d0-47a2-910f-24f15088b35c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:43.776888 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-26419a5a-97d0-47a2-910f-24f15088b35c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:43.783114 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-26419a5a-97d0-47a2-910f-24f15088b35c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:43.785392 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-26419a5a-97d0-47a2-910f-24f15088b35c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:43.785392 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-26419a5a-97d0-47a2-910f-24f15088b35c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:43.785392 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-26419a5a-97d0-47a2-910f-24f15088b35c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:43.785392 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-26419a5a-97d0-47a2-910f-24f15088b35c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:43.785790 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-26419a5a-97d0-47a2-910f-24f15088b35c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:43.792203 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e30fecc6-6cd7-434f-a17a-dad70aa5b58a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:43.792808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e30fecc6-6cd7-434f-a17a-dad70aa5b58a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 2f8e2b4f-5870-46a3-b826-1b80fb322c73] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:43.799718 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e30fecc6-6cd7-434f-a17a-dad70aa5b58a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:43.800272 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e30fecc6-6cd7-434f-a17a-dad70aa5b58a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:43.800935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e30fecc6-6cd7-434f-a17a-dad70aa5b58a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:43.801634 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e30fecc6-6cd7-434f-a17a-dad70aa5b58a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:43.802090 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e30fecc6-6cd7-434f-a17a-dad70aa5b58a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:43.802608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e30fecc6-6cd7-434f-a17a-dad70aa5b58a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:43.899843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e30fecc6-6cd7-434f-a17a-dad70aa5b58a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:43.909058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e30fecc6-6cd7-434f-a17a-dad70aa5b58a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:43.910727 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e30fecc6-6cd7-434f-a17a-dad70aa5b58a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:43.912053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e30fecc6-6cd7-434f-a17a-dad70aa5b58a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73" status: 200 len: 1340 microversion: 2.20 time: 0.123744 Aug 10 13:03:43.916715 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1542/3106] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:43 2022] GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73 => generated 1340 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:03:43.917699 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-cec34913-1870-4bdb-b848-efccc4f40d96 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:43.918306 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-cec34913-1870-4bdb-b848-efccc4f40d96 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:43.924638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cec34913-1870-4bdb-b848-efccc4f40d96 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:43.925303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cec34913-1870-4bdb-b848-efccc4f40d96 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:43.925910 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cec34913-1870-4bdb-b848-efccc4f40d96 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:43.926777 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cec34913-1870-4bdb-b848-efccc4f40d96 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:43.927426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cec34913-1870-4bdb-b848-efccc4f40d96 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:43.928097 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cec34913-1870-4bdb-b848-efccc4f40d96 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:44.004673 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-cec34913-1870-4bdb-b848-efccc4f40d96 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:44.013907 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-cec34913-1870-4bdb-b848-efccc4f40d96 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.100208 Aug 10 13:03:44.014484 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1543/3107] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:43 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:44.024290 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-26419a5a-97d0-47a2-910f-24f15088b35c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:44.025389 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3492239e-6687-4efd-8937-e92dc39fa61d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:44.026735 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3492239e-6687-4efd-8937-e92dc39fa61d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:44.032864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3492239e-6687-4efd-8937-e92dc39fa61d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:44.033354 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3492239e-6687-4efd-8937-e92dc39fa61d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:44.033785 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-26419a5a-97d0-47a2-910f-24f15088b35c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.265318 Aug 10 13:03:44.033935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3492239e-6687-4efd-8937-e92dc39fa61d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:44.034459 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1565/3108] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:43 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:44.034600 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3492239e-6687-4efd-8937-e92dc39fa61d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:44.034912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3492239e-6687-4efd-8937-e92dc39fa61d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:44.035367 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3492239e-6687-4efd-8937-e92dc39fa61d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:44.237209 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3492239e-6687-4efd-8937-e92dc39fa61d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:44.246117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3492239e-6687-4efd-8937-e92dc39fa61d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.230603 Aug 10 13:03:44.246707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1544/3109] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:44 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:44.937239 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c9a378c1-695c-44bf-8c00-e8cc5444a25d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:44.937239 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c9a378c1-695c-44bf-8c00-e8cc5444a25d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 2f8e2b4f-5870-46a3-b826-1b80fb322c73] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:44.938934 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-bb54c391-2a8d-4e80-8121-eee40feb1c32 req-3a587817-3311-453b-8269-d601ccaed109 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f8e2b4f-5870-46a3-b826-1b80fb322c73", "tag": "2bffdf55-050a-468d-a05d-6fd7af5df24a"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:03:44.943266 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c9a378c1-695c-44bf-8c00-e8cc5444a25d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:44.943747 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c9a378c1-695c-44bf-8c00-e8cc5444a25d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:44.944176 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c9a378c1-695c-44bf-8c00-e8cc5444a25d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:44.944929 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c9a378c1-695c-44bf-8c00-e8cc5444a25d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:44.945374 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c9a378c1-695c-44bf-8c00-e8cc5444a25d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:44.945791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c9a378c1-695c-44bf-8c00-e8cc5444a25d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:44.951041 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-bb54c391-2a8d-4e80-8121-eee40feb1c32 req-3a587817-3311-453b-8269-d601ccaed109 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:44.951972 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-bb54c391-2a8d-4e80-8121-eee40feb1c32 req-3a587817-3311-453b-8269-d601ccaed109 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:44.952403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-bb54c391-2a8d-4e80-8121-eee40feb1c32 req-3a587817-3311-453b-8269-d601ccaed109 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:44.965228 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-bb54c391-2a8d-4e80-8121-eee40feb1c32 req-3a587817-3311-453b-8269-d601ccaed109 service nova] Creating event network-changed:2bffdf55-050a-468d-a05d-6fd7af5df24a for instance 2f8e2b4f-5870-46a3-b826-1b80fb322c73 on hv-cinder-85199 Aug 10 13:03:44.971091 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-bb54c391-2a8d-4e80-8121-eee40feb1c32 req-3a587817-3311-453b-8269-d601ccaed109 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036391 Aug 10 13:03:44.971915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1545/3110] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:03:45.036546 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-55e024d8-4d08-48b0-a0c4-c3d2e08bed97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:45.037249 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-55e024d8-4d08-48b0-a0c4-c3d2e08bed97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:45.045079 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55e024d8-4d08-48b0-a0c4-c3d2e08bed97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:45.045576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55e024d8-4d08-48b0-a0c4-c3d2e08bed97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:45.046016 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55e024d8-4d08-48b0-a0c4-c3d2e08bed97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:45.046713 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55e024d8-4d08-48b0-a0c4-c3d2e08bed97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:45.047165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55e024d8-4d08-48b0-a0c4-c3d2e08bed97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:45.047614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55e024d8-4d08-48b0-a0c4-c3d2e08bed97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:45.174398 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-55e024d8-4d08-48b0-a0c4-c3d2e08bed97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:45.183025 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-55e024d8-4d08-48b0-a0c4-c3d2e08bed97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.150130 Aug 10 13:03:45.183864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1546/3111] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:45 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:45.188410 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0b7ad342-f71c-4f08-98c1-a56775956635 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:45.188840 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0b7ad342-f71c-4f08-98c1-a56775956635 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:45.194588 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b7ad342-f71c-4f08-98c1-a56775956635 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:45.195061 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b7ad342-f71c-4f08-98c1-a56775956635 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:45.198371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b7ad342-f71c-4f08-98c1-a56775956635 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:45.198371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b7ad342-f71c-4f08-98c1-a56775956635 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:45.198371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b7ad342-f71c-4f08-98c1-a56775956635 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:45.198371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b7ad342-f71c-4f08-98c1-a56775956635 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:45.202346 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c9a378c1-695c-44bf-8c00-e8cc5444a25d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:45.210829 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c9a378c1-695c-44bf-8c00-e8cc5444a25d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:45.212771 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c9a378c1-695c-44bf-8c00-e8cc5444a25d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:45.214495 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c9a378c1-695c-44bf-8c00-e8cc5444a25d tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73" status: 200 len: 1408 microversion: 2.20 time: 0.283413 Aug 10 13:03:45.215546 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1566/3112] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:44 2022] GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73 => generated 1408 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:03:45.268933 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9dd69243-fae9-490d-a5ff-b2604c57d7b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:45.269919 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9dd69243-fae9-490d-a5ff-b2604c57d7b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:45.278366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9dd69243-fae9-490d-a5ff-b2604c57d7b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:45.280570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9dd69243-fae9-490d-a5ff-b2604c57d7b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:45.280570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9dd69243-fae9-490d-a5ff-b2604c57d7b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:45.280570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9dd69243-fae9-490d-a5ff-b2604c57d7b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:45.281100 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9dd69243-fae9-490d-a5ff-b2604c57d7b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:45.281685 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9dd69243-fae9-490d-a5ff-b2604c57d7b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:45.471574 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0b7ad342-f71c-4f08-98c1-a56775956635 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:45.480403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0b7ad342-f71c-4f08-98c1-a56775956635 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.295347 Aug 10 13:03:45.491457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1547/3113] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:45 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:45.495788 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9dd69243-fae9-490d-a5ff-b2604c57d7b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:45.504242 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9dd69243-fae9-490d-a5ff-b2604c57d7b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.239321 Aug 10 13:03:45.504827 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1567/3114] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:45 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:46.204677 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d9997019-2d22-404c-b267-aec8d4d16992 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:46.205264 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d9997019-2d22-404c-b267-aec8d4d16992 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:46.211583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d9997019-2d22-404c-b267-aec8d4d16992 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:46.212068 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d9997019-2d22-404c-b267-aec8d4d16992 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:46.212524 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d9997019-2d22-404c-b267-aec8d4d16992 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:46.213260 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d9997019-2d22-404c-b267-aec8d4d16992 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:46.214548 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d9997019-2d22-404c-b267-aec8d4d16992 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:46.214997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d9997019-2d22-404c-b267-aec8d4d16992 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:46.238767 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-15cd96a4-b4c7-4d22-8133-137dc5265a61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:46.239551 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-15cd96a4-b4c7-4d22-8133-137dc5265a61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 2f8e2b4f-5870-46a3-b826-1b80fb322c73] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:46.246665 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15cd96a4-b4c7-4d22-8133-137dc5265a61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:46.247054 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15cd96a4-b4c7-4d22-8133-137dc5265a61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:46.247519 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15cd96a4-b4c7-4d22-8133-137dc5265a61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:46.248218 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15cd96a4-b4c7-4d22-8133-137dc5265a61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:46.248673 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15cd96a4-b4c7-4d22-8133-137dc5265a61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:46.249102 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15cd96a4-b4c7-4d22-8133-137dc5265a61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:46.278453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d9997019-2d22-404c-b267-aec8d4d16992 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:46.287095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d9997019-2d22-404c-b267-aec8d4d16992 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.086218 Aug 10 13:03:46.287730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1548/3115] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:46 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:46.379025 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-15cd96a4-b4c7-4d22-8133-137dc5265a61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:46.387618 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-15cd96a4-b4c7-4d22-8133-137dc5265a61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:46.389116 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-15cd96a4-b4c7-4d22-8133-137dc5265a61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:46.390213 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-15cd96a4-b4c7-4d22-8133-137dc5265a61 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73" status: 200 len: 1408 microversion: 2.20 time: 0.155413 Aug 10 13:03:46.390799 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1568/3116] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:46 2022] GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:03:46.501673 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-af574881-03ad-4116-9d75-ce5e57b3bbfb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:46.502236 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-af574881-03ad-4116-9d75-ce5e57b3bbfb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:46.508360 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-af574881-03ad-4116-9d75-ce5e57b3bbfb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:46.508851 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-af574881-03ad-4116-9d75-ce5e57b3bbfb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:46.509290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-af574881-03ad-4116-9d75-ce5e57b3bbfb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:46.510018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-af574881-03ad-4116-9d75-ce5e57b3bbfb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:46.511168 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-af574881-03ad-4116-9d75-ce5e57b3bbfb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:46.511625 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-af574881-03ad-4116-9d75-ce5e57b3bbfb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:46.525874 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-18520992-ea04-445d-8400-dc0ca43a1c71 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:46.526820 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-18520992-ea04-445d-8400-dc0ca43a1c71 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:46.532593 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-18520992-ea04-445d-8400-dc0ca43a1c71 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:46.533065 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-18520992-ea04-445d-8400-dc0ca43a1c71 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:46.533491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-18520992-ea04-445d-8400-dc0ca43a1c71 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:46.534171 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-18520992-ea04-445d-8400-dc0ca43a1c71 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:46.534614 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-18520992-ea04-445d-8400-dc0ca43a1c71 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:46.535031 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-18520992-ea04-445d-8400-dc0ca43a1c71 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:46.703335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-af574881-03ad-4116-9d75-ce5e57b3bbfb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:46.711344 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-af574881-03ad-4116-9d75-ce5e57b3bbfb tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.213654 Aug 10 13:03:46.711922 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1549/3117] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:46 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:46.719624 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-18520992-ea04-445d-8400-dc0ca43a1c71 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:46.727578 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-18520992-ea04-445d-8400-dc0ca43a1c71 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.205511 Aug 10 13:03:46.728099 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1569/3118] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:46 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:47.308589 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7cbe7d26-a22f-4404-8337-4ca4167be52a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:47.309186 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7cbe7d26-a22f-4404-8337-4ca4167be52a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:47.315946 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7cbe7d26-a22f-4404-8337-4ca4167be52a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:47.316530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7cbe7d26-a22f-4404-8337-4ca4167be52a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:47.316971 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7cbe7d26-a22f-4404-8337-4ca4167be52a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:47.317669 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7cbe7d26-a22f-4404-8337-4ca4167be52a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:47.318121 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7cbe7d26-a22f-4404-8337-4ca4167be52a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:47.318572 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7cbe7d26-a22f-4404-8337-4ca4167be52a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:47.384734 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7cbe7d26-a22f-4404-8337-4ca4167be52a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:47.393250 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7cbe7d26-a22f-4404-8337-4ca4167be52a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.089008 Aug 10 13:03:47.393809 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1550/3119] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:47 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:47.411994 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e9750cd5-82ac-4a60-89bd-9b5b885ca2fd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:47.412633 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e9750cd5-82ac-4a60-89bd-9b5b885ca2fd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 2f8e2b4f-5870-46a3-b826-1b80fb322c73] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:47.420153 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e9750cd5-82ac-4a60-89bd-9b5b885ca2fd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:47.420616 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e9750cd5-82ac-4a60-89bd-9b5b885ca2fd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:47.421049 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e9750cd5-82ac-4a60-89bd-9b5b885ca2fd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:47.421740 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e9750cd5-82ac-4a60-89bd-9b5b885ca2fd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:47.422196 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e9750cd5-82ac-4a60-89bd-9b5b885ca2fd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:47.422621 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e9750cd5-82ac-4a60-89bd-9b5b885ca2fd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:47.425305 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:47.553077 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e9750cd5-82ac-4a60-89bd-9b5b885ca2fd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:47.561592 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e9750cd5-82ac-4a60-89bd-9b5b885ca2fd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:47.563107 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e9750cd5-82ac-4a60-89bd-9b5b885ca2fd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:47.564257 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e9750cd5-82ac-4a60-89bd-9b5b885ca2fd tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73" status: 200 len: 1408 microversion: 2.20 time: 0.156183 Aug 10 13:03:47.564816 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1570/3120] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:47 2022] GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:03:47.734158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-078009be-f0f0-4402-a976-c5a015170aff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:47.734796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-078009be-f0f0-4402-a976-c5a015170aff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:47.741000 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-078009be-f0f0-4402-a976-c5a015170aff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:47.741485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-078009be-f0f0-4402-a976-c5a015170aff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:47.741919 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-078009be-f0f0-4402-a976-c5a015170aff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:47.742684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-078009be-f0f0-4402-a976-c5a015170aff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:47.743220 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-078009be-f0f0-4402-a976-c5a015170aff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:47.743677 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-078009be-f0f0-4402-a976-c5a015170aff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:47.749634 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-25501433-31c9-4bea-ba39-df0ab136a357 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:47.750345 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-25501433-31c9-4bea-ba39-df0ab136a357 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:47.756275 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-25501433-31c9-4bea-ba39-df0ab136a357 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:47.756817 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-25501433-31c9-4bea-ba39-df0ab136a357 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:47.757254 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-25501433-31c9-4bea-ba39-df0ab136a357 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:47.757954 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-25501433-31c9-4bea-ba39-df0ab136a357 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:47.758408 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-25501433-31c9-4bea-ba39-df0ab136a357 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:47.758838 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-25501433-31c9-4bea-ba39-df0ab136a357 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:47.945903 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-078009be-f0f0-4402-a976-c5a015170aff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:47.950464 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-25501433-31c9-4bea-ba39-df0ab136a357 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:47.954703 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-078009be-f0f0-4402-a976-c5a015170aff tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.226120 Aug 10 13:03:47.955423 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1551/3121] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:47 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:47.958710 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-25501433-31c9-4bea-ba39-df0ab136a357 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.212916 Aug 10 13:03:47.959481 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1571/3122] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:47 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:48.414448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-34567fc5-110d-4c54-9c40-a4fbf1a3ce34 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:48.415049 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-34567fc5-110d-4c54-9c40-a4fbf1a3ce34 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:48.421661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34567fc5-110d-4c54-9c40-a4fbf1a3ce34 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:48.422142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34567fc5-110d-4c54-9c40-a4fbf1a3ce34 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:48.422576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34567fc5-110d-4c54-9c40-a4fbf1a3ce34 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:48.423286 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34567fc5-110d-4c54-9c40-a4fbf1a3ce34 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:48.423741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34567fc5-110d-4c54-9c40-a4fbf1a3ce34 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:48.424162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34567fc5-110d-4c54-9c40-a4fbf1a3ce34 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:48.488058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-34567fc5-110d-4c54-9c40-a4fbf1a3ce34 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:48.496630 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-34567fc5-110d-4c54-9c40-a4fbf1a3ce34 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.086221 Aug 10 13:03:48.497199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1552/3123] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:48 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:48.587199 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-67640fb3-44db-48f4-a238-e0043330df1b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:48.587812 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-67640fb3-44db-48f4-a238-e0043330df1b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 2f8e2b4f-5870-46a3-b826-1b80fb322c73] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:48.595225 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-67640fb3-44db-48f4-a238-e0043330df1b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:48.595703 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-67640fb3-44db-48f4-a238-e0043330df1b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:48.596130 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-67640fb3-44db-48f4-a238-e0043330df1b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:48.596809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-67640fb3-44db-48f4-a238-e0043330df1b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:48.597253 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-67640fb3-44db-48f4-a238-e0043330df1b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:48.597668 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-67640fb3-44db-48f4-a238-e0043330df1b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:48.724749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-67640fb3-44db-48f4-a238-e0043330df1b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:48.733939 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-67640fb3-44db-48f4-a238-e0043330df1b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:48.735505 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-67640fb3-44db-48f4-a238-e0043330df1b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:48.736964 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-67640fb3-44db-48f4-a238-e0043330df1b tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73" status: 200 len: 1408 microversion: 2.20 time: 0.153703 Aug 10 13:03:48.737528 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1572/3124] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:48 2022] GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:03:48.975444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-41b01c3f-9a5a-48ca-a789-dd31f18ca368 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:48.976081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-41b01c3f-9a5a-48ca-a789-dd31f18ca368 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:48.981620 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bc0ff934-0366-4213-b7b6-826f6abaa6e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:48.983350 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bc0ff934-0366-4213-b7b6-826f6abaa6e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:48.983490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41b01c3f-9a5a-48ca-a789-dd31f18ca368 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:48.983808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41b01c3f-9a5a-48ca-a789-dd31f18ca368 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:48.984120 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41b01c3f-9a5a-48ca-a789-dd31f18ca368 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:48.984817 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41b01c3f-9a5a-48ca-a789-dd31f18ca368 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:48.985374 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41b01c3f-9a5a-48ca-a789-dd31f18ca368 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:48.985871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41b01c3f-9a5a-48ca-a789-dd31f18ca368 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:48.988346 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc0ff934-0366-4213-b7b6-826f6abaa6e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:48.988822 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc0ff934-0366-4213-b7b6-826f6abaa6e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:48.989295 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc0ff934-0366-4213-b7b6-826f6abaa6e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:48.989988 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc0ff934-0366-4213-b7b6-826f6abaa6e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:48.990575 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc0ff934-0366-4213-b7b6-826f6abaa6e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:48.991006 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bc0ff934-0366-4213-b7b6-826f6abaa6e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:49.172208 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-bc0ff934-0366-4213-b7b6-826f6abaa6e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:49.180306 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bc0ff934-0366-4213-b7b6-826f6abaa6e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.203843 Aug 10 13:03:49.180754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1573/3125] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:48 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:49.182927 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-41b01c3f-9a5a-48ca-a789-dd31f18ca368 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:49.192091 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-41b01c3f-9a5a-48ca-a789-dd31f18ca368 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.220561 Aug 10 13:03:49.192651 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1553/3126] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:48 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:49.517577 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-696812ba-709c-43d4-b1a7-e4aa58f6ef1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:49.518188 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-696812ba-709c-43d4-b1a7-e4aa58f6ef1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:49.524129 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-696812ba-709c-43d4-b1a7-e4aa58f6ef1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:49.524632 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-696812ba-709c-43d4-b1a7-e4aa58f6ef1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:49.525067 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-696812ba-709c-43d4-b1a7-e4aa58f6ef1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:49.526240 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-696812ba-709c-43d4-b1a7-e4aa58f6ef1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:49.526692 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-696812ba-709c-43d4-b1a7-e4aa58f6ef1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:49.527115 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-696812ba-709c-43d4-b1a7-e4aa58f6ef1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:49.591684 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-696812ba-709c-43d4-b1a7-e4aa58f6ef1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:49.599969 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-696812ba-709c-43d4-b1a7-e4aa58f6ef1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.086298 Aug 10 13:03:49.600539 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1574/3127] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:49 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:49.759271 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c2178ac1-b525-4a63-ba9c-5fc3bfa30f4c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:49.759880 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c2178ac1-b525-4a63-ba9c-5fc3bfa30f4c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 2f8e2b4f-5870-46a3-b826-1b80fb322c73] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:49.766741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2178ac1-b525-4a63-ba9c-5fc3bfa30f4c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:49.767241 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2178ac1-b525-4a63-ba9c-5fc3bfa30f4c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:49.767673 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2178ac1-b525-4a63-ba9c-5fc3bfa30f4c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:49.768349 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2178ac1-b525-4a63-ba9c-5fc3bfa30f4c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:49.768792 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2178ac1-b525-4a63-ba9c-5fc3bfa30f4c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:49.769209 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2178ac1-b525-4a63-ba9c-5fc3bfa30f4c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:49.900002 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c2178ac1-b525-4a63-ba9c-5fc3bfa30f4c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:49.908651 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c2178ac1-b525-4a63-ba9c-5fc3bfa30f4c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:49.910145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c2178ac1-b525-4a63-ba9c-5fc3bfa30f4c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:49.911274 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c2178ac1-b525-4a63-ba9c-5fc3bfa30f4c tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73" status: 200 len: 1408 microversion: 2.20 time: 0.155885 Aug 10 13:03:49.911838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1554/3128] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:49 2022] GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:03:50.201363 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-72d07587-acfc-473b-9eeb-f5ba11c5db3d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:50.201980 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-72d07587-acfc-473b-9eeb-f5ba11c5db3d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:50.207904 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72d07587-acfc-473b-9eeb-f5ba11c5db3d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:50.208390 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72d07587-acfc-473b-9eeb-f5ba11c5db3d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:50.208826 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72d07587-acfc-473b-9eeb-f5ba11c5db3d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:50.209514 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72d07587-acfc-473b-9eeb-f5ba11c5db3d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:50.209967 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72d07587-acfc-473b-9eeb-f5ba11c5db3d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:50.210393 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-72d07587-acfc-473b-9eeb-f5ba11c5db3d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:50.213790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-96c7aa40-fdcb-4a59-b4aa-c71a5c548413 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:50.214555 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-96c7aa40-fdcb-4a59-b4aa-c71a5c548413 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:50.220405 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-96c7aa40-fdcb-4a59-b4aa-c71a5c548413 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:50.220888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-96c7aa40-fdcb-4a59-b4aa-c71a5c548413 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:50.221325 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-96c7aa40-fdcb-4a59-b4aa-c71a5c548413 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:50.222017 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-96c7aa40-fdcb-4a59-b4aa-c71a5c548413 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:50.222467 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-96c7aa40-fdcb-4a59-b4aa-c71a5c548413 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:50.222888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-96c7aa40-fdcb-4a59-b4aa-c71a5c548413 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:50.412005 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-96c7aa40-fdcb-4a59-b4aa-c71a5c548413 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:50.418423 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-72d07587-acfc-473b-9eeb-f5ba11c5db3d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:50.421557 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-96c7aa40-fdcb-4a59-b4aa-c71a5c548413 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.211621 Aug 10 13:03:50.422414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1555/3129] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:50 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:50.426319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-72d07587-acfc-473b-9eeb-f5ba11c5db3d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.229580 Aug 10 13:03:50.427411 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1575/3130] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:50 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:50.622816 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5f9d64d1-b7c2-488a-94ac-db38e6d43f65 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:50.623462 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5f9d64d1-b7c2-488a-94ac-db38e6d43f65 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:50.629538 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5f9d64d1-b7c2-488a-94ac-db38e6d43f65 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:50.630015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5f9d64d1-b7c2-488a-94ac-db38e6d43f65 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:50.630469 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5f9d64d1-b7c2-488a-94ac-db38e6d43f65 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:50.631266 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5f9d64d1-b7c2-488a-94ac-db38e6d43f65 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:50.631719 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5f9d64d1-b7c2-488a-94ac-db38e6d43f65 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:50.632269 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5f9d64d1-b7c2-488a-94ac-db38e6d43f65 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:50.714119 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5f9d64d1-b7c2-488a-94ac-db38e6d43f65 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:50.722035 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5f9d64d1-b7c2-488a-94ac-db38e6d43f65 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.104371 Aug 10 13:03:50.722601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1556/3131] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:50 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:50.933105 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b7f15aab-ddce-439a-95ee-752a64ab1735 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:50.933717 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b7f15aab-ddce-439a-95ee-752a64ab1735 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 2f8e2b4f-5870-46a3-b826-1b80fb322c73] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:50.940110 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b7f15aab-ddce-439a-95ee-752a64ab1735 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:50.940582 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b7f15aab-ddce-439a-95ee-752a64ab1735 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:50.941014 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b7f15aab-ddce-439a-95ee-752a64ab1735 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:50.941699 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b7f15aab-ddce-439a-95ee-752a64ab1735 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:50.942144 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b7f15aab-ddce-439a-95ee-752a64ab1735 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:50.942930 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b7f15aab-ddce-439a-95ee-752a64ab1735 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:51.145053 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b7f15aab-ddce-439a-95ee-752a64ab1735 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:51.153736 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b7f15aab-ddce-439a-95ee-752a64ab1735 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:51.155366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b7f15aab-ddce-439a-95ee-752a64ab1735 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:51.156599 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b7f15aab-ddce-439a-95ee-752a64ab1735 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73" status: 200 len: 1408 microversion: 2.20 time: 0.227472 Aug 10 13:03:51.157159 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1576/3132] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:50 2022] GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73 => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:03:51.442206 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b4e02d3d-748b-47da-b185-8dd06596ef95 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:51.442820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b4e02d3d-748b-47da-b185-8dd06596ef95 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:51.445391 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=2 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:51.446056 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=10 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:51.446484 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f8f3bad0-7f51-4aeb-94dd-75811d62c0f6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:51.447101 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f8f3bad0-7f51-4aeb-94dd-75811d62c0f6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:51.450842 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4e02d3d-748b-47da-b185-8dd06596ef95 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:51.451355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4e02d3d-748b-47da-b185-8dd06596ef95 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:51.451793 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4e02d3d-748b-47da-b185-8dd06596ef95 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:51.452484 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4e02d3d-748b-47da-b185-8dd06596ef95 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:51.452935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4e02d3d-748b-47da-b185-8dd06596ef95 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:51.453149 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f8f3bad0-7f51-4aeb-94dd-75811d62c0f6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:51.453357 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b4e02d3d-748b-47da-b185-8dd06596ef95 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:51.453630 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f8f3bad0-7f51-4aeb-94dd-75811d62c0f6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:51.454065 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f8f3bad0-7f51-4aeb-94dd-75811d62c0f6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:51.454753 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f8f3bad0-7f51-4aeb-94dd-75811d62c0f6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:51.455239 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f8f3bad0-7f51-4aeb-94dd-75811d62c0f6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:51.455668 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f8f3bad0-7f51-4aeb-94dd-75811d62c0f6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:51.646956 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b4e02d3d-748b-47da-b185-8dd06596ef95 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:51.647127 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell0:SELECT=2 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:51.655016 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b4e02d3d-748b-47da-b185-8dd06596ef95 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.216620 Aug 10 13:03:51.655948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1557/3133] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:51 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:51.658447 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f8f3bad0-7f51-4aeb-94dd-75811d62c0f6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:51.667148 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f8f3bad0-7f51-4aeb-94dd-75811d62c0f6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.223838 Aug 10 13:03:51.667741 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1577/3134] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:51 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:51.743835 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6e350d7d-93bb-4646-a11c-21d065ef3116 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:51.744466 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6e350d7d-93bb-4646-a11c-21d065ef3116 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:51.750344 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6e350d7d-93bb-4646-a11c-21d065ef3116 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:51.750819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6e350d7d-93bb-4646-a11c-21d065ef3116 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:51.751298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6e350d7d-93bb-4646-a11c-21d065ef3116 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:51.751978 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6e350d7d-93bb-4646-a11c-21d065ef3116 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:51.752426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6e350d7d-93bb-4646-a11c-21d065ef3116 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:51.752845 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6e350d7d-93bb-4646-a11c-21d065ef3116 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:51.768310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:51.814333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6e350d7d-93bb-4646-a11c-21d065ef3116 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:51.822073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6e350d7d-93bb-4646-a11c-21d065ef3116 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082124 Aug 10 13:03:51.822690 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1558/3135] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:51 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:52.146958 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [req-16074825-6e14-4ac9-a321-faa99b001f91 req-03f7cedc-6eaf-4bdb-9c96-6331254974ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f8e2b4f-5870-46a3-b826-1b80fb322c73", "name": "network-vif-plugged", "status": "completed", "tag": "2bffdf55-050a-468d-a05d-6fd7af5df24a"}]} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:03:52.157173 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-16074825-6e14-4ac9-a321-faa99b001f91 req-03f7cedc-6eaf-4bdb-9c96-6331254974ed service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:52.157641 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-16074825-6e14-4ac9-a321-faa99b001f91 req-03f7cedc-6eaf-4bdb-9c96-6331254974ed service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:52.158069 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-16074825-6e14-4ac9-a321-faa99b001f91 req-03f7cedc-6eaf-4bdb-9c96-6331254974ed service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:52.170885 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.compute.server_external_events [req-16074825-6e14-4ac9-a321-faa99b001f91 req-03f7cedc-6eaf-4bdb-9c96-6331254974ed service nova] Creating event network-vif-plugged:2bffdf55-050a-468d-a05d-6fd7af5df24a for instance 2f8e2b4f-5870-46a3-b826-1b80fb322c73 on hv-cinder-85199 Aug 10 13:03:52.177230 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [req-16074825-6e14-4ac9-a321-faa99b001f91 req-03f7cedc-6eaf-4bdb-9c96-6331254974ed service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089586 Aug 10 13:03:52.177529 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1578/3136] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:03:52.180563 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a76264aa-5af7-4024-b89f-a679e28aba78 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:52.181419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a76264aa-5af7-4024-b89f-a679e28aba78 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 2f8e2b4f-5870-46a3-b826-1b80fb322c73] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:52.184935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:52.188463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a76264aa-5af7-4024-b89f-a679e28aba78 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:52.188961 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a76264aa-5af7-4024-b89f-a679e28aba78 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:52.189397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a76264aa-5af7-4024-b89f-a679e28aba78 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:52.190304 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a76264aa-5af7-4024-b89f-a679e28aba78 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:52.190784 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a76264aa-5af7-4024-b89f-a679e28aba78 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:52.191346 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a76264aa-5af7-4024-b89f-a679e28aba78 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:52.326249 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a76264aa-5af7-4024-b89f-a679e28aba78 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:52.334085 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a76264aa-5af7-4024-b89f-a679e28aba78 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:52.335657 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a76264aa-5af7-4024-b89f-a679e28aba78 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:52.336690 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a76264aa-5af7-4024-b89f-a679e28aba78 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73" status: 200 len: 1408 microversion: 2.20 time: 0.160567 Aug 10 13:03:52.337250 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1559/3137] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:52 2022] GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 13:03:52.677331 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-457dc467-c0a5-41ff-8f0e-dbaa1eee6ebf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:52.678052 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-457dc467-c0a5-41ff-8f0e-dbaa1eee6ebf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:52.685207 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-457dc467-c0a5-41ff-8f0e-dbaa1eee6ebf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:52.685694 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-457dc467-c0a5-41ff-8f0e-dbaa1eee6ebf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:52.686127 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-457dc467-c0a5-41ff-8f0e-dbaa1eee6ebf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:52.686810 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-457dc467-c0a5-41ff-8f0e-dbaa1eee6ebf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:52.687285 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-457dc467-c0a5-41ff-8f0e-dbaa1eee6ebf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:52.687704 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-457dc467-c0a5-41ff-8f0e-dbaa1eee6ebf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:52.689066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bd9e72b7-0ce7-405e-80a1-c87ab9cc3eb2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:52.689673 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bd9e72b7-0ce7-405e-80a1-c87ab9cc3eb2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:52.696535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd9e72b7-0ce7-405e-80a1-c87ab9cc3eb2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:52.697006 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd9e72b7-0ce7-405e-80a1-c87ab9cc3eb2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:52.697437 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd9e72b7-0ce7-405e-80a1-c87ab9cc3eb2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:52.698140 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd9e72b7-0ce7-405e-80a1-c87ab9cc3eb2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:52.698701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd9e72b7-0ce7-405e-80a1-c87ab9cc3eb2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:52.699121 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd9e72b7-0ce7-405e-80a1-c87ab9cc3eb2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:52.884192 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-457dc467-c0a5-41ff-8f0e-dbaa1eee6ebf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:52.888455 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-bd9e72b7-0ce7-405e-80a1-c87ab9cc3eb2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:52.893297 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-457dc467-c0a5-41ff-8f0e-dbaa1eee6ebf tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.220131 Aug 10 13:03:52.894000 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1579/3138] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:52 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:52.896259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bd9e72b7-0ce7-405e-80a1-c87ab9cc3eb2 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.211026 Aug 10 13:03:52.896995 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1560/3139] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:52 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:52.898656 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fcbd2908-9a7b-4c9d-9b52-6fbbf0dd351a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:52.899375 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fcbd2908-9a7b-4c9d-9b52-6fbbf0dd351a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:52.906006 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fcbd2908-9a7b-4c9d-9b52-6fbbf0dd351a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:52.906574 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fcbd2908-9a7b-4c9d-9b52-6fbbf0dd351a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:52.907101 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fcbd2908-9a7b-4c9d-9b52-6fbbf0dd351a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:52.907894 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fcbd2908-9a7b-4c9d-9b52-6fbbf0dd351a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:52.908354 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fcbd2908-9a7b-4c9d-9b52-6fbbf0dd351a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:52.908782 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fcbd2908-9a7b-4c9d-9b52-6fbbf0dd351a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:52.969959 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fcbd2908-9a7b-4c9d-9b52-6fbbf0dd351a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:52.977869 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fcbd2908-9a7b-4c9d-9b52-6fbbf0dd351a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082887 Aug 10 13:03:52.978441 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1580/3140] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:52 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:53.359819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2a6eba8c-a04e-4630-b82e-c92cc7469adf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:53.360424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2a6eba8c-a04e-4630-b82e-c92cc7469adf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 2f8e2b4f-5870-46a3-b826-1b80fb322c73] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:53.366288 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a6eba8c-a04e-4630-b82e-c92cc7469adf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:53.366766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a6eba8c-a04e-4630-b82e-c92cc7469adf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:53.367265 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a6eba8c-a04e-4630-b82e-c92cc7469adf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:53.367945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a6eba8c-a04e-4630-b82e-c92cc7469adf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:53.368392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a6eba8c-a04e-4630-b82e-c92cc7469adf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:53.368837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a6eba8c-a04e-4630-b82e-c92cc7469adf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:53.497062 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2a6eba8c-a04e-4630-b82e-c92cc7469adf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:53.504989 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2a6eba8c-a04e-4630-b82e-c92cc7469adf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:53.506476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2a6eba8c-a04e-4630-b82e-c92cc7469adf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:53.507626 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2a6eba8c-a04e-4630-b82e-c92cc7469adf tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73" status: 200 len: 1408 microversion: 2.20 time: 0.151718 Aug 10 13:03:53.508181 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1561/3141] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:53 2022] GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:03:53.914316 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6a8c8515-5347-41d3-bf7c-fb7feb74fa81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:53.915056 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6a8c8515-5347-41d3-bf7c-fb7feb74fa81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:53.918207 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ad2dfec8-b4db-4b19-b21f-9190a2d99c48 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:53.918806 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ad2dfec8-b4db-4b19-b21f-9190a2d99c48 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:53.921674 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a8c8515-5347-41d3-bf7c-fb7feb74fa81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:53.922156 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a8c8515-5347-41d3-bf7c-fb7feb74fa81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:53.922591 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a8c8515-5347-41d3-bf7c-fb7feb74fa81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:53.923314 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a8c8515-5347-41d3-bf7c-fb7feb74fa81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:53.923767 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a8c8515-5347-41d3-bf7c-fb7feb74fa81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:53.924188 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a8c8515-5347-41d3-bf7c-fb7feb74fa81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:53.925193 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ad2dfec8-b4db-4b19-b21f-9190a2d99c48 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:53.925671 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ad2dfec8-b4db-4b19-b21f-9190a2d99c48 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:53.926098 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ad2dfec8-b4db-4b19-b21f-9190a2d99c48 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:53.926780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ad2dfec8-b4db-4b19-b21f-9190a2d99c48 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:53.927248 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ad2dfec8-b4db-4b19-b21f-9190a2d99c48 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:53.927668 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ad2dfec8-b4db-4b19-b21f-9190a2d99c48 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:54.128369 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6a8c8515-5347-41d3-bf7c-fb7feb74fa81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:54.131418 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ad2dfec8-b4db-4b19-b21f-9190a2d99c48 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:54.139483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ad2dfec8-b4db-4b19-b21f-9190a2d99c48 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.225155 Aug 10 13:03:54.139927 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6a8c8515-5347-41d3-bf7c-fb7feb74fa81 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.229147 Aug 10 13:03:54.140055 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1562/3142] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:53 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:54.140734 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1581/3143] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:53 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:54.153227 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a08b566e-aeb0-420a-a147-5a9aac928545 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:54.154064 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a08b566e-aeb0-420a-a147-5a9aac928545 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:54.160190 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a08b566e-aeb0-420a-a147-5a9aac928545 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:54.160673 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a08b566e-aeb0-420a-a147-5a9aac928545 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:54.161106 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a08b566e-aeb0-420a-a147-5a9aac928545 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:54.161847 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a08b566e-aeb0-420a-a147-5a9aac928545 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:54.162303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a08b566e-aeb0-420a-a147-5a9aac928545 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:54.162725 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a08b566e-aeb0-420a-a147-5a9aac928545 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:54.227666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a08b566e-aeb0-420a-a147-5a9aac928545 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:54.236380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a08b566e-aeb0-420a-a147-5a9aac928545 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.095385 Aug 10 13:03:54.236944 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1563/3144] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:54 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:54.529942 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-215cf1f5-ce16-425a-8439-6b4121abbd96 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:54.530556 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-215cf1f5-ce16-425a-8439-6b4121abbd96 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 2f8e2b4f-5870-46a3-b826-1b80fb322c73] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:54.536436 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-215cf1f5-ce16-425a-8439-6b4121abbd96 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:54.536919 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-215cf1f5-ce16-425a-8439-6b4121abbd96 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:54.537358 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-215cf1f5-ce16-425a-8439-6b4121abbd96 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:54.538042 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-215cf1f5-ce16-425a-8439-6b4121abbd96 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:54.538500 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-215cf1f5-ce16-425a-8439-6b4121abbd96 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:54.538927 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-215cf1f5-ce16-425a-8439-6b4121abbd96 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:54.665728 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-215cf1f5-ce16-425a-8439-6b4121abbd96 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:54.674282 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-215cf1f5-ce16-425a-8439-6b4121abbd96 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:54.675828 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-215cf1f5-ce16-425a-8439-6b4121abbd96 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:54.676985 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-215cf1f5-ce16-425a-8439-6b4121abbd96 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73" status: 200 len: 1600 microversion: 2.20 time: 0.150928 Aug 10 13:03:54.677561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1582/3145] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:03:54 2022] GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:03:54.699472 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4023b7db-ff09-4893-901d-a5e99ae89393 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:54.699976 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4023b7db-ff09-4893-901d-a5e99ae89393 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 2f8e2b4f-5870-46a3-b826-1b80fb322c73] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:54.705818 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4023b7db-ff09-4893-901d-a5e99ae89393 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:54.706303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4023b7db-ff09-4893-901d-a5e99ae89393 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:54.706744 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4023b7db-ff09-4893-901d-a5e99ae89393 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:54.707464 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4023b7db-ff09-4893-901d-a5e99ae89393 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:54.707921 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4023b7db-ff09-4893-901d-a5e99ae89393 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:54.708352 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4023b7db-ff09-4893-901d-a5e99ae89393 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:54.782960 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4023b7db-ff09-4893-901d-a5e99ae89393 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.087938 Aug 10 13:03:54.783600 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1564/3146] 10.222.0.49 () {60 vars in 1316 bytes} [Wed Aug 10 13:03:54 2022] GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 13:03:55.161931 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c1885155-56ca-4262-bf70-bb83e3c8ff73 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:55.162536 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-093627a3-79a0-47e8-b6a7-7029c95dc94b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:55.162915 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c1885155-56ca-4262-bf70-bb83e3c8ff73 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:55.163142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-093627a3-79a0-47e8-b6a7-7029c95dc94b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:55.170348 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-093627a3-79a0-47e8-b6a7-7029c95dc94b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:55.170847 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-093627a3-79a0-47e8-b6a7-7029c95dc94b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:55.171303 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c1885155-56ca-4262-bf70-bb83e3c8ff73 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:55.171442 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-093627a3-79a0-47e8-b6a7-7029c95dc94b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:55.171797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c1885155-56ca-4262-bf70-bb83e3c8ff73 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:55.172009 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-093627a3-79a0-47e8-b6a7-7029c95dc94b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:55.172258 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c1885155-56ca-4262-bf70-bb83e3c8ff73 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:55.172461 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-093627a3-79a0-47e8-b6a7-7029c95dc94b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:55.172931 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c1885155-56ca-4262-bf70-bb83e3c8ff73 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:55.173097 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-093627a3-79a0-47e8-b6a7-7029c95dc94b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:55.173402 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c1885155-56ca-4262-bf70-bb83e3c8ff73 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:55.173817 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c1885155-56ca-4262-bf70-bb83e3c8ff73 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:55.446858 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-093627a3-79a0-47e8-b6a7-7029c95dc94b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:55.454803 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c1885155-56ca-4262-bf70-bb83e3c8ff73 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:55.455233 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-093627a3-79a0-47e8-b6a7-7029c95dc94b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.297055 Aug 10 13:03:55.455816 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1565/3147] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:55 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:55.460432 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-83fa9051-d00c-4174-a1fc-7306815e1951 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:55.462240 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-83fa9051-d00c-4174-a1fc-7306815e1951 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:55.468279 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83fa9051-d00c-4174-a1fc-7306815e1951 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:55.468766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83fa9051-d00c-4174-a1fc-7306815e1951 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:55.469204 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83fa9051-d00c-4174-a1fc-7306815e1951 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:55.469898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83fa9051-d00c-4174-a1fc-7306815e1951 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:55.470351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83fa9051-d00c-4174-a1fc-7306815e1951 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:55.470876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83fa9051-d00c-4174-a1fc-7306815e1951 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:55.476119 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c1885155-56ca-4262-bf70-bb83e3c8ff73 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.318850 Aug 10 13:03:55.480088 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1583/3148] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:55 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:55.540891 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-83fa9051-d00c-4174-a1fc-7306815e1951 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:55.548813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-83fa9051-d00c-4174-a1fc-7306815e1951 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.091841 Aug 10 13:03:55.549393 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1566/3149] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:55 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:56.124902 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [req-4e430821-680e-4ff1-a359-c0ffd69e80bc req-7d4bfccf-2fa3-4e22-bbef-e5e2fd517fea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f8e2b4f-5870-46a3-b826-1b80fb322c73", "tag": "2bffdf55-050a-468d-a05d-6fd7af5df24a"}]} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:03:56.134199 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-4e430821-680e-4ff1-a359-c0ffd69e80bc req-7d4bfccf-2fa3-4e22-bbef-e5e2fd517fea service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:56.134673 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-4e430821-680e-4ff1-a359-c0ffd69e80bc req-7d4bfccf-2fa3-4e22-bbef-e5e2fd517fea service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:56.135745 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-4e430821-680e-4ff1-a359-c0ffd69e80bc req-7d4bfccf-2fa3-4e22-bbef-e5e2fd517fea service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:56.146751 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.compute.server_external_events [req-4e430821-680e-4ff1-a359-c0ffd69e80bc req-7d4bfccf-2fa3-4e22-bbef-e5e2fd517fea service nova] Creating event network-changed:2bffdf55-050a-468d-a05d-6fd7af5df24a for instance 2f8e2b4f-5870-46a3-b826-1b80fb322c73 on hv-cinder-85199 Aug 10 13:03:56.152483 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [req-4e430821-680e-4ff1-a359-c0ffd69e80bc req-7d4bfccf-2fa3-4e22-bbef-e5e2fd517fea service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030999 Aug 10 13:03:56.153084 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1584/3150] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:03:56.477901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e2892b01-d75a-4e6d-8429-5b9a21b6c3d2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:56.479433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e2892b01-d75a-4e6d-8429-5b9a21b6c3d2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:56.486304 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2892b01-d75a-4e6d-8429-5b9a21b6c3d2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:56.486809 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2892b01-d75a-4e6d-8429-5b9a21b6c3d2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:56.487253 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2892b01-d75a-4e6d-8429-5b9a21b6c3d2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:56.487945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2892b01-d75a-4e6d-8429-5b9a21b6c3d2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:56.488629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2892b01-d75a-4e6d-8429-5b9a21b6c3d2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:56.489046 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2892b01-d75a-4e6d-8429-5b9a21b6c3d2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:56.501536 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e4cf6f4c-dfb7-4099-919c-e179445e7169 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:56.503103 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e4cf6f4c-dfb7-4099-919c-e179445e7169 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:56.510731 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4cf6f4c-dfb7-4099-919c-e179445e7169 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:56.511237 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4cf6f4c-dfb7-4099-919c-e179445e7169 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:56.511672 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4cf6f4c-dfb7-4099-919c-e179445e7169 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:56.512514 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4cf6f4c-dfb7-4099-919c-e179445e7169 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:56.512962 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4cf6f4c-dfb7-4099-919c-e179445e7169 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:56.513383 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e4cf6f4c-dfb7-4099-919c-e179445e7169 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:56.788026 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e2892b01-d75a-4e6d-8429-5b9a21b6c3d2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:56.797700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e2892b01-d75a-4e6d-8429-5b9a21b6c3d2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.323527 Aug 10 13:03:56.812015 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e4cf6f4c-dfb7-4099-919c-e179445e7169 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:56.812593 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1567/3151] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:56 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:56.818471 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8f2ee753-39b9-4cdb-93c6-c65817c24ad6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:56.819081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8f2ee753-39b9-4cdb-93c6-c65817c24ad6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:56.825654 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f2ee753-39b9-4cdb-93c6-c65817c24ad6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:56.826407 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f2ee753-39b9-4cdb-93c6-c65817c24ad6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:56.826552 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f2ee753-39b9-4cdb-93c6-c65817c24ad6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:56.827277 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f2ee753-39b9-4cdb-93c6-c65817c24ad6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:56.828147 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f2ee753-39b9-4cdb-93c6-c65817c24ad6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:56.828147 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f2ee753-39b9-4cdb-93c6-c65817c24ad6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:56.833901 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e4cf6f4c-dfb7-4099-919c-e179445e7169 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.336509 Aug 10 13:03:56.835189 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1585/3152] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:56 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:56.901750 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8f2ee753-39b9-4cdb-93c6-c65817c24ad6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:56.910093 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8f2ee753-39b9-4cdb-93c6-c65817c24ad6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.096377 Aug 10 13:03:56.910749 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1568/3153] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:56 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:57.824316 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0dccf76f-c202-4b12-904c-dda2d1e2a15d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:57.825035 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0dccf76f-c202-4b12-904c-dda2d1e2a15d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:57.831499 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0dccf76f-c202-4b12-904c-dda2d1e2a15d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:57.831981 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0dccf76f-c202-4b12-904c-dda2d1e2a15d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:57.832412 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0dccf76f-c202-4b12-904c-dda2d1e2a15d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:57.833100 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0dccf76f-c202-4b12-904c-dda2d1e2a15d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:57.833547 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0dccf76f-c202-4b12-904c-dda2d1e2a15d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:57.833966 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0dccf76f-c202-4b12-904c-dda2d1e2a15d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:57.857426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-817d1404-cce0-40b2-8c8c-7a69311382b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:57.858035 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-817d1404-cce0-40b2-8c8c-7a69311382b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:57.864504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-817d1404-cce0-40b2-8c8c-7a69311382b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:57.864983 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-817d1404-cce0-40b2-8c8c-7a69311382b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:57.865440 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-817d1404-cce0-40b2-8c8c-7a69311382b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:57.866128 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-817d1404-cce0-40b2-8c8c-7a69311382b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:57.866578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-817d1404-cce0-40b2-8c8c-7a69311382b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:57.867002 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-817d1404-cce0-40b2-8c8c-7a69311382b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:58.014413 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0dccf76f-c202-4b12-904c-dda2d1e2a15d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:58.022220 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0dccf76f-c202-4b12-904c-dda2d1e2a15d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.202323 Aug 10 13:03:58.022789 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1586/3154] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:57 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:58.027275 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6f8a0b99-4ae9-432b-a3d9-c29bf14e901d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:58.027879 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6f8a0b99-4ae9-432b-a3d9-c29bf14e901d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:58.033412 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f8a0b99-4ae9-432b-a3d9-c29bf14e901d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:58.033892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f8a0b99-4ae9-432b-a3d9-c29bf14e901d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:58.034338 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f8a0b99-4ae9-432b-a3d9-c29bf14e901d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:58.035013 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f8a0b99-4ae9-432b-a3d9-c29bf14e901d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:58.035479 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f8a0b99-4ae9-432b-a3d9-c29bf14e901d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:58.035898 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6f8a0b99-4ae9-432b-a3d9-c29bf14e901d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:58.037875 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-817d1404-cce0-40b2-8c8c-7a69311382b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:58.048158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-817d1404-cce0-40b2-8c8c-7a69311382b8 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.195029 Aug 10 13:03:58.048748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1569/3155] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:57 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:58.104209 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6f8a0b99-4ae9-432b-a3d9-c29bf14e901d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:58.112358 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6f8a0b99-4ae9-432b-a3d9-c29bf14e901d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.088610 Aug 10 13:03:58.112926 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1587/3156] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:58 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:03:59.044877 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-596f9c50-e2a0-4658-814e-1a34a2cd6776 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:59.045487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-596f9c50-e2a0-4658-814e-1a34a2cd6776 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:59.052102 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-596f9c50-e2a0-4658-814e-1a34a2cd6776 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:59.052612 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-596f9c50-e2a0-4658-814e-1a34a2cd6776 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:59.053045 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-596f9c50-e2a0-4658-814e-1a34a2cd6776 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:59.053731 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-596f9c50-e2a0-4658-814e-1a34a2cd6776 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:59.054185 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-596f9c50-e2a0-4658-814e-1a34a2cd6776 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:59.054635 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-596f9c50-e2a0-4658-814e-1a34a2cd6776 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:59.070063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0e070c4c-4427-46b8-8395-d2600cc6647d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:59.070679 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0e070c4c-4427-46b8-8395-d2600cc6647d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:59.077344 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e070c4c-4427-46b8-8395-d2600cc6647d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:59.077827 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e070c4c-4427-46b8-8395-d2600cc6647d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:59.078262 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e070c4c-4427-46b8-8395-d2600cc6647d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:59.078986 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e070c4c-4427-46b8-8395-d2600cc6647d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:59.079460 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e070c4c-4427-46b8-8395-d2600cc6647d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:59.079887 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e070c4c-4427-46b8-8395-d2600cc6647d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:59.082564 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:03:59.252437 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-596f9c50-e2a0-4658-814e-1a34a2cd6776 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:59.259374 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0e070c4c-4427-46b8-8395-d2600cc6647d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:59.261199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-596f9c50-e2a0-4658-814e-1a34a2cd6776 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.220515 Aug 10 13:03:59.261903 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1570/3157] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:59 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:59.265978 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0e070c4c-4427-46b8-8395-d2600cc6647d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.199754 Aug 10 13:03:59.266216 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fe4cdc37-7bd2-4b19-85b2-d38509a561fa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:03:59.266681 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1588/3158] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:59 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:03:59.266805 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fe4cdc37-7bd2-4b19-85b2-d38509a561fa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:03:59.273204 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe4cdc37-7bd2-4b19-85b2-d38509a561fa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:59.273692 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe4cdc37-7bd2-4b19-85b2-d38509a561fa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:59.274134 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe4cdc37-7bd2-4b19-85b2-d38509a561fa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:59.274830 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe4cdc37-7bd2-4b19-85b2-d38509a561fa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:03:59.275315 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe4cdc37-7bd2-4b19-85b2-d38509a561fa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:03:59.276320 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe4cdc37-7bd2-4b19-85b2-d38509a561fa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:03:59.341483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fe4cdc37-7bd2-4b19-85b2-d38509a561fa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:03:59.349156 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fe4cdc37-7bd2-4b19-85b2-d38509a561fa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.086515 Aug 10 13:03:59.349718 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1571/3159] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:03:59 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:00.282914 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f347d3c0-26ce-4946-8c85-2f5fea6ea375 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:00.283350 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f347d3c0-26ce-4946-8c85-2f5fea6ea375 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:00.289017 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-986611d2-64ac-4ec8-ae06-7ebeedf3abee tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:00.289609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-986611d2-64ac-4ec8-ae06-7ebeedf3abee tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:00.289859 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f347d3c0-26ce-4946-8c85-2f5fea6ea375 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:00.290406 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f347d3c0-26ce-4946-8c85-2f5fea6ea375 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:00.290846 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f347d3c0-26ce-4946-8c85-2f5fea6ea375 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:00.291623 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f347d3c0-26ce-4946-8c85-2f5fea6ea375 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:00.292171 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f347d3c0-26ce-4946-8c85-2f5fea6ea375 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:00.292627 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f347d3c0-26ce-4946-8c85-2f5fea6ea375 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:00.295926 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-986611d2-64ac-4ec8-ae06-7ebeedf3abee tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:00.296407 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-986611d2-64ac-4ec8-ae06-7ebeedf3abee tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:00.296871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-986611d2-64ac-4ec8-ae06-7ebeedf3abee tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:00.297552 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-986611d2-64ac-4ec8-ae06-7ebeedf3abee tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:00.297998 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-986611d2-64ac-4ec8-ae06-7ebeedf3abee tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:00.298418 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-986611d2-64ac-4ec8-ae06-7ebeedf3abee tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:00.485001 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f347d3c0-26ce-4946-8c85-2f5fea6ea375 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:00.487749 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-986611d2-64ac-4ec8-ae06-7ebeedf3abee tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:00.493335 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f347d3c0-26ce-4946-8c85-2f5fea6ea375 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.214562 Aug 10 13:04:00.493852 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1589/3160] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:00 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:00.496134 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-986611d2-64ac-4ec8-ae06-7ebeedf3abee tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.211384 Aug 10 13:04:00.496875 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1572/3161] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:00 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:04:00.498452 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-085a4919-5ba3-4828-b999-25369de6ff9d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:00.499053 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-085a4919-5ba3-4828-b999-25369de6ff9d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:00.504690 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-085a4919-5ba3-4828-b999-25369de6ff9d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:00.505166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-085a4919-5ba3-4828-b999-25369de6ff9d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:00.505593 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-085a4919-5ba3-4828-b999-25369de6ff9d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:00.506271 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-085a4919-5ba3-4828-b999-25369de6ff9d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:00.506770 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-085a4919-5ba3-4828-b999-25369de6ff9d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:00.507147 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-085a4919-5ba3-4828-b999-25369de6ff9d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:00.570514 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-085a4919-5ba3-4828-b999-25369de6ff9d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:00.578496 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-085a4919-5ba3-4828-b999-25369de6ff9d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083711 Aug 10 13:04:00.579063 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1590/3162] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:00 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:01.515294 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7badc570-bc2d-4346-b675-44eaf54a64e5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:01.515900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7badc570-bc2d-4346-b675-44eaf54a64e5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:01.517017 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-681442e6-583e-469b-ae4d-7d30df7eeeb1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:01.517621 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-681442e6-583e-469b-ae4d-7d30df7eeeb1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:01.522455 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7badc570-bc2d-4346-b675-44eaf54a64e5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:01.522935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7badc570-bc2d-4346-b675-44eaf54a64e5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:01.523396 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7badc570-bc2d-4346-b675-44eaf54a64e5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:01.523885 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-681442e6-583e-469b-ae4d-7d30df7eeeb1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:01.524083 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7badc570-bc2d-4346-b675-44eaf54a64e5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:01.524362 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-681442e6-583e-469b-ae4d-7d30df7eeeb1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:01.524527 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7badc570-bc2d-4346-b675-44eaf54a64e5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:01.524789 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-681442e6-583e-469b-ae4d-7d30df7eeeb1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:01.524944 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7badc570-bc2d-4346-b675-44eaf54a64e5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:01.525466 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-681442e6-583e-469b-ae4d-7d30df7eeeb1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:01.525942 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-681442e6-583e-469b-ae4d-7d30df7eeeb1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:01.526452 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-681442e6-583e-469b-ae4d-7d30df7eeeb1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:01.720529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7badc570-bc2d-4346-b675-44eaf54a64e5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:01.727136 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-681442e6-583e-469b-ae4d-7d30df7eeeb1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:01.728521 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7badc570-bc2d-4346-b675-44eaf54a64e5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.218161 Aug 10 13:04:01.729609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1573/3163] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:01 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:01.734335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-27de87d6-98df-40dd-bfc6-11aa63c5e8ce tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:01.734938 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-27de87d6-98df-40dd-bfc6-11aa63c5e8ce tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:01.736402 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-681442e6-583e-469b-ae4d-7d30df7eeeb1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.223037 Aug 10 13:04:01.737230 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1591/3164] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:01 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:04:01.747026 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27de87d6-98df-40dd-bfc6-11aa63c5e8ce tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:01.747543 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27de87d6-98df-40dd-bfc6-11aa63c5e8ce tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:01.747975 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27de87d6-98df-40dd-bfc6-11aa63c5e8ce tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:01.748660 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27de87d6-98df-40dd-bfc6-11aa63c5e8ce tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:01.749104 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27de87d6-98df-40dd-bfc6-11aa63c5e8ce tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:01.749528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27de87d6-98df-40dd-bfc6-11aa63c5e8ce tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:01.809942 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-27de87d6-98df-40dd-bfc6-11aa63c5e8ce tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:01.817659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-27de87d6-98df-40dd-bfc6-11aa63c5e8ce tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.086856 Aug 10 13:04:01.818216 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1574/3165] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:01 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:02.750541 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-cdf834b1-d641-465d-819c-ad9f31dafce5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:02.751110 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-cdf834b1-d641-465d-819c-ad9f31dafce5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:02.757579 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cdf834b1-d641-465d-819c-ad9f31dafce5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:02.757960 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-43ae33fb-ef41-4409-8536-f47a75a05024 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:02.758372 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cdf834b1-d641-465d-819c-ad9f31dafce5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:02.758502 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cdf834b1-d641-465d-819c-ad9f31dafce5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:02.758616 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-43ae33fb-ef41-4409-8536-f47a75a05024 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:02.759165 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cdf834b1-d641-465d-819c-ad9f31dafce5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:02.759642 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cdf834b1-d641-465d-819c-ad9f31dafce5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:02.760134 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cdf834b1-d641-465d-819c-ad9f31dafce5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:02.765004 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-43ae33fb-ef41-4409-8536-f47a75a05024 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:02.765480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-43ae33fb-ef41-4409-8536-f47a75a05024 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:02.765912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-43ae33fb-ef41-4409-8536-f47a75a05024 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:02.766596 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-43ae33fb-ef41-4409-8536-f47a75a05024 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:02.767044 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-43ae33fb-ef41-4409-8536-f47a75a05024 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:02.767496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-43ae33fb-ef41-4409-8536-f47a75a05024 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:02.783938 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:02.952292 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-cdf834b1-d641-465d-819c-ad9f31dafce5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:02.959110 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-43ae33fb-ef41-4409-8536-f47a75a05024 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:02.960132 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-cdf834b1-d641-465d-819c-ad9f31dafce5 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.213539 Aug 10 13:04:02.960940 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1592/3166] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:02 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:02.965787 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c4ea8176-c455-4373-87e4-e14fc8f83601 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:02.966481 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c4ea8176-c455-4373-87e4-e14fc8f83601 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:02.973694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-43ae33fb-ef41-4409-8536-f47a75a05024 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.219495 Aug 10 13:04:02.974909 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1575/3167] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:02 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:04:02.983264 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c4ea8176-c455-4373-87e4-e14fc8f83601 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:02.983991 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c4ea8176-c455-4373-87e4-e14fc8f83601 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:02.984433 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c4ea8176-c455-4373-87e4-e14fc8f83601 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:02.985135 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c4ea8176-c455-4373-87e4-e14fc8f83601 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:02.985589 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c4ea8176-c455-4373-87e4-e14fc8f83601 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:02.986016 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c4ea8176-c455-4373-87e4-e14fc8f83601 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:03.047537 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c4ea8176-c455-4373-87e4-e14fc8f83601 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:03.055424 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c4ea8176-c455-4373-87e4-e14fc8f83601 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.093740 Aug 10 13:04:03.055998 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1593/3168] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:02 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:03.982586 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d4bef213-5e5d-4dfc-b95f-2826d89b775a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:03.983318 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d4bef213-5e5d-4dfc-b95f-2826d89b775a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:03.989788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d4bef213-5e5d-4dfc-b95f-2826d89b775a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:03.990266 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d4bef213-5e5d-4dfc-b95f-2826d89b775a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:03.990779 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d4bef213-5e5d-4dfc-b95f-2826d89b775a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:03.991493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d4bef213-5e5d-4dfc-b95f-2826d89b775a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:03.991946 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d4bef213-5e5d-4dfc-b95f-2826d89b775a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:03.992373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d4bef213-5e5d-4dfc-b95f-2826d89b775a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:03.996611 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-68e751fb-fb9b-437b-a232-1193388315be tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:03.997237 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-68e751fb-fb9b-437b-a232-1193388315be tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:04.003595 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-68e751fb-fb9b-437b-a232-1193388315be tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:04.004084 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-68e751fb-fb9b-437b-a232-1193388315be tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:04.004527 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-68e751fb-fb9b-437b-a232-1193388315be tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:04.005224 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-68e751fb-fb9b-437b-a232-1193388315be tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:04.005688 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-68e751fb-fb9b-437b-a232-1193388315be tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:04.006115 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-68e751fb-fb9b-437b-a232-1193388315be tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:04.190943 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d4bef213-5e5d-4dfc-b95f-2826d89b775a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:04.198443 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-68e751fb-fb9b-437b-a232-1193388315be tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:04.199499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d4bef213-5e5d-4dfc-b95f-2826d89b775a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.221500 Aug 10 13:04:04.200082 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1576/3169] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:03 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:04.204803 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6f7e1d83-86cf-4f36-b036-0da868c70566 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:04.205408 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6f7e1d83-86cf-4f36-b036-0da868c70566 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:04.207464 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-68e751fb-fb9b-437b-a232-1193388315be tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.215222 Aug 10 13:04:04.209525 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1594/3170] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:03 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:04.214360 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f7e1d83-86cf-4f36-b036-0da868c70566 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:04.214360 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f7e1d83-86cf-4f36-b036-0da868c70566 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:04.214360 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f7e1d83-86cf-4f36-b036-0da868c70566 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:04.214360 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f7e1d83-86cf-4f36-b036-0da868c70566 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:04.214838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f7e1d83-86cf-4f36-b036-0da868c70566 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:04.214838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6f7e1d83-86cf-4f36-b036-0da868c70566 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:04.277714 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6f7e1d83-86cf-4f36-b036-0da868c70566 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:04.285932 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6f7e1d83-86cf-4f36-b036-0da868c70566 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084867 Aug 10 13:04:04.286514 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1577/3171] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:04 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:05.222246 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3dd31143-dff0-41b8-952e-0832d7d6e9b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:05.222889 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3dd31143-dff0-41b8-952e-0832d7d6e9b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:05.230799 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3dd31143-dff0-41b8-952e-0832d7d6e9b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:05.231312 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3dd31143-dff0-41b8-952e-0832d7d6e9b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:05.231743 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3dd31143-dff0-41b8-952e-0832d7d6e9b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:05.233070 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3dd31143-dff0-41b8-952e-0832d7d6e9b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:05.233529 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3dd31143-dff0-41b8-952e-0832d7d6e9b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:05.233946 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3dd31143-dff0-41b8-952e-0832d7d6e9b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:05.235626 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6240332d-adca-4905-a481-38d0dd40ddf6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:05.242143 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6240332d-adca-4905-a481-38d0dd40ddf6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:05.242143 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6240332d-adca-4905-a481-38d0dd40ddf6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:05.242723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6240332d-adca-4905-a481-38d0dd40ddf6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:05.243162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6240332d-adca-4905-a481-38d0dd40ddf6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:05.243877 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6240332d-adca-4905-a481-38d0dd40ddf6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:05.244328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6240332d-adca-4905-a481-38d0dd40ddf6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:05.245442 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6240332d-adca-4905-a481-38d0dd40ddf6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:05.427549 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3dd31143-dff0-41b8-952e-0832d7d6e9b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:05.434884 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6240332d-adca-4905-a481-38d0dd40ddf6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:05.436598 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3dd31143-dff0-41b8-952e-0832d7d6e9b8 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.218189 Aug 10 13:04:05.437366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1595/3172] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:05 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:05.441836 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6a3fe365-2ee5-4991-b1b0-d71331c8defd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:05.442438 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6a3fe365-2ee5-4991-b1b0-d71331c8defd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:05.442821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6240332d-adca-4905-a481-38d0dd40ddf6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.211032 Aug 10 13:04:05.443572 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1578/3173] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:05 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:05.448268 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a3fe365-2ee5-4991-b1b0-d71331c8defd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:05.448745 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a3fe365-2ee5-4991-b1b0-d71331c8defd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:05.449171 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a3fe365-2ee5-4991-b1b0-d71331c8defd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:05.449853 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a3fe365-2ee5-4991-b1b0-d71331c8defd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:05.450297 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a3fe365-2ee5-4991-b1b0-d71331c8defd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:05.450777 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6a3fe365-2ee5-4991-b1b0-d71331c8defd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:05.511494 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6a3fe365-2ee5-4991-b1b0-d71331c8defd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:05.519281 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6a3fe365-2ee5-4991-b1b0-d71331c8defd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.080964 Aug 10 13:04:05.519866 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1596/3174] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:05 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:06.458077 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-dac5584e-6f28-4be3-9b3e-584240c766f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:06.458628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-dac5584e-6f28-4be3-9b3e-584240c766f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:06.464126 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-30fe64fa-74f1-4d82-80c2-7eb7d86c0f41 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:06.464738 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-30fe64fa-74f1-4d82-80c2-7eb7d86c0f41 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:06.465839 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dac5584e-6f28-4be3-9b3e-584240c766f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:06.466325 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dac5584e-6f28-4be3-9b3e-584240c766f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:06.466763 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dac5584e-6f28-4be3-9b3e-584240c766f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:06.467484 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dac5584e-6f28-4be3-9b3e-584240c766f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:06.467935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dac5584e-6f28-4be3-9b3e-584240c766f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:06.468361 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dac5584e-6f28-4be3-9b3e-584240c766f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:06.470950 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-30fe64fa-74f1-4d82-80c2-7eb7d86c0f41 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:06.471460 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-30fe64fa-74f1-4d82-80c2-7eb7d86c0f41 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:06.471893 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-30fe64fa-74f1-4d82-80c2-7eb7d86c0f41 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:06.472576 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-30fe64fa-74f1-4d82-80c2-7eb7d86c0f41 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:06.473021 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-30fe64fa-74f1-4d82-80c2-7eb7d86c0f41 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:06.473443 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-30fe64fa-74f1-4d82-80c2-7eb7d86c0f41 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:06.662936 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-dac5584e-6f28-4be3-9b3e-584240c766f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:06.669893 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-30fe64fa-74f1-4d82-80c2-7eb7d86c0f41 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:06.671862 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-dac5584e-6f28-4be3-9b3e-584240c766f3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.217700 Aug 10 13:04:06.683199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1579/3175] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:06 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:06.683199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ef30874c-6461-4f21-94b0-464997ef2736 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:06.683199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ef30874c-6461-4f21-94b0-464997ef2736 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:06.683593 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-30fe64fa-74f1-4d82-80c2-7eb7d86c0f41 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.219963 Aug 10 13:04:06.683593 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1597/3176] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:06 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:04:06.684576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef30874c-6461-4f21-94b0-464997ef2736 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:06.685065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef30874c-6461-4f21-94b0-464997ef2736 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:06.685499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef30874c-6461-4f21-94b0-464997ef2736 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:06.686189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef30874c-6461-4f21-94b0-464997ef2736 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:06.686640 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef30874c-6461-4f21-94b0-464997ef2736 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:06.687143 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ef30874c-6461-4f21-94b0-464997ef2736 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:06.752146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ef30874c-6461-4f21-94b0-464997ef2736 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:06.760009 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ef30874c-6461-4f21-94b0-464997ef2736 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.086089 Aug 10 13:04:06.761205 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1580/3177] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:06 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:07.694297 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ca48abae-0ef0-4789-a915-2dc18d900f62 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:07.694962 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ca48abae-0ef0-4789-a915-2dc18d900f62 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:07.697386 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=90 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:07.702433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-750bdbe5-4fc6-4ff8-9aeb-1958dc099a05 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:07.703037 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca48abae-0ef0-4789-a915-2dc18d900f62 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:07.703164 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-750bdbe5-4fc6-4ff8-9aeb-1958dc099a05 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:07.703292 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca48abae-0ef0-4789-a915-2dc18d900f62 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:07.703565 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca48abae-0ef0-4789-a915-2dc18d900f62 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:07.704255 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca48abae-0ef0-4789-a915-2dc18d900f62 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:07.704706 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca48abae-0ef0-4789-a915-2dc18d900f62 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:07.705127 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca48abae-0ef0-4789-a915-2dc18d900f62 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:07.709115 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-750bdbe5-4fc6-4ff8-9aeb-1958dc099a05 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:07.712086 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-750bdbe5-4fc6-4ff8-9aeb-1958dc099a05 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:07.712086 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-750bdbe5-4fc6-4ff8-9aeb-1958dc099a05 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:07.712086 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-750bdbe5-4fc6-4ff8-9aeb-1958dc099a05 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:07.712086 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-750bdbe5-4fc6-4ff8-9aeb-1958dc099a05 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:07.712538 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-750bdbe5-4fc6-4ff8-9aeb-1958dc099a05 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:07.906705 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ca48abae-0ef0-4789-a915-2dc18d900f62 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:07.910411 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-750bdbe5-4fc6-4ff8-9aeb-1958dc099a05 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:07.915145 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ca48abae-0ef0-4789-a915-2dc18d900f62 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.224636 Aug 10 13:04:07.916021 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1598/3178] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:07 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:07.919550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-750bdbe5-4fc6-4ff8-9aeb-1958dc099a05 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.221622 Aug 10 13:04:07.920617 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1581/3179] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:07 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:04:07.921370 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-883e860d-e53d-41d8-91b1-d704dd81bf1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:07.922521 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-883e860d-e53d-41d8-91b1-d704dd81bf1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:07.928588 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-883e860d-e53d-41d8-91b1-d704dd81bf1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:07.929069 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-883e860d-e53d-41d8-91b1-d704dd81bf1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:07.929499 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-883e860d-e53d-41d8-91b1-d704dd81bf1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:07.930184 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-883e860d-e53d-41d8-91b1-d704dd81bf1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:07.930747 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-883e860d-e53d-41d8-91b1-d704dd81bf1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:07.931168 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-883e860d-e53d-41d8-91b1-d704dd81bf1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:07.994570 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-883e860d-e53d-41d8-91b1-d704dd81bf1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:08.002385 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-883e860d-e53d-41d8-91b1-d704dd81bf1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084831 Aug 10 13:04:08.002955 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1599/3180] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:07 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:08.938486 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ca0e4f6e-7c39-4e2d-8111-a4347338be9c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:08.939135 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ca0e4f6e-7c39-4e2d-8111-a4347338be9c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:08.943017 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6611130b-7ce4-475c-b149-912918b33287 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:08.943700 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6611130b-7ce4-475c-b149-912918b33287 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:08.945698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ca0e4f6e-7c39-4e2d-8111-a4347338be9c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:08.946183 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ca0e4f6e-7c39-4e2d-8111-a4347338be9c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:08.946620 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ca0e4f6e-7c39-4e2d-8111-a4347338be9c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:08.947348 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ca0e4f6e-7c39-4e2d-8111-a4347338be9c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:08.948582 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ca0e4f6e-7c39-4e2d-8111-a4347338be9c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:08.949087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ca0e4f6e-7c39-4e2d-8111-a4347338be9c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:08.951275 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6611130b-7ce4-475c-b149-912918b33287 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:08.951694 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6611130b-7ce4-475c-b149-912918b33287 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:08.952127 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6611130b-7ce4-475c-b149-912918b33287 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:08.952823 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6611130b-7ce4-475c-b149-912918b33287 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:08.953271 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6611130b-7ce4-475c-b149-912918b33287 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:08.953690 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6611130b-7ce4-475c-b149-912918b33287 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:09.193508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ca0e4f6e-7c39-4e2d-8111-a4347338be9c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:09.198703 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6611130b-7ce4-475c-b149-912918b33287 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:09.203794 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ca0e4f6e-7c39-4e2d-8111-a4347338be9c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.269124 Aug 10 13:04:09.204384 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1582/3181] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:08 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:09.206670 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6611130b-7ce4-475c-b149-912918b33287 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.267415 Aug 10 13:04:09.209220 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7f1b181f-dfa3-4397-be66-3cfdfe7bda85 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:09.209766 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1600/3182] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:08 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:04:09.210422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7f1b181f-dfa3-4397-be66-3cfdfe7bda85 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:09.217230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f1b181f-dfa3-4397-be66-3cfdfe7bda85 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:09.217717 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f1b181f-dfa3-4397-be66-3cfdfe7bda85 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:09.218169 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f1b181f-dfa3-4397-be66-3cfdfe7bda85 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:09.219004 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f1b181f-dfa3-4397-be66-3cfdfe7bda85 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:09.219504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f1b181f-dfa3-4397-be66-3cfdfe7bda85 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:09.219922 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f1b181f-dfa3-4397-be66-3cfdfe7bda85 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:09.287698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7f1b181f-dfa3-4397-be66-3cfdfe7bda85 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:09.296525 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7f1b181f-dfa3-4397-be66-3cfdfe7bda85 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.091174 Aug 10 13:04:09.297092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1583/3183] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:09 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:10.229290 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-cb45bc5b-df84-4c2a-9ba4-b049326f7319 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:10.230190 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-cb45bc5b-df84-4c2a-9ba4-b049326f7319 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:10.230485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3d6c7545-837d-42f5-bd15-13d977102c27 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:10.230894 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3d6c7545-837d-42f5-bd15-13d977102c27 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:10.237050 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cb45bc5b-df84-4c2a-9ba4-b049326f7319 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:10.237216 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3d6c7545-837d-42f5-bd15-13d977102c27 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:10.237538 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cb45bc5b-df84-4c2a-9ba4-b049326f7319 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:10.237679 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3d6c7545-837d-42f5-bd15-13d977102c27 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:10.237976 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cb45bc5b-df84-4c2a-9ba4-b049326f7319 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:10.238111 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3d6c7545-837d-42f5-bd15-13d977102c27 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:10.238667 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cb45bc5b-df84-4c2a-9ba4-b049326f7319 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:10.238788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3d6c7545-837d-42f5-bd15-13d977102c27 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:10.239123 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cb45bc5b-df84-4c2a-9ba4-b049326f7319 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:10.239278 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3d6c7545-837d-42f5-bd15-13d977102c27 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:10.239578 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-cb45bc5b-df84-4c2a-9ba4-b049326f7319 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:10.239689 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3d6c7545-837d-42f5-bd15-13d977102c27 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:10.434792 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-cb45bc5b-df84-4c2a-9ba4-b049326f7319 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:10.438543 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3d6c7545-837d-42f5-bd15-13d977102c27 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:10.442702 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-cb45bc5b-df84-4c2a-9ba4-b049326f7319 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 200 len: 1725 microversion: 2.1 time: 0.217887 Aug 10 13:04:10.443306 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1601/3184] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:10 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:10.446548 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3d6c7545-837d-42f5-bd15-13d977102c27 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.221105 Aug 10 13:04:10.447291 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1584/3185] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:10 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:04:10.448288 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8ed64f61-f85d-46e8-8a44-6cb8b74ab154 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:10.448905 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8ed64f61-f85d-46e8-8a44-6cb8b74ab154 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:10.454577 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8ed64f61-f85d-46e8-8a44-6cb8b74ab154 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:10.455062 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8ed64f61-f85d-46e8-8a44-6cb8b74ab154 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:10.455533 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8ed64f61-f85d-46e8-8a44-6cb8b74ab154 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:10.456223 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8ed64f61-f85d-46e8-8a44-6cb8b74ab154 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:10.457262 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8ed64f61-f85d-46e8-8a44-6cb8b74ab154 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:10.457703 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8ed64f61-f85d-46e8-8a44-6cb8b74ab154 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:10.465490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-20c3d592-90c3-461e-b233-29ed33d107a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '.version_select at 0x7fb82692e940>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:10.519089 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-8ed64f61-f85d-46e8-8a44-6cb8b74ab154 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:10.527154 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8ed64f61-f85d-46e8-8a44-6cb8b74ab154 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082860 Aug 10 13:04:10.531114 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1602/3186] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:10 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:10.548694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-20c3d592-90c3-461e-b233-29ed33d107a0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-29348087" status: 202 len: 0 microversion: 2.1 time: 0.087126 Aug 10 13:04:10.549283 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1585/3187] 10.222.0.49 () {58 vars in 1215 bytes} [Wed Aug 10 13:04:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-29348087 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 13:04:11.418791 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [req-8987d708-d756-4ce5-b8be-f910b0804fd8 req-434d1107-6329-4f21-8572-8a32de6d0e6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fad49521-8b28-4a9f-a4a0-88e41b5a1566", "tag": "63207b81-6588-46d1-8129-1070b16da6a5"}]} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:04:11.429340 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-8987d708-d756-4ce5-b8be-f910b0804fd8 req-434d1107-6329-4f21-8572-8a32de6d0e6b service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:11.430081 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-8987d708-d756-4ce5-b8be-f910b0804fd8 req-434d1107-6329-4f21-8572-8a32de6d0e6b service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:11.430608 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-8987d708-d756-4ce5-b8be-f910b0804fd8 req-434d1107-6329-4f21-8572-8a32de6d0e6b service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:11.443403 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.compute.server_external_events [req-8987d708-d756-4ce5-b8be-f910b0804fd8 req-434d1107-6329-4f21-8572-8a32de6d0e6b service nova] Creating event network-changed:63207b81-6588-46d1-8129-1070b16da6a5 for instance fad49521-8b28-4a9f-a4a0-88e41b5a1566 on hv-cinder-85199 Aug 10 13:04:11.449113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [req-8987d708-d756-4ce5-b8be-f910b0804fd8 req-434d1107-6329-4f21-8572-8a32de6d0e6b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034610 Aug 10 13:04:11.450025 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1603/3188] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:04:11.469236 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6afb202e-4ac2-488d-bc53-87e06ff398ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:11.472534 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6afb202e-4ac2-488d-bc53-87e06ff398ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:11.476899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6afb202e-4ac2-488d-bc53-87e06ff398ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:11.477457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6afb202e-4ac2-488d-bc53-87e06ff398ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:11.477986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6afb202e-4ac2-488d-bc53-87e06ff398ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:11.478670 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6afb202e-4ac2-488d-bc53-87e06ff398ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:11.479244 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6afb202e-4ac2-488d-bc53-87e06ff398ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:11.479678 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6afb202e-4ac2-488d-bc53-87e06ff398ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:11.555881 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-53fae56f-ab08-43d3-bf5a-269d1b953e09 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:11.556612 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-53fae56f-ab08-43d3-bf5a-269d1b953e09 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:11.563638 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53fae56f-ab08-43d3-bf5a-269d1b953e09 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:11.564558 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53fae56f-ab08-43d3-bf5a-269d1b953e09 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:11.567237 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53fae56f-ab08-43d3-bf5a-269d1b953e09 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:11.568546 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53fae56f-ab08-43d3-bf5a-269d1b953e09 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:11.569240 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53fae56f-ab08-43d3-bf5a-269d1b953e09 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:11.569928 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53fae56f-ab08-43d3-bf5a-269d1b953e09 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:11.680165 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-53fae56f-ab08-43d3-bf5a-269d1b953e09 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:11.689948 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-53fae56f-ab08-43d3-bf5a-269d1b953e09 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.146004 Aug 10 13:04:11.691784 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1604/3189] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:11 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:04:11.699893 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e72c5093-49c6-4bf0-9db0-409a7a3b696c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Action: 'create', calling method: .version_select at 0x7fb827301940>, body: {"keypair": {"name": "tempest-keypair-1017957999", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNk89YncJsCNChpziqJUxzA+9kT0PmTrF51iHDYuD3+GmKjjcLaQGP98GISUa0I7iAa90Agugu8umc2ZJ48MkX8od29TpuT0Jzdg6WPcO+aEMWSLIR4uoOuveg31ItZcgw=="}} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:04:11.717598 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.quota [None req-e72c5093-49c6-4bf0-9db0-409a7a3b696c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Getting quotas for project a2857015013f466d95f3a9037925c6fc. Resources: {'key_pairs'} {{(pid=124642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:04:11.721520 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.quota [None req-e72c5093-49c6-4bf0-9db0-409a7a3b696c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Getting quotas for user 570c2a77b862411083b9444f8292192b and project a2857015013f466d95f3a9037925c6fc. Resources: {'key_pairs'} {{(pid=124642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:04:11.769353 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6afb202e-4ac2-488d-bc53-87e06ff398ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:11.778639 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6afb202e-4ac2-488d-bc53-87e06ff398ae tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.313743 Aug 10 13:04:11.781948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1586/3190] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:11 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:11.824494 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e72c5093-49c6-4bf0-9db0-409a7a3b696c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.131234 Aug 10 13:04:11.825337 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1605/3191] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 10 13:04:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:04:12.711800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f6bc75ba-e249-4a79-855a-d50266cdf1ad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:12.712406 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f6bc75ba-e249-4a79-855a-d50266cdf1ad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:12.718377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6bc75ba-e249-4a79-855a-d50266cdf1ad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:12.718855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6bc75ba-e249-4a79-855a-d50266cdf1ad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:12.719317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6bc75ba-e249-4a79-855a-d50266cdf1ad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:12.719999 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6bc75ba-e249-4a79-855a-d50266cdf1ad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:12.720443 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6bc75ba-e249-4a79-855a-d50266cdf1ad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:12.720861 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f6bc75ba-e249-4a79-855a-d50266cdf1ad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:12.783897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f6bc75ba-e249-4a79-855a-d50266cdf1ad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:12.791888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f6bc75ba-e249-4a79-855a-d50266cdf1ad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083903 Aug 10 13:04:12.792501 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1587/3192] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:12 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:12.801120 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-69e7d8e1-8c08-4dbc-8858-2412dbf727e3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:12.801783 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-69e7d8e1-8c08-4dbc-8858-2412dbf727e3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:12.807675 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-69e7d8e1-8c08-4dbc-8858-2412dbf727e3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:12.808754 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-69e7d8e1-8c08-4dbc-8858-2412dbf727e3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:12.809199 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-69e7d8e1-8c08-4dbc-8858-2412dbf727e3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:12.809883 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-69e7d8e1-8c08-4dbc-8858-2412dbf727e3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:12.810334 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-69e7d8e1-8c08-4dbc-8858-2412dbf727e3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:12.810766 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-69e7d8e1-8c08-4dbc-8858-2412dbf727e3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:12.828416 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:12.947876 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-69e7d8e1-8c08-4dbc-8858-2412dbf727e3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:12.956441 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-69e7d8e1-8c08-4dbc-8858-2412dbf727e3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.159748 Aug 10 13:04:12.957018 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1606/3193] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:12 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:13.813613 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9fed4891-00f1-4958-8c4d-556b19da9e86 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:13.814229 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9fed4891-00f1-4958-8c4d-556b19da9e86 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:13.820656 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9fed4891-00f1-4958-8c4d-556b19da9e86 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:13.821140 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9fed4891-00f1-4958-8c4d-556b19da9e86 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:13.821571 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9fed4891-00f1-4958-8c4d-556b19da9e86 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:13.822259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9fed4891-00f1-4958-8c4d-556b19da9e86 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:13.822704 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9fed4891-00f1-4958-8c4d-556b19da9e86 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:13.823122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9fed4891-00f1-4958-8c4d-556b19da9e86 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:13.890811 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9fed4891-00f1-4958-8c4d-556b19da9e86 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:13.898683 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9fed4891-00f1-4958-8c4d-556b19da9e86 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.089010 Aug 10 13:04:13.899263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1588/3194] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:13 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:13.977609 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c3a0f010-fa6c-4476-8bb0-75e80019d461 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:13.978167 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c3a0f010-fa6c-4476-8bb0-75e80019d461 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:13.986079 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3a0f010-fa6c-4476-8bb0-75e80019d461 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:13.986602 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3a0f010-fa6c-4476-8bb0-75e80019d461 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:13.987160 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3a0f010-fa6c-4476-8bb0-75e80019d461 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:13.987977 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3a0f010-fa6c-4476-8bb0-75e80019d461 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:13.988480 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3a0f010-fa6c-4476-8bb0-75e80019d461 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:13.988942 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c3a0f010-fa6c-4476-8bb0-75e80019d461 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:13.991646 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-60eb585f-b5e9-4d8e-a813-36c8f93c1667 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-195023481", "imageRef": "674dcf76-6c38-40de-b204-ad2842738058", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b8fb292-ce0b-4d10-a119-78752ef6ec31"}], "security_groups": [{"name": "tempest-securitygroup--465954768"}], "key_name": "tempest-keypair-1017957999", "user_data": "}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:04:14.127396 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.network.neutron [None req-60eb585f-b5e9-4d8e-a813-36c8f93c1667 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] validate_networks() for [('7b8fb292-ce0b-4d10-a119-78752ef6ec31', None, None, None, None, None)] {{(pid=124643) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:04:14.205021 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c3a0f010-fa6c-4476-8bb0-75e80019d461 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:14.213407 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c3a0f010-fa6c-4476-8bb0-75e80019d461 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.239623 Aug 10 13:04:14.214024 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1607/3195] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:13 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:14.519068 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-60eb585f-b5e9-4d8e-a813-36c8f93c1667 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Flavor limits 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:04:14.519521 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-60eb585f-b5e9-4d8e-a813-36c8f93c1667 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Image limits 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:04:14.519987 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-60eb585f-b5e9-4d8e-a813-36c8f93c1667 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Flavor pref 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:04:14.520389 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-60eb585f-b5e9-4d8e-a813-36c8f93c1667 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Image pref 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:04:14.520793 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-60eb585f-b5e9-4d8e-a813-36c8f93c1667 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:04:14.529723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60eb585f-b5e9-4d8e-a813-36c8f93c1667 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:14.530188 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60eb585f-b5e9-4d8e-a813-36c8f93c1667 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:14.530614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60eb585f-b5e9-4d8e-a813-36c8f93c1667 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:14.531380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60eb585f-b5e9-4d8e-a813-36c8f93c1667 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:14.531825 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60eb585f-b5e9-4d8e-a813-36c8f93c1667 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:14.532238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-60eb585f-b5e9-4d8e-a813-36c8f93c1667 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:14.548885 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-60eb585f-b5e9-4d8e-a813-36c8f93c1667 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Getting quotas for project a2857015013f466d95f3a9037925c6fc. Resources: {'cores', 'ram', 'instances'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:04:14.552895 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-60eb585f-b5e9-4d8e-a813-36c8f93c1667 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Getting quotas for user 570c2a77b862411083b9444f8292192b and project a2857015013f466d95f3a9037925c6fc. Resources: {'cores', 'ram', 'instances'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:04:14.564245 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-60eb585f-b5e9-4d8e-a813-36c8f93c1667 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Going to run 1 instances... {{(pid=124643) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:04:14.566449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-60eb585f-b5e9-4d8e-a813-36c8f93c1667 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d18ee67-6285-4877-ae40-c30da937c050] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='674dcf76-6c38-40de-b204-ad2842738058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:04:14.699156 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-60eb585f-b5e9-4d8e-a813-36c8f93c1667 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.712006 Aug 10 13:04:14.699854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1589/3196] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 13:04:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 13:04:14.710969 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-52072b4e-8092-4244-9624-ba7c34657341 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:14.711622 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-52072b4e-8092-4244-9624-ba7c34657341 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d18ee67-6285-4877-ae40-c30da937c050] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:14.765652 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-52072b4e-8092-4244-9624-ba7c34657341 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:14.772563 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-52072b4e-8092-4244-9624-ba7c34657341 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050" status: 200 len: 1241 microversion: 2.1 time: 0.065647 Aug 10 13:04:14.773134 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1608/3197] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:14 2022] GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:14.920948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-80d56509-bdc8-4fc6-a20f-e6311bcee7c4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:14.921623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-80d56509-bdc8-4fc6-a20f-e6311bcee7c4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:14.928611 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80d56509-bdc8-4fc6-a20f-e6311bcee7c4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:14.929082 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80d56509-bdc8-4fc6-a20f-e6311bcee7c4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:14.929511 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80d56509-bdc8-4fc6-a20f-e6311bcee7c4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:14.930190 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80d56509-bdc8-4fc6-a20f-e6311bcee7c4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:14.930635 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80d56509-bdc8-4fc6-a20f-e6311bcee7c4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:14.931051 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80d56509-bdc8-4fc6-a20f-e6311bcee7c4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:14.994843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-80d56509-bdc8-4fc6-a20f-e6311bcee7c4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:15.003425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-80d56509-bdc8-4fc6-a20f-e6311bcee7c4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.087202 Aug 10 13:04:15.003995 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1590/3198] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:14 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:15.234892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-73ea9427-0f3e-4212-bac0-348ef6958cc9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:15.235311 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-73ea9427-0f3e-4212-bac0-348ef6958cc9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:15.242284 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73ea9427-0f3e-4212-bac0-348ef6958cc9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:15.244362 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73ea9427-0f3e-4212-bac0-348ef6958cc9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:15.244362 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73ea9427-0f3e-4212-bac0-348ef6958cc9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:15.244362 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73ea9427-0f3e-4212-bac0-348ef6958cc9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:15.244689 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73ea9427-0f3e-4212-bac0-348ef6958cc9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:15.244830 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73ea9427-0f3e-4212-bac0-348ef6958cc9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:15.374416 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-73ea9427-0f3e-4212-bac0-348ef6958cc9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:15.382304 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-73ea9427-0f3e-4212-bac0-348ef6958cc9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.152342 Aug 10 13:04:15.382870 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1609/3199] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:15 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:15.794255 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3d0b4b25-ecaa-4b2b-b27d-e535aa4d3dad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:15.794870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3d0b4b25-ecaa-4b2b-b27d-e535aa4d3dad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d18ee67-6285-4877-ae40-c30da937c050] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:15.800924 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3d0b4b25-ecaa-4b2b-b27d-e535aa4d3dad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:15.801587 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3d0b4b25-ecaa-4b2b-b27d-e535aa4d3dad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:15.802024 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3d0b4b25-ecaa-4b2b-b27d-e535aa4d3dad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:15.802712 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3d0b4b25-ecaa-4b2b-b27d-e535aa4d3dad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:15.803166 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3d0b4b25-ecaa-4b2b-b27d-e535aa4d3dad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:15.803614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3d0b4b25-ecaa-4b2b-b27d-e535aa4d3dad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:15.869815 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3d0b4b25-ecaa-4b2b-b27d-e535aa4d3dad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:15.877816 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3d0b4b25-ecaa-4b2b-b27d-e535aa4d3dad tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050" status: 200 len: 1237 microversion: 2.1 time: 0.087496 Aug 10 13:04:15.878388 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1591/3200] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:15 2022] GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050 => generated 1237 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:16.024179 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e5957e30-3e8b-4b7a-a63c-2cace3e21804 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:16.024859 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e5957e30-3e8b-4b7a-a63c-2cace3e21804 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:16.031041 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5957e30-3e8b-4b7a-a63c-2cace3e21804 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:16.032463 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5957e30-3e8b-4b7a-a63c-2cace3e21804 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:16.032463 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5957e30-3e8b-4b7a-a63c-2cace3e21804 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:16.032682 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5957e30-3e8b-4b7a-a63c-2cace3e21804 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:16.033084 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5957e30-3e8b-4b7a-a63c-2cace3e21804 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:16.033509 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e5957e30-3e8b-4b7a-a63c-2cace3e21804 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:16.094193 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e5957e30-3e8b-4b7a-a63c-2cace3e21804 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:16.103415 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e5957e30-3e8b-4b7a-a63c-2cace3e21804 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083019 Aug 10 13:04:16.106973 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1610/3201] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:16 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:04:16.404059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c1ae69a6-0397-43bd-929d-04e5005d3023 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:16.404613 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c1ae69a6-0397-43bd-929d-04e5005d3023 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:16.411043 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c1ae69a6-0397-43bd-929d-04e5005d3023 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:16.411819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c1ae69a6-0397-43bd-929d-04e5005d3023 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:16.411979 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c1ae69a6-0397-43bd-929d-04e5005d3023 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:16.412666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c1ae69a6-0397-43bd-929d-04e5005d3023 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:16.413117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c1ae69a6-0397-43bd-929d-04e5005d3023 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:16.413540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c1ae69a6-0397-43bd-929d-04e5005d3023 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:16.634428 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c1ae69a6-0397-43bd-929d-04e5005d3023 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:16.643440 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c1ae69a6-0397-43bd-929d-04e5005d3023 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.243818 Aug 10 13:04:16.644025 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1592/3202] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:16 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:16.898792 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-58970d45-e02f-4b33-ac75-010d81e2f70b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:16.899540 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-58970d45-e02f-4b33-ac75-010d81e2f70b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d18ee67-6285-4877-ae40-c30da937c050] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:16.906620 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-58970d45-e02f-4b33-ac75-010d81e2f70b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:16.907195 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-58970d45-e02f-4b33-ac75-010d81e2f70b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:16.907724 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-58970d45-e02f-4b33-ac75-010d81e2f70b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:16.908482 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-58970d45-e02f-4b33-ac75-010d81e2f70b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:16.909004 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-58970d45-e02f-4b33-ac75-010d81e2f70b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:16.909516 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-58970d45-e02f-4b33-ac75-010d81e2f70b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:16.996814 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-58970d45-e02f-4b33-ac75-010d81e2f70b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:17.004079 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-58970d45-e02f-4b33-ac75-010d81e2f70b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050" status: 200 len: 1299 microversion: 2.1 time: 0.109120 Aug 10 13:04:17.004652 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1611/3203] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:16 2022] GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050 => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:17.125598 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-dd5cbfc9-6f7d-4ddc-864b-833ae63bbf77 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:17.126233 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-dd5cbfc9-6f7d-4ddc-864b-833ae63bbf77 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:17.132210 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd5cbfc9-6f7d-4ddc-864b-833ae63bbf77 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:17.132692 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd5cbfc9-6f7d-4ddc-864b-833ae63bbf77 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:17.133128 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd5cbfc9-6f7d-4ddc-864b-833ae63bbf77 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:17.133819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd5cbfc9-6f7d-4ddc-864b-833ae63bbf77 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:17.134270 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd5cbfc9-6f7d-4ddc-864b-833ae63bbf77 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:17.134695 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd5cbfc9-6f7d-4ddc-864b-833ae63bbf77 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:17.212524 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-dd5cbfc9-6f7d-4ddc-864b-833ae63bbf77 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:17.214784 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:17.221148 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-dd5cbfc9-6f7d-4ddc-864b-833ae63bbf77 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.099527 Aug 10 13:04:17.221714 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1593/3204] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:17 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:17.665534 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7325e82a-63f0-4720-a18d-d08f9340a6d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:17.666459 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7325e82a-63f0-4720-a18d-d08f9340a6d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:17.674125 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7325e82a-63f0-4720-a18d-d08f9340a6d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:17.675442 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7325e82a-63f0-4720-a18d-d08f9340a6d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:17.675442 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7325e82a-63f0-4720-a18d-d08f9340a6d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:17.675749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7325e82a-63f0-4720-a18d-d08f9340a6d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:17.676460 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7325e82a-63f0-4720-a18d-d08f9340a6d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:17.676915 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7325e82a-63f0-4720-a18d-d08f9340a6d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:17.868018 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-7325e82a-63f0-4720-a18d-d08f9340a6d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:17.876332 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7325e82a-63f0-4720-a18d-d08f9340a6d7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.215429 Aug 10 13:04:17.876906 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1612/3205] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:17 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:18.025628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2f547152-6771-4f98-9d08-0c4b12e82483 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:18.026222 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2f547152-6771-4f98-9d08-0c4b12e82483 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d18ee67-6285-4877-ae40-c30da937c050] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:18.033909 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2f547152-6771-4f98-9d08-0c4b12e82483 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:18.034387 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2f547152-6771-4f98-9d08-0c4b12e82483 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:18.034812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2f547152-6771-4f98-9d08-0c4b12e82483 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:18.035554 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2f547152-6771-4f98-9d08-0c4b12e82483 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:18.036000 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2f547152-6771-4f98-9d08-0c4b12e82483 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:18.036482 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2f547152-6771-4f98-9d08-0c4b12e82483 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:18.188753 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2f547152-6771-4f98-9d08-0c4b12e82483 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:18.196316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2f547152-6771-4f98-9d08-0c4b12e82483 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050" status: 200 len: 1366 microversion: 2.1 time: 0.174517 Aug 10 13:04:18.197103 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1594/3206] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:18 2022] GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:18.233169 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [req-347ca541-2ab5-4410-8925-1c6dede966fc req-5d4ac732-4c5a-4609-89bb-630b254c4fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d18ee67-6285-4877-ae40-c30da937c050", "tag": "f21fab9d-9f5a-4151-8777-6c9b96dd7618"}]} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:04:18.241724 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a325db30-4975-48a0-960c-c8bf670379a6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:18.242634 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a325db30-4975-48a0-960c-c8bf670379a6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:18.243756 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-347ca541-2ab5-4410-8925-1c6dede966fc req-5d4ac732-4c5a-4609-89bb-630b254c4fd2 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:18.244360 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-347ca541-2ab5-4410-8925-1c6dede966fc req-5d4ac732-4c5a-4609-89bb-630b254c4fd2 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:18.244995 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-347ca541-2ab5-4410-8925-1c6dede966fc req-5d4ac732-4c5a-4609-89bb-630b254c4fd2 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:18.249888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a325db30-4975-48a0-960c-c8bf670379a6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:18.257050 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a325db30-4975-48a0-960c-c8bf670379a6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:18.257050 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a325db30-4975-48a0-960c-c8bf670379a6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:18.257050 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a325db30-4975-48a0-960c-c8bf670379a6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:18.257050 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a325db30-4975-48a0-960c-c8bf670379a6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:18.257892 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a325db30-4975-48a0-960c-c8bf670379a6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:18.258220 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.compute.server_external_events [req-347ca541-2ab5-4410-8925-1c6dede966fc req-5d4ac732-4c5a-4609-89bb-630b254c4fd2 service nova] Creating event network-changed:f21fab9d-9f5a-4151-8777-6c9b96dd7618 for instance 9d18ee67-6285-4877-ae40-c30da937c050 on hv-cinder-85199 Aug 10 13:04:18.266967 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [req-347ca541-2ab5-4410-8925-1c6dede966fc req-5d4ac732-4c5a-4609-89bb-630b254c4fd2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038359 Aug 10 13:04:18.268043 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1613/3207] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:04:18.349890 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a325db30-4975-48a0-960c-c8bf670379a6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:18.358805 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a325db30-4975-48a0-960c-c8bf670379a6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.120843 Aug 10 13:04:18.359422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1595/3208] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:18 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:04:18.897785 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-64645c7e-24b7-462a-873b-6205b917eb31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:18.898402 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-64645c7e-24b7-462a-873b-6205b917eb31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:18.905352 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-64645c7e-24b7-462a-873b-6205b917eb31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:18.906147 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-64645c7e-24b7-462a-873b-6205b917eb31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:18.906617 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-64645c7e-24b7-462a-873b-6205b917eb31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:18.907489 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-64645c7e-24b7-462a-873b-6205b917eb31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:18.908050 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-64645c7e-24b7-462a-873b-6205b917eb31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:18.908698 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-64645c7e-24b7-462a-873b-6205b917eb31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:19.050862 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-64645c7e-24b7-462a-873b-6205b917eb31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:19.058988 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-64645c7e-24b7-462a-873b-6205b917eb31 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.165517 Aug 10 13:04:19.059628 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1614/3209] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:18 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:19.218059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9b3e07be-782f-4735-9891-8dec05ddefa0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:19.218595 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9b3e07be-782f-4735-9891-8dec05ddefa0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d18ee67-6285-4877-ae40-c30da937c050] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:19.224528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9b3e07be-782f-4735-9891-8dec05ddefa0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:19.225002 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9b3e07be-782f-4735-9891-8dec05ddefa0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:19.225430 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9b3e07be-782f-4735-9891-8dec05ddefa0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:19.226103 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9b3e07be-782f-4735-9891-8dec05ddefa0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:19.226549 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9b3e07be-782f-4735-9891-8dec05ddefa0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:19.226961 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9b3e07be-782f-4735-9891-8dec05ddefa0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:19.360598 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9b3e07be-782f-4735-9891-8dec05ddefa0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:19.368002 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9b3e07be-782f-4735-9891-8dec05ddefa0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050" status: 200 len: 1366 microversion: 2.1 time: 0.154664 Aug 10 13:04:19.368569 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1596/3210] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:19 2022] GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:19.379898 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-332c828d-6b92-4e10-b599-57662c55dd77 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:19.380514 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-332c828d-6b92-4e10-b599-57662c55dd77 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:19.387648 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-332c828d-6b92-4e10-b599-57662c55dd77 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:19.388129 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-332c828d-6b92-4e10-b599-57662c55dd77 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:19.388563 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-332c828d-6b92-4e10-b599-57662c55dd77 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:19.389253 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-332c828d-6b92-4e10-b599-57662c55dd77 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:19.389710 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-332c828d-6b92-4e10-b599-57662c55dd77 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:19.390135 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-332c828d-6b92-4e10-b599-57662c55dd77 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:19.449766 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-332c828d-6b92-4e10-b599-57662c55dd77 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:19.457666 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-332c828d-6b92-4e10-b599-57662c55dd77 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.081613 Aug 10 13:04:19.458237 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1615/3211] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:19 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:20.080179 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3f3da430-7f3e-4db6-ae2e-8d48163dfb87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:20.080795 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3f3da430-7f3e-4db6-ae2e-8d48163dfb87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:20.086746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f3da430-7f3e-4db6-ae2e-8d48163dfb87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:20.087268 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f3da430-7f3e-4db6-ae2e-8d48163dfb87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:20.087705 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f3da430-7f3e-4db6-ae2e-8d48163dfb87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:20.088396 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f3da430-7f3e-4db6-ae2e-8d48163dfb87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:20.088868 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f3da430-7f3e-4db6-ae2e-8d48163dfb87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:20.089299 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3f3da430-7f3e-4db6-ae2e-8d48163dfb87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:20.222528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3f3da430-7f3e-4db6-ae2e-8d48163dfb87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:20.230761 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3f3da430-7f3e-4db6-ae2e-8d48163dfb87 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.154442 Aug 10 13:04:20.231359 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1597/3212] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:20 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:20.389853 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4bcbbef1-3286-4e1c-bc52-0a82f3dfa234 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:20.390388 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4bcbbef1-3286-4e1c-bc52-0a82f3dfa234 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d18ee67-6285-4877-ae40-c30da937c050] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:20.396809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bcbbef1-3286-4e1c-bc52-0a82f3dfa234 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:20.397288 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bcbbef1-3286-4e1c-bc52-0a82f3dfa234 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:20.397716 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bcbbef1-3286-4e1c-bc52-0a82f3dfa234 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:20.398390 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bcbbef1-3286-4e1c-bc52-0a82f3dfa234 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:20.398836 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bcbbef1-3286-4e1c-bc52-0a82f3dfa234 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:20.399291 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bcbbef1-3286-4e1c-bc52-0a82f3dfa234 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:20.478230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4b1fc7f4-d51f-426b-8282-1dcacdb4efde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:20.478861 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4b1fc7f4-d51f-426b-8282-1dcacdb4efde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:20.486441 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b1fc7f4-d51f-426b-8282-1dcacdb4efde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:20.486928 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b1fc7f4-d51f-426b-8282-1dcacdb4efde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:20.487402 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b1fc7f4-d51f-426b-8282-1dcacdb4efde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:20.488128 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b1fc7f4-d51f-426b-8282-1dcacdb4efde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:20.488587 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b1fc7f4-d51f-426b-8282-1dcacdb4efde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:20.489015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b1fc7f4-d51f-426b-8282-1dcacdb4efde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:20.536109 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4bcbbef1-3286-4e1c-bc52-0a82f3dfa234 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:20.544124 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4bcbbef1-3286-4e1c-bc52-0a82f3dfa234 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050" status: 200 len: 1366 microversion: 2.1 time: 0.159286 Aug 10 13:04:20.544701 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1616/3213] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:20 2022] GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:20.552468 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4b1fc7f4-d51f-426b-8282-1dcacdb4efde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:20.561166 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4b1fc7f4-d51f-426b-8282-1dcacdb4efde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.086785 Aug 10 13:04:20.561740 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1598/3214] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:20 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:04:21.252250 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-53597b47-6371-4de2-b8c3-fc2bd993de74 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:21.252856 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-53597b47-6371-4de2-b8c3-fc2bd993de74 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:21.258990 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53597b47-6371-4de2-b8c3-fc2bd993de74 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:21.259516 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53597b47-6371-4de2-b8c3-fc2bd993de74 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:21.259956 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53597b47-6371-4de2-b8c3-fc2bd993de74 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:21.260653 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53597b47-6371-4de2-b8c3-fc2bd993de74 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:21.261128 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53597b47-6371-4de2-b8c3-fc2bd993de74 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:21.262068 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-53597b47-6371-4de2-b8c3-fc2bd993de74 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:21.389240 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-53597b47-6371-4de2-b8c3-fc2bd993de74 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:21.397439 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-53597b47-6371-4de2-b8c3-fc2bd993de74 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.149013 Aug 10 13:04:21.398018 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1617/3215] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:21 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:21.565484 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f34350c8-f09c-4bc0-b66d-1f207499a113 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:21.566096 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f34350c8-f09c-4bc0-b66d-1f207499a113 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d18ee67-6285-4877-ae40-c30da937c050] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:21.572487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f34350c8-f09c-4bc0-b66d-1f207499a113 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:21.572965 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f34350c8-f09c-4bc0-b66d-1f207499a113 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:21.573399 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f34350c8-f09c-4bc0-b66d-1f207499a113 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:21.574871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f34350c8-f09c-4bc0-b66d-1f207499a113 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:21.575486 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f34350c8-f09c-4bc0-b66d-1f207499a113 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:21.575913 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f34350c8-f09c-4bc0-b66d-1f207499a113 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:21.582227 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2d676d9d-61ea-46d8-a0d5-23ca4f8867e6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:21.582841 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2d676d9d-61ea-46d8-a0d5-23ca4f8867e6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:21.588727 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2d676d9d-61ea-46d8-a0d5-23ca4f8867e6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:21.589213 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2d676d9d-61ea-46d8-a0d5-23ca4f8867e6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:21.589658 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2d676d9d-61ea-46d8-a0d5-23ca4f8867e6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:21.590350 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2d676d9d-61ea-46d8-a0d5-23ca4f8867e6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:21.590814 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2d676d9d-61ea-46d8-a0d5-23ca4f8867e6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:21.591286 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2d676d9d-61ea-46d8-a0d5-23ca4f8867e6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:21.670624 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2d676d9d-61ea-46d8-a0d5-23ca4f8867e6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:21.678643 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2d676d9d-61ea-46d8-a0d5-23ca4f8867e6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.100251 Aug 10 13:04:21.679239 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1618/3216] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:21 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:04:21.726989 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f34350c8-f09c-4bc0-b66d-1f207499a113 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:21.734837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f34350c8-f09c-4bc0-b66d-1f207499a113 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050" status: 200 len: 1366 microversion: 2.1 time: 0.173168 Aug 10 13:04:21.735464 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1599/3217] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:21 2022] GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:22.419205 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-20114626-ad86-4422-b1d6-7e7ab330919c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:22.419838 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-20114626-ad86-4422-b1d6-7e7ab330919c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:22.426227 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20114626-ad86-4422-b1d6-7e7ab330919c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:22.426701 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20114626-ad86-4422-b1d6-7e7ab330919c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:22.427129 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20114626-ad86-4422-b1d6-7e7ab330919c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:22.427831 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20114626-ad86-4422-b1d6-7e7ab330919c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:22.428277 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20114626-ad86-4422-b1d6-7e7ab330919c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:22.428697 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-20114626-ad86-4422-b1d6-7e7ab330919c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:22.559594 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-20114626-ad86-4422-b1d6-7e7ab330919c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:22.567506 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-20114626-ad86-4422-b1d6-7e7ab330919c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.152274 Aug 10 13:04:22.568078 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1619/3218] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:22 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:22.700196 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e3733da9-0fbc-4288-8512-bfb756b69396 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:22.700925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e3733da9-0fbc-4288-8512-bfb756b69396 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:22.704277 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:22.707661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e3733da9-0fbc-4288-8512-bfb756b69396 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:22.708152 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e3733da9-0fbc-4288-8512-bfb756b69396 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:22.708589 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e3733da9-0fbc-4288-8512-bfb756b69396 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:22.709286 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e3733da9-0fbc-4288-8512-bfb756b69396 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:22.709738 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e3733da9-0fbc-4288-8512-bfb756b69396 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:22.710165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e3733da9-0fbc-4288-8512-bfb756b69396 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:22.755873 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4c7c9708-1f14-4192-b90c-b0b3f95f3101 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:22.756594 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4c7c9708-1f14-4192-b90c-b0b3f95f3101 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d18ee67-6285-4877-ae40-c30da937c050] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:22.762429 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c7c9708-1f14-4192-b90c-b0b3f95f3101 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:22.762886 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c7c9708-1f14-4192-b90c-b0b3f95f3101 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:22.763351 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c7c9708-1f14-4192-b90c-b0b3f95f3101 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:22.764035 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c7c9708-1f14-4192-b90c-b0b3f95f3101 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:22.764478 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c7c9708-1f14-4192-b90c-b0b3f95f3101 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:22.764899 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4c7c9708-1f14-4192-b90c-b0b3f95f3101 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:22.772574 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e3733da9-0fbc-4288-8512-bfb756b69396 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:22.780580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e3733da9-0fbc-4288-8512-bfb756b69396 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084366 Aug 10 13:04:22.781161 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1600/3219] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:22 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:22.893038 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4c7c9708-1f14-4192-b90c-b0b3f95f3101 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:22.900369 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4c7c9708-1f14-4192-b90c-b0b3f95f3101 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050" status: 200 len: 1366 microversion: 2.1 time: 0.148411 Aug 10 13:04:22.900939 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1620/3220] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:22 2022] GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:04:23.588630 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8ab661cc-5764-4464-954f-d0210c58bee4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:23.589169 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8ab661cc-5764-4464-954f-d0210c58bee4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:23.595387 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ab661cc-5764-4464-954f-d0210c58bee4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:23.595866 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ab661cc-5764-4464-954f-d0210c58bee4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:23.596298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ab661cc-5764-4464-954f-d0210c58bee4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:23.596981 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ab661cc-5764-4464-954f-d0210c58bee4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:23.597432 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ab661cc-5764-4464-954f-d0210c58bee4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:23.597855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ab661cc-5764-4464-954f-d0210c58bee4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:23.733784 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8ab661cc-5764-4464-954f-d0210c58bee4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:23.736268 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8ab661cc-5764-4464-954f-d0210c58bee4 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.152000 Aug 10 13:04:23.736833 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1601/3221] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:23 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:23.802201 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b45829bd-6164-4e64-a5a8-aa12381a8be1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:23.802809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b45829bd-6164-4e64-a5a8-aa12381a8be1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:23.809556 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b45829bd-6164-4e64-a5a8-aa12381a8be1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:23.810031 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b45829bd-6164-4e64-a5a8-aa12381a8be1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:23.810462 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b45829bd-6164-4e64-a5a8-aa12381a8be1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:23.811139 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b45829bd-6164-4e64-a5a8-aa12381a8be1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:23.811613 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b45829bd-6164-4e64-a5a8-aa12381a8be1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:23.812033 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b45829bd-6164-4e64-a5a8-aa12381a8be1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:23.873815 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b45829bd-6164-4e64-a5a8-aa12381a8be1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:23.881678 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b45829bd-6164-4e64-a5a8-aa12381a8be1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083292 Aug 10 13:04:23.882308 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1621/3222] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:23 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:23.922540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1b1acee6-d7b8-4843-8062-41866dfaa758 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:23.923244 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1b1acee6-d7b8-4843-8062-41866dfaa758 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d18ee67-6285-4877-ae40-c30da937c050] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:23.929167 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1b1acee6-d7b8-4843-8062-41866dfaa758 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:23.929727 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1b1acee6-d7b8-4843-8062-41866dfaa758 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:23.930165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1b1acee6-d7b8-4843-8062-41866dfaa758 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:23.930855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1b1acee6-d7b8-4843-8062-41866dfaa758 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:23.931376 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1b1acee6-d7b8-4843-8062-41866dfaa758 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:23.931832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1b1acee6-d7b8-4843-8062-41866dfaa758 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:24.060147 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1b1acee6-d7b8-4843-8062-41866dfaa758 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:24.067426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1b1acee6-d7b8-4843-8062-41866dfaa758 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050" status: 200 len: 1366 microversion: 2.1 time: 0.149576 Aug 10 13:04:24.067995 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1602/3223] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:23 2022] GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:24.292469 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [req-5df40ff5-3fd9-4a5c-ac2f-0fc215fddf49 req-bd13ad41-3a05-4e8b-9292-5cb5142ebfce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d18ee67-6285-4877-ae40-c30da937c050", "name": "network-vif-plugged", "status": "completed", "tag": "f21fab9d-9f5a-4151-8777-6c9b96dd7618"}]} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:04:24.302045 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-5df40ff5-3fd9-4a5c-ac2f-0fc215fddf49 req-bd13ad41-3a05-4e8b-9292-5cb5142ebfce service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:24.302525 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-5df40ff5-3fd9-4a5c-ac2f-0fc215fddf49 req-bd13ad41-3a05-4e8b-9292-5cb5142ebfce service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:24.302955 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-5df40ff5-3fd9-4a5c-ac2f-0fc215fddf49 req-bd13ad41-3a05-4e8b-9292-5cb5142ebfce service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:24.315516 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.compute.server_external_events [req-5df40ff5-3fd9-4a5c-ac2f-0fc215fddf49 req-bd13ad41-3a05-4e8b-9292-5cb5142ebfce service nova] Creating event network-vif-plugged:f21fab9d-9f5a-4151-8777-6c9b96dd7618 for instance 9d18ee67-6285-4877-ae40-c30da937c050 on hv-cinder-85199 Aug 10 13:04:24.320804 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [req-5df40ff5-3fd9-4a5c-ac2f-0fc215fddf49 req-bd13ad41-3a05-4e8b-9292-5cb5142ebfce service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031920 Aug 10 13:04:24.321518 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1622/3224] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:04:24.758371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2c89cb09-62b9-403a-b9b9-17bf23e8a45f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:24.758989 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2c89cb09-62b9-403a-b9b9-17bf23e8a45f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:24.760907 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=2 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:24.762379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=6 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:24.767608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c89cb09-62b9-403a-b9b9-17bf23e8a45f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:24.768090 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c89cb09-62b9-403a-b9b9-17bf23e8a45f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:24.768530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c89cb09-62b9-403a-b9b9-17bf23e8a45f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:24.769220 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c89cb09-62b9-403a-b9b9-17bf23e8a45f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:24.769674 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c89cb09-62b9-403a-b9b9-17bf23e8a45f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:24.770105 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c89cb09-62b9-403a-b9b9-17bf23e8a45f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:24.897902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2c89cb09-62b9-403a-b9b9-17bf23e8a45f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:24.899055 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell0:SELECT=6 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:24.903983 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c96416de-a013-420d-a8bb-9c273812b3f1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:24.904678 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c96416de-a013-420d-a8bb-9c273812b3f1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:24.906082 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2c89cb09-62b9-403a-b9b9-17bf23e8a45f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.151613 Aug 10 13:04:24.906669 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1603/3225] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:24 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:24.910670 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c96416de-a013-420d-a8bb-9c273812b3f1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:24.912080 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c96416de-a013-420d-a8bb-9c273812b3f1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:24.912080 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c96416de-a013-420d-a8bb-9c273812b3f1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:24.912316 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c96416de-a013-420d-a8bb-9c273812b3f1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:24.912743 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c96416de-a013-420d-a8bb-9c273812b3f1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:24.913161 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c96416de-a013-420d-a8bb-9c273812b3f1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:24.974906 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c96416de-a013-420d-a8bb-9c273812b3f1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:24.983738 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c96416de-a013-420d-a8bb-9c273812b3f1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.085601 Aug 10 13:04:24.984311 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1623/3226] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:24 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:25.088192 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e6c45f2e-d409-42d3-8f56-2b6bee2080f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:25.088832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e6c45f2e-d409-42d3-8f56-2b6bee2080f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d18ee67-6285-4877-ae40-c30da937c050] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:25.095008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6c45f2e-d409-42d3-8f56-2b6bee2080f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:25.095665 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6c45f2e-d409-42d3-8f56-2b6bee2080f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:25.096105 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6c45f2e-d409-42d3-8f56-2b6bee2080f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:25.096794 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6c45f2e-d409-42d3-8f56-2b6bee2080f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:25.097245 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6c45f2e-d409-42d3-8f56-2b6bee2080f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:25.097670 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6c45f2e-d409-42d3-8f56-2b6bee2080f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:25.226129 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e6c45f2e-d409-42d3-8f56-2b6bee2080f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:25.234507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e6c45f2e-d409-42d3-8f56-2b6bee2080f4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050" status: 200 len: 1366 microversion: 2.1 time: 0.150114 Aug 10 13:04:25.235083 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1604/3227] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:25 2022] GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:25.926727 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b8e539b2-4fdb-43f0-a8b1-9e80fd3c7ffa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:25.927495 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b8e539b2-4fdb-43f0-a8b1-9e80fd3c7ffa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:25.933668 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b8e539b2-4fdb-43f0-a8b1-9e80fd3c7ffa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:25.935283 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b8e539b2-4fdb-43f0-a8b1-9e80fd3c7ffa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:25.935724 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b8e539b2-4fdb-43f0-a8b1-9e80fd3c7ffa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:25.936406 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b8e539b2-4fdb-43f0-a8b1-9e80fd3c7ffa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:25.936852 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b8e539b2-4fdb-43f0-a8b1-9e80fd3c7ffa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:25.937271 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b8e539b2-4fdb-43f0-a8b1-9e80fd3c7ffa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:26.005141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d9703178-9a8f-486f-969a-a9136e2841aa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:26.005739 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d9703178-9a8f-486f-969a-a9136e2841aa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:26.014194 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d9703178-9a8f-486f-969a-a9136e2841aa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:26.014680 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d9703178-9a8f-486f-969a-a9136e2841aa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:26.015116 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d9703178-9a8f-486f-969a-a9136e2841aa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:26.015851 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d9703178-9a8f-486f-969a-a9136e2841aa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:26.016331 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d9703178-9a8f-486f-969a-a9136e2841aa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:26.016762 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d9703178-9a8f-486f-969a-a9136e2841aa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:26.087897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d9703178-9a8f-486f-969a-a9136e2841aa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:26.092719 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b8e539b2-4fdb-43f0-a8b1-9e80fd3c7ffa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:26.096642 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d9703178-9a8f-486f-969a-a9136e2841aa tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.095383 Aug 10 13:04:26.097215 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1605/3228] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:25 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:04:26.100820 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b8e539b2-4fdb-43f0-a8b1-9e80fd3c7ffa tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.177952 Aug 10 13:04:26.101392 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1624/3229] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:25 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:26.255810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-308ecdd4-f3ef-497c-a7af-ca11c12ec2b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:26.259390 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-308ecdd4-f3ef-497c-a7af-ca11c12ec2b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d18ee67-6285-4877-ae40-c30da937c050] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:26.266179 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-308ecdd4-f3ef-497c-a7af-ca11c12ec2b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:26.266685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-308ecdd4-f3ef-497c-a7af-ca11c12ec2b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:26.267124 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-308ecdd4-f3ef-497c-a7af-ca11c12ec2b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:26.267861 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-308ecdd4-f3ef-497c-a7af-ca11c12ec2b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:26.268318 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-308ecdd4-f3ef-497c-a7af-ca11c12ec2b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:26.268779 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-308ecdd4-f3ef-497c-a7af-ca11c12ec2b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:26.405106 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-308ecdd4-f3ef-497c-a7af-ca11c12ec2b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:26.412785 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-308ecdd4-f3ef-497c-a7af-ca11c12ec2b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050" status: 200 len: 1556 microversion: 2.1 time: 0.160952 Aug 10 13:04:26.414207 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1606/3230] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:26 2022] GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:26.432778 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ce20054c-d464-4b29-9c40-705eadf0b152 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:26.433265 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ce20054c-d464-4b29-9c40-705eadf0b152 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d18ee67-6285-4877-ae40-c30da937c050] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:26.439025 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce20054c-d464-4b29-9c40-705eadf0b152 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:26.439532 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce20054c-d464-4b29-9c40-705eadf0b152 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:26.439964 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce20054c-d464-4b29-9c40-705eadf0b152 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:26.440642 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce20054c-d464-4b29-9c40-705eadf0b152 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:26.441088 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce20054c-d464-4b29-9c40-705eadf0b152 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:26.441506 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce20054c-d464-4b29-9c40-705eadf0b152 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:26.455413 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:26.517887 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ce20054c-d464-4b29-9c40-705eadf0b152 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088848 Aug 10 13:04:26.518488 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1625/3231] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 10 13:04:26 2022] GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:04:27.118227 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0efebbd0-17fd-48c4-8d88-29def5c228c2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:27.118787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0efebbd0-17fd-48c4-8d88-29def5c228c2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:27.122568 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-48054ffa-8ac5-46f4-b245-852d17b07990 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:27.123793 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-48054ffa-8ac5-46f4-b245-852d17b07990 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:27.126134 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0efebbd0-17fd-48c4-8d88-29def5c228c2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:27.126624 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0efebbd0-17fd-48c4-8d88-29def5c228c2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:27.127704 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0efebbd0-17fd-48c4-8d88-29def5c228c2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:27.128419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0efebbd0-17fd-48c4-8d88-29def5c228c2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:27.128870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0efebbd0-17fd-48c4-8d88-29def5c228c2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:27.129296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0efebbd0-17fd-48c4-8d88-29def5c228c2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:27.130445 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-48054ffa-8ac5-46f4-b245-852d17b07990 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:27.130939 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-48054ffa-8ac5-46f4-b245-852d17b07990 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:27.131410 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-48054ffa-8ac5-46f4-b245-852d17b07990 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:27.132121 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-48054ffa-8ac5-46f4-b245-852d17b07990 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:27.132581 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-48054ffa-8ac5-46f4-b245-852d17b07990 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:27.133008 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-48054ffa-8ac5-46f4-b245-852d17b07990 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:27.256490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0efebbd0-17fd-48c4-8d88-29def5c228c2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:27.265680 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0efebbd0-17fd-48c4-8d88-29def5c228c2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.151346 Aug 10 13:04:27.266624 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1607/3232] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:27 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:27.329796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-48054ffa-8ac5-46f4-b245-852d17b07990 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:27.337692 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-48054ffa-8ac5-46f4-b245-852d17b07990 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.219954 Aug 10 13:04:27.338260 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1626/3233] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:27 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:04:27.783769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-5da11e4b-c3bd-4384-89be-62ba621ea1d1 req-6e242180-6d1c-471e-9dd1-e2057697fb2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d18ee67-6285-4877-ae40-c30da937c050", "tag": "f21fab9d-9f5a-4151-8777-6c9b96dd7618"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:04:27.793160 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-5da11e4b-c3bd-4384-89be-62ba621ea1d1 req-6e242180-6d1c-471e-9dd1-e2057697fb2e service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:27.794245 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-5da11e4b-c3bd-4384-89be-62ba621ea1d1 req-6e242180-6d1c-471e-9dd1-e2057697fb2e service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:27.794681 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-5da11e4b-c3bd-4384-89be-62ba621ea1d1 req-6e242180-6d1c-471e-9dd1-e2057697fb2e service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:27.805620 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-5da11e4b-c3bd-4384-89be-62ba621ea1d1 req-6e242180-6d1c-471e-9dd1-e2057697fb2e service nova] Creating event network-changed:f21fab9d-9f5a-4151-8777-6c9b96dd7618 for instance 9d18ee67-6285-4877-ae40-c30da937c050 on hv-cinder-85199 Aug 10 13:04:27.811529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-5da11e4b-c3bd-4384-89be-62ba621ea1d1 req-6e242180-6d1c-471e-9dd1-e2057697fb2e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031302 Aug 10 13:04:27.812208 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1608/3234] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:04:28.287401 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-66e972c0-99e9-45ff-8b9e-16c7149be884 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:28.288015 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-66e972c0-99e9-45ff-8b9e-16c7149be884 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:28.294807 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-66e972c0-99e9-45ff-8b9e-16c7149be884 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:28.295228 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-66e972c0-99e9-45ff-8b9e-16c7149be884 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:28.295665 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-66e972c0-99e9-45ff-8b9e-16c7149be884 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:28.296359 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-66e972c0-99e9-45ff-8b9e-16c7149be884 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:28.296806 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-66e972c0-99e9-45ff-8b9e-16c7149be884 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:28.297223 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-66e972c0-99e9-45ff-8b9e-16c7149be884 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:28.360968 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-aa7d6d92-918a-4899-ae32-85ffd1facf8c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:28.362171 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-66e972c0-99e9-45ff-8b9e-16c7149be884 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:28.362927 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-aa7d6d92-918a-4899-ae32-85ffd1facf8c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:28.369293 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa7d6d92-918a-4899-ae32-85ffd1facf8c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:28.370018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa7d6d92-918a-4899-ae32-85ffd1facf8c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:28.370394 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-66e972c0-99e9-45ff-8b9e-16c7149be884 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.086752 Aug 10 13:04:28.370841 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa7d6d92-918a-4899-ae32-85ffd1facf8c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:28.371357 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1627/3235] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:28 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:28.371975 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa7d6d92-918a-4899-ae32-85ffd1facf8c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:28.372637 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa7d6d92-918a-4899-ae32-85ffd1facf8c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:28.373069 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa7d6d92-918a-4899-ae32-85ffd1facf8c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:28.509682 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-aa7d6d92-918a-4899-ae32-85ffd1facf8c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:28.518509 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-aa7d6d92-918a-4899-ae32-85ffd1facf8c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.163106 Aug 10 13:04:28.519114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1609/3236] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:28 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:04:29.392400 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-252e1d69-a838-433c-801e-34987a5c8308 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:29.393010 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-252e1d69-a838-433c-801e-34987a5c8308 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:29.399561 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-252e1d69-a838-433c-801e-34987a5c8308 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:29.400038 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-252e1d69-a838-433c-801e-34987a5c8308 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:29.400466 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-252e1d69-a838-433c-801e-34987a5c8308 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:29.401145 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-252e1d69-a838-433c-801e-34987a5c8308 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:29.401593 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-252e1d69-a838-433c-801e-34987a5c8308 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:29.402010 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-252e1d69-a838-433c-801e-34987a5c8308 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:29.466579 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-252e1d69-a838-433c-801e-34987a5c8308 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:29.474453 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-252e1d69-a838-433c-801e-34987a5c8308 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.087091 Aug 10 13:04:29.475016 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1628/3237] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:29 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:29.540349 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-23fe9383-86ea-4c27-8ecf-bd174df12149 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:29.540922 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-23fe9383-86ea-4c27-8ecf-bd174df12149 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:29.547998 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23fe9383-86ea-4c27-8ecf-bd174df12149 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:29.548481 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23fe9383-86ea-4c27-8ecf-bd174df12149 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:29.548917 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23fe9383-86ea-4c27-8ecf-bd174df12149 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:29.549604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23fe9383-86ea-4c27-8ecf-bd174df12149 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:29.550056 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23fe9383-86ea-4c27-8ecf-bd174df12149 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:29.550481 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-23fe9383-86ea-4c27-8ecf-bd174df12149 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:29.683596 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-23fe9383-86ea-4c27-8ecf-bd174df12149 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:29.692235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-23fe9383-86ea-4c27-8ecf-bd174df12149 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.155771 Aug 10 13:04:29.692804 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1610/3238] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:29 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:30.495218 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-909f148c-c76c-4a59-ace1-6b86772c13b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:30.495869 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-909f148c-c76c-4a59-ace1-6b86772c13b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:30.502786 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-909f148c-c76c-4a59-ace1-6b86772c13b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:30.503304 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-909f148c-c76c-4a59-ace1-6b86772c13b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:30.503743 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-909f148c-c76c-4a59-ace1-6b86772c13b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:30.504433 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-909f148c-c76c-4a59-ace1-6b86772c13b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:30.504887 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-909f148c-c76c-4a59-ace1-6b86772c13b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:30.505314 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-909f148c-c76c-4a59-ace1-6b86772c13b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:30.568467 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-909f148c-c76c-4a59-ace1-6b86772c13b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:30.577090 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-909f148c-c76c-4a59-ace1-6b86772c13b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.085762 Aug 10 13:04:30.577661 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1629/3239] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:30 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:30.712509 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6483afc0-22bb-41bc-b745-19627a54748a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:30.713131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6483afc0-22bb-41bc-b745-19627a54748a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:30.719764 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6483afc0-22bb-41bc-b745-19627a54748a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:30.720244 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6483afc0-22bb-41bc-b745-19627a54748a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:30.720682 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6483afc0-22bb-41bc-b745-19627a54748a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:30.721371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6483afc0-22bb-41bc-b745-19627a54748a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:30.721821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6483afc0-22bb-41bc-b745-19627a54748a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:30.722242 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6483afc0-22bb-41bc-b745-19627a54748a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:30.724865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:30.852706 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6483afc0-22bb-41bc-b745-19627a54748a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:30.861085 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6483afc0-22bb-41bc-b745-19627a54748a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.152421 Aug 10 13:04:30.861665 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1611/3240] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:30 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:31.606969 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9dca752a-7938-4089-b182-d2fa7ca25297 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:31.607527 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9dca752a-7938-4089-b182-d2fa7ca25297 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:31.614008 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9dca752a-7938-4089-b182-d2fa7ca25297 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:31.614494 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9dca752a-7938-4089-b182-d2fa7ca25297 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:31.614929 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9dca752a-7938-4089-b182-d2fa7ca25297 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:31.615643 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9dca752a-7938-4089-b182-d2fa7ca25297 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:31.616099 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9dca752a-7938-4089-b182-d2fa7ca25297 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:31.616522 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9dca752a-7938-4089-b182-d2fa7ca25297 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:31.677824 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9dca752a-7938-4089-b182-d2fa7ca25297 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:31.686444 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9dca752a-7938-4089-b182-d2fa7ca25297 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083799 Aug 10 13:04:31.687017 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1630/3241] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:31 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:31.882267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e2d5fcb5-3c3d-4d41-a00a-1b36a948a828 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:31.882831 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e2d5fcb5-3c3d-4d41-a00a-1b36a948a828 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:31.889470 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2d5fcb5-3c3d-4d41-a00a-1b36a948a828 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:31.889945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2d5fcb5-3c3d-4d41-a00a-1b36a948a828 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:31.890373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2d5fcb5-3c3d-4d41-a00a-1b36a948a828 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:31.891051 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2d5fcb5-3c3d-4d41-a00a-1b36a948a828 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:31.891523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2d5fcb5-3c3d-4d41-a00a-1b36a948a828 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:31.891948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e2d5fcb5-3c3d-4d41-a00a-1b36a948a828 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:31.944140 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e281321b-da4d-4dd3-b74b-5321dce0df03 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:31.944777 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e281321b-da4d-4dd3-b74b-5321dce0df03 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 2f8e2b4f-5870-46a3-b826-1b80fb322c73] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:31.950848 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e281321b-da4d-4dd3-b74b-5321dce0df03 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:31.951376 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e281321b-da4d-4dd3-b74b-5321dce0df03 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:31.951813 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e281321b-da4d-4dd3-b74b-5321dce0df03 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:31.952506 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e281321b-da4d-4dd3-b74b-5321dce0df03 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:31.952958 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e281321b-da4d-4dd3-b74b-5321dce0df03 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:31.953382 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e281321b-da4d-4dd3-b74b-5321dce0df03 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:31.976454 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e281321b-da4d-4dd3-b74b-5321dce0df03 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73/ips" status: 200 len: 152 microversion: 2.20 time: 0.036149 Aug 10 13:04:31.977041 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1631/3242] 10.222.0.49 () {60 vars in 1289 bytes} [Wed Aug 10 13:04:31 2022] GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 13:04:32.022166 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e2d5fcb5-3c3d-4d41-a00a-1b36a948a828 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:32.030704 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e2d5fcb5-3c3d-4d41-a00a-1b36a948a828 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.152340 Aug 10 13:04:32.031282 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1612/3243] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:31 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:32.706943 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-97396886-3824-4562-b55d-cf82c2c8cdbb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:32.707524 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-97396886-3824-4562-b55d-cf82c2c8cdbb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:32.713931 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-97396886-3824-4562-b55d-cf82c2c8cdbb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:32.714409 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-97396886-3824-4562-b55d-cf82c2c8cdbb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:32.714838 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-97396886-3824-4562-b55d-cf82c2c8cdbb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:32.716337 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-97396886-3824-4562-b55d-cf82c2c8cdbb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:32.716788 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-97396886-3824-4562-b55d-cf82c2c8cdbb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:32.717207 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-97396886-3824-4562-b55d-cf82c2c8cdbb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:32.780823 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-97396886-3824-4562-b55d-cf82c2c8cdbb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:32.788695 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-97396886-3824-4562-b55d-cf82c2c8cdbb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.085807 Aug 10 13:04:32.789254 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1632/3244] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:32 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:33.052320 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e8248f86-5d21-4740-a0d6-254ec21611dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:33.052931 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e8248f86-5d21-4740-a0d6-254ec21611dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:33.059813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e8248f86-5d21-4740-a0d6-254ec21611dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:33.060295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e8248f86-5d21-4740-a0d6-254ec21611dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:33.060727 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e8248f86-5d21-4740-a0d6-254ec21611dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:33.061411 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e8248f86-5d21-4740-a0d6-254ec21611dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:33.061865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e8248f86-5d21-4740-a0d6-254ec21611dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:33.062286 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e8248f86-5d21-4740-a0d6-254ec21611dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:33.192510 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e8248f86-5d21-4740-a0d6-254ec21611dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:33.200231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e8248f86-5d21-4740-a0d6-254ec21611dc tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.151780 Aug 10 13:04:33.200790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1613/3245] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:33 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:33.808892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0441fa98-1407-40f7-81de-78996c46fddb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:33.809744 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0441fa98-1407-40f7-81de-78996c46fddb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:33.816276 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0441fa98-1407-40f7-81de-78996c46fddb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:33.816749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0441fa98-1407-40f7-81de-78996c46fddb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:33.817177 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0441fa98-1407-40f7-81de-78996c46fddb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:33.817852 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0441fa98-1407-40f7-81de-78996c46fddb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:33.818294 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0441fa98-1407-40f7-81de-78996c46fddb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:33.818718 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0441fa98-1407-40f7-81de-78996c46fddb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:33.880210 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0441fa98-1407-40f7-81de-78996c46fddb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:33.889019 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0441fa98-1407-40f7-81de-78996c46fddb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084013 Aug 10 13:04:33.889589 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1633/3246] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:33 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:34.221849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e72ee820-586a-4a58-bf58-ab0e81b6acf9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:34.222449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e72ee820-586a-4a58-bf58-ab0e81b6acf9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:34.228900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e72ee820-586a-4a58-bf58-ab0e81b6acf9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:34.238259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e72ee820-586a-4a58-bf58-ab0e81b6acf9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:34.238259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e72ee820-586a-4a58-bf58-ab0e81b6acf9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:34.238259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e72ee820-586a-4a58-bf58-ab0e81b6acf9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:34.238259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e72ee820-586a-4a58-bf58-ab0e81b6acf9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:34.238866 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e72ee820-586a-4a58-bf58-ab0e81b6acf9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:34.365579 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e72ee820-586a-4a58-bf58-ab0e81b6acf9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:34.374066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e72ee820-586a-4a58-bf58-ab0e81b6acf9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.156203 Aug 10 13:04:34.379802 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1614/3247] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:34 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:34.909759 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f630ad43-5d72-4dca-8773-d6645792b028 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:34.910369 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f630ad43-5d72-4dca-8773-d6645792b028 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:34.916748 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f630ad43-5d72-4dca-8773-d6645792b028 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:34.917229 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f630ad43-5d72-4dca-8773-d6645792b028 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:34.917669 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f630ad43-5d72-4dca-8773-d6645792b028 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:34.918350 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f630ad43-5d72-4dca-8773-d6645792b028 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:34.919331 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f630ad43-5d72-4dca-8773-d6645792b028 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:34.919761 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f630ad43-5d72-4dca-8773-d6645792b028 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:34.980801 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f630ad43-5d72-4dca-8773-d6645792b028 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:34.989342 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f630ad43-5d72-4dca-8773-d6645792b028 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083505 Aug 10 13:04:34.989905 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1634/3248] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:34 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:35.395138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8013a7f5-a4b1-46b6-a378-80362a7179a2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:35.395772 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8013a7f5-a4b1-46b6-a378-80362a7179a2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:35.402342 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8013a7f5-a4b1-46b6-a378-80362a7179a2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:35.402819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8013a7f5-a4b1-46b6-a378-80362a7179a2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:35.404003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8013a7f5-a4b1-46b6-a378-80362a7179a2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:35.404764 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8013a7f5-a4b1-46b6-a378-80362a7179a2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:35.405200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8013a7f5-a4b1-46b6-a378-80362a7179a2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:35.405617 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8013a7f5-a4b1-46b6-a378-80362a7179a2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:35.533350 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8013a7f5-a4b1-46b6-a378-80362a7179a2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:35.541175 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8013a7f5-a4b1-46b6-a378-80362a7179a2 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.149938 Aug 10 13:04:35.541736 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1615/3249] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:35 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:36.011764 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-70036fb4-b47b-47f3-bcdd-694fd87dae42 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:36.012389 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-70036fb4-b47b-47f3-bcdd-694fd87dae42 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:36.019462 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70036fb4-b47b-47f3-bcdd-694fd87dae42 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:36.019943 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70036fb4-b47b-47f3-bcdd-694fd87dae42 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:36.020378 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70036fb4-b47b-47f3-bcdd-694fd87dae42 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:36.021098 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70036fb4-b47b-47f3-bcdd-694fd87dae42 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:36.021549 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70036fb4-b47b-47f3-bcdd-694fd87dae42 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:36.021973 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70036fb4-b47b-47f3-bcdd-694fd87dae42 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:36.085073 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-70036fb4-b47b-47f3-bcdd-694fd87dae42 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:36.093638 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-70036fb4-b47b-47f3-bcdd-694fd87dae42 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.085775 Aug 10 13:04:36.094208 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1635/3250] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:36 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:36.563335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2ead540d-7754-44c9-bb0f-43ac4b710fcd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:36.563859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2ead540d-7754-44c9-bb0f-43ac4b710fcd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:36.570268 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2ead540d-7754-44c9-bb0f-43ac4b710fcd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:36.570744 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2ead540d-7754-44c9-bb0f-43ac4b710fcd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:36.571211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2ead540d-7754-44c9-bb0f-43ac4b710fcd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:36.571898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2ead540d-7754-44c9-bb0f-43ac4b710fcd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:36.572342 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2ead540d-7754-44c9-bb0f-43ac4b710fcd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:36.572760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2ead540d-7754-44c9-bb0f-43ac4b710fcd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:36.702469 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2ead540d-7754-44c9-bb0f-43ac4b710fcd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:36.710327 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2ead540d-7754-44c9-bb0f-43ac4b710fcd tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.152017 Aug 10 13:04:36.715899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1616/3251] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:36 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:37.114342 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5950dce7-ae48-4e86-a8e2-5cd6a721fe9b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:37.115075 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5950dce7-ae48-4e86-a8e2-5cd6a721fe9b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:37.121539 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5950dce7-ae48-4e86-a8e2-5cd6a721fe9b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:37.122686 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5950dce7-ae48-4e86-a8e2-5cd6a721fe9b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:37.123124 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5950dce7-ae48-4e86-a8e2-5cd6a721fe9b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:37.123842 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5950dce7-ae48-4e86-a8e2-5cd6a721fe9b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:37.124297 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5950dce7-ae48-4e86-a8e2-5cd6a721fe9b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:37.124723 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5950dce7-ae48-4e86-a8e2-5cd6a721fe9b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:37.187514 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5950dce7-ae48-4e86-a8e2-5cd6a721fe9b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:37.195342 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5950dce7-ae48-4e86-a8e2-5cd6a721fe9b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084868 Aug 10 13:04:37.195917 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1636/3252] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:37 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:37.731508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e9d844bc-ea17-4507-a22f-ed3e6ecea783 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:37.732232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e9d844bc-ea17-4507-a22f-ed3e6ecea783 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:37.738550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9d844bc-ea17-4507-a22f-ed3e6ecea783 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:37.739031 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9d844bc-ea17-4507-a22f-ed3e6ecea783 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:37.739500 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9d844bc-ea17-4507-a22f-ed3e6ecea783 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:37.740191 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9d844bc-ea17-4507-a22f-ed3e6ecea783 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:37.740645 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9d844bc-ea17-4507-a22f-ed3e6ecea783 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:37.741105 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9d844bc-ea17-4507-a22f-ed3e6ecea783 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:37.873871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e9d844bc-ea17-4507-a22f-ed3e6ecea783 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:37.881756 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e9d844bc-ea17-4507-a22f-ed3e6ecea783 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.154497 Aug 10 13:04:37.882325 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1617/3253] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:37 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:38.216092 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c390a78f-8fcc-49f7-8fc8-387ab9b98e7c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:38.216720 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c390a78f-8fcc-49f7-8fc8-387ab9b98e7c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:38.219115 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=1 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:38.223805 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c390a78f-8fcc-49f7-8fc8-387ab9b98e7c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:38.224289 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c390a78f-8fcc-49f7-8fc8-387ab9b98e7c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:38.224725 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c390a78f-8fcc-49f7-8fc8-387ab9b98e7c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:38.225414 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c390a78f-8fcc-49f7-8fc8-387ab9b98e7c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:38.225864 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c390a78f-8fcc-49f7-8fc8-387ab9b98e7c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:38.226289 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c390a78f-8fcc-49f7-8fc8-387ab9b98e7c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:38.290184 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c390a78f-8fcc-49f7-8fc8-387ab9b98e7c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:38.298065 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c390a78f-8fcc-49f7-8fc8-387ab9b98e7c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.085936 Aug 10 13:04:38.298634 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1637/3254] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:38 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:38.904837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9488ffa3-be74-499d-9a9a-5cb95161c674 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:38.905438 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9488ffa3-be74-499d-9a9a-5cb95161c674 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:38.911730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9488ffa3-be74-499d-9a9a-5cb95161c674 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:38.912208 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9488ffa3-be74-499d-9a9a-5cb95161c674 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:38.912640 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9488ffa3-be74-499d-9a9a-5cb95161c674 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:38.913315 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9488ffa3-be74-499d-9a9a-5cb95161c674 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:38.913759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9488ffa3-be74-499d-9a9a-5cb95161c674 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:38.914175 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9488ffa3-be74-499d-9a9a-5cb95161c674 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:39.041593 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9488ffa3-be74-499d-9a9a-5cb95161c674 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:39.050078 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9488ffa3-be74-499d-9a9a-5cb95161c674 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.149774 Aug 10 13:04:39.050640 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1618/3255] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:38 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:39.319271 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-d8d5ef82-56aa-466f-bd4f-1a4c7cf1ae2d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:39.319890 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-d8d5ef82-56aa-466f-bd4f-1a4c7cf1ae2d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:39.326746 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d8d5ef82-56aa-466f-bd4f-1a4c7cf1ae2d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:39.327250 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d8d5ef82-56aa-466f-bd4f-1a4c7cf1ae2d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:39.327684 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d8d5ef82-56aa-466f-bd4f-1a4c7cf1ae2d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:39.328366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d8d5ef82-56aa-466f-bd4f-1a4c7cf1ae2d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:39.328816 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d8d5ef82-56aa-466f-bd4f-1a4c7cf1ae2d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:39.329237 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-d8d5ef82-56aa-466f-bd4f-1a4c7cf1ae2d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:39.392719 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-d8d5ef82-56aa-466f-bd4f-1a4c7cf1ae2d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:39.400536 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-d8d5ef82-56aa-466f-bd4f-1a4c7cf1ae2d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.085123 Aug 10 13:04:39.401113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1638/3256] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:39 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:40.071377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-90bfb2f0-af9d-4cbe-a510-e496c6fb9d57 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:40.071985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-90bfb2f0-af9d-4cbe-a510-e496c6fb9d57 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:40.079003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90bfb2f0-af9d-4cbe-a510-e496c6fb9d57 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:40.079508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90bfb2f0-af9d-4cbe-a510-e496c6fb9d57 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:40.079938 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90bfb2f0-af9d-4cbe-a510-e496c6fb9d57 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:40.080622 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90bfb2f0-af9d-4cbe-a510-e496c6fb9d57 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:40.081066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90bfb2f0-af9d-4cbe-a510-e496c6fb9d57 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:40.081484 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90bfb2f0-af9d-4cbe-a510-e496c6fb9d57 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:40.209117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-90bfb2f0-af9d-4cbe-a510-e496c6fb9d57 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:40.217339 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-90bfb2f0-af9d-4cbe-a510-e496c6fb9d57 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.150081 Aug 10 13:04:40.217901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1619/3257] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:40 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:40.422869 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-15e77920-fd23-4539-8244-00a96c5a2c7f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:40.423466 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-15e77920-fd23-4539-8244-00a96c5a2c7f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:40.429821 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15e77920-fd23-4539-8244-00a96c5a2c7f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:40.430305 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15e77920-fd23-4539-8244-00a96c5a2c7f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:40.430743 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15e77920-fd23-4539-8244-00a96c5a2c7f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:40.431458 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15e77920-fd23-4539-8244-00a96c5a2c7f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:40.431917 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15e77920-fd23-4539-8244-00a96c5a2c7f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:40.432345 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-15e77920-fd23-4539-8244-00a96c5a2c7f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:40.492751 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-15e77920-fd23-4539-8244-00a96c5a2c7f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:40.500973 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-15e77920-fd23-4539-8244-00a96c5a2c7f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082838 Aug 10 13:04:40.501543 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1639/3258] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:40 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:41.238506 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-64e403f6-9dce-46d0-9945-75fc03bc3a25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:41.239136 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-64e403f6-9dce-46d0-9945-75fc03bc3a25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:41.245459 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64e403f6-9dce-46d0-9945-75fc03bc3a25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:41.245938 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64e403f6-9dce-46d0-9945-75fc03bc3a25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:41.246389 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64e403f6-9dce-46d0-9945-75fc03bc3a25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:41.247588 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64e403f6-9dce-46d0-9945-75fc03bc3a25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:41.248048 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64e403f6-9dce-46d0-9945-75fc03bc3a25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:41.248467 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-64e403f6-9dce-46d0-9945-75fc03bc3a25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:41.380621 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-64e403f6-9dce-46d0-9945-75fc03bc3a25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:41.389094 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-64e403f6-9dce-46d0-9945-75fc03bc3a25 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.154371 Aug 10 13:04:41.389666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1620/3259] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:41 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:41.521301 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fe64e401-f896-4c34-937c-f578d6136295 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:41.521918 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fe64e401-f896-4c34-937c-f578d6136295 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:41.528960 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe64e401-f896-4c34-937c-f578d6136295 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:41.529444 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe64e401-f896-4c34-937c-f578d6136295 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:41.529888 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe64e401-f896-4c34-937c-f578d6136295 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:41.530575 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe64e401-f896-4c34-937c-f578d6136295 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:41.531031 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe64e401-f896-4c34-937c-f578d6136295 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:41.531491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe64e401-f896-4c34-937c-f578d6136295 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:41.592399 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fe64e401-f896-4c34-937c-f578d6136295 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:41.600133 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fe64e401-f896-4c34-937c-f578d6136295 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082715 Aug 10 13:04:41.600705 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1640/3260] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:41 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:42.410256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2a732ebb-e2cb-4981-bdd7-1f9f3ded26c3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:42.410886 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2a732ebb-e2cb-4981-bdd7-1f9f3ded26c3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:42.417355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a732ebb-e2cb-4981-bdd7-1f9f3ded26c3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:42.417832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a732ebb-e2cb-4981-bdd7-1f9f3ded26c3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:42.418263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a732ebb-e2cb-4981-bdd7-1f9f3ded26c3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:42.419045 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a732ebb-e2cb-4981-bdd7-1f9f3ded26c3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:42.419701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a732ebb-e2cb-4981-bdd7-1f9f3ded26c3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:42.420129 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a732ebb-e2cb-4981-bdd7-1f9f3ded26c3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:42.546117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2a732ebb-e2cb-4981-bdd7-1f9f3ded26c3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:42.553904 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2a732ebb-e2cb-4981-bdd7-1f9f3ded26c3 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.147506 Aug 10 13:04:42.554490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1621/3261] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:42 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:42.621073 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f095840f-1449-44ee-85cd-9a02ff75e6b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:42.621719 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f095840f-1449-44ee-85cd-9a02ff75e6b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:42.628708 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f095840f-1449-44ee-85cd-9a02ff75e6b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:42.629190 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f095840f-1449-44ee-85cd-9a02ff75e6b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:42.629627 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f095840f-1449-44ee-85cd-9a02ff75e6b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:42.630310 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f095840f-1449-44ee-85cd-9a02ff75e6b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:42.630761 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f095840f-1449-44ee-85cd-9a02ff75e6b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:42.631207 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f095840f-1449-44ee-85cd-9a02ff75e6b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:42.694220 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f095840f-1449-44ee-85cd-9a02ff75e6b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:42.702666 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f095840f-1449-44ee-85cd-9a02ff75e6b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.085395 Aug 10 13:04:42.703258 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1641/3262] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:42 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:43.575086 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c4aac363-1790-4ed6-8cf1-3591b16eef63 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:43.575851 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c4aac363-1790-4ed6-8cf1-3591b16eef63 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:43.582095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4aac363-1790-4ed6-8cf1-3591b16eef63 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:43.582579 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4aac363-1790-4ed6-8cf1-3591b16eef63 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:43.583014 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4aac363-1790-4ed6-8cf1-3591b16eef63 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:43.583746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4aac363-1790-4ed6-8cf1-3591b16eef63 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:43.584199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4aac363-1790-4ed6-8cf1-3591b16eef63 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:43.584631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c4aac363-1790-4ed6-8cf1-3591b16eef63 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:43.711657 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c4aac363-1790-4ed6-8cf1-3591b16eef63 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:43.720074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c4aac363-1790-4ed6-8cf1-3591b16eef63 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.148916 Aug 10 13:04:43.720642 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1622/3263] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:43 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:43.722825 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c5ab8534-3d17-452c-8bb5-5f09211232b6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:43.723482 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c5ab8534-3d17-452c-8bb5-5f09211232b6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:43.729737 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c5ab8534-3d17-452c-8bb5-5f09211232b6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:43.730479 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c5ab8534-3d17-452c-8bb5-5f09211232b6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:43.730907 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c5ab8534-3d17-452c-8bb5-5f09211232b6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:43.732194 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c5ab8534-3d17-452c-8bb5-5f09211232b6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:43.732628 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c5ab8534-3d17-452c-8bb5-5f09211232b6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:43.733050 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c5ab8534-3d17-452c-8bb5-5f09211232b6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:43.795460 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c5ab8534-3d17-452c-8bb5-5f09211232b6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:43.797637 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=100 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:43.803993 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c5ab8534-3d17-452c-8bb5-5f09211232b6 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084947 Aug 10 13:04:43.810223 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1642/3264] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:43 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:04:44.741837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-175dc52c-403c-41b2-a985-cd58af50712b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:44.742449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-175dc52c-403c-41b2-a985-cd58af50712b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:44.749419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-175dc52c-403c-41b2-a985-cd58af50712b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:44.749902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-175dc52c-403c-41b2-a985-cd58af50712b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:44.750337 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-175dc52c-403c-41b2-a985-cd58af50712b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:44.751023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-175dc52c-403c-41b2-a985-cd58af50712b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:44.751505 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-175dc52c-403c-41b2-a985-cd58af50712b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:44.751931 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-175dc52c-403c-41b2-a985-cd58af50712b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:44.829987 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-165e7167-4774-46c1-a324-02d7ce7438da tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:44.830605 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-165e7167-4774-46c1-a324-02d7ce7438da tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:44.837168 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-165e7167-4774-46c1-a324-02d7ce7438da tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:44.837650 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-165e7167-4774-46c1-a324-02d7ce7438da tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:44.838088 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-165e7167-4774-46c1-a324-02d7ce7438da tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:44.838789 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-165e7167-4774-46c1-a324-02d7ce7438da tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:44.839267 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-165e7167-4774-46c1-a324-02d7ce7438da tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:44.839696 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-165e7167-4774-46c1-a324-02d7ce7438da tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:44.892123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-175dc52c-403c-41b2-a985-cd58af50712b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:44.899994 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-175dc52c-403c-41b2-a985-cd58af50712b tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.162016 Aug 10 13:04:44.900573 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1623/3265] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:44 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:44.907783 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-165e7167-4774-46c1-a324-02d7ce7438da tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:44.915917 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-165e7167-4774-46c1-a324-02d7ce7438da tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.090873 Aug 10 13:04:44.916481 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1643/3266] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:44 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:04:45.920861 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-81eae26b-2b86-4689-9af9-000112ad7e66 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:45.921705 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-81eae26b-2b86-4689-9af9-000112ad7e66 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:45.928246 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81eae26b-2b86-4689-9af9-000112ad7e66 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:45.928737 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81eae26b-2b86-4689-9af9-000112ad7e66 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:45.929175 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81eae26b-2b86-4689-9af9-000112ad7e66 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:45.929861 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81eae26b-2b86-4689-9af9-000112ad7e66 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:45.930350 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81eae26b-2b86-4689-9af9-000112ad7e66 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:45.930772 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81eae26b-2b86-4689-9af9-000112ad7e66 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:45.936651 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fbfb4d4b-964d-4521-acea-3e1aa23465f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:45.937264 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fbfb4d4b-964d-4521-acea-3e1aa23465f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:45.943622 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fbfb4d4b-964d-4521-acea-3e1aa23465f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:45.944101 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fbfb4d4b-964d-4521-acea-3e1aa23465f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:45.944536 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fbfb4d4b-964d-4521-acea-3e1aa23465f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:45.945230 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fbfb4d4b-964d-4521-acea-3e1aa23465f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:45.945681 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fbfb4d4b-964d-4521-acea-3e1aa23465f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:45.946327 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fbfb4d4b-964d-4521-acea-3e1aa23465f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:46.026882 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fbfb4d4b-964d-4521-acea-3e1aa23465f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:46.035064 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fbfb4d4b-964d-4521-acea-3e1aa23465f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.102205 Aug 10 13:04:46.035664 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1644/3267] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:45 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:04:46.082314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-81eae26b-2b86-4689-9af9-000112ad7e66 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:46.090173 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-81eae26b-2b86-4689-9af9-000112ad7e66 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.173276 Aug 10 13:04:46.090774 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1624/3268] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:45 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:47.056537 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-46fd88ce-f404-497e-b75d-a5c9c4b7fabc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:47.057176 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-46fd88ce-f404-497e-b75d-a5c9c4b7fabc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:47.064195 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46fd88ce-f404-497e-b75d-a5c9c4b7fabc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:47.064679 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46fd88ce-f404-497e-b75d-a5c9c4b7fabc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:47.065113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46fd88ce-f404-497e-b75d-a5c9c4b7fabc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:47.065812 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46fd88ce-f404-497e-b75d-a5c9c4b7fabc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:47.066268 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46fd88ce-f404-497e-b75d-a5c9c4b7fabc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:47.066695 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-46fd88ce-f404-497e-b75d-a5c9c4b7fabc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:47.111026 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fd31d411-55f5-4c1b-bb6d-080834c598c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:47.111864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fd31d411-55f5-4c1b-bb6d-080834c598c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:47.118506 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fd31d411-55f5-4c1b-bb6d-080834c598c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:47.118992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fd31d411-55f5-4c1b-bb6d-080834c598c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:47.119454 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fd31d411-55f5-4c1b-bb6d-080834c598c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:47.120176 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fd31d411-55f5-4c1b-bb6d-080834c598c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:47.120628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fd31d411-55f5-4c1b-bb6d-080834c598c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:47.121090 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fd31d411-55f5-4c1b-bb6d-080834c598c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:47.132442 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-46fd88ce-f404-497e-b75d-a5c9c4b7fabc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:47.141115 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-46fd88ce-f404-497e-b75d-a5c9c4b7fabc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.088487 Aug 10 13:04:47.145324 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1645/3269] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:47 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:47.249274 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fd31d411-55f5-4c1b-bb6d-080834c598c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:47.257281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fd31d411-55f5-4c1b-bb6d-080834c598c6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.150171 Aug 10 13:04:47.257855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1625/3270] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:47 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:04:48.161840 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bd333d1f-cbb8-44c1-b73a-63ee9819db30 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:48.162445 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bd333d1f-cbb8-44c1-b73a-63ee9819db30 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:48.169326 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bd333d1f-cbb8-44c1-b73a-63ee9819db30 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:48.169870 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bd333d1f-cbb8-44c1-b73a-63ee9819db30 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:48.170299 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bd333d1f-cbb8-44c1-b73a-63ee9819db30 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:48.170975 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bd333d1f-cbb8-44c1-b73a-63ee9819db30 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:48.171446 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bd333d1f-cbb8-44c1-b73a-63ee9819db30 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:48.171867 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bd333d1f-cbb8-44c1-b73a-63ee9819db30 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:48.233237 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-bd333d1f-cbb8-44c1-b73a-63ee9819db30 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:48.241029 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bd333d1f-cbb8-44c1-b73a-63ee9819db30 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083058 Aug 10 13:04:48.241593 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1646/3271] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:48 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:48.279100 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0ab17a43-4fd5-4395-b6ce-375ec4ad657c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:48.279808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0ab17a43-4fd5-4395-b6ce-375ec4ad657c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 3181426f-eb81-4712-97c6-8c92b61f53a0] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:48.289204 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ab17a43-4fd5-4395-b6ce-375ec4ad657c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:48.289204 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ab17a43-4fd5-4395-b6ce-375ec4ad657c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:48.289204 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ab17a43-4fd5-4395-b6ce-375ec4ad657c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:48.289204 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ab17a43-4fd5-4395-b6ce-375ec4ad657c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:48.290142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ab17a43-4fd5-4395-b6ce-375ec4ad657c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:48.290142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0ab17a43-4fd5-4395-b6ce-375ec4ad657c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:48.421231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0ab17a43-4fd5-4395-b6ce-375ec4ad657c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:48.429137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0ab17a43-4fd5-4395-b6ce-375ec4ad657c tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0" status: 200 len: 1736 microversion: 2.1 time: 0.154029 Aug 10 13:04:48.430817 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1626/3272] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:48 2022] GET /compute/v2.1/servers/3181426f-eb81-4712-97c6-8c92b61f53a0 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:48.450163 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-11025573-a8a2-4473-b131-65108e442031 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '.version_select at 0x7fb82b26c280>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:48.560218 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-11025573-a8a2-4473-b131-65108e442031 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-899395175" status: 202 len: 0 microversion: 2.1 time: 0.113867 Aug 10 13:04:48.560811 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1647/3273] 10.222.0.49 () {58 vars in 1218 bytes} [Wed Aug 10 13:04:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-899395175 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:04:49.262165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1466881e-f219-45fc-90e3-12e2d78c51ec tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:49.262812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1466881e-f219-45fc-90e3-12e2d78c51ec tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:49.269193 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1466881e-f219-45fc-90e3-12e2d78c51ec tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:49.269726 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1466881e-f219-45fc-90e3-12e2d78c51ec tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:49.270162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1466881e-f219-45fc-90e3-12e2d78c51ec tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:49.270863 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1466881e-f219-45fc-90e3-12e2d78c51ec tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:49.271342 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1466881e-f219-45fc-90e3-12e2d78c51ec tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:49.271767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1466881e-f219-45fc-90e3-12e2d78c51ec tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:49.471868 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1466881e-f219-45fc-90e3-12e2d78c51ec tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:49.474068 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:49.480643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1466881e-f219-45fc-90e3-12e2d78c51ec tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.222131 Aug 10 13:04:49.482177 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1627/3274] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:49 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:49.729724 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [req-be8de4f3-6e35-427f-acd7-3e205198d368 req-71e749ca-a4fd-4741-9561-f420f1072d72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3181426f-eb81-4712-97c6-8c92b61f53a0", "tag": "bd12d9c9-bde7-4a2b-92de-b4401e6328ab"}]} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:04:49.741205 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-be8de4f3-6e35-427f-acd7-3e205198d368 req-71e749ca-a4fd-4741-9561-f420f1072d72 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:49.741965 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-be8de4f3-6e35-427f-acd7-3e205198d368 req-71e749ca-a4fd-4741-9561-f420f1072d72 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:49.742392 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-be8de4f3-6e35-427f-acd7-3e205198d368 req-71e749ca-a4fd-4741-9561-f420f1072d72 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:49.753047 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.compute.server_external_events [req-be8de4f3-6e35-427f-acd7-3e205198d368 req-71e749ca-a4fd-4741-9561-f420f1072d72 service nova] Creating event network-changed:bd12d9c9-bde7-4a2b-92de-b4401e6328ab for instance 3181426f-eb81-4712-97c6-8c92b61f53a0 on hv-cinder-85199 Aug 10 13:04:49.758197 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [req-be8de4f3-6e35-427f-acd7-3e205198d368 req-71e749ca-a4fd-4741-9561-f420f1072d72 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032176 Aug 10 13:04:49.758903 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1648/3275] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:04:50.505198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3ac69b22-073e-4339-9822-ed01845056af tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:50.505899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3ac69b22-073e-4339-9822-ed01845056af tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:50.513733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ac69b22-073e-4339-9822-ed01845056af tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:50.513966 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ac69b22-073e-4339-9822-ed01845056af tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:50.514444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ac69b22-073e-4339-9822-ed01845056af tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:50.515197 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ac69b22-073e-4339-9822-ed01845056af tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:50.515695 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ac69b22-073e-4339-9822-ed01845056af tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:50.516259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ac69b22-073e-4339-9822-ed01845056af tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:50.585319 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3ac69b22-073e-4339-9822-ed01845056af tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:50.593837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3ac69b22-073e-4339-9822-ed01845056af tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.093046 Aug 10 13:04:50.594451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1628/3276] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:50 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:04:51.616832 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e29c3574-a569-48cd-bcae-1c0ff2ba8a5d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:51.617537 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e29c3574-a569-48cd-bcae-1c0ff2ba8a5d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:51.624399 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e29c3574-a569-48cd-bcae-1c0ff2ba8a5d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:51.624886 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e29c3574-a569-48cd-bcae-1c0ff2ba8a5d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:51.625321 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e29c3574-a569-48cd-bcae-1c0ff2ba8a5d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:51.626009 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e29c3574-a569-48cd-bcae-1c0ff2ba8a5d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:51.626466 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e29c3574-a569-48cd-bcae-1c0ff2ba8a5d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:51.626890 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e29c3574-a569-48cd-bcae-1c0ff2ba8a5d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:51.695747 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e29c3574-a569-48cd-bcae-1c0ff2ba8a5d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:51.704317 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e29c3574-a569-48cd-bcae-1c0ff2ba8a5d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.092220 Aug 10 13:04:51.704927 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1649/3277] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:51 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:52.725900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e673326c-b771-429f-a8a9-f07bf46bab14 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:52.726447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e673326c-b771-429f-a8a9-f07bf46bab14 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:52.733454 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e673326c-b771-429f-a8a9-f07bf46bab14 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:52.733926 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e673326c-b771-429f-a8a9-f07bf46bab14 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:52.734357 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e673326c-b771-429f-a8a9-f07bf46bab14 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:52.735056 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e673326c-b771-429f-a8a9-f07bf46bab14 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:52.735516 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e673326c-b771-429f-a8a9-f07bf46bab14 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:52.735936 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e673326c-b771-429f-a8a9-f07bf46bab14 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:52.800719 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e673326c-b771-429f-a8a9-f07bf46bab14 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:52.808597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e673326c-b771-429f-a8a9-f07bf46bab14 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.086600 Aug 10 13:04:52.809222 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1629/3278] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:52 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:04:53.829512 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-71d82480-af2f-49b7-af83-7f5ad254a5ba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:53.830117 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-71d82480-af2f-49b7-af83-7f5ad254a5ba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:53.836414 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-71d82480-af2f-49b7-af83-7f5ad254a5ba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:53.836888 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-71d82480-af2f-49b7-af83-7f5ad254a5ba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:53.837319 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-71d82480-af2f-49b7-af83-7f5ad254a5ba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:53.838003 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-71d82480-af2f-49b7-af83-7f5ad254a5ba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:53.838451 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-71d82480-af2f-49b7-af83-7f5ad254a5ba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:53.839026 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-71d82480-af2f-49b7-af83-7f5ad254a5ba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:53.902014 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-71d82480-af2f-49b7-af83-7f5ad254a5ba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:53.910547 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-71d82480-af2f-49b7-af83-7f5ad254a5ba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084982 Aug 10 13:04:53.911107 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1650/3279] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:53 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:54.932055 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bd2260b8-5997-4364-a118-e345a4b5f9cc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:54.932681 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bd2260b8-5997-4364-a118-e345a4b5f9cc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:54.935085 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=60 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:04:54.939770 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd2260b8-5997-4364-a118-e345a4b5f9cc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:54.940250 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd2260b8-5997-4364-a118-e345a4b5f9cc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:54.940685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd2260b8-5997-4364-a118-e345a4b5f9cc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:54.941371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd2260b8-5997-4364-a118-e345a4b5f9cc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:54.941819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd2260b8-5997-4364-a118-e345a4b5f9cc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:54.942243 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd2260b8-5997-4364-a118-e345a4b5f9cc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:55.004448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-bd2260b8-5997-4364-a118-e345a4b5f9cc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:55.012305 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bd2260b8-5997-4364-a118-e345a4b5f9cc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084117 Aug 10 13:04:55.013862 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1630/3280] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:54 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:56.034434 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3c928f0b-ed9f-498d-93ab-6b41a193a2be tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:56.035034 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3c928f0b-ed9f-498d-93ab-6b41a193a2be tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:56.041587 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3c928f0b-ed9f-498d-93ab-6b41a193a2be tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:56.042062 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3c928f0b-ed9f-498d-93ab-6b41a193a2be tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:56.042496 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3c928f0b-ed9f-498d-93ab-6b41a193a2be tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:56.043168 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3c928f0b-ed9f-498d-93ab-6b41a193a2be tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:56.043672 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3c928f0b-ed9f-498d-93ab-6b41a193a2be tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:56.044925 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3c928f0b-ed9f-498d-93ab-6b41a193a2be tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:56.104774 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3c928f0b-ed9f-498d-93ab-6b41a193a2be tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:56.113515 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3c928f0b-ed9f-498d-93ab-6b41a193a2be tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082958 Aug 10 13:04:56.114076 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1651/3281] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:56 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:57.134285 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-49f9314b-25b9-42a6-b9cf-5b3ffeb29c06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:57.134948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-49f9314b-25b9-42a6-b9cf-5b3ffeb29c06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:57.141681 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49f9314b-25b9-42a6-b9cf-5b3ffeb29c06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:57.142161 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49f9314b-25b9-42a6-b9cf-5b3ffeb29c06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:57.142595 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49f9314b-25b9-42a6-b9cf-5b3ffeb29c06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:57.143329 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49f9314b-25b9-42a6-b9cf-5b3ffeb29c06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:57.143784 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49f9314b-25b9-42a6-b9cf-5b3ffeb29c06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:57.144209 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49f9314b-25b9-42a6-b9cf-5b3ffeb29c06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:57.207447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-49f9314b-25b9-42a6-b9cf-5b3ffeb29c06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:57.215288 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-49f9314b-25b9-42a6-b9cf-5b3ffeb29c06 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084847 Aug 10 13:04:57.215945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1631/3282] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:57 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:58.237324 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e53c38b6-9d3f-4317-be22-da14d287e53c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:58.237921 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e53c38b6-9d3f-4317-be22-da14d287e53c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:58.244388 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e53c38b6-9d3f-4317-be22-da14d287e53c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:58.244883 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e53c38b6-9d3f-4317-be22-da14d287e53c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:58.245322 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e53c38b6-9d3f-4317-be22-da14d287e53c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:58.246017 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e53c38b6-9d3f-4317-be22-da14d287e53c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:58.246474 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e53c38b6-9d3f-4317-be22-da14d287e53c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:58.246914 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e53c38b6-9d3f-4317-be22-da14d287e53c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:58.311272 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e53c38b6-9d3f-4317-be22-da14d287e53c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:58.319109 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e53c38b6-9d3f-4317-be22-da14d287e53c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.085729 Aug 10 13:04:58.319705 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1652/3283] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:58 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:04:59.339947 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-19451ee8-ee85-478d-9924-7bbd0b5e27a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:04:59.340559 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-19451ee8-ee85-478d-9924-7bbd0b5e27a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:04:59.347478 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19451ee8-ee85-478d-9924-7bbd0b5e27a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:59.347958 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19451ee8-ee85-478d-9924-7bbd0b5e27a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:59.348394 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19451ee8-ee85-478d-9924-7bbd0b5e27a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:59.349081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19451ee8-ee85-478d-9924-7bbd0b5e27a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:04:59.349531 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19451ee8-ee85-478d-9924-7bbd0b5e27a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:04:59.349958 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19451ee8-ee85-478d-9924-7bbd0b5e27a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:04:59.410824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-19451ee8-ee85-478d-9924-7bbd0b5e27a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:04:59.418655 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-19451ee8-ee85-478d-9924-7bbd0b5e27a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082632 Aug 10 13:04:59.419932 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1632/3284] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:04:59 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:00.440493 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-f18e46a1-cc47-4e08-8fab-34361f12248d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:00.441140 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-f18e46a1-cc47-4e08-8fab-34361f12248d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:00.447651 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f18e46a1-cc47-4e08-8fab-34361f12248d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:00.448140 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f18e46a1-cc47-4e08-8fab-34361f12248d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:00.448576 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f18e46a1-cc47-4e08-8fab-34361f12248d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:00.449268 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f18e46a1-cc47-4e08-8fab-34361f12248d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:00.449721 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f18e46a1-cc47-4e08-8fab-34361f12248d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:00.450181 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-f18e46a1-cc47-4e08-8fab-34361f12248d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:00.511301 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-f18e46a1-cc47-4e08-8fab-34361f12248d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:00.519216 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-f18e46a1-cc47-4e08-8fab-34361f12248d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082595 Aug 10 13:05:00.519796 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1653/3285] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:00 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:01.540575 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a7144173-95cf-4653-910c-fd44c5dbc661 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:01.541122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a7144173-95cf-4653-910c-fd44c5dbc661 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:01.548376 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a7144173-95cf-4653-910c-fd44c5dbc661 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:01.548863 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a7144173-95cf-4653-910c-fd44c5dbc661 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:01.549299 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a7144173-95cf-4653-910c-fd44c5dbc661 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:01.549985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a7144173-95cf-4653-910c-fd44c5dbc661 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:01.550437 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a7144173-95cf-4653-910c-fd44c5dbc661 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:01.550861 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a7144173-95cf-4653-910c-fd44c5dbc661 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:01.616127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a7144173-95cf-4653-910c-fd44c5dbc661 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:01.624097 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a7144173-95cf-4653-910c-fd44c5dbc661 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.087363 Aug 10 13:05:01.624665 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1633/3286] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:01 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:02.644806 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-83673809-4b5e-4298-ba72-506e2f5f2351 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:02.645379 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-83673809-4b5e-4298-ba72-506e2f5f2351 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:02.651779 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83673809-4b5e-4298-ba72-506e2f5f2351 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:02.652257 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83673809-4b5e-4298-ba72-506e2f5f2351 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:02.652687 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83673809-4b5e-4298-ba72-506e2f5f2351 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:02.654237 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83673809-4b5e-4298-ba72-506e2f5f2351 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:02.654689 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83673809-4b5e-4298-ba72-506e2f5f2351 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:02.655113 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83673809-4b5e-4298-ba72-506e2f5f2351 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:02.714729 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-83673809-4b5e-4298-ba72-506e2f5f2351 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:02.723136 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-83673809-4b5e-4298-ba72-506e2f5f2351 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082307 Aug 10 13:05:02.723731 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1654/3287] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:02 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:03.744233 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d251cc96-4158-4165-b661-f130553f2ab7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:03.744786 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d251cc96-4158-4165-b661-f130553f2ab7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:03.751586 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d251cc96-4158-4165-b661-f130553f2ab7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:03.752062 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d251cc96-4158-4165-b661-f130553f2ab7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:03.752493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d251cc96-4158-4165-b661-f130553f2ab7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:03.753164 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d251cc96-4158-4165-b661-f130553f2ab7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:03.753636 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d251cc96-4158-4165-b661-f130553f2ab7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:03.754053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d251cc96-4158-4165-b661-f130553f2ab7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:03.816179 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d251cc96-4158-4165-b661-f130553f2ab7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:03.823956 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d251cc96-4158-4165-b661-f130553f2ab7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083634 Aug 10 13:05:03.824547 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1634/3288] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:03 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:05:03.906200 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c09c02e7-c010-490f-b8ef-60d0a2bd9dd9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:03.906745 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c09c02e7-c010-490f-b8ef-60d0a2bd9dd9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d18ee67-6285-4877-ae40-c30da937c050] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:03.913075 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c09c02e7-c010-490f-b8ef-60d0a2bd9dd9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:03.913545 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c09c02e7-c010-490f-b8ef-60d0a2bd9dd9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:03.913981 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c09c02e7-c010-490f-b8ef-60d0a2bd9dd9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:03.914665 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c09c02e7-c010-490f-b8ef-60d0a2bd9dd9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:03.915114 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c09c02e7-c010-490f-b8ef-60d0a2bd9dd9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:03.915564 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c09c02e7-c010-490f-b8ef-60d0a2bd9dd9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:03.939715 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c09c02e7-c010-490f-b8ef-60d0a2bd9dd9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050/ips" status: 200 len: 150 microversion: 2.1 time: 0.037857 Aug 10 13:05:03.940275 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1655/3289] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 10 13:05:03 2022] GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:05:04.846570 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-80e2183f-eea4-4d09-8d85-2b264eda58c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:04.847191 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-80e2183f-eea4-4d09-8d85-2b264eda58c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:04.853428 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80e2183f-eea4-4d09-8d85-2b264eda58c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:04.853902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80e2183f-eea4-4d09-8d85-2b264eda58c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:04.854340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80e2183f-eea4-4d09-8d85-2b264eda58c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:04.855010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80e2183f-eea4-4d09-8d85-2b264eda58c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:04.855744 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80e2183f-eea4-4d09-8d85-2b264eda58c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:04.856165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-80e2183f-eea4-4d09-8d85-2b264eda58c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:04.917263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-80e2183f-eea4-4d09-8d85-2b264eda58c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:04.925565 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-80e2183f-eea4-4d09-8d85-2b264eda58c9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082843 Aug 10 13:05:04.926122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1635/3290] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:04 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:05.946542 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0d2eff05-5527-45d4-8900-7cfad4f14446 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:05.947197 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0d2eff05-5527-45d4-8900-7cfad4f14446 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:05.953759 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0d2eff05-5527-45d4-8900-7cfad4f14446 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:05.954238 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0d2eff05-5527-45d4-8900-7cfad4f14446 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:05.954670 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0d2eff05-5527-45d4-8900-7cfad4f14446 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:05.955390 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0d2eff05-5527-45d4-8900-7cfad4f14446 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:05.955839 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0d2eff05-5527-45d4-8900-7cfad4f14446 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:05.956262 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0d2eff05-5527-45d4-8900-7cfad4f14446 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:06.019322 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0d2eff05-5527-45d4-8900-7cfad4f14446 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:06.027110 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0d2eff05-5527-45d4-8900-7cfad4f14446 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084498 Aug 10 13:05:06.027717 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1656/3291] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:05 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:07.049038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4aa98666-d17a-41bb-989c-940dc67770bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:07.049644 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4aa98666-d17a-41bb-989c-940dc67770bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:07.055956 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4aa98666-d17a-41bb-989c-940dc67770bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:07.056433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4aa98666-d17a-41bb-989c-940dc67770bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:07.056861 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4aa98666-d17a-41bb-989c-940dc67770bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:07.057539 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4aa98666-d17a-41bb-989c-940dc67770bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:07.057986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4aa98666-d17a-41bb-989c-940dc67770bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:07.058403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4aa98666-d17a-41bb-989c-940dc67770bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:07.119286 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4aa98666-d17a-41bb-989c-940dc67770bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:07.128382 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4aa98666-d17a-41bb-989c-940dc67770bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083890 Aug 10 13:05:07.128947 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1636/3292] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:07 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:08.149125 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-5855e3a9-f2fc-4d67-b0e9-df196aa333b5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:08.149794 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-5855e3a9-f2fc-4d67-b0e9-df196aa333b5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:08.156324 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5855e3a9-f2fc-4d67-b0e9-df196aa333b5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:08.156831 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5855e3a9-f2fc-4d67-b0e9-df196aa333b5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:08.157267 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5855e3a9-f2fc-4d67-b0e9-df196aa333b5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:08.157952 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5855e3a9-f2fc-4d67-b0e9-df196aa333b5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:08.158404 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5855e3a9-f2fc-4d67-b0e9-df196aa333b5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:08.158828 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-5855e3a9-f2fc-4d67-b0e9-df196aa333b5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:08.219376 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-5855e3a9-f2fc-4d67-b0e9-df196aa333b5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:08.227348 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-5855e3a9-f2fc-4d67-b0e9-df196aa333b5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082112 Aug 10 13:05:08.227912 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1657/3293] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:08 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:05:09.247659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4cda1726-7d4d-4158-bc8e-978799e62070 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:09.248255 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4cda1726-7d4d-4158-bc8e-978799e62070 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:09.254757 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4cda1726-7d4d-4158-bc8e-978799e62070 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:09.255277 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4cda1726-7d4d-4158-bc8e-978799e62070 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:09.255722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4cda1726-7d4d-4158-bc8e-978799e62070 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:09.256433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4cda1726-7d4d-4158-bc8e-978799e62070 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:09.256869 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4cda1726-7d4d-4158-bc8e-978799e62070 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:09.257294 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4cda1726-7d4d-4158-bc8e-978799e62070 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:09.320204 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4cda1726-7d4d-4158-bc8e-978799e62070 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:09.328796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4cda1726-7d4d-4158-bc8e-978799e62070 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.085084 Aug 10 13:05:09.329361 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1637/3294] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:09 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:10.352693 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a809191f-aa79-4736-a484-4207c1004ef9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:10.353813 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a809191f-aa79-4736-a484-4207c1004ef9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:10.358433 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:10.364270 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a809191f-aa79-4736-a484-4207c1004ef9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:10.369308 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a809191f-aa79-4736-a484-4207c1004ef9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:10.369308 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a809191f-aa79-4736-a484-4207c1004ef9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:10.369308 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a809191f-aa79-4736-a484-4207c1004ef9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:10.369308 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a809191f-aa79-4736-a484-4207c1004ef9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:10.369767 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a809191f-aa79-4736-a484-4207c1004ef9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:10.432797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a809191f-aa79-4736-a484-4207c1004ef9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:10.440589 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a809191f-aa79-4736-a484-4207c1004ef9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.094240 Aug 10 13:05:10.441156 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1658/3295] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:10 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:05:11.461886 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-cdd3e743-b05e-4532-b0a1-826089598778 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:11.462552 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-cdd3e743-b05e-4532-b0a1-826089598778 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:11.469096 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cdd3e743-b05e-4532-b0a1-826089598778 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:11.469584 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cdd3e743-b05e-4532-b0a1-826089598778 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:11.470024 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cdd3e743-b05e-4532-b0a1-826089598778 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:11.470719 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cdd3e743-b05e-4532-b0a1-826089598778 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:11.471187 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cdd3e743-b05e-4532-b0a1-826089598778 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:11.471623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cdd3e743-b05e-4532-b0a1-826089598778 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:11.553981 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-cdd3e743-b05e-4532-b0a1-826089598778 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:11.562503 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-cdd3e743-b05e-4532-b0a1-826089598778 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.104518 Aug 10 13:05:11.563075 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1638/3296] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:11 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:12.583635 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-7a36503c-7aa2-4588-a33e-3d05a6c2bf17 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:12.584195 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-7a36503c-7aa2-4588-a33e-3d05a6c2bf17 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:12.590616 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7a36503c-7aa2-4588-a33e-3d05a6c2bf17 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:12.591090 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7a36503c-7aa2-4588-a33e-3d05a6c2bf17 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:12.592457 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7a36503c-7aa2-4588-a33e-3d05a6c2bf17 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:12.593214 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7a36503c-7aa2-4588-a33e-3d05a6c2bf17 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:12.593664 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7a36503c-7aa2-4588-a33e-3d05a6c2bf17 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:12.594082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-7a36503c-7aa2-4588-a33e-3d05a6c2bf17 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:12.656034 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-7a36503c-7aa2-4588-a33e-3d05a6c2bf17 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:12.663837 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-7a36503c-7aa2-4588-a33e-3d05a6c2bf17 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084135 Aug 10 13:05:12.664399 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1659/3297] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:12 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:13.685572 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b63b0a30-7d5b-4587-badf-af58646ccd4a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:13.686125 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b63b0a30-7d5b-4587-badf-af58646ccd4a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:13.693164 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b63b0a30-7d5b-4587-badf-af58646ccd4a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:13.693718 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b63b0a30-7d5b-4587-badf-af58646ccd4a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:13.694126 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b63b0a30-7d5b-4587-badf-af58646ccd4a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:13.694809 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b63b0a30-7d5b-4587-badf-af58646ccd4a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:13.695310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b63b0a30-7d5b-4587-badf-af58646ccd4a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:13.695734 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b63b0a30-7d5b-4587-badf-af58646ccd4a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:13.759488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b63b0a30-7d5b-4587-badf-af58646ccd4a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:13.767401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b63b0a30-7d5b-4587-badf-af58646ccd4a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.085748 Aug 10 13:05:13.767967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1639/3298] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:13 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:14.788629 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-fe56c81f-c7fb-446d-93e7-746352f23b2c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:14.789288 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-fe56c81f-c7fb-446d-93e7-746352f23b2c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:14.796883 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe56c81f-c7fb-446d-93e7-746352f23b2c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:14.797370 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe56c81f-c7fb-446d-93e7-746352f23b2c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:14.797808 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe56c81f-c7fb-446d-93e7-746352f23b2c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:14.798507 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe56c81f-c7fb-446d-93e7-746352f23b2c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:14.798972 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe56c81f-c7fb-446d-93e7-746352f23b2c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:14.799436 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-fe56c81f-c7fb-446d-93e7-746352f23b2c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:14.864448 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-fe56c81f-c7fb-446d-93e7-746352f23b2c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:14.866635 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=96 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:14.873655 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-fe56c81f-c7fb-446d-93e7-746352f23b2c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.088939 Aug 10 13:05:14.874216 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1660/3299] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:14 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:15.894914 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-cd2b1eb0-1db4-49cd-80ba-fc2053243af0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:15.895531 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-cd2b1eb0-1db4-49cd-80ba-fc2053243af0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:15.901893 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd2b1eb0-1db4-49cd-80ba-fc2053243af0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:15.902378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd2b1eb0-1db4-49cd-80ba-fc2053243af0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:15.902815 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd2b1eb0-1db4-49cd-80ba-fc2053243af0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:15.903534 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd2b1eb0-1db4-49cd-80ba-fc2053243af0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:15.904785 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd2b1eb0-1db4-49cd-80ba-fc2053243af0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:15.905217 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd2b1eb0-1db4-49cd-80ba-fc2053243af0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:15.964675 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-cd2b1eb0-1db4-49cd-80ba-fc2053243af0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:15.973324 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-cd2b1eb0-1db4-49cd-80ba-fc2053243af0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082253 Aug 10 13:05:15.973883 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1640/3300] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:15 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:16.993981 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-a94e4bc9-a913-488b-891e-1dd217252c2d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:16.994530 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-a94e4bc9-a913-488b-891e-1dd217252c2d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:17.001833 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a94e4bc9-a913-488b-891e-1dd217252c2d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:17.002321 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a94e4bc9-a913-488b-891e-1dd217252c2d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:17.002759 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a94e4bc9-a913-488b-891e-1dd217252c2d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:17.003484 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a94e4bc9-a913-488b-891e-1dd217252c2d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:17.003934 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a94e4bc9-a913-488b-891e-1dd217252c2d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:17.004369 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-a94e4bc9-a913-488b-891e-1dd217252c2d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:17.065374 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-a94e4bc9-a913-488b-891e-1dd217252c2d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:17.073137 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-a94e4bc9-a913-488b-891e-1dd217252c2d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083169 Aug 10 13:05:17.073699 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1661/3301] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:16 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:18.095408 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-df887c12-34d6-42ec-a3e5-8f43ea526c81 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:18.096052 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-df887c12-34d6-42ec-a3e5-8f43ea526c81 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:18.102716 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-df887c12-34d6-42ec-a3e5-8f43ea526c81 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:18.103222 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-df887c12-34d6-42ec-a3e5-8f43ea526c81 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:18.103659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-df887c12-34d6-42ec-a3e5-8f43ea526c81 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:18.104339 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-df887c12-34d6-42ec-a3e5-8f43ea526c81 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:18.104788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-df887c12-34d6-42ec-a3e5-8f43ea526c81 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:18.105205 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-df887c12-34d6-42ec-a3e5-8f43ea526c81 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:18.167024 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-df887c12-34d6-42ec-a3e5-8f43ea526c81 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:18.174978 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-df887c12-34d6-42ec-a3e5-8f43ea526c81 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083965 Aug 10 13:05:18.175555 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1641/3302] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:18 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:19.196888 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-491f16ce-1ea3-48be-a3ed-88b0b2a4bba0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:19.197762 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-491f16ce-1ea3-48be-a3ed-88b0b2a4bba0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:19.206524 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-491f16ce-1ea3-48be-a3ed-88b0b2a4bba0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:19.207074 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-491f16ce-1ea3-48be-a3ed-88b0b2a4bba0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:19.207548 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-491f16ce-1ea3-48be-a3ed-88b0b2a4bba0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:19.208263 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-491f16ce-1ea3-48be-a3ed-88b0b2a4bba0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:19.208720 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-491f16ce-1ea3-48be-a3ed-88b0b2a4bba0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:19.209146 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-491f16ce-1ea3-48be-a3ed-88b0b2a4bba0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:19.273743 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-491f16ce-1ea3-48be-a3ed-88b0b2a4bba0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:19.283297 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-491f16ce-1ea3-48be-a3ed-88b0b2a4bba0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.091987 Aug 10 13:05:19.283879 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1662/3303] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:19 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:20.304528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0cd046ba-1da5-4d89-947f-b62ed9cea5a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:20.310616 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0cd046ba-1da5-4d89-947f-b62ed9cea5a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:20.311790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0cd046ba-1da5-4d89-947f-b62ed9cea5a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:20.312279 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0cd046ba-1da5-4d89-947f-b62ed9cea5a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:20.312716 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0cd046ba-1da5-4d89-947f-b62ed9cea5a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:20.313415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0cd046ba-1da5-4d89-947f-b62ed9cea5a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:20.313869 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0cd046ba-1da5-4d89-947f-b62ed9cea5a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:20.314297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0cd046ba-1da5-4d89-947f-b62ed9cea5a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:20.394002 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0cd046ba-1da5-4d89-947f-b62ed9cea5a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:20.410251 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0cd046ba-1da5-4d89-947f-b62ed9cea5a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.109562 Aug 10 13:05:20.411679 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1642/3304] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:20 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:21.432163 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-32951af3-9572-48f1-a108-1cc906da106c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:21.432764 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-32951af3-9572-48f1-a108-1cc906da106c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:21.439500 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-32951af3-9572-48f1-a108-1cc906da106c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:21.439982 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-32951af3-9572-48f1-a108-1cc906da106c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:21.440419 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-32951af3-9572-48f1-a108-1cc906da106c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:21.441108 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-32951af3-9572-48f1-a108-1cc906da106c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:21.441559 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-32951af3-9572-48f1-a108-1cc906da106c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:21.441980 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-32951af3-9572-48f1-a108-1cc906da106c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:21.507695 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-32951af3-9572-48f1-a108-1cc906da106c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:21.516355 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-32951af3-9572-48f1-a108-1cc906da106c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.088058 Aug 10 13:05:21.516980 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1663/3305] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:21 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:22.537416 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f37ff810-7394-4cdd-a2f5-397d9915d357 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:22.538033 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f37ff810-7394-4cdd-a2f5-397d9915d357 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:22.545421 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f37ff810-7394-4cdd-a2f5-397d9915d357 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:22.545944 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f37ff810-7394-4cdd-a2f5-397d9915d357 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:22.546375 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f37ff810-7394-4cdd-a2f5-397d9915d357 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:22.547065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f37ff810-7394-4cdd-a2f5-397d9915d357 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:22.547553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f37ff810-7394-4cdd-a2f5-397d9915d357 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:22.547980 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f37ff810-7394-4cdd-a2f5-397d9915d357 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:22.551904 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=92 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:22.609448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f37ff810-7394-4cdd-a2f5-397d9915d357 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:22.617346 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f37ff810-7394-4cdd-a2f5-397d9915d357 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083878 Aug 10 13:05:22.617914 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1643/3306] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:22 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:23.638223 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-8083eeb5-cdd1-4c9e-bc1e-d01bf1ded3a5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:23.638764 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-8083eeb5-cdd1-4c9e-bc1e-d01bf1ded3a5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:23.645284 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8083eeb5-cdd1-4c9e-bc1e-d01bf1ded3a5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:23.645762 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8083eeb5-cdd1-4c9e-bc1e-d01bf1ded3a5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:23.646202 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8083eeb5-cdd1-4c9e-bc1e-d01bf1ded3a5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:23.646945 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8083eeb5-cdd1-4c9e-bc1e-d01bf1ded3a5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:23.647425 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8083eeb5-cdd1-4c9e-bc1e-d01bf1ded3a5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:23.647849 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-8083eeb5-cdd1-4c9e-bc1e-d01bf1ded3a5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:23.711864 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-8083eeb5-cdd1-4c9e-bc1e-d01bf1ded3a5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:23.720365 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-8083eeb5-cdd1-4c9e-bc1e-d01bf1ded3a5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.086099 Aug 10 13:05:23.723835 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1664/3307] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:23 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:24.742133 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e5c78129-4219-4038-a67f-4227a8f0ed3e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:24.742697 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e5c78129-4219-4038-a67f-4227a8f0ed3e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:24.749065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e5c78129-4219-4038-a67f-4227a8f0ed3e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:24.749546 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e5c78129-4219-4038-a67f-4227a8f0ed3e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:24.749984 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e5c78129-4219-4038-a67f-4227a8f0ed3e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:24.750673 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e5c78129-4219-4038-a67f-4227a8f0ed3e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:24.751125 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e5c78129-4219-4038-a67f-4227a8f0ed3e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:24.751575 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e5c78129-4219-4038-a67f-4227a8f0ed3e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:24.812656 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e5c78129-4219-4038-a67f-4227a8f0ed3e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:24.820476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e5c78129-4219-4038-a67f-4227a8f0ed3e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082315 Aug 10 13:05:24.821031 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1644/3308] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:24 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:25.842021 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-81679307-3f82-45d6-976a-f7f023e2b234 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:25.842803 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-81679307-3f82-45d6-976a-f7f023e2b234 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:25.848957 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-81679307-3f82-45d6-976a-f7f023e2b234 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:25.849432 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-81679307-3f82-45d6-976a-f7f023e2b234 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:25.849856 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-81679307-3f82-45d6-976a-f7f023e2b234 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:25.850528 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-81679307-3f82-45d6-976a-f7f023e2b234 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:25.851101 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-81679307-3f82-45d6-976a-f7f023e2b234 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:25.851410 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-81679307-3f82-45d6-976a-f7f023e2b234 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:25.914659 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-81679307-3f82-45d6-976a-f7f023e2b234 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:25.923204 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-81679307-3f82-45d6-976a-f7f023e2b234 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084988 Aug 10 13:05:25.923766 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1665/3309] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:25 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:26.944712 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7f082604-4018-4bb4-bdd8-975f2af1e5fc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:26.945316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7f082604-4018-4bb4-bdd8-975f2af1e5fc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:26.947611 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=30 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:26.952247 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f082604-4018-4bb4-bdd8-975f2af1e5fc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:26.952752 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f082604-4018-4bb4-bdd8-975f2af1e5fc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:26.953194 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f082604-4018-4bb4-bdd8-975f2af1e5fc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:26.953879 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f082604-4018-4bb4-bdd8-975f2af1e5fc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:26.954333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f082604-4018-4bb4-bdd8-975f2af1e5fc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:26.954777 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f082604-4018-4bb4-bdd8-975f2af1e5fc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:27.016664 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7f082604-4018-4bb4-bdd8-975f2af1e5fc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:27.024381 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7f082604-4018-4bb4-bdd8-975f2af1e5fc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083560 Aug 10 13:05:27.024951 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1645/3310] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:26 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:28.045680 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ca93d12c-aa9a-4d92-8d32-57a4357070b4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:28.046445 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ca93d12c-aa9a-4d92-8d32-57a4357070b4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:28.052558 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca93d12c-aa9a-4d92-8d32-57a4357070b4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:28.053085 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca93d12c-aa9a-4d92-8d32-57a4357070b4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:28.053521 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca93d12c-aa9a-4d92-8d32-57a4357070b4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:28.054209 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca93d12c-aa9a-4d92-8d32-57a4357070b4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:28.054665 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca93d12c-aa9a-4d92-8d32-57a4357070b4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:28.055088 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ca93d12c-aa9a-4d92-8d32-57a4357070b4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:28.115492 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ca93d12c-aa9a-4d92-8d32-57a4357070b4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:28.123372 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ca93d12c-aa9a-4d92-8d32-57a4357070b4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.081664 Aug 10 13:05:28.124157 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1666/3311] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:28 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:29.144389 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2baa4e61-6b93-4034-bfbe-0c7497d72edd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:29.144989 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2baa4e61-6b93-4034-bfbe-0c7497d72edd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:29.151446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2baa4e61-6b93-4034-bfbe-0c7497d72edd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:29.151928 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2baa4e61-6b93-4034-bfbe-0c7497d72edd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:29.152360 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2baa4e61-6b93-4034-bfbe-0c7497d72edd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:29.153044 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2baa4e61-6b93-4034-bfbe-0c7497d72edd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:29.153496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2baa4e61-6b93-4034-bfbe-0c7497d72edd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:29.153920 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2baa4e61-6b93-4034-bfbe-0c7497d72edd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:29.216181 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2baa4e61-6b93-4034-bfbe-0c7497d72edd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:29.224604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2baa4e61-6b93-4034-bfbe-0c7497d72edd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084083 Aug 10 13:05:29.225174 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1646/3312] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:29 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:30.245815 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9ab272c7-598e-4f11-a06d-c3da90b9242d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:30.246433 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9ab272c7-598e-4f11-a06d-c3da90b9242d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:30.252864 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ab272c7-598e-4f11-a06d-c3da90b9242d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:30.253344 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ab272c7-598e-4f11-a06d-c3da90b9242d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:30.253778 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ab272c7-598e-4f11-a06d-c3da90b9242d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:30.254461 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ab272c7-598e-4f11-a06d-c3da90b9242d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:30.254912 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ab272c7-598e-4f11-a06d-c3da90b9242d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:30.255372 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ab272c7-598e-4f11-a06d-c3da90b9242d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:30.319158 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9ab272c7-598e-4f11-a06d-c3da90b9242d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:30.327972 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9ab272c7-598e-4f11-a06d-c3da90b9242d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.085084 Aug 10 13:05:30.328549 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1667/3313] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:30 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:31.348945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-27a02509-71a3-4e99-9588-c7f1ea0d793b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:31.349555 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-27a02509-71a3-4e99-9588-c7f1ea0d793b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:31.356392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27a02509-71a3-4e99-9588-c7f1ea0d793b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:31.360081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27a02509-71a3-4e99-9588-c7f1ea0d793b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:31.360081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27a02509-71a3-4e99-9588-c7f1ea0d793b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:31.360081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27a02509-71a3-4e99-9588-c7f1ea0d793b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:31.360081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27a02509-71a3-4e99-9588-c7f1ea0d793b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:31.360495 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27a02509-71a3-4e99-9588-c7f1ea0d793b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:31.419051 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-27a02509-71a3-4e99-9588-c7f1ea0d793b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:31.427460 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-27a02509-71a3-4e99-9588-c7f1ea0d793b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082349 Aug 10 13:05:31.428018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1647/3314] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:31 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:32.448429 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-4bca4f57-cc6e-4c63-b313-a2eb51a81316 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:32.449023 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-4bca4f57-cc6e-4c63-b313-a2eb51a81316 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:32.455577 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bca4f57-cc6e-4c63-b313-a2eb51a81316 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:32.456058 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bca4f57-cc6e-4c63-b313-a2eb51a81316 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:32.456490 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bca4f57-cc6e-4c63-b313-a2eb51a81316 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:32.457177 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bca4f57-cc6e-4c63-b313-a2eb51a81316 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:32.457657 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bca4f57-cc6e-4c63-b313-a2eb51a81316 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:32.458082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-4bca4f57-cc6e-4c63-b313-a2eb51a81316 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:32.518920 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-4bca4f57-cc6e-4c63-b313-a2eb51a81316 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:32.526731 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-4bca4f57-cc6e-4c63-b313-a2eb51a81316 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082181 Aug 10 13:05:32.527320 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1668/3315] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:32 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:33.548972 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a8cff93c-93a2-41d8-96f1-1a79ea3ad36d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:33.549508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a8cff93c-93a2-41d8-96f1-1a79ea3ad36d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:33.555838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a8cff93c-93a2-41d8-96f1-1a79ea3ad36d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:33.556319 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a8cff93c-93a2-41d8-96f1-1a79ea3ad36d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:33.556759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a8cff93c-93a2-41d8-96f1-1a79ea3ad36d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:33.557441 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a8cff93c-93a2-41d8-96f1-1a79ea3ad36d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:33.557890 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a8cff93c-93a2-41d8-96f1-1a79ea3ad36d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:33.558310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a8cff93c-93a2-41d8-96f1-1a79ea3ad36d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:33.619218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a8cff93c-93a2-41d8-96f1-1a79ea3ad36d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:33.627248 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a8cff93c-93a2-41d8-96f1-1a79ea3ad36d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083131 Aug 10 13:05:33.627810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1648/3316] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:33 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:34.647868 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2cae9554-95ce-42c7-ab65-aee640f25d74 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:34.648426 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2cae9554-95ce-42c7-ab65-aee640f25d74 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:34.655492 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2cae9554-95ce-42c7-ab65-aee640f25d74 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:34.655982 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2cae9554-95ce-42c7-ab65-aee640f25d74 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:34.656413 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2cae9554-95ce-42c7-ab65-aee640f25d74 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:34.657098 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2cae9554-95ce-42c7-ab65-aee640f25d74 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:34.657548 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2cae9554-95ce-42c7-ab65-aee640f25d74 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:34.657969 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2cae9554-95ce-42c7-ab65-aee640f25d74 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:34.721127 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2cae9554-95ce-42c7-ab65-aee640f25d74 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:34.729041 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2cae9554-95ce-42c7-ab65-aee640f25d74 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.085163 Aug 10 13:05:34.729611 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1669/3317] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:34 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:35.750073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-63a5743c-2711-4d81-aa38-00a22bd345a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:35.750686 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-63a5743c-2711-4d81-aa38-00a22bd345a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:35.757082 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-63a5743c-2711-4d81-aa38-00a22bd345a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:35.757561 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-63a5743c-2711-4d81-aa38-00a22bd345a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:35.757996 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-63a5743c-2711-4d81-aa38-00a22bd345a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:35.758683 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-63a5743c-2711-4d81-aa38-00a22bd345a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:35.759133 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-63a5743c-2711-4d81-aa38-00a22bd345a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:35.759581 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-63a5743c-2711-4d81-aa38-00a22bd345a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:35.821000 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-63a5743c-2711-4d81-aa38-00a22bd345a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:35.829263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-63a5743c-2711-4d81-aa38-00a22bd345a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083095 Aug 10 13:05:35.829854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1649/3318] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:35 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:36.849902 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-83b16394-dc08-42f2-9475-e2ddd288b772 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:36.850502 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-83b16394-dc08-42f2-9475-e2ddd288b772 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:36.857055 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83b16394-dc08-42f2-9475-e2ddd288b772 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:36.857530 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83b16394-dc08-42f2-9475-e2ddd288b772 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:36.858584 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83b16394-dc08-42f2-9475-e2ddd288b772 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:36.859373 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83b16394-dc08-42f2-9475-e2ddd288b772 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:36.859823 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83b16394-dc08-42f2-9475-e2ddd288b772 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:36.860245 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-83b16394-dc08-42f2-9475-e2ddd288b772 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:36.919132 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-83b16394-dc08-42f2-9475-e2ddd288b772 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:36.927488 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-83b16394-dc08-42f2-9475-e2ddd288b772 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.081405 Aug 10 13:05:36.928059 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1670/3319] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:36 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:37.949576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-695125ce-3f69-4704-9838-ca40de49f581 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:37.950193 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-695125ce-3f69-4704-9838-ca40de49f581 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:37.956780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-695125ce-3f69-4704-9838-ca40de49f581 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:37.957263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-695125ce-3f69-4704-9838-ca40de49f581 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:37.957697 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-695125ce-3f69-4704-9838-ca40de49f581 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:37.958382 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-695125ce-3f69-4704-9838-ca40de49f581 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:37.958832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-695125ce-3f69-4704-9838-ca40de49f581 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:37.959287 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-695125ce-3f69-4704-9838-ca40de49f581 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:38.020389 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-695125ce-3f69-4704-9838-ca40de49f581 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:38.028198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-695125ce-3f69-4704-9838-ca40de49f581 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082572 Aug 10 13:05:38.028762 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1650/3320] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:37 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:39.049757 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-2bf911c9-7a6e-486a-a638-cbe29fc018ee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:39.050366 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-2bf911c9-7a6e-486a-a638-cbe29fc018ee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:39.056814 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bf911c9-7a6e-486a-a638-cbe29fc018ee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:39.057300 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bf911c9-7a6e-486a-a638-cbe29fc018ee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:39.057734 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bf911c9-7a6e-486a-a638-cbe29fc018ee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:39.058424 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bf911c9-7a6e-486a-a638-cbe29fc018ee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:39.058880 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bf911c9-7a6e-486a-a638-cbe29fc018ee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:39.059343 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-2bf911c9-7a6e-486a-a638-cbe29fc018ee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:39.125977 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-2bf911c9-7a6e-486a-a638-cbe29fc018ee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:39.134056 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-2bf911c9-7a6e-486a-a638-cbe29fc018ee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.088299 Aug 10 13:05:39.134631 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1671/3321] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:39 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:40.154792 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f53003bd-0b48-4186-92d1-8e5d435eae17 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:40.156168 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f53003bd-0b48-4186-92d1-8e5d435eae17 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:40.162551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f53003bd-0b48-4186-92d1-8e5d435eae17 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:40.163016 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f53003bd-0b48-4186-92d1-8e5d435eae17 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:40.163484 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f53003bd-0b48-4186-92d1-8e5d435eae17 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:40.164181 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f53003bd-0b48-4186-92d1-8e5d435eae17 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:40.164644 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f53003bd-0b48-4186-92d1-8e5d435eae17 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:40.165075 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f53003bd-0b48-4186-92d1-8e5d435eae17 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:40.225508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f53003bd-0b48-4186-92d1-8e5d435eae17 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:40.234054 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f53003bd-0b48-4186-92d1-8e5d435eae17 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082921 Aug 10 13:05:40.234628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1651/3322] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:40 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:41.254137 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-952a5ef7-b929-4ce1-944c-af73955419a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:41.254687 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-952a5ef7-b929-4ce1-944c-af73955419a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:41.257033 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=28 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:41.261892 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-952a5ef7-b929-4ce1-944c-af73955419a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:41.267860 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-952a5ef7-b929-4ce1-944c-af73955419a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:41.267860 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-952a5ef7-b929-4ce1-944c-af73955419a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:41.267860 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-952a5ef7-b929-4ce1-944c-af73955419a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:41.267860 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-952a5ef7-b929-4ce1-944c-af73955419a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:41.268291 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-952a5ef7-b929-4ce1-944c-af73955419a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:41.328916 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-952a5ef7-b929-4ce1-944c-af73955419a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:41.336729 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-952a5ef7-b929-4ce1-944c-af73955419a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.086631 Aug 10 13:05:41.337293 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1672/3323] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:41 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:42.359201 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a485827f-0402-4f59-b453-7bed53f6fa39 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:42.359865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a485827f-0402-4f59-b453-7bed53f6fa39 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:42.366256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a485827f-0402-4f59-b453-7bed53f6fa39 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:42.366741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a485827f-0402-4f59-b453-7bed53f6fa39 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:42.367183 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a485827f-0402-4f59-b453-7bed53f6fa39 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:42.367880 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a485827f-0402-4f59-b453-7bed53f6fa39 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:42.368331 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a485827f-0402-4f59-b453-7bed53f6fa39 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:42.368788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a485827f-0402-4f59-b453-7bed53f6fa39 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:42.429368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a485827f-0402-4f59-b453-7bed53f6fa39 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:42.437944 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a485827f-0402-4f59-b453-7bed53f6fa39 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083474 Aug 10 13:05:42.438517 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1652/3324] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:42 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:43.458936 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-afaa78a0-e3d9-450c-ad98-2953870ce6a4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:43.459607 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-afaa78a0-e3d9-450c-ad98-2953870ce6a4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:43.465969 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-afaa78a0-e3d9-450c-ad98-2953870ce6a4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:43.466449 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-afaa78a0-e3d9-450c-ad98-2953870ce6a4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:43.466884 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-afaa78a0-e3d9-450c-ad98-2953870ce6a4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:43.467672 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-afaa78a0-e3d9-450c-ad98-2953870ce6a4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:43.468124 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-afaa78a0-e3d9-450c-ad98-2953870ce6a4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:43.468546 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-afaa78a0-e3d9-450c-ad98-2953870ce6a4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:43.531015 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-afaa78a0-e3d9-450c-ad98-2953870ce6a4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:43.538850 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-afaa78a0-e3d9-450c-ad98-2953870ce6a4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083786 Aug 10 13:05:43.539454 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1673/3325] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:43 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:44.559774 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-619406ef-b61c-4c1c-a9ed-77577e9f18c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:44.560333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-619406ef-b61c-4c1c-a9ed-77577e9f18c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:44.566677 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-619406ef-b61c-4c1c-a9ed-77577e9f18c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:44.567155 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-619406ef-b61c-4c1c-a9ed-77577e9f18c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:44.567637 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-619406ef-b61c-4c1c-a9ed-77577e9f18c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:44.568306 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-619406ef-b61c-4c1c-a9ed-77577e9f18c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:44.568788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-619406ef-b61c-4c1c-a9ed-77577e9f18c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:44.569211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-619406ef-b61c-4c1c-a9ed-77577e9f18c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:44.631594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-619406ef-b61c-4c1c-a9ed-77577e9f18c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:44.641128 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-619406ef-b61c-4c1c-a9ed-77577e9f18c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.085299 Aug 10 13:05:44.641690 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1653/3326] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:44 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:45.661060 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-df9a82c5-44da-4121-8a11-ca3f5d69ee0a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:45.661615 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-df9a82c5-44da-4121-8a11-ca3f5d69ee0a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:45.668012 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-df9a82c5-44da-4121-8a11-ca3f5d69ee0a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:45.668492 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-df9a82c5-44da-4121-8a11-ca3f5d69ee0a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:45.668929 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-df9a82c5-44da-4121-8a11-ca3f5d69ee0a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:45.669610 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-df9a82c5-44da-4121-8a11-ca3f5d69ee0a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:45.670058 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-df9a82c5-44da-4121-8a11-ca3f5d69ee0a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:45.670491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-df9a82c5-44da-4121-8a11-ca3f5d69ee0a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:45.731763 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-df9a82c5-44da-4121-8a11-ca3f5d69ee0a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:45.739772 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-df9a82c5-44da-4121-8a11-ca3f5d69ee0a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082618 Aug 10 13:05:45.740341 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1674/3327] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:45 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:46.760364 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-68a96fab-58cf-4148-9319-5027710e2046 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:46.760973 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-68a96fab-58cf-4148-9319-5027710e2046 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:46.768007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68a96fab-58cf-4148-9319-5027710e2046 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:46.769387 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68a96fab-58cf-4148-9319-5027710e2046 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:46.769387 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68a96fab-58cf-4148-9319-5027710e2046 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:46.769610 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68a96fab-58cf-4148-9319-5027710e2046 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:46.770067 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68a96fab-58cf-4148-9319-5027710e2046 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:46.770493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-68a96fab-58cf-4148-9319-5027710e2046 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:46.831716 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-68a96fab-58cf-4148-9319-5027710e2046 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:46.839573 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-68a96fab-58cf-4148-9319-5027710e2046 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083027 Aug 10 13:05:46.840141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1654/3328] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:46 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:47.860557 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-03451649-dadb-47e4-9dd7-21e1c608508d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:47.861171 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-03451649-dadb-47e4-9dd7-21e1c608508d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:47.867543 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-03451649-dadb-47e4-9dd7-21e1c608508d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:47.868026 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-03451649-dadb-47e4-9dd7-21e1c608508d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:47.868456 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-03451649-dadb-47e4-9dd7-21e1c608508d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:47.869141 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-03451649-dadb-47e4-9dd7-21e1c608508d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:47.869588 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-03451649-dadb-47e4-9dd7-21e1c608508d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:47.870010 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-03451649-dadb-47e4-9dd7-21e1c608508d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:47.875425 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=86 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:47.935126 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-03451649-dadb-47e4-9dd7-21e1c608508d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:47.943551 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-03451649-dadb-47e4-9dd7-21e1c608508d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.086991 Aug 10 13:05:47.944127 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1675/3329] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:47 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:48.965371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e6c2b123-3a12-4707-8458-6ea370110c71 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:48.965984 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e6c2b123-3a12-4707-8458-6ea370110c71 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:48.972609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6c2b123-3a12-4707-8458-6ea370110c71 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:48.973088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6c2b123-3a12-4707-8458-6ea370110c71 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:48.973522 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6c2b123-3a12-4707-8458-6ea370110c71 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:48.974203 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6c2b123-3a12-4707-8458-6ea370110c71 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:48.974654 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6c2b123-3a12-4707-8458-6ea370110c71 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:48.975079 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e6c2b123-3a12-4707-8458-6ea370110c71 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:49.035984 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e6c2b123-3a12-4707-8458-6ea370110c71 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:49.043846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e6c2b123-3a12-4707-8458-6ea370110c71 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082547 Aug 10 13:05:49.044410 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1655/3330] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:48 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:50.065157 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ef2b0fb7-70aa-4b22-928e-1539e3090d0a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:50.065751 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ef2b0fb7-70aa-4b22-928e-1539e3090d0a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:50.072233 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef2b0fb7-70aa-4b22-928e-1539e3090d0a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:50.072713 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef2b0fb7-70aa-4b22-928e-1539e3090d0a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:50.073171 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef2b0fb7-70aa-4b22-928e-1539e3090d0a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:50.073849 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef2b0fb7-70aa-4b22-928e-1539e3090d0a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:50.074300 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef2b0fb7-70aa-4b22-928e-1539e3090d0a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:50.074719 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef2b0fb7-70aa-4b22-928e-1539e3090d0a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:50.136716 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ef2b0fb7-70aa-4b22-928e-1539e3090d0a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:50.144746 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ef2b0fb7-70aa-4b22-928e-1539e3090d0a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083942 Aug 10 13:05:50.145316 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1676/3331] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:50 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:51.166888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e75ccb54-03ce-4cb6-99d0-24940f688abd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:51.167527 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e75ccb54-03ce-4cb6-99d0-24940f688abd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:51.173830 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e75ccb54-03ce-4cb6-99d0-24940f688abd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:51.174303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e75ccb54-03ce-4cb6-99d0-24940f688abd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:51.174730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e75ccb54-03ce-4cb6-99d0-24940f688abd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:51.175430 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e75ccb54-03ce-4cb6-99d0-24940f688abd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:51.175876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e75ccb54-03ce-4cb6-99d0-24940f688abd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:51.176293 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e75ccb54-03ce-4cb6-99d0-24940f688abd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:51.238200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e75ccb54-03ce-4cb6-99d0-24940f688abd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:51.245987 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e75ccb54-03ce-4cb6-99d0-24940f688abd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083033 Aug 10 13:05:51.246633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1656/3332] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:51 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:52.266827 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-70fdadae-48a7-4ba8-a8f6-60321e303a97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:52.267534 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-70fdadae-48a7-4ba8-a8f6-60321e303a97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:52.273827 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70fdadae-48a7-4ba8-a8f6-60321e303a97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:52.274308 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70fdadae-48a7-4ba8-a8f6-60321e303a97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:52.274743 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70fdadae-48a7-4ba8-a8f6-60321e303a97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:52.275451 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70fdadae-48a7-4ba8-a8f6-60321e303a97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:52.275907 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70fdadae-48a7-4ba8-a8f6-60321e303a97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:52.276329 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-70fdadae-48a7-4ba8-a8f6-60321e303a97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:52.341925 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-70fdadae-48a7-4ba8-a8f6-60321e303a97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:52.350554 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-70fdadae-48a7-4ba8-a8f6-60321e303a97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.087639 Aug 10 13:05:52.351130 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1677/3333] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:52 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:53.372422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-846b5d5f-533e-41e0-bf0c-c60b2f66d711 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:53.373030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-846b5d5f-533e-41e0-bf0c-c60b2f66d711 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:53.380122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-846b5d5f-533e-41e0-bf0c-c60b2f66d711 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:53.380610 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-846b5d5f-533e-41e0-bf0c-c60b2f66d711 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:53.381041 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-846b5d5f-533e-41e0-bf0c-c60b2f66d711 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:53.381726 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-846b5d5f-533e-41e0-bf0c-c60b2f66d711 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:53.382176 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-846b5d5f-533e-41e0-bf0c-c60b2f66d711 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:53.382605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-846b5d5f-533e-41e0-bf0c-c60b2f66d711 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:53.386415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=84 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:53.443103 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-846b5d5f-533e-41e0-bf0c-c60b2f66d711 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:53.450818 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-846b5d5f-533e-41e0-bf0c-c60b2f66d711 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082196 Aug 10 13:05:53.451415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1657/3334] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:53 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:54.471639 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-35dc5ba0-2bb1-4a68-922f-98a74d660cd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:54.472254 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-35dc5ba0-2bb1-4a68-922f-98a74d660cd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:54.478560 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-35dc5ba0-2bb1-4a68-922f-98a74d660cd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:54.479034 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-35dc5ba0-2bb1-4a68-922f-98a74d660cd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:54.479493 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-35dc5ba0-2bb1-4a68-922f-98a74d660cd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:54.480176 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-35dc5ba0-2bb1-4a68-922f-98a74d660cd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:54.480906 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-35dc5ba0-2bb1-4a68-922f-98a74d660cd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:54.481313 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-35dc5ba0-2bb1-4a68-922f-98a74d660cd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:54.548737 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-35dc5ba0-2bb1-4a68-922f-98a74d660cd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:54.556697 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-35dc5ba0-2bb1-4a68-922f-98a74d660cd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.088998 Aug 10 13:05:54.557257 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1678/3335] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:54 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:55.578641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c1e8d114-8e1f-4f55-b561-46466840c771 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:55.579347 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c1e8d114-8e1f-4f55-b561-46466840c771 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:55.585697 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c1e8d114-8e1f-4f55-b561-46466840c771 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:55.586180 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c1e8d114-8e1f-4f55-b561-46466840c771 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:55.586613 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c1e8d114-8e1f-4f55-b561-46466840c771 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:55.587337 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c1e8d114-8e1f-4f55-b561-46466840c771 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:55.587796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c1e8d114-8e1f-4f55-b561-46466840c771 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:55.588222 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c1e8d114-8e1f-4f55-b561-46466840c771 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:55.649325 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c1e8d114-8e1f-4f55-b561-46466840c771 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:55.657878 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c1e8d114-8e1f-4f55-b561-46466840c771 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083862 Aug 10 13:05:55.658435 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1658/3336] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:55 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:56.678719 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ce4694e1-5f8e-47dc-80aa-0aa382c1ee92 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:56.679307 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ce4694e1-5f8e-47dc-80aa-0aa382c1ee92 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:56.685245 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce4694e1-5f8e-47dc-80aa-0aa382c1ee92 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:56.685726 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce4694e1-5f8e-47dc-80aa-0aa382c1ee92 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:56.686229 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce4694e1-5f8e-47dc-80aa-0aa382c1ee92 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:56.686916 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce4694e1-5f8e-47dc-80aa-0aa382c1ee92 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:56.687404 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce4694e1-5f8e-47dc-80aa-0aa382c1ee92 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:56.687870 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ce4694e1-5f8e-47dc-80aa-0aa382c1ee92 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:56.753533 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ce4694e1-5f8e-47dc-80aa-0aa382c1ee92 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:56.761510 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ce4694e1-5f8e-47dc-80aa-0aa382c1ee92 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.086906 Aug 10 13:05:56.762087 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1679/3337] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:56 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:57.782549 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1c0433ec-49c1-432b-8940-336049877be8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:57.783262 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1c0433ec-49c1-432b-8940-336049877be8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:57.785520 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=28 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:05:57.790124 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1c0433ec-49c1-432b-8940-336049877be8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:57.790595 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1c0433ec-49c1-432b-8940-336049877be8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:57.791022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1c0433ec-49c1-432b-8940-336049877be8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:57.791795 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1c0433ec-49c1-432b-8940-336049877be8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:57.792242 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1c0433ec-49c1-432b-8940-336049877be8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:57.798422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1c0433ec-49c1-432b-8940-336049877be8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:57.853498 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1c0433ec-49c1-432b-8940-336049877be8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:57.862229 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1c0433ec-49c1-432b-8940-336049877be8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083867 Aug 10 13:05:57.864852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1659/3338] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:57 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:58.882815 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ef82a8dc-5345-4b0d-880f-afcdfd032749 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:58.883424 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ef82a8dc-5345-4b0d-880f-afcdfd032749 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:58.889745 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef82a8dc-5345-4b0d-880f-afcdfd032749 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:58.890221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef82a8dc-5345-4b0d-880f-afcdfd032749 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:58.890648 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef82a8dc-5345-4b0d-880f-afcdfd032749 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:58.891863 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef82a8dc-5345-4b0d-880f-afcdfd032749 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:58.892347 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef82a8dc-5345-4b0d-880f-afcdfd032749 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:58.892770 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ef82a8dc-5345-4b0d-880f-afcdfd032749 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:58.954225 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ef82a8dc-5345-4b0d-880f-afcdfd032749 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:05:58.962305 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ef82a8dc-5345-4b0d-880f-afcdfd032749 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083466 Aug 10 13:05:58.962866 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1680/3339] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:58 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:05:59.982734 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-17b983df-09f8-4f95-998c-f090447b8c76 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:05:59.983374 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-17b983df-09f8-4f95-998c-f090447b8c76 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:05:59.990444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-17b983df-09f8-4f95-998c-f090447b8c76 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:59.990929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-17b983df-09f8-4f95-998c-f090447b8c76 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:59.991401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-17b983df-09f8-4f95-998c-f090447b8c76 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:05:59.992094 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-17b983df-09f8-4f95-998c-f090447b8c76 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:05:59.992565 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-17b983df-09f8-4f95-998c-f090447b8c76 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:05:59.992974 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-17b983df-09f8-4f95-998c-f090447b8c76 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:00.054714 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-17b983df-09f8-4f95-998c-f090447b8c76 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:00.062733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-17b983df-09f8-4f95-998c-f090447b8c76 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084172 Aug 10 13:06:00.063492 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1660/3340] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:05:59 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:01.083452 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-1099b043-891d-4bba-99e2-3914e26dc887 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:01.084091 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-1099b043-891d-4bba-99e2-3914e26dc887 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:01.090669 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1099b043-891d-4bba-99e2-3914e26dc887 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:01.091143 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1099b043-891d-4bba-99e2-3914e26dc887 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:01.091601 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1099b043-891d-4bba-99e2-3914e26dc887 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:01.092281 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1099b043-891d-4bba-99e2-3914e26dc887 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:01.092726 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1099b043-891d-4bba-99e2-3914e26dc887 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:01.093139 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-1099b043-891d-4bba-99e2-3914e26dc887 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:01.159486 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-1099b043-891d-4bba-99e2-3914e26dc887 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:01.168157 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-1099b043-891d-4bba-99e2-3914e26dc887 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.088721 Aug 10 13:06:01.168845 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1681/3341] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:01 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:02.190135 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ed046472-3f3b-4f6a-91c6-1bb7a0efedad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:02.190713 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ed046472-3f3b-4f6a-91c6-1bb7a0efedad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:02.197170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ed046472-3f3b-4f6a-91c6-1bb7a0efedad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:02.197675 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ed046472-3f3b-4f6a-91c6-1bb7a0efedad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:02.198122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ed046472-3f3b-4f6a-91c6-1bb7a0efedad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:02.198784 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ed046472-3f3b-4f6a-91c6-1bb7a0efedad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:02.199260 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ed046472-3f3b-4f6a-91c6-1bb7a0efedad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:02.199684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ed046472-3f3b-4f6a-91c6-1bb7a0efedad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:02.486481 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ed046472-3f3b-4f6a-91c6-1bb7a0efedad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:02.494356 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ed046472-3f3b-4f6a-91c6-1bb7a0efedad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.308342 Aug 10 13:06:02.494914 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1661/3342] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:02 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:03.514202 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3a60a6e6-9cf0-4ec7-8d2d-80cf365e91d0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:03.514814 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3a60a6e6-9cf0-4ec7-8d2d-80cf365e91d0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:03.521381 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3a60a6e6-9cf0-4ec7-8d2d-80cf365e91d0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:03.521856 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3a60a6e6-9cf0-4ec7-8d2d-80cf365e91d0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:03.522290 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3a60a6e6-9cf0-4ec7-8d2d-80cf365e91d0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:03.522960 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3a60a6e6-9cf0-4ec7-8d2d-80cf365e91d0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:03.523431 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3a60a6e6-9cf0-4ec7-8d2d-80cf365e91d0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:03.523848 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3a60a6e6-9cf0-4ec7-8d2d-80cf365e91d0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:03.584038 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3a60a6e6-9cf0-4ec7-8d2d-80cf365e91d0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:03.591894 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3a60a6e6-9cf0-4ec7-8d2d-80cf365e91d0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.081661 Aug 10 13:06:03.592462 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1682/3343] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:03 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:04.614166 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-efeecd28-fb19-41ec-848f-46ef395dab97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:04.614739 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-efeecd28-fb19-41ec-848f-46ef395dab97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:04.621103 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-efeecd28-fb19-41ec-848f-46ef395dab97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:04.621577 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-efeecd28-fb19-41ec-848f-46ef395dab97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:04.622002 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-efeecd28-fb19-41ec-848f-46ef395dab97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:04.622680 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-efeecd28-fb19-41ec-848f-46ef395dab97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:04.623125 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-efeecd28-fb19-41ec-848f-46ef395dab97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:04.623570 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-efeecd28-fb19-41ec-848f-46ef395dab97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:04.684370 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-efeecd28-fb19-41ec-848f-46ef395dab97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:04.692305 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-efeecd28-fb19-41ec-848f-46ef395dab97 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082495 Aug 10 13:06:04.692872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1662/3344] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:04 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:05.713784 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-eb56a627-fe97-4a26-a5ea-0e68544bc812 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:05.714347 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-eb56a627-fe97-4a26-a5ea-0e68544bc812 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:05.721269 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eb56a627-fe97-4a26-a5ea-0e68544bc812 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:05.721747 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eb56a627-fe97-4a26-a5ea-0e68544bc812 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:05.722266 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eb56a627-fe97-4a26-a5ea-0e68544bc812 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:05.722954 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eb56a627-fe97-4a26-a5ea-0e68544bc812 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:05.723433 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eb56a627-fe97-4a26-a5ea-0e68544bc812 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:05.723850 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-eb56a627-fe97-4a26-a5ea-0e68544bc812 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:05.784614 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-eb56a627-fe97-4a26-a5ea-0e68544bc812 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:05.792579 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-eb56a627-fe97-4a26-a5ea-0e68544bc812 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082792 Aug 10 13:06:05.793146 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1683/3345] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:05 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:06.814141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-01b3f60c-fc07-41b9-affa-f9f71f4ebcad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:06.814722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-01b3f60c-fc07-41b9-affa-f9f71f4ebcad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:06.821119 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01b3f60c-fc07-41b9-affa-f9f71f4ebcad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:06.821594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01b3f60c-fc07-41b9-affa-f9f71f4ebcad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:06.822020 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01b3f60c-fc07-41b9-affa-f9f71f4ebcad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:06.822699 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01b3f60c-fc07-41b9-affa-f9f71f4ebcad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:06.823145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01b3f60c-fc07-41b9-affa-f9f71f4ebcad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:06.823587 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01b3f60c-fc07-41b9-affa-f9f71f4ebcad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:06.886584 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-01b3f60c-fc07-41b9-affa-f9f71f4ebcad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:06.895365 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-01b3f60c-fc07-41b9-affa-f9f71f4ebcad tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.085485 Aug 10 13:06:06.895927 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1663/3346] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:06 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:06:07.917169 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c52f58d2-b0f9-4a13-9259-247d4c3d0725 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:07.917780 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c52f58d2-b0f9-4a13-9259-247d4c3d0725 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:07.924495 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c52f58d2-b0f9-4a13-9259-247d4c3d0725 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:07.924975 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c52f58d2-b0f9-4a13-9259-247d4c3d0725 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:07.925439 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c52f58d2-b0f9-4a13-9259-247d4c3d0725 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:07.926123 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c52f58d2-b0f9-4a13-9259-247d4c3d0725 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:07.926573 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c52f58d2-b0f9-4a13-9259-247d4c3d0725 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:07.926993 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c52f58d2-b0f9-4a13-9259-247d4c3d0725 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:08.005313 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c52f58d2-b0f9-4a13-9259-247d4c3d0725 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:08.013132 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c52f58d2-b0f9-4a13-9259-247d4c3d0725 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.099986 Aug 10 13:06:08.013702 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1684/3347] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:07 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:09.038843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8d758109-c342-469e-9d11-8f68961a30c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:09.039603 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8d758109-c342-469e-9d11-8f68961a30c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:09.052310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d758109-c342-469e-9d11-8f68961a30c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:09.052310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d758109-c342-469e-9d11-8f68961a30c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:09.052310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d758109-c342-469e-9d11-8f68961a30c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:09.062673 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d758109-c342-469e-9d11-8f68961a30c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:09.062673 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d758109-c342-469e-9d11-8f68961a30c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:09.062673 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d758109-c342-469e-9d11-8f68961a30c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:09.170569 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8d758109-c342-469e-9d11-8f68961a30c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:09.178974 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8d758109-c342-469e-9d11-8f68961a30c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.144712 Aug 10 13:06:09.183272 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1664/3348] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:09 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:09.504248 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [req-1be76ed7-e002-4620-b360-5c3b897240cd req-d692f446-916c-4669-bc2c-054dd8528783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "572a91d2-8a56-4616-97e4-b0d48cc57ea5", "name": "network-vif-deleted", "tag": "5bdde102-3780-4fb4-a112-3f9af85f6b61"}]} {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:06:09.514030 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-1be76ed7-e002-4620-b360-5c3b897240cd req-d692f446-916c-4669-bc2c-054dd8528783 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:09.514502 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-1be76ed7-e002-4620-b360-5c3b897240cd req-d692f446-916c-4669-bc2c-054dd8528783 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:09.514930 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [req-1be76ed7-e002-4620-b360-5c3b897240cd req-d692f446-916c-4669-bc2c-054dd8528783 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:09.526229 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.compute.server_external_events [req-1be76ed7-e002-4620-b360-5c3b897240cd req-d692f446-916c-4669-bc2c-054dd8528783 service nova] Creating event network-vif-deleted:5bdde102-3780-4fb4-a112-3f9af85f6b61 for instance 572a91d2-8a56-4616-97e4-b0d48cc57ea5 on hv-cinder-85199 Aug 10 13:06:09.531457 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [req-1be76ed7-e002-4620-b360-5c3b897240cd req-d692f446-916c-4669-bc2c-054dd8528783 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031678 Aug 10 13:06:09.532040 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1685/3349] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:06:10.199792 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-500dea61-8c92-4984-93a5-090f345e6b31 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:10.200353 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-500dea61-8c92-4984-93a5-090f345e6b31 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:10.206690 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-500dea61-8c92-4984-93a5-090f345e6b31 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:10.207187 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-500dea61-8c92-4984-93a5-090f345e6b31 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:10.207630 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-500dea61-8c92-4984-93a5-090f345e6b31 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:10.208313 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-500dea61-8c92-4984-93a5-090f345e6b31 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:10.208761 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-500dea61-8c92-4984-93a5-090f345e6b31 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:10.209186 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-500dea61-8c92-4984-93a5-090f345e6b31 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:10.270456 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-500dea61-8c92-4984-93a5-090f345e6b31 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:10.278473 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-500dea61-8c92-4984-93a5-090f345e6b31 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082620 Aug 10 13:06:10.279050 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1665/3350] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:10 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:11.300246 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-73011707-0035-4147-ac41-58fd2211d256 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:11.300936 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-73011707-0035-4147-ac41-58fd2211d256 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:11.303348 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=28 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:06:11.308454 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73011707-0035-4147-ac41-58fd2211d256 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:11.308932 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73011707-0035-4147-ac41-58fd2211d256 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:11.309362 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73011707-0035-4147-ac41-58fd2211d256 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:11.310042 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73011707-0035-4147-ac41-58fd2211d256 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:11.310491 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73011707-0035-4147-ac41-58fd2211d256 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:11.311010 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73011707-0035-4147-ac41-58fd2211d256 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:11.374387 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-73011707-0035-4147-ac41-58fd2211d256 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:11.382379 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-73011707-0035-4147-ac41-58fd2211d256 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.086886 Aug 10 13:06:11.382943 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1686/3351] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:11 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:06:12.403682 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b462ea67-6acb-48d1-bde0-b6f1a4aa4938 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:12.404295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b462ea67-6acb-48d1-bde0-b6f1a4aa4938 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:12.411195 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b462ea67-6acb-48d1-bde0-b6f1a4aa4938 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:12.411680 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b462ea67-6acb-48d1-bde0-b6f1a4aa4938 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:12.412117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b462ea67-6acb-48d1-bde0-b6f1a4aa4938 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:12.412807 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b462ea67-6acb-48d1-bde0-b6f1a4aa4938 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:12.413259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b462ea67-6acb-48d1-bde0-b6f1a4aa4938 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:12.413684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b462ea67-6acb-48d1-bde0-b6f1a4aa4938 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:12.478275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b462ea67-6acb-48d1-bde0-b6f1a4aa4938 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:12.487523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b462ea67-6acb-48d1-bde0-b6f1a4aa4938 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.087725 Aug 10 13:06:12.488092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1666/3352] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:12 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:13.509163 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-175e3d8b-661d-425f-8b02-d9dfe5be65fd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:13.509799 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-175e3d8b-661d-425f-8b02-d9dfe5be65fd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:13.516778 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-175e3d8b-661d-425f-8b02-d9dfe5be65fd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:13.517460 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-175e3d8b-661d-425f-8b02-d9dfe5be65fd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:13.517895 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-175e3d8b-661d-425f-8b02-d9dfe5be65fd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:13.518573 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-175e3d8b-661d-425f-8b02-d9dfe5be65fd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:13.519017 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-175e3d8b-661d-425f-8b02-d9dfe5be65fd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:13.519464 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-175e3d8b-661d-425f-8b02-d9dfe5be65fd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:13.579476 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-175e3d8b-661d-425f-8b02-d9dfe5be65fd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:13.587280 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-175e3d8b-661d-425f-8b02-d9dfe5be65fd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.081969 Aug 10 13:06:13.587851 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1687/3353] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:13 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:14.608400 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5bcd8d03-c59d-476d-ad8b-d405e8afe0a9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:14.608955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5bcd8d03-c59d-476d-ad8b-d405e8afe0a9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:14.615867 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5bcd8d03-c59d-476d-ad8b-d405e8afe0a9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:14.616342 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5bcd8d03-c59d-476d-ad8b-d405e8afe0a9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:14.616774 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5bcd8d03-c59d-476d-ad8b-d405e8afe0a9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:14.617459 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5bcd8d03-c59d-476d-ad8b-d405e8afe0a9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:14.617905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5bcd8d03-c59d-476d-ad8b-d405e8afe0a9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:14.618324 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5bcd8d03-c59d-476d-ad8b-d405e8afe0a9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:14.679155 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5bcd8d03-c59d-476d-ad8b-d405e8afe0a9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:14.687031 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5bcd8d03-c59d-476d-ad8b-d405e8afe0a9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082844 Aug 10 13:06:14.687620 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1667/3354] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:14 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:15.708934 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-34c67cf0-ae6d-49d7-876c-f962eb9932ed tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:15.709531 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-34c67cf0-ae6d-49d7-876c-f962eb9932ed tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:15.715927 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34c67cf0-ae6d-49d7-876c-f962eb9932ed tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:15.716407 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34c67cf0-ae6d-49d7-876c-f962eb9932ed tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:15.716838 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34c67cf0-ae6d-49d7-876c-f962eb9932ed tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:15.717518 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34c67cf0-ae6d-49d7-876c-f962eb9932ed tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:15.717985 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34c67cf0-ae6d-49d7-876c-f962eb9932ed tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:15.718388 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-34c67cf0-ae6d-49d7-876c-f962eb9932ed tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:15.779192 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-34c67cf0-ae6d-49d7-876c-f962eb9932ed tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:15.787260 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-34c67cf0-ae6d-49d7-876c-f962eb9932ed tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082171 Aug 10 13:06:15.787821 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1688/3355] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:15 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:16.808192 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-01d36ef7-4883-403e-a1c7-2e7e9afe52f4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:16.808793 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-01d36ef7-4883-403e-a1c7-2e7e9afe52f4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:16.815263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01d36ef7-4883-403e-a1c7-2e7e9afe52f4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:16.815740 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01d36ef7-4883-403e-a1c7-2e7e9afe52f4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:16.816168 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01d36ef7-4883-403e-a1c7-2e7e9afe52f4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:16.816849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01d36ef7-4883-403e-a1c7-2e7e9afe52f4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:16.817290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01d36ef7-4883-403e-a1c7-2e7e9afe52f4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:16.817705 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01d36ef7-4883-403e-a1c7-2e7e9afe52f4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:16.880992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-01d36ef7-4883-403e-a1c7-2e7e9afe52f4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:16.889248 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-01d36ef7-4883-403e-a1c7-2e7e9afe52f4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.085008 Aug 10 13:06:16.889809 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1668/3356] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:16 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:17.911092 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ffdf2f24-ba6b-472d-9120-d844bbf6bda2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:17.911725 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ffdf2f24-ba6b-472d-9120-d844bbf6bda2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:17.918079 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ffdf2f24-ba6b-472d-9120-d844bbf6bda2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:17.918565 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ffdf2f24-ba6b-472d-9120-d844bbf6bda2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:17.918995 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ffdf2f24-ba6b-472d-9120-d844bbf6bda2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:17.919705 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ffdf2f24-ba6b-472d-9120-d844bbf6bda2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:17.920156 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ffdf2f24-ba6b-472d-9120-d844bbf6bda2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:17.920574 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ffdf2f24-ba6b-472d-9120-d844bbf6bda2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:17.925234 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=80 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:06:17.981825 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ffdf2f24-ba6b-472d-9120-d844bbf6bda2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:17.990769 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ffdf2f24-ba6b-472d-9120-d844bbf6bda2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084068 Aug 10 13:06:17.991371 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1689/3357] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:17 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:19.011788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-276e43bb-62bc-497e-a73c-acc33b33799f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:19.012403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-276e43bb-62bc-497e-a73c-acc33b33799f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:19.018697 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-276e43bb-62bc-497e-a73c-acc33b33799f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:19.019199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-276e43bb-62bc-497e-a73c-acc33b33799f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:19.019643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-276e43bb-62bc-497e-a73c-acc33b33799f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:19.020392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-276e43bb-62bc-497e-a73c-acc33b33799f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:19.020846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-276e43bb-62bc-497e-a73c-acc33b33799f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:19.021272 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-276e43bb-62bc-497e-a73c-acc33b33799f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:19.081766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-276e43bb-62bc-497e-a73c-acc33b33799f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:19.089683 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-276e43bb-62bc-497e-a73c-acc33b33799f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.081976 Aug 10 13:06:19.090243 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1669/3358] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:19 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:20.110815 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-bf90ec19-7d7e-4ac2-9e5b-4d27837639ff tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:20.111668 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-bf90ec19-7d7e-4ac2-9e5b-4d27837639ff tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:20.118096 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf90ec19-7d7e-4ac2-9e5b-4d27837639ff tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:20.118576 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf90ec19-7d7e-4ac2-9e5b-4d27837639ff tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:20.119009 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf90ec19-7d7e-4ac2-9e5b-4d27837639ff tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:20.119728 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf90ec19-7d7e-4ac2-9e5b-4d27837639ff tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:20.120180 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf90ec19-7d7e-4ac2-9e5b-4d27837639ff tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:20.120602 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-bf90ec19-7d7e-4ac2-9e5b-4d27837639ff tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:20.181776 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-bf90ec19-7d7e-4ac2-9e5b-4d27837639ff tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:20.190224 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-bf90ec19-7d7e-4ac2-9e5b-4d27837639ff tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084179 Aug 10 13:06:20.190819 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1690/3359] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:20 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:21.210840 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7103e9af-720b-424f-b6cd-19f656f67d7e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:21.211420 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7103e9af-720b-424f-b6cd-19f656f67d7e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:21.217572 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7103e9af-720b-424f-b6cd-19f656f67d7e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:21.218056 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7103e9af-720b-424f-b6cd-19f656f67d7e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:21.218491 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7103e9af-720b-424f-b6cd-19f656f67d7e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:21.219246 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7103e9af-720b-424f-b6cd-19f656f67d7e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:21.220334 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7103e9af-720b-424f-b6cd-19f656f67d7e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:21.220772 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7103e9af-720b-424f-b6cd-19f656f67d7e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:21.285797 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7103e9af-720b-424f-b6cd-19f656f67d7e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:21.293674 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7103e9af-720b-424f-b6cd-19f656f67d7e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.086652 Aug 10 13:06:21.294237 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1670/3360] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:21 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:22.314425 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-73cba080-ff77-4048-ab36-673fbc89dd18 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:22.315039 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-73cba080-ff77-4048-ab36-673fbc89dd18 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:22.321410 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73cba080-ff77-4048-ab36-673fbc89dd18 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:22.321883 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73cba080-ff77-4048-ab36-673fbc89dd18 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:22.322309 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73cba080-ff77-4048-ab36-673fbc89dd18 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:22.322982 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73cba080-ff77-4048-ab36-673fbc89dd18 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:22.323451 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73cba080-ff77-4048-ab36-673fbc89dd18 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:22.323867 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-73cba080-ff77-4048-ab36-673fbc89dd18 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:22.386929 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-73cba080-ff77-4048-ab36-673fbc89dd18 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:22.394733 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-73cba080-ff77-4048-ab36-673fbc89dd18 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084600 Aug 10 13:06:22.395325 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1691/3361] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:22 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:23.415395 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d0c0be6d-738e-4fe1-be0a-b9c7d1cfe295 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:23.415997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d0c0be6d-738e-4fe1-be0a-b9c7d1cfe295 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:23.422488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0c0be6d-738e-4fe1-be0a-b9c7d1cfe295 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:23.423936 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0c0be6d-738e-4fe1-be0a-b9c7d1cfe295 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:23.424089 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0c0be6d-738e-4fe1-be0a-b9c7d1cfe295 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:23.424713 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0c0be6d-738e-4fe1-be0a-b9c7d1cfe295 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:23.425162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0c0be6d-738e-4fe1-be0a-b9c7d1cfe295 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:23.425580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0c0be6d-738e-4fe1-be0a-b9c7d1cfe295 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:23.428114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=84 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:06:23.489343 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d0c0be6d-738e-4fe1-be0a-b9c7d1cfe295 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:23.497508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d0c0be6d-738e-4fe1-be0a-b9c7d1cfe295 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.086070 Aug 10 13:06:23.511365 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1671/3362] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:23 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:24.519252 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-b9d948e0-ca8e-4f89-b345-cace4c5213c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:24.519880 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-b9d948e0-ca8e-4f89-b345-cace4c5213c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:24.526529 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b9d948e0-ca8e-4f89-b345-cace4c5213c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:24.527002 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b9d948e0-ca8e-4f89-b345-cace4c5213c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:24.527476 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b9d948e0-ca8e-4f89-b345-cace4c5213c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:24.528419 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b9d948e0-ca8e-4f89-b345-cace4c5213c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:24.528980 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b9d948e0-ca8e-4f89-b345-cace4c5213c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:24.529405 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-b9d948e0-ca8e-4f89-b345-cace4c5213c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:24.595324 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-b9d948e0-ca8e-4f89-b345-cace4c5213c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:24.598972 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-b9d948e0-ca8e-4f89-b345-cace4c5213c8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083911 Aug 10 13:06:24.599579 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1692/3363] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:24 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:25.620692 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c08c05d0-dfcc-46dd-bde0-66711da5ea4d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:25.621248 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c08c05d0-dfcc-46dd-bde0-66711da5ea4d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:25.628982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c08c05d0-dfcc-46dd-bde0-66711da5ea4d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:25.629465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c08c05d0-dfcc-46dd-bde0-66711da5ea4d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:25.629900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c08c05d0-dfcc-46dd-bde0-66711da5ea4d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:25.630580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c08c05d0-dfcc-46dd-bde0-66711da5ea4d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:25.631027 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c08c05d0-dfcc-46dd-bde0-66711da5ea4d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:25.631483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c08c05d0-dfcc-46dd-bde0-66711da5ea4d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:25.695231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c08c05d0-dfcc-46dd-bde0-66711da5ea4d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:25.703266 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c08c05d0-dfcc-46dd-bde0-66711da5ea4d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.086602 Aug 10 13:06:25.703837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1672/3364] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:25 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:26.724973 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-057e9890-0360-4a1c-af0e-a65c8394240c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:26.725597 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-057e9890-0360-4a1c-af0e-a65c8394240c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:26.731862 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-057e9890-0360-4a1c-af0e-a65c8394240c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:26.732339 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-057e9890-0360-4a1c-af0e-a65c8394240c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:26.732793 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-057e9890-0360-4a1c-af0e-a65c8394240c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:26.733630 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-057e9890-0360-4a1c-af0e-a65c8394240c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:26.734082 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-057e9890-0360-4a1c-af0e-a65c8394240c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:26.734500 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-057e9890-0360-4a1c-af0e-a65c8394240c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:26.794917 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-057e9890-0360-4a1c-af0e-a65c8394240c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:26.803157 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-057e9890-0360-4a1c-af0e-a65c8394240c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082644 Aug 10 13:06:26.803747 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1693/3365] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:26 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:27.824597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fdf195b5-1ad0-4b4c-b129-333324a808a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:27.825198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fdf195b5-1ad0-4b4c-b129-333324a808a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:27.827485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=28 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:06:27.832133 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdf195b5-1ad0-4b4c-b129-333324a808a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:27.832611 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdf195b5-1ad0-4b4c-b129-333324a808a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:27.833045 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdf195b5-1ad0-4b4c-b129-333324a808a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:27.833735 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdf195b5-1ad0-4b4c-b129-333324a808a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:27.834186 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdf195b5-1ad0-4b4c-b129-333324a808a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:27.834605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdf195b5-1ad0-4b4c-b129-333324a808a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:27.897190 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fdf195b5-1ad0-4b4c-b129-333324a808a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:27.905034 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fdf195b5-1ad0-4b4c-b129-333324a808a3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084311 Aug 10 13:06:27.905600 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1673/3366] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:27 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:28.925668 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3ff4d8f6-1b93-4150-b540-b84d89d45bde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:28.926285 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3ff4d8f6-1b93-4150-b540-b84d89d45bde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:28.932789 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ff4d8f6-1b93-4150-b540-b84d89d45bde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:28.933298 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ff4d8f6-1b93-4150-b540-b84d89d45bde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:28.933758 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ff4d8f6-1b93-4150-b540-b84d89d45bde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:28.934467 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ff4d8f6-1b93-4150-b540-b84d89d45bde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:28.934922 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ff4d8f6-1b93-4150-b540-b84d89d45bde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:28.935413 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3ff4d8f6-1b93-4150-b540-b84d89d45bde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:28.997253 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3ff4d8f6-1b93-4150-b540-b84d89d45bde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:29.005213 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3ff4d8f6-1b93-4150-b540-b84d89d45bde tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084079 Aug 10 13:06:29.005782 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1694/3367] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:28 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:30.025778 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5eb07234-1332-4ff3-93c6-18fe4acc1355 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:30.026371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5eb07234-1332-4ff3-93c6-18fe4acc1355 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:30.033774 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5eb07234-1332-4ff3-93c6-18fe4acc1355 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:30.034279 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5eb07234-1332-4ff3-93c6-18fe4acc1355 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:30.034711 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5eb07234-1332-4ff3-93c6-18fe4acc1355 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:30.035430 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5eb07234-1332-4ff3-93c6-18fe4acc1355 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:30.035880 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5eb07234-1332-4ff3-93c6-18fe4acc1355 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:30.036298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5eb07234-1332-4ff3-93c6-18fe4acc1355 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:30.099794 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5eb07234-1332-4ff3-93c6-18fe4acc1355 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:30.107899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5eb07234-1332-4ff3-93c6-18fe4acc1355 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.086010 Aug 10 13:06:30.108461 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1674/3368] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:30 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:31.129249 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-0e24a3f0-57df-4afe-90bd-2ff7a0cb59a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:31.129863 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-0e24a3f0-57df-4afe-90bd-2ff7a0cb59a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:31.136270 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e24a3f0-57df-4afe-90bd-2ff7a0cb59a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:31.136751 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e24a3f0-57df-4afe-90bd-2ff7a0cb59a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:31.137184 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e24a3f0-57df-4afe-90bd-2ff7a0cb59a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:31.137868 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e24a3f0-57df-4afe-90bd-2ff7a0cb59a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:31.138317 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e24a3f0-57df-4afe-90bd-2ff7a0cb59a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:31.138740 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-0e24a3f0-57df-4afe-90bd-2ff7a0cb59a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:31.199836 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-0e24a3f0-57df-4afe-90bd-2ff7a0cb59a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:31.208072 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-0e24a3f0-57df-4afe-90bd-2ff7a0cb59a8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083599 Aug 10 13:06:31.208649 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1695/3369] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:31 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:32.228705 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9de1c899-16cd-4feb-9d82-5f4f8ce5ec99 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:32.229301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9de1c899-16cd-4feb-9d82-5f4f8ce5ec99 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:32.236499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9de1c899-16cd-4feb-9d82-5f4f8ce5ec99 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:32.237104 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9de1c899-16cd-4feb-9d82-5f4f8ce5ec99 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:32.237531 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9de1c899-16cd-4feb-9d82-5f4f8ce5ec99 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:32.238206 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9de1c899-16cd-4feb-9d82-5f4f8ce5ec99 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:32.238650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9de1c899-16cd-4feb-9d82-5f4f8ce5ec99 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:32.239272 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9de1c899-16cd-4feb-9d82-5f4f8ce5ec99 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:32.300544 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9de1c899-16cd-4feb-9d82-5f4f8ce5ec99 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:32.308347 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9de1c899-16cd-4feb-9d82-5f4f8ce5ec99 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083610 Aug 10 13:06:32.308901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1675/3370] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:32 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:33.329503 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3bcabb40-2132-4730-ae10-0a8568a2c21a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:33.330634 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3bcabb40-2132-4730-ae10-0a8568a2c21a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:33.336980 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3bcabb40-2132-4730-ae10-0a8568a2c21a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:33.337455 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3bcabb40-2132-4730-ae10-0a8568a2c21a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:33.337878 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3bcabb40-2132-4730-ae10-0a8568a2c21a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:33.338555 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3bcabb40-2132-4730-ae10-0a8568a2c21a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:33.339003 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3bcabb40-2132-4730-ae10-0a8568a2c21a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:33.339443 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3bcabb40-2132-4730-ae10-0a8568a2c21a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:33.400815 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3bcabb40-2132-4730-ae10-0a8568a2c21a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:33.408692 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3bcabb40-2132-4730-ae10-0a8568a2c21a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083046 Aug 10 13:06:33.409254 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1696/3371] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:33 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:34.429345 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-13f399fd-9c24-4c6a-a2db-295c458877c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:34.429958 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-13f399fd-9c24-4c6a-a2db-295c458877c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:34.436455 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-13f399fd-9c24-4c6a-a2db-295c458877c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:34.436935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-13f399fd-9c24-4c6a-a2db-295c458877c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:34.437370 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-13f399fd-9c24-4c6a-a2db-295c458877c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:34.438053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-13f399fd-9c24-4c6a-a2db-295c458877c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:34.438501 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-13f399fd-9c24-4c6a-a2db-295c458877c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:34.438928 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-13f399fd-9c24-4c6a-a2db-295c458877c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:34.504149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-13f399fd-9c24-4c6a-a2db-295c458877c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:34.512098 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-13f399fd-9c24-4c6a-a2db-295c458877c3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.086642 Aug 10 13:06:34.512838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1676/3372] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:34 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:34.875566 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:06:34.876158 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Wed Aug 10 13:06:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:06:35.533740 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9ddd29ec-13f0-4103-ae9a-69d4bdd0380a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:35.534278 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9ddd29ec-13f0-4103-ae9a-69d4bdd0380a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:35.540760 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ddd29ec-13f0-4103-ae9a-69d4bdd0380a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:35.541237 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ddd29ec-13f0-4103-ae9a-69d4bdd0380a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:35.541670 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ddd29ec-13f0-4103-ae9a-69d4bdd0380a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:35.542348 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ddd29ec-13f0-4103-ae9a-69d4bdd0380a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:35.542795 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ddd29ec-13f0-4103-ae9a-69d4bdd0380a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:35.543238 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9ddd29ec-13f0-4103-ae9a-69d4bdd0380a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:35.604465 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9ddd29ec-13f0-4103-ae9a-69d4bdd0380a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:35.613084 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9ddd29ec-13f0-4103-ae9a-69d4bdd0380a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083460 Aug 10 13:06:35.613652 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1697/3373] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:35 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:36.634219 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-533340d7-7273-450c-8458-afcd14814733 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:36.634766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-533340d7-7273-450c-8458-afcd14814733 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:36.641268 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-533340d7-7273-450c-8458-afcd14814733 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:36.641747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-533340d7-7273-450c-8458-afcd14814733 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:36.642177 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-533340d7-7273-450c-8458-afcd14814733 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:36.643775 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-533340d7-7273-450c-8458-afcd14814733 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:36.644230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-533340d7-7273-450c-8458-afcd14814733 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:36.644653 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-533340d7-7273-450c-8458-afcd14814733 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:36.706535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-533340d7-7273-450c-8458-afcd14814733 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:36.714449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-533340d7-7273-450c-8458-afcd14814733 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084208 Aug 10 13:06:36.715028 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1677/3374] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:36 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:06:37.735397 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-ea3e2f4e-4691-4dc7-a2ea-7ddd2bc9f76e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:37.735942 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-ea3e2f4e-4691-4dc7-a2ea-7ddd2bc9f76e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:37.742302 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ea3e2f4e-4691-4dc7-a2ea-7ddd2bc9f76e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:37.742776 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ea3e2f4e-4691-4dc7-a2ea-7ddd2bc9f76e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:37.743221 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ea3e2f4e-4691-4dc7-a2ea-7ddd2bc9f76e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:37.743901 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ea3e2f4e-4691-4dc7-a2ea-7ddd2bc9f76e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:37.744345 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ea3e2f4e-4691-4dc7-a2ea-7ddd2bc9f76e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:37.744760 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-ea3e2f4e-4691-4dc7-a2ea-7ddd2bc9f76e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:37.806661 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-ea3e2f4e-4691-4dc7-a2ea-7ddd2bc9f76e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:37.814675 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-ea3e2f4e-4691-4dc7-a2ea-7ddd2bc9f76e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083366 Aug 10 13:06:37.815324 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1698/3375] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:37 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:06:38.540982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:06:38.541414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Wed Aug 10 13:06:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:06:38.835956 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-27f5ac1d-59e4-47f2-a126-b932ef476d0e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:38.836496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-27f5ac1d-59e4-47f2-a126-b932ef476d0e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:38.842905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27f5ac1d-59e4-47f2-a126-b932ef476d0e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:38.843424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27f5ac1d-59e4-47f2-a126-b932ef476d0e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:38.843866 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27f5ac1d-59e4-47f2-a126-b932ef476d0e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:38.844558 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27f5ac1d-59e4-47f2-a126-b932ef476d0e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:38.845011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27f5ac1d-59e4-47f2-a126-b932ef476d0e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:38.845438 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27f5ac1d-59e4-47f2-a126-b932ef476d0e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:38.909640 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-27f5ac1d-59e4-47f2-a126-b932ef476d0e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:38.917516 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-27f5ac1d-59e4-47f2-a126-b932ef476d0e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.085470 Aug 10 13:06:38.918691 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1678/3376] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:38 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:39.937971 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-93f91ca3-702a-4154-a750-48595cc64ed8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:39.938641 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-93f91ca3-702a-4154-a750-48595cc64ed8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:39.945297 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-93f91ca3-702a-4154-a750-48595cc64ed8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:39.945776 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-93f91ca3-702a-4154-a750-48595cc64ed8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:39.946208 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-93f91ca3-702a-4154-a750-48595cc64ed8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:39.946894 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-93f91ca3-702a-4154-a750-48595cc64ed8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:39.947380 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-93f91ca3-702a-4154-a750-48595cc64ed8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:39.947805 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-93f91ca3-702a-4154-a750-48595cc64ed8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:40.009728 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-93f91ca3-702a-4154-a750-48595cc64ed8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:40.017658 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-93f91ca3-702a-4154-a750-48595cc64ed8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083516 Aug 10 13:06:40.018760 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1699/3377] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:39 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:41.039143 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3afe6c71-45d5-4993-8283-c1cb83a9b0b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:41.039789 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3afe6c71-45d5-4993-8283-c1cb83a9b0b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:41.046212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3afe6c71-45d5-4993-8283-c1cb83a9b0b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:41.046692 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3afe6c71-45d5-4993-8283-c1cb83a9b0b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:41.047123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3afe6c71-45d5-4993-8283-c1cb83a9b0b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:41.047861 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3afe6c71-45d5-4993-8283-c1cb83a9b0b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:41.048315 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3afe6c71-45d5-4993-8283-c1cb83a9b0b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:41.048771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3afe6c71-45d5-4993-8283-c1cb83a9b0b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:41.109549 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3afe6c71-45d5-4993-8283-c1cb83a9b0b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:41.118275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3afe6c71-45d5-4993-8283-c1cb83a9b0b0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082988 Aug 10 13:06:41.118867 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1679/3378] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:41 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:41.495072 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:06:41.495273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Wed Aug 10 13:06:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:06:42.296571 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c0e3321d-c279-4a23-afbc-32e09701466a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:42.297188 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c0e3321d-c279-4a23-afbc-32e09701466a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:42.299003 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_api:SELECT=28 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:06:42.304312 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c0e3321d-c279-4a23-afbc-32e09701466a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:42.304794 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c0e3321d-c279-4a23-afbc-32e09701466a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:42.305230 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c0e3321d-c279-4a23-afbc-32e09701466a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:42.305918 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c0e3321d-c279-4a23-afbc-32e09701466a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:42.306372 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c0e3321d-c279-4a23-afbc-32e09701466a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:42.306797 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c0e3321d-c279-4a23-afbc-32e09701466a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:42.368250 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-c0e3321d-c279-4a23-afbc-32e09701466a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:42.376146 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-c0e3321d-c279-4a23-afbc-32e09701466a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.240294 Aug 10 13:06:42.376715 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1700/3379] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:42 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:43.396764 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-04f2a51b-3068-4cd3-bcc8-0b092e40d3b9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:43.397373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-04f2a51b-3068-4cd3-bcc8-0b092e40d3b9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:43.404471 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04f2a51b-3068-4cd3-bcc8-0b092e40d3b9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:43.404941 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04f2a51b-3068-4cd3-bcc8-0b092e40d3b9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:43.405367 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04f2a51b-3068-4cd3-bcc8-0b092e40d3b9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:43.406045 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04f2a51b-3068-4cd3-bcc8-0b092e40d3b9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:43.406488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04f2a51b-3068-4cd3-bcc8-0b092e40d3b9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:43.406903 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04f2a51b-3068-4cd3-bcc8-0b092e40d3b9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:43.471760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-04f2a51b-3068-4cd3-bcc8-0b092e40d3b9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:43.479739 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-04f2a51b-3068-4cd3-bcc8-0b092e40d3b9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.086892 Aug 10 13:06:43.480299 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1680/3380] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:43 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:44.501175 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-6e84bf96-e15b-4509-a34f-af95b71c7d20 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:44.501788 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-6e84bf96-e15b-4509-a34f-af95b71c7d20 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:44.508755 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6e84bf96-e15b-4509-a34f-af95b71c7d20 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:44.509237 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6e84bf96-e15b-4509-a34f-af95b71c7d20 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:44.509670 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6e84bf96-e15b-4509-a34f-af95b71c7d20 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:44.510356 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6e84bf96-e15b-4509-a34f-af95b71c7d20 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:44.510809 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6e84bf96-e15b-4509-a34f-af95b71c7d20 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:44.511254 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-6e84bf96-e15b-4509-a34f-af95b71c7d20 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:44.577347 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-6e84bf96-e15b-4509-a34f-af95b71c7d20 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:44.580287 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-6e84bf96-e15b-4509-a34f-af95b71c7d20 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082998 Aug 10 13:06:44.580872 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1701/3381] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:44 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:45.601933 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-531e4991-42b5-4150-ad23-08d2625114bf tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:45.602483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-531e4991-42b5-4150-ad23-08d2625114bf tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:45.609071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-531e4991-42b5-4150-ad23-08d2625114bf tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:45.609552 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-531e4991-42b5-4150-ad23-08d2625114bf tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:45.609980 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-531e4991-42b5-4150-ad23-08d2625114bf tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:45.610654 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-531e4991-42b5-4150-ad23-08d2625114bf tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:45.611099 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-531e4991-42b5-4150-ad23-08d2625114bf tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:45.611540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-531e4991-42b5-4150-ad23-08d2625114bf tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:45.672777 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-531e4991-42b5-4150-ad23-08d2625114bf tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:45.681443 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-531e4991-42b5-4150-ad23-08d2625114bf tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083636 Aug 10 13:06:45.682001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1681/3382] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:45 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:46.702965 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-84179784-177f-4dc7-b122-be7c3374310f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:46.703732 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-84179784-177f-4dc7-b122-be7c3374310f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:46.711070 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-84179784-177f-4dc7-b122-be7c3374310f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:46.711580 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-84179784-177f-4dc7-b122-be7c3374310f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:46.712026 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-84179784-177f-4dc7-b122-be7c3374310f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:46.712700 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-84179784-177f-4dc7-b122-be7c3374310f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:46.713162 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-84179784-177f-4dc7-b122-be7c3374310f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:46.713578 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-84179784-177f-4dc7-b122-be7c3374310f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:46.775781 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-84179784-177f-4dc7-b122-be7c3374310f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:46.783648 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-84179784-177f-4dc7-b122-be7c3374310f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084544 Aug 10 13:06:46.784393 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1702/3383] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:46 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:47.804840 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1dea063a-8876-4549-8e3c-8229dfce1161 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:47.805441 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1dea063a-8876-4549-8e3c-8229dfce1161 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:47.811825 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1dea063a-8876-4549-8e3c-8229dfce1161 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:47.812299 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1dea063a-8876-4549-8e3c-8229dfce1161 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:47.812722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1dea063a-8876-4549-8e3c-8229dfce1161 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:47.813400 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1dea063a-8876-4549-8e3c-8229dfce1161 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:47.813843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1dea063a-8876-4549-8e3c-8229dfce1161 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:47.814259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1dea063a-8876-4549-8e3c-8229dfce1161 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:47.883629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1dea063a-8876-4549-8e3c-8229dfce1161 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:47.891584 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1dea063a-8876-4549-8e3c-8229dfce1161 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.090550 Aug 10 13:06:47.892146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1682/3384] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:47 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:48.913943 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-9f4b19e9-e74c-47a4-8aa9-c00222d386ea tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:48.914584 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-9f4b19e9-e74c-47a4-8aa9-c00222d386ea tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:48.920999 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9f4b19e9-e74c-47a4-8aa9-c00222d386ea tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:48.921481 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9f4b19e9-e74c-47a4-8aa9-c00222d386ea tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:48.921912 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9f4b19e9-e74c-47a4-8aa9-c00222d386ea tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:48.922595 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9f4b19e9-e74c-47a4-8aa9-c00222d386ea tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:48.923045 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9f4b19e9-e74c-47a4-8aa9-c00222d386ea tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:48.923499 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-9f4b19e9-e74c-47a4-8aa9-c00222d386ea tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:48.926149 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG dbcounter [-] [124642] Writing DB stats nova_cell1:SELECT=84 {{(pid=124642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:06:48.986027 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-9f4b19e9-e74c-47a4-8aa9-c00222d386ea tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:48.994268 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-9f4b19e9-e74c-47a4-8aa9-c00222d386ea tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.085031 Aug 10 13:06:48.994832 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1703/3385] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:48 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:50.014817 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c290f4fc-1da7-4dda-b763-488e793f0686 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:50.015457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c290f4fc-1da7-4dda-b763-488e793f0686 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:50.021627 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c290f4fc-1da7-4dda-b763-488e793f0686 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:50.022109 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c290f4fc-1da7-4dda-b763-488e793f0686 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:50.022573 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c290f4fc-1da7-4dda-b763-488e793f0686 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:50.023288 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c290f4fc-1da7-4dda-b763-488e793f0686 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:50.023744 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c290f4fc-1da7-4dda-b763-488e793f0686 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:50.024176 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c290f4fc-1da7-4dda-b763-488e793f0686 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:50.084433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c290f4fc-1da7-4dda-b763-488e793f0686 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:50.092376 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c290f4fc-1da7-4dda-b763-488e793f0686 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.081510 Aug 10 13:06:50.092948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1683/3386] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:50 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:51.114105 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-3d39ca71-3331-40ff-98f7-f63ce093ad9b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:51.114667 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-3d39ca71-3331-40ff-98f7-f63ce093ad9b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:51.121165 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d39ca71-3331-40ff-98f7-f63ce093ad9b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:51.121643 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d39ca71-3331-40ff-98f7-f63ce093ad9b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:51.122068 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d39ca71-3331-40ff-98f7-f63ce093ad9b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:51.122749 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d39ca71-3331-40ff-98f7-f63ce093ad9b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:51.123213 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d39ca71-3331-40ff-98f7-f63ce093ad9b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:51.123635 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-3d39ca71-3331-40ff-98f7-f63ce093ad9b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:51.188080 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-3d39ca71-3331-40ff-98f7-f63ce093ad9b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:51.196018 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-3d39ca71-3331-40ff-98f7-f63ce093ad9b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.085994 Aug 10 13:06:51.196579 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1704/3387] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:51 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:52.218411 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4d5c68b1-e4f2-44d8-a33c-9279c0b61f5b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:52.219011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4d5c68b1-e4f2-44d8-a33c-9279c0b61f5b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:52.226382 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d5c68b1-e4f2-44d8-a33c-9279c0b61f5b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:52.226853 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d5c68b1-e4f2-44d8-a33c-9279c0b61f5b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:52.227314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d5c68b1-e4f2-44d8-a33c-9279c0b61f5b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:52.227990 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d5c68b1-e4f2-44d8-a33c-9279c0b61f5b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:52.228433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d5c68b1-e4f2-44d8-a33c-9279c0b61f5b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:52.228852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4d5c68b1-e4f2-44d8-a33c-9279c0b61f5b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:52.293724 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4d5c68b1-e4f2-44d8-a33c-9279c0b61f5b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:52.302635 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4d5c68b1-e4f2-44d8-a33c-9279c0b61f5b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.088039 Aug 10 13:06:52.304373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1684/3388] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:52 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:53.323555 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-e1dcb82c-cb39-41d0-9f28-94126f0d583c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:53.324166 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-e1dcb82c-cb39-41d0-9f28-94126f0d583c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:53.330465 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1dcb82c-cb39-41d0-9f28-94126f0d583c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:53.332179 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1dcb82c-cb39-41d0-9f28-94126f0d583c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:53.332743 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1dcb82c-cb39-41d0-9f28-94126f0d583c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:53.333429 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1dcb82c-cb39-41d0-9f28-94126f0d583c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:53.333886 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1dcb82c-cb39-41d0-9f28-94126f0d583c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:53.334311 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-e1dcb82c-cb39-41d0-9f28-94126f0d583c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:53.396293 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.policy [None req-e1dcb82c-cb39-41d0-9f28-94126f0d583c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124642) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:53.404136 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: INFO nova.api.openstack.requestlog [None req-e1dcb82c-cb39-41d0-9f28-94126f0d583c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084542 Aug 10 13:06:53.404705 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: [pid: 124642|app: 0|req: 1705/3389] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:53 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:06:54.426782 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-29136361-8cc5-47da-a512-60cff11c998f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:54.427415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-29136361-8cc5-47da-a512-60cff11c998f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:54.433803 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-29136361-8cc5-47da-a512-60cff11c998f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:54.434301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-29136361-8cc5-47da-a512-60cff11c998f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:54.434727 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-29136361-8cc5-47da-a512-60cff11c998f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:54.435425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-29136361-8cc5-47da-a512-60cff11c998f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:54.435871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-29136361-8cc5-47da-a512-60cff11c998f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:54.436286 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-29136361-8cc5-47da-a512-60cff11c998f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:54.438812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=84 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:06:54.498771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-29136361-8cc5-47da-a512-60cff11c998f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:06:54.506764 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-29136361-8cc5-47da-a512-60cff11c998f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084833 Aug 10 13:06:54.510757 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1685/3390] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:06:54 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:06:55.528075 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.api.openstack.wsgi [None req-c30c98b1-7c1a-4e02-b159-e3cc623b38bb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:06:55.528687 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG nova.compute.api [None req-c30c98b1-7c1a-4e02-b159-e3cc623b38bb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124642) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:06:55.535019 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c30c98b1-7c1a-4e02-b159-e3cc623b38bb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:55.535529 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c30c98b1-7c1a-4e02-b159-e3cc623b38bb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:06:55.535968 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c30c98b1-7c1a-4e02-b159-e3cc623b38bb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:06:55.536697 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: DEBUG oslo_concurrency.lockutils [None req-c30c98b1-7c1a-4e02-b159-e3cc623b38bb tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:06:55.561501 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: Traceback (most recent call last): Aug 10 13:06:55.561652 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Aug 10 13:06:55.561652 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: timer() Aug 10 13:06:55.561652 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Aug 10 13:06:55.561652 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: cb(*args, **kw) Aug 10 13:06:55.561652 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Aug 10 13:06:55.561652 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: waiter.switch() Aug 10 13:06:55.561652 dv-cinder-851996-7-iscsi devstack@n-api.service[124642]: greenlet.error: cannot switch to a different thread Aug 10 13:07:55.584248 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=25 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:07:55.588882 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-431db6a7-2a3e-4ac3-b0aa-73c4d2ed5547 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:07:55.589492 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-431db6a7-2a3e-4ac3-b0aa-73c4d2ed5547 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:07:55.595716 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-431db6a7-2a3e-4ac3-b0aa-73c4d2ed5547 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:07:55.603031 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-431db6a7-2a3e-4ac3-b0aa-73c4d2ed5547 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:07:55.603031 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-431db6a7-2a3e-4ac3-b0aa-73c4d2ed5547 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:07:55.603031 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-431db6a7-2a3e-4ac3-b0aa-73c4d2ed5547 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:07:55.603031 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-431db6a7-2a3e-4ac3-b0aa-73c4d2ed5547 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:07:55.603529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-431db6a7-2a3e-4ac3-b0aa-73c4d2ed5547 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:07:55.737731 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-431db6a7-2a3e-4ac3-b0aa-73c4d2ed5547 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:07:55.746371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-431db6a7-2a3e-4ac3-b0aa-73c4d2ed5547 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.164178 Aug 10 13:07:55.746943 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1686/3391] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:07:55 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:07:56.769087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-50394020-a8c1-4296-a69b-9205fdb15cd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:07:56.769747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-50394020-a8c1-4296-a69b-9205fdb15cd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:07:56.777254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50394020-a8c1-4296-a69b-9205fdb15cd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:07:56.777728 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50394020-a8c1-4296-a69b-9205fdb15cd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:07:56.778154 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50394020-a8c1-4296-a69b-9205fdb15cd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:07:56.778832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50394020-a8c1-4296-a69b-9205fdb15cd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:07:56.779297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50394020-a8c1-4296-a69b-9205fdb15cd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:07:56.779718 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50394020-a8c1-4296-a69b-9205fdb15cd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:07:56.845559 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-50394020-a8c1-4296-a69b-9205fdb15cd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:07:56.853926 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-50394020-a8c1-4296-a69b-9205fdb15cd5 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.088918 Aug 10 13:07:56.854494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1687/3392] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:07:56 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:07:57.874386 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5d7b22a9-5e52-4718-abdc-e0554ca24e28 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:07:57.875058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5d7b22a9-5e52-4718-abdc-e0554ca24e28 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:07:57.881455 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d7b22a9-5e52-4718-abdc-e0554ca24e28 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:07:57.881931 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d7b22a9-5e52-4718-abdc-e0554ca24e28 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:07:57.882356 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d7b22a9-5e52-4718-abdc-e0554ca24e28 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:07:57.883066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d7b22a9-5e52-4718-abdc-e0554ca24e28 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:07:57.883541 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d7b22a9-5e52-4718-abdc-e0554ca24e28 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:07:57.883956 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5d7b22a9-5e52-4718-abdc-e0554ca24e28 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:07:57.943911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5d7b22a9-5e52-4718-abdc-e0554ca24e28 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:07:57.951616 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5d7b22a9-5e52-4718-abdc-e0554ca24e28 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.081066 Aug 10 13:07:57.952169 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1688/3393] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:07:57 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:07:58.972863 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-519994a1-d01b-47bd-aa4e-435466b83b93 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:07:58.973589 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-519994a1-d01b-47bd-aa4e-435466b83b93 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:07:58.980591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-519994a1-d01b-47bd-aa4e-435466b83b93 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:07:58.981066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-519994a1-d01b-47bd-aa4e-435466b83b93 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:07:58.981742 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-519994a1-d01b-47bd-aa4e-435466b83b93 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:07:58.982435 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-519994a1-d01b-47bd-aa4e-435466b83b93 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:07:58.982884 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-519994a1-d01b-47bd-aa4e-435466b83b93 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:07:58.983333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-519994a1-d01b-47bd-aa4e-435466b83b93 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:07:59.046634 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-519994a1-d01b-47bd-aa4e-435466b83b93 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:07:59.054579 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-519994a1-d01b-47bd-aa4e-435466b83b93 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.085674 Aug 10 13:07:59.055921 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1689/3394] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:07:58 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:00.075514 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d7dc3c64-528b-4b42-9273-a001afa1f890 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:00.076211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d7dc3c64-528b-4b42-9273-a001afa1f890 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:00.082474 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d7dc3c64-528b-4b42-9273-a001afa1f890 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:00.082958 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d7dc3c64-528b-4b42-9273-a001afa1f890 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:00.083430 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d7dc3c64-528b-4b42-9273-a001afa1f890 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:00.084123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d7dc3c64-528b-4b42-9273-a001afa1f890 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:00.084577 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d7dc3c64-528b-4b42-9273-a001afa1f890 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:00.085006 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d7dc3c64-528b-4b42-9273-a001afa1f890 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:00.145859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d7dc3c64-528b-4b42-9273-a001afa1f890 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:00.154352 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d7dc3c64-528b-4b42-9273-a001afa1f890 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082737 Aug 10 13:08:00.154912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1690/3395] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:00 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:08:01.175249 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7b2c981d-cb3c-4cf8-90aa-d4f100668dab tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:01.175909 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7b2c981d-cb3c-4cf8-90aa-d4f100668dab tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:01.183001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b2c981d-cb3c-4cf8-90aa-d4f100668dab tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:01.183522 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b2c981d-cb3c-4cf8-90aa-d4f100668dab tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:01.183982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b2c981d-cb3c-4cf8-90aa-d4f100668dab tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:01.184662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b2c981d-cb3c-4cf8-90aa-d4f100668dab tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:01.185111 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b2c981d-cb3c-4cf8-90aa-d4f100668dab tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:01.185530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b2c981d-cb3c-4cf8-90aa-d4f100668dab tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:01.245802 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7b2c981d-cb3c-4cf8-90aa-d4f100668dab tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:01.253611 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7b2c981d-cb3c-4cf8-90aa-d4f100668dab tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082216 Aug 10 13:08:01.254177 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1691/3396] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:01 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:02.274725 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f3f97a22-5f87-43f2-87b5-b43df73d6f8f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:02.275412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f3f97a22-5f87-43f2-87b5-b43df73d6f8f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:02.281840 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3f97a22-5f87-43f2-87b5-b43df73d6f8f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:02.282314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3f97a22-5f87-43f2-87b5-b43df73d6f8f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:02.282743 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3f97a22-5f87-43f2-87b5-b43df73d6f8f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:02.283460 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3f97a22-5f87-43f2-87b5-b43df73d6f8f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:02.283907 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3f97a22-5f87-43f2-87b5-b43df73d6f8f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:02.284326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f3f97a22-5f87-43f2-87b5-b43df73d6f8f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:02.344832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f3f97a22-5f87-43f2-87b5-b43df73d6f8f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:02.353537 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f3f97a22-5f87-43f2-87b5-b43df73d6f8f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083141 Aug 10 13:08:02.354094 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1692/3397] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:02 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:03.375299 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9a99d2ab-a04e-442c-b3d5-db52f37e48e2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:03.448141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9a99d2ab-a04e-442c-b3d5-db52f37e48e2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:03.448141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a99d2ab-a04e-442c-b3d5-db52f37e48e2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:03.448141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a99d2ab-a04e-442c-b3d5-db52f37e48e2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:03.448141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a99d2ab-a04e-442c-b3d5-db52f37e48e2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:03.448608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a99d2ab-a04e-442c-b3d5-db52f37e48e2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:03.448608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a99d2ab-a04e-442c-b3d5-db52f37e48e2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:03.448608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9a99d2ab-a04e-442c-b3d5-db52f37e48e2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:03.456444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9a99d2ab-a04e-442c-b3d5-db52f37e48e2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:03.464334 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9a99d2ab-a04e-442c-b3d5-db52f37e48e2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.093277 Aug 10 13:08:03.464899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1693/3398] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:03 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:04.485865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-03a1ffa9-376a-48cc-ac09-0dc93f1c2785 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:04.486556 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-03a1ffa9-376a-48cc-ac09-0dc93f1c2785 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:04.493707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03a1ffa9-376a-48cc-ac09-0dc93f1c2785 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:04.494183 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03a1ffa9-376a-48cc-ac09-0dc93f1c2785 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:04.494615 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03a1ffa9-376a-48cc-ac09-0dc93f1c2785 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:04.495324 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03a1ffa9-376a-48cc-ac09-0dc93f1c2785 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:04.495770 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03a1ffa9-376a-48cc-ac09-0dc93f1c2785 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:04.496189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03a1ffa9-376a-48cc-ac09-0dc93f1c2785 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:04.557208 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-03a1ffa9-376a-48cc-ac09-0dc93f1c2785 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:04.565259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-03a1ffa9-376a-48cc-ac09-0dc93f1c2785 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083622 Aug 10 13:08:04.565830 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1694/3399] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:04 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:05.586812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-81910a3d-5a0b-4651-9f16-80d25c471c78 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:05.587518 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-81910a3d-5a0b-4651-9f16-80d25c471c78 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:05.593802 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81910a3d-5a0b-4651-9f16-80d25c471c78 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:05.594274 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81910a3d-5a0b-4651-9f16-80d25c471c78 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:05.594699 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81910a3d-5a0b-4651-9f16-80d25c471c78 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:05.595401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81910a3d-5a0b-4651-9f16-80d25c471c78 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:05.595849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81910a3d-5a0b-4651-9f16-80d25c471c78 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:05.596268 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81910a3d-5a0b-4651-9f16-80d25c471c78 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:05.657490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-81910a3d-5a0b-4651-9f16-80d25c471c78 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:05.666226 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-81910a3d-5a0b-4651-9f16-80d25c471c78 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083611 Aug 10 13:08:05.666796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1695/3400] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:05 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:06.687102 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-362ce9a5-8625-4302-b867-3ef4cfd2fa1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:06.687843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-362ce9a5-8625-4302-b867-3ef4cfd2fa1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:06.694126 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-362ce9a5-8625-4302-b867-3ef4cfd2fa1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:06.694596 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-362ce9a5-8625-4302-b867-3ef4cfd2fa1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:06.695021 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-362ce9a5-8625-4302-b867-3ef4cfd2fa1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:06.696866 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-362ce9a5-8625-4302-b867-3ef4cfd2fa1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:06.697312 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-362ce9a5-8625-4302-b867-3ef4cfd2fa1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:06.697733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-362ce9a5-8625-4302-b867-3ef4cfd2fa1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:06.760274 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-362ce9a5-8625-4302-b867-3ef4cfd2fa1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:06.768190 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-362ce9a5-8625-4302-b867-3ef4cfd2fa1d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084971 Aug 10 13:08:06.768758 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1696/3401] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:06 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:07.789637 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-badf458a-9490-43c0-8424-601ca604b952 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:07.790306 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-badf458a-9490-43c0-8424-601ca604b952 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:07.796605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-badf458a-9490-43c0-8424-601ca604b952 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:07.797080 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-badf458a-9490-43c0-8424-601ca604b952 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:07.797507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-badf458a-9490-43c0-8424-601ca604b952 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:07.798182 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-badf458a-9490-43c0-8424-601ca604b952 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:07.798628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-badf458a-9490-43c0-8424-601ca604b952 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:07.799047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-badf458a-9490-43c0-8424-601ca604b952 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:07.861973 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-badf458a-9490-43c0-8424-601ca604b952 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:07.869856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-badf458a-9490-43c0-8424-601ca604b952 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084171 Aug 10 13:08:07.870412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1697/3402] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:07 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:08.890381 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f31eeeed-f103-4297-966f-1431ad5c7229 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:08.891049 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f31eeeed-f103-4297-966f-1431ad5c7229 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:08.897310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f31eeeed-f103-4297-966f-1431ad5c7229 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:09.044285 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f31eeeed-f103-4297-966f-1431ad5c7229 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:09.044285 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f31eeeed-f103-4297-966f-1431ad5c7229 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:09.044285 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f31eeeed-f103-4297-966f-1431ad5c7229 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:09.044285 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f31eeeed-f103-4297-966f-1431ad5c7229 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:09.049281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f31eeeed-f103-4297-966f-1431ad5c7229 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:09.049281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f31eeeed-f103-4297-966f-1431ad5c7229 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:09.049281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f31eeeed-f103-4297-966f-1431ad5c7229 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084334 Aug 10 13:08:09.049281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1698/3403] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:08 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:09.992781 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b1b59ba8-4e0b-414e-ac84-8f2cee5b105a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:09.993527 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b1b59ba8-4e0b-414e-ac84-8f2cee5b105a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:10.000769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1b59ba8-4e0b-414e-ac84-8f2cee5b105a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:10.001253 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1b59ba8-4e0b-414e-ac84-8f2cee5b105a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:10.001685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1b59ba8-4e0b-414e-ac84-8f2cee5b105a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:10.002384 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1b59ba8-4e0b-414e-ac84-8f2cee5b105a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:10.002929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1b59ba8-4e0b-414e-ac84-8f2cee5b105a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:10.003379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1b59ba8-4e0b-414e-ac84-8f2cee5b105a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:10.080975 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b1b59ba8-4e0b-414e-ac84-8f2cee5b105a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:10.089664 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b1b59ba8-4e0b-414e-ac84-8f2cee5b105a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.100956 Aug 10 13:08:10.090239 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1699/3404] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:09 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:11.111506 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d85c498b-8c8b-4ef5-818c-6aaafb88e48d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:11.112224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d85c498b-8c8b-4ef5-818c-6aaafb88e48d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:11.119260 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d85c498b-8c8b-4ef5-818c-6aaafb88e48d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:11.119736 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d85c498b-8c8b-4ef5-818c-6aaafb88e48d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:11.120342 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d85c498b-8c8b-4ef5-818c-6aaafb88e48d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:11.121025 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d85c498b-8c8b-4ef5-818c-6aaafb88e48d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:11.121469 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d85c498b-8c8b-4ef5-818c-6aaafb88e48d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:11.121886 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d85c498b-8c8b-4ef5-818c-6aaafb88e48d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:11.185386 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d85c498b-8c8b-4ef5-818c-6aaafb88e48d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:11.193144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d85c498b-8c8b-4ef5-818c-6aaafb88e48d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.085571 Aug 10 13:08:11.193709 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1700/3405] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:11 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:12.215541 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e60f64a5-b35f-4102-9273-78c63327429a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:12.216158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e60f64a5-b35f-4102-9273-78c63327429a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:12.222487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e60f64a5-b35f-4102-9273-78c63327429a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:12.222909 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e60f64a5-b35f-4102-9273-78c63327429a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:12.223393 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e60f64a5-b35f-4102-9273-78c63327429a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:12.224075 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e60f64a5-b35f-4102-9273-78c63327429a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:12.224532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e60f64a5-b35f-4102-9273-78c63327429a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:12.224955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e60f64a5-b35f-4102-9273-78c63327429a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:12.289887 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e60f64a5-b35f-4102-9273-78c63327429a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:12.292151 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:12.298703 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e60f64a5-b35f-4102-9273-78c63327429a tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.087235 Aug 10 13:08:12.299301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1701/3406] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:12 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:13.321058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4dc8a039-7b26-4bb9-af18-e47d47600b6b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:13.321666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4dc8a039-7b26-4bb9-af18-e47d47600b6b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:13.328374 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4dc8a039-7b26-4bb9-af18-e47d47600b6b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:13.328852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4dc8a039-7b26-4bb9-af18-e47d47600b6b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:13.329286 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4dc8a039-7b26-4bb9-af18-e47d47600b6b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:13.329975 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4dc8a039-7b26-4bb9-af18-e47d47600b6b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:13.330423 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4dc8a039-7b26-4bb9-af18-e47d47600b6b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:13.330884 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4dc8a039-7b26-4bb9-af18-e47d47600b6b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:13.390954 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4dc8a039-7b26-4bb9-af18-e47d47600b6b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:13.398810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4dc8a039-7b26-4bb9-af18-e47d47600b6b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082390 Aug 10 13:08:13.399485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1702/3407] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:13 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:14.419981 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-96003c34-2f32-4986-9c1f-e692a38fe6b8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:14.420594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-96003c34-2f32-4986-9c1f-e692a38fe6b8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:14.426919 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-96003c34-2f32-4986-9c1f-e692a38fe6b8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:14.427438 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-96003c34-2f32-4986-9c1f-e692a38fe6b8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:14.427878 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-96003c34-2f32-4986-9c1f-e692a38fe6b8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:14.428562 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-96003c34-2f32-4986-9c1f-e692a38fe6b8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:14.429012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-96003c34-2f32-4986-9c1f-e692a38fe6b8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:14.429439 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-96003c34-2f32-4986-9c1f-e692a38fe6b8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:14.491574 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-96003c34-2f32-4986-9c1f-e692a38fe6b8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:14.499751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-96003c34-2f32-4986-9c1f-e692a38fe6b8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083922 Aug 10 13:08:14.500316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1703/3408] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:14 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:15.520652 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-41501146-4154-4a09-8f7f-c507c17850d8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:15.521243 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-41501146-4154-4a09-8f7f-c507c17850d8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:15.527803 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41501146-4154-4a09-8f7f-c507c17850d8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:15.528268 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41501146-4154-4a09-8f7f-c507c17850d8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:15.528700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41501146-4154-4a09-8f7f-c507c17850d8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:15.529381 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41501146-4154-4a09-8f7f-c507c17850d8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:15.529835 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41501146-4154-4a09-8f7f-c507c17850d8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:15.530255 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41501146-4154-4a09-8f7f-c507c17850d8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:15.590458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-41501146-4154-4a09-8f7f-c507c17850d8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:15.598392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-41501146-4154-4a09-8f7f-c507c17850d8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.081611 Aug 10 13:08:15.598964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1704/3409] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:15 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:16.620333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-cb52518c-02b7-4e73-a9e4-3fd1469c4808 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:16.620888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-cb52518c-02b7-4e73-a9e4-3fd1469c4808 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:16.627286 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb52518c-02b7-4e73-a9e4-3fd1469c4808 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:16.627772 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb52518c-02b7-4e73-a9e4-3fd1469c4808 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:16.628207 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb52518c-02b7-4e73-a9e4-3fd1469c4808 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:16.628895 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb52518c-02b7-4e73-a9e4-3fd1469c4808 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:16.629356 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb52518c-02b7-4e73-a9e4-3fd1469c4808 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:16.629782 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb52518c-02b7-4e73-a9e4-3fd1469c4808 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:16.693884 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-cb52518c-02b7-4e73-a9e4-3fd1469c4808 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:16.702171 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-cb52518c-02b7-4e73-a9e4-3fd1469c4808 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.086601 Aug 10 13:08:16.702738 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1705/3410] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:16 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:17.723146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-19b362c2-fc51-4b08-8243-23f6398b975e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:17.723785 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-19b362c2-fc51-4b08-8243-23f6398b975e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:17.730162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19b362c2-fc51-4b08-8243-23f6398b975e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:17.730644 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19b362c2-fc51-4b08-8243-23f6398b975e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:17.731077 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19b362c2-fc51-4b08-8243-23f6398b975e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:17.732069 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19b362c2-fc51-4b08-8243-23f6398b975e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:17.732517 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19b362c2-fc51-4b08-8243-23f6398b975e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:17.732941 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-19b362c2-fc51-4b08-8243-23f6398b975e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:17.796328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-19b362c2-fc51-4b08-8243-23f6398b975e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:17.804139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-19b362c2-fc51-4b08-8243-23f6398b975e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084958 Aug 10 13:08:17.804715 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1706/3411] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:17 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:18.825144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4eb4cd2e-6295-44d8-b20f-3e92b06e06b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:18.825757 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4eb4cd2e-6295-44d8-b20f-3e92b06e06b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:18.831591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4eb4cd2e-6295-44d8-b20f-3e92b06e06b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:18.832068 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4eb4cd2e-6295-44d8-b20f-3e92b06e06b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:18.832499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4eb4cd2e-6295-44d8-b20f-3e92b06e06b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:18.833181 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4eb4cd2e-6295-44d8-b20f-3e92b06e06b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:18.833631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4eb4cd2e-6295-44d8-b20f-3e92b06e06b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:18.834054 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4eb4cd2e-6295-44d8-b20f-3e92b06e06b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:18.895419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4eb4cd2e-6295-44d8-b20f-3e92b06e06b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:18.903508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4eb4cd2e-6295-44d8-b20f-3e92b06e06b3 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082370 Aug 10 13:08:18.904078 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1707/3412] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:18 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:19.924729 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-aa601e03-dadf-4e24-8c90-522feb110998 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:19.925329 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-aa601e03-dadf-4e24-8c90-522feb110998 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:19.932331 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa601e03-dadf-4e24-8c90-522feb110998 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:19.932801 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa601e03-dadf-4e24-8c90-522feb110998 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:19.933229 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa601e03-dadf-4e24-8c90-522feb110998 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:19.933900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa601e03-dadf-4e24-8c90-522feb110998 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:19.934344 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa601e03-dadf-4e24-8c90-522feb110998 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:19.934759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa601e03-dadf-4e24-8c90-522feb110998 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:19.995616 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-aa601e03-dadf-4e24-8c90-522feb110998 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:20.003384 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-aa601e03-dadf-4e24-8c90-522feb110998 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082510 Aug 10 13:08:20.003944 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1708/3413] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:19 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:21.024623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3df64a5d-0c9e-4b58-8dc0-0f282b5403d4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:21.025372 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3df64a5d-0c9e-4b58-8dc0-0f282b5403d4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:21.031780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3df64a5d-0c9e-4b58-8dc0-0f282b5403d4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:21.032271 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3df64a5d-0c9e-4b58-8dc0-0f282b5403d4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:21.032706 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3df64a5d-0c9e-4b58-8dc0-0f282b5403d4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:21.033392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3df64a5d-0c9e-4b58-8dc0-0f282b5403d4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:21.033846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3df64a5d-0c9e-4b58-8dc0-0f282b5403d4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:21.034270 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3df64a5d-0c9e-4b58-8dc0-0f282b5403d4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:21.097206 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3df64a5d-0c9e-4b58-8dc0-0f282b5403d4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:21.105747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3df64a5d-0c9e-4b58-8dc0-0f282b5403d4 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.085128 Aug 10 13:08:21.106309 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1709/3414] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:21 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:22.127556 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b0735b1d-0ccf-4073-ab3d-6ffc24679aca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:22.128167 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b0735b1d-0ccf-4073-ab3d-6ffc24679aca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:22.134646 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b0735b1d-0ccf-4073-ab3d-6ffc24679aca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:22.135123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b0735b1d-0ccf-4073-ab3d-6ffc24679aca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:22.135583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b0735b1d-0ccf-4073-ab3d-6ffc24679aca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:22.136267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b0735b1d-0ccf-4073-ab3d-6ffc24679aca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:22.136715 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b0735b1d-0ccf-4073-ab3d-6ffc24679aca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:22.137138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b0735b1d-0ccf-4073-ab3d-6ffc24679aca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:22.197574 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b0735b1d-0ccf-4073-ab3d-6ffc24679aca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:22.205383 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b0735b1d-0ccf-4073-ab3d-6ffc24679aca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.081731 Aug 10 13:08:22.205945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1710/3415] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:22 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:23.226437 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c9383e34-fc7e-4b77-ad5b-59f2fc334d3d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:23.227208 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c9383e34-fc7e-4b77-ad5b-59f2fc334d3d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:23.233581 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9383e34-fc7e-4b77-ad5b-59f2fc334d3d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:23.234055 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9383e34-fc7e-4b77-ad5b-59f2fc334d3d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:23.234483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9383e34-fc7e-4b77-ad5b-59f2fc334d3d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:23.235158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9383e34-fc7e-4b77-ad5b-59f2fc334d3d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:23.235628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9383e34-fc7e-4b77-ad5b-59f2fc334d3d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:23.236046 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9383e34-fc7e-4b77-ad5b-59f2fc334d3d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:23.296562 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c9383e34-fc7e-4b77-ad5b-59f2fc334d3d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:23.304548 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c9383e34-fc7e-4b77-ad5b-59f2fc334d3d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.081941 Aug 10 13:08:23.305369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1711/3416] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:23 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:24.325324 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-414e758b-70ac-442d-997c-e23b63037107 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:24.325963 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-414e758b-70ac-442d-997c-e23b63037107 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:24.332367 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-414e758b-70ac-442d-997c-e23b63037107 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:24.332844 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-414e758b-70ac-442d-997c-e23b63037107 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:24.333273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-414e758b-70ac-442d-997c-e23b63037107 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:24.333956 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-414e758b-70ac-442d-997c-e23b63037107 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:24.334407 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-414e758b-70ac-442d-997c-e23b63037107 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:24.334830 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-414e758b-70ac-442d-997c-e23b63037107 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:24.396243 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-414e758b-70ac-442d-997c-e23b63037107 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:24.404884 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-414e758b-70ac-442d-997c-e23b63037107 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083527 Aug 10 13:08:24.405456 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1712/3417] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:24 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:25.426254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-26f39e50-296f-4608-b7d5-a339eafcd2cd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:25.426878 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-26f39e50-296f-4608-b7d5-a339eafcd2cd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:25.434469 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26f39e50-296f-4608-b7d5-a339eafcd2cd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:25.434940 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26f39e50-296f-4608-b7d5-a339eafcd2cd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:25.435397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26f39e50-296f-4608-b7d5-a339eafcd2cd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:25.436076 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26f39e50-296f-4608-b7d5-a339eafcd2cd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:25.436523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26f39e50-296f-4608-b7d5-a339eafcd2cd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:25.437044 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26f39e50-296f-4608-b7d5-a339eafcd2cd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:25.503515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-26f39e50-296f-4608-b7d5-a339eafcd2cd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:25.511469 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-26f39e50-296f-4608-b7d5-a339eafcd2cd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.089098 Aug 10 13:08:25.512080 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1713/3418] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:25 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:26.532652 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3e8e2994-d135-40d8-a01c-df53982e507b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:26.533192 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3e8e2994-d135-40d8-a01c-df53982e507b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:26.535553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=57 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:26.540136 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3e8e2994-d135-40d8-a01c-df53982e507b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:26.540609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3e8e2994-d135-40d8-a01c-df53982e507b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:26.541043 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3e8e2994-d135-40d8-a01c-df53982e507b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:26.541931 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3e8e2994-d135-40d8-a01c-df53982e507b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:26.542378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3e8e2994-d135-40d8-a01c-df53982e507b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:26.542800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3e8e2994-d135-40d8-a01c-df53982e507b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:26.604153 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3e8e2994-d135-40d8-a01c-df53982e507b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:26.612371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3e8e2994-d135-40d8-a01c-df53982e507b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083621 Aug 10 13:08:26.612958 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1714/3419] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:26 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:27.633948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f1df2e44-06f8-41a0-a215-415b9160d175 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:27.634530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f1df2e44-06f8-41a0-a215-415b9160d175 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:27.641820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f1df2e44-06f8-41a0-a215-415b9160d175 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:27.642296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f1df2e44-06f8-41a0-a215-415b9160d175 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:27.642728 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f1df2e44-06f8-41a0-a215-415b9160d175 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:27.643434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f1df2e44-06f8-41a0-a215-415b9160d175 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:27.643880 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f1df2e44-06f8-41a0-a215-415b9160d175 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:27.644298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f1df2e44-06f8-41a0-a215-415b9160d175 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:27.705758 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f1df2e44-06f8-41a0-a215-415b9160d175 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:27.714782 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f1df2e44-06f8-41a0-a215-415b9160d175 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084572 Aug 10 13:08:27.715376 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1715/3420] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:27 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:28.736103 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-43096a42-bbcd-4b7e-8f2b-447c9808b6fc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:28.736713 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-43096a42-bbcd-4b7e-8f2b-447c9808b6fc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:28.743497 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-43096a42-bbcd-4b7e-8f2b-447c9808b6fc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:28.743987 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-43096a42-bbcd-4b7e-8f2b-447c9808b6fc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:28.744958 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-43096a42-bbcd-4b7e-8f2b-447c9808b6fc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:28.745949 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-43096a42-bbcd-4b7e-8f2b-447c9808b6fc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:28.746398 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-43096a42-bbcd-4b7e-8f2b-447c9808b6fc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:28.746825 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-43096a42-bbcd-4b7e-8f2b-447c9808b6fc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:28.807650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-43096a42-bbcd-4b7e-8f2b-447c9808b6fc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:28.815453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-43096a42-bbcd-4b7e-8f2b-447c9808b6fc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083508 Aug 10 13:08:28.816025 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1716/3421] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:28 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:29.837196 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c7bbd249-c9b6-40e1-997d-1e8959e9ea1f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:29.837825 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c7bbd249-c9b6-40e1-997d-1e8959e9ea1f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:29.844789 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7bbd249-c9b6-40e1-997d-1e8959e9ea1f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:29.845268 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7bbd249-c9b6-40e1-997d-1e8959e9ea1f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:29.845707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7bbd249-c9b6-40e1-997d-1e8959e9ea1f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:29.846392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7bbd249-c9b6-40e1-997d-1e8959e9ea1f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:29.846847 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7bbd249-c9b6-40e1-997d-1e8959e9ea1f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:29.847302 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7bbd249-c9b6-40e1-997d-1e8959e9ea1f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:29.912246 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c7bbd249-c9b6-40e1-997d-1e8959e9ea1f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:29.920511 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c7bbd249-c9b6-40e1-997d-1e8959e9ea1f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.087311 Aug 10 13:08:29.921078 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1717/3422] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:29 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:30.941555 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-589e65d0-de71-4a55-84d1-62ba5ab305d0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:30.942159 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-589e65d0-de71-4a55-84d1-62ba5ab305d0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:30.949349 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-589e65d0-de71-4a55-84d1-62ba5ab305d0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:30.949864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-589e65d0-de71-4a55-84d1-62ba5ab305d0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:30.950298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-589e65d0-de71-4a55-84d1-62ba5ab305d0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:30.951036 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-589e65d0-de71-4a55-84d1-62ba5ab305d0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:30.951512 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-589e65d0-de71-4a55-84d1-62ba5ab305d0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:30.951955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-589e65d0-de71-4a55-84d1-62ba5ab305d0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:30.967302 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:31.014678 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-589e65d0-de71-4a55-84d1-62ba5ab305d0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:31.024152 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-589e65d0-de71-4a55-84d1-62ba5ab305d0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.086733 Aug 10 13:08:31.024729 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1718/3423] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:30 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:08:32.045597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-38ecd182-5431-4bec-acfb-303b6d882263 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:32.046214 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-38ecd182-5431-4bec-acfb-303b6d882263 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:32.052827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38ecd182-5431-4bec-acfb-303b6d882263 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:32.053315 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38ecd182-5431-4bec-acfb-303b6d882263 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:32.053755 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38ecd182-5431-4bec-acfb-303b6d882263 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:32.054446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38ecd182-5431-4bec-acfb-303b6d882263 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:32.054903 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38ecd182-5431-4bec-acfb-303b6d882263 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:32.055433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38ecd182-5431-4bec-acfb-303b6d882263 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:32.120970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-38ecd182-5431-4bec-acfb-303b6d882263 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:32.128859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-38ecd182-5431-4bec-acfb-303b6d882263 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.087369 Aug 10 13:08:32.129425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1719/3424] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:32 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:33.149771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-774a3fef-1853-439d-b360-b7420491cca8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:33.150423 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-774a3fef-1853-439d-b360-b7420491cca8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:33.157263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-774a3fef-1853-439d-b360-b7420491cca8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:33.157759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-774a3fef-1853-439d-b360-b7420491cca8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:33.158183 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-774a3fef-1853-439d-b360-b7420491cca8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:33.158859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-774a3fef-1853-439d-b360-b7420491cca8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:33.159338 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-774a3fef-1853-439d-b360-b7420491cca8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:33.159757 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-774a3fef-1853-439d-b360-b7420491cca8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:33.229236 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-774a3fef-1853-439d-b360-b7420491cca8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:33.237345 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-774a3fef-1853-439d-b360-b7420491cca8 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.091356 Aug 10 13:08:33.237902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1720/3425] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:33 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:34.258508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a69425b6-7e85-4926-8b28-d4a33fc31866 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:34.259158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a69425b6-7e85-4926-8b28-d4a33fc31866 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:34.266603 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a69425b6-7e85-4926-8b28-d4a33fc31866 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:34.267078 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a69425b6-7e85-4926-8b28-d4a33fc31866 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:34.267535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a69425b6-7e85-4926-8b28-d4a33fc31866 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:34.268218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a69425b6-7e85-4926-8b28-d4a33fc31866 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:34.268672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a69425b6-7e85-4926-8b28-d4a33fc31866 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:34.269084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a69425b6-7e85-4926-8b28-d4a33fc31866 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:34.332412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a69425b6-7e85-4926-8b28-d4a33fc31866 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:34.340778 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a69425b6-7e85-4926-8b28-d4a33fc31866 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.086100 Aug 10 13:08:34.341347 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1721/3426] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:34 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:35.361599 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-49634524-7fa9-447b-88a6-3cc53c5c2b0f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:35.362193 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-49634524-7fa9-447b-88a6-3cc53c5c2b0f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:35.368286 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49634524-7fa9-447b-88a6-3cc53c5c2b0f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:35.368771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49634524-7fa9-447b-88a6-3cc53c5c2b0f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:35.369234 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49634524-7fa9-447b-88a6-3cc53c5c2b0f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:35.370563 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49634524-7fa9-447b-88a6-3cc53c5c2b0f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:35.371099 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49634524-7fa9-447b-88a6-3cc53c5c2b0f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:35.371550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-49634524-7fa9-447b-88a6-3cc53c5c2b0f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:35.431820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-49634524-7fa9-447b-88a6-3cc53c5c2b0f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:35.440407 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-49634524-7fa9-447b-88a6-3cc53c5c2b0f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082601 Aug 10 13:08:35.440979 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1722/3427] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:35 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:36.461821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0b6940a0-b5af-4593-a156-f452acdd3f88 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:36.462466 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0b6940a0-b5af-4593-a156-f452acdd3f88 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:36.469684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b6940a0-b5af-4593-a156-f452acdd3f88 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:36.470165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b6940a0-b5af-4593-a156-f452acdd3f88 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:36.470599 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b6940a0-b5af-4593-a156-f452acdd3f88 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:36.471318 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b6940a0-b5af-4593-a156-f452acdd3f88 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:36.471773 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b6940a0-b5af-4593-a156-f452acdd3f88 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:36.472200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b6940a0-b5af-4593-a156-f452acdd3f88 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:36.532747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0b6940a0-b5af-4593-a156-f452acdd3f88 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:36.540531 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0b6940a0-b5af-4593-a156-f452acdd3f88 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082561 Aug 10 13:08:36.541089 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1723/3428] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:36 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:37.561978 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-17580e98-1edc-49b7-907b-8e35c2c07263 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:37.562571 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-17580e98-1edc-49b7-907b-8e35c2c07263 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:37.568816 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-17580e98-1edc-49b7-907b-8e35c2c07263 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:37.569289 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-17580e98-1edc-49b7-907b-8e35c2c07263 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:37.569715 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-17580e98-1edc-49b7-907b-8e35c2c07263 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:37.570395 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-17580e98-1edc-49b7-907b-8e35c2c07263 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:37.570838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-17580e98-1edc-49b7-907b-8e35c2c07263 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:37.571274 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-17580e98-1edc-49b7-907b-8e35c2c07263 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:37.631333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-17580e98-1edc-49b7-907b-8e35c2c07263 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:37.639440 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-17580e98-1edc-49b7-907b-8e35c2c07263 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082019 Aug 10 13:08:37.640028 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1724/3429] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:37 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:38.660275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-93f4655a-7d2b-4170-99e6-073d7dab0c84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:38.660832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-93f4655a-7d2b-4170-99e6-073d7dab0c84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:38.667950 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93f4655a-7d2b-4170-99e6-073d7dab0c84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:38.668425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93f4655a-7d2b-4170-99e6-073d7dab0c84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:38.668857 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93f4655a-7d2b-4170-99e6-073d7dab0c84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:38.669541 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93f4655a-7d2b-4170-99e6-073d7dab0c84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:38.669991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93f4655a-7d2b-4170-99e6-073d7dab0c84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:38.670418 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93f4655a-7d2b-4170-99e6-073d7dab0c84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:38.734108 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-93f4655a-7d2b-4170-99e6-073d7dab0c84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:38.742435 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-93f4655a-7d2b-4170-99e6-073d7dab0c84 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.086084 Aug 10 13:08:38.743005 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1725/3430] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:38 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:39.763421 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1668a081-00a7-423c-9c7f-5a67cb89abfe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:39.764024 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1668a081-00a7-423c-9c7f-5a67cb89abfe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:39.770425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1668a081-00a7-423c-9c7f-5a67cb89abfe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:39.770904 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1668a081-00a7-423c-9c7f-5a67cb89abfe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:39.771372 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1668a081-00a7-423c-9c7f-5a67cb89abfe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:39.772065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1668a081-00a7-423c-9c7f-5a67cb89abfe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:39.772528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1668a081-00a7-423c-9c7f-5a67cb89abfe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:39.772978 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1668a081-00a7-423c-9c7f-5a67cb89abfe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:39.836113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1668a081-00a7-423c-9c7f-5a67cb89abfe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:39.844030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1668a081-00a7-423c-9c7f-5a67cb89abfe tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084676 Aug 10 13:08:39.844597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1726/3431] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:39 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:40.865795 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e27bedef-c4f5-4093-8a00-12e4e1605bb0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:40.866435 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e27bedef-c4f5-4093-8a00-12e4e1605bb0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:40.874095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e27bedef-c4f5-4093-8a00-12e4e1605bb0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:40.874570 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e27bedef-c4f5-4093-8a00-12e4e1605bb0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:40.875008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e27bedef-c4f5-4093-8a00-12e4e1605bb0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:40.875723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e27bedef-c4f5-4093-8a00-12e4e1605bb0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:40.876168 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e27bedef-c4f5-4093-8a00-12e4e1605bb0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:40.876586 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e27bedef-c4f5-4093-8a00-12e4e1605bb0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:40.941434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e27bedef-c4f5-4093-8a00-12e4e1605bb0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:40.947465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e27bedef-c4f5-4093-8a00-12e4e1605bb0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.085442 Aug 10 13:08:40.948470 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1727/3432] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:40 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:41.968373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4a1d19e4-23a7-4325-8ac4-7cf5de9047e1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:41.968998 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4a1d19e4-23a7-4325-8ac4-7cf5de9047e1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:41.975255 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4a1d19e4-23a7-4325-8ac4-7cf5de9047e1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:41.975734 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4a1d19e4-23a7-4325-8ac4-7cf5de9047e1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:41.976160 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4a1d19e4-23a7-4325-8ac4-7cf5de9047e1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:41.976836 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4a1d19e4-23a7-4325-8ac4-7cf5de9047e1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:41.977281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4a1d19e4-23a7-4325-8ac4-7cf5de9047e1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:41.977697 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4a1d19e4-23a7-4325-8ac4-7cf5de9047e1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:42.038701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4a1d19e4-23a7-4325-8ac4-7cf5de9047e1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:42.047273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4a1d19e4-23a7-4325-8ac4-7cf5de9047e1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082762 Aug 10 13:08:42.047852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1728/3433] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:41 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:43.068738 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-dbc33291-5c42-4056-bc24-9edc4908476e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:43.069384 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-dbc33291-5c42-4056-bc24-9edc4908476e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:43.076407 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dbc33291-5c42-4056-bc24-9edc4908476e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:43.076887 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dbc33291-5c42-4056-bc24-9edc4908476e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:43.077318 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dbc33291-5c42-4056-bc24-9edc4908476e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:43.078035 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dbc33291-5c42-4056-bc24-9edc4908476e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:43.078482 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dbc33291-5c42-4056-bc24-9edc4908476e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:43.078904 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dbc33291-5c42-4056-bc24-9edc4908476e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:43.141864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-dbc33291-5c42-4056-bc24-9edc4908476e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:43.149608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-dbc33291-5c42-4056-bc24-9edc4908476e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084778 Aug 10 13:08:43.150180 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1729/3434] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:43 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:44.170297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-94650c91-53d7-43f2-b6c5-74997c5f4483 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:44.170935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-94650c91-53d7-43f2-b6c5-74997c5f4483 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:44.177297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94650c91-53d7-43f2-b6c5-74997c5f4483 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:44.177775 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94650c91-53d7-43f2-b6c5-74997c5f4483 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:44.178211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94650c91-53d7-43f2-b6c5-74997c5f4483 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:44.178892 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94650c91-53d7-43f2-b6c5-74997c5f4483 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:44.179384 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94650c91-53d7-43f2-b6c5-74997c5f4483 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:44.179810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-94650c91-53d7-43f2-b6c5-74997c5f4483 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:44.240586 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-94650c91-53d7-43f2-b6c5-74997c5f4483 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:44.248414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-94650c91-53d7-43f2-b6c5-74997c5f4483 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082063 Aug 10 13:08:44.248975 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1730/3435] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:44 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:45.268270 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0badf319-1d9d-401b-92f9-0e54f8750472 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:45.268933 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0badf319-1d9d-401b-92f9-0e54f8750472 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:45.275425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0badf319-1d9d-401b-92f9-0e54f8750472 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:45.275902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0badf319-1d9d-401b-92f9-0e54f8750472 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:45.276324 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0badf319-1d9d-401b-92f9-0e54f8750472 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:45.277560 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0badf319-1d9d-401b-92f9-0e54f8750472 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:45.278128 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0badf319-1d9d-401b-92f9-0e54f8750472 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:45.278545 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0badf319-1d9d-401b-92f9-0e54f8750472 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:45.342013 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0badf319-1d9d-401b-92f9-0e54f8750472 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:45.349961 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0badf319-1d9d-401b-92f9-0e54f8750472 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.085615 Aug 10 13:08:45.350568 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1731/3436] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:45 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:46.371497 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4981fa29-d633-4be2-8bef-3f53fbda786c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:46.372114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4981fa29-d633-4be2-8bef-3f53fbda786c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:46.378558 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4981fa29-d633-4be2-8bef-3f53fbda786c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:46.379036 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4981fa29-d633-4be2-8bef-3f53fbda786c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:46.379499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4981fa29-d633-4be2-8bef-3f53fbda786c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:46.380184 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4981fa29-d633-4be2-8bef-3f53fbda786c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:46.380638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4981fa29-d633-4be2-8bef-3f53fbda786c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:46.381060 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4981fa29-d633-4be2-8bef-3f53fbda786c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:46.443673 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4981fa29-d633-4be2-8bef-3f53fbda786c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:46.452089 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4981fa29-d633-4be2-8bef-3f53fbda786c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084615 Aug 10 13:08:46.452655 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1732/3437] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:46 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:47.473385 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e3480f1e-3beb-4921-ae3e-d51f56f13823 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:47.474081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e3480f1e-3beb-4921-ae3e-d51f56f13823 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:47.480643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e3480f1e-3beb-4921-ae3e-d51f56f13823 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:47.481062 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e3480f1e-3beb-4921-ae3e-d51f56f13823 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:47.481499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e3480f1e-3beb-4921-ae3e-d51f56f13823 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:47.482457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e3480f1e-3beb-4921-ae3e-d51f56f13823 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:47.482910 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e3480f1e-3beb-4921-ae3e-d51f56f13823 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:47.483369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e3480f1e-3beb-4921-ae3e-d51f56f13823 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:47.545816 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e3480f1e-3beb-4921-ae3e-d51f56f13823 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:47.553705 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e3480f1e-3beb-4921-ae3e-d51f56f13823 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084151 Aug 10 13:08:47.554273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1733/3438] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:47 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:48.575806 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-cafed3d6-b38d-4921-8d11-ba190f23f625 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:48.576359 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-cafed3d6-b38d-4921-8d11-ba190f23f625 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:48.582355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cafed3d6-b38d-4921-8d11-ba190f23f625 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:48.582822 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cafed3d6-b38d-4921-8d11-ba190f23f625 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:48.583274 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cafed3d6-b38d-4921-8d11-ba190f23f625 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:48.583949 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cafed3d6-b38d-4921-8d11-ba190f23f625 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:48.584393 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cafed3d6-b38d-4921-8d11-ba190f23f625 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:48.584814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cafed3d6-b38d-4921-8d11-ba190f23f625 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:48.645753 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-cafed3d6-b38d-4921-8d11-ba190f23f625 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:48.654141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-cafed3d6-b38d-4921-8d11-ba190f23f625 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082848 Aug 10 13:08:48.654700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1734/3439] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:48 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:49.674781 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0db0488e-3d4b-4797-8930-71cb0229423f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:49.675422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0db0488e-3d4b-4797-8930-71cb0229423f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:49.681716 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0db0488e-3d4b-4797-8930-71cb0229423f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:49.682195 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0db0488e-3d4b-4797-8930-71cb0229423f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:49.682628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0db0488e-3d4b-4797-8930-71cb0229423f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:49.683990 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0db0488e-3d4b-4797-8930-71cb0229423f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:49.684447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0db0488e-3d4b-4797-8930-71cb0229423f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:49.684875 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0db0488e-3d4b-4797-8930-71cb0229423f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:49.687417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:49.746492 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0db0488e-3d4b-4797-8930-71cb0229423f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:49.754290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0db0488e-3d4b-4797-8930-71cb0229423f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083422 Aug 10 13:08:49.754855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1735/3440] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:49 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:50.775370 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e97d98ca-8fd4-4904-8439-7d048bac9549 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:50.776089 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e97d98ca-8fd4-4904-8439-7d048bac9549 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:50.782521 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e97d98ca-8fd4-4904-8439-7d048bac9549 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:50.783006 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e97d98ca-8fd4-4904-8439-7d048bac9549 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:50.783469 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e97d98ca-8fd4-4904-8439-7d048bac9549 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:50.784157 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e97d98ca-8fd4-4904-8439-7d048bac9549 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:50.784609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e97d98ca-8fd4-4904-8439-7d048bac9549 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:50.785035 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e97d98ca-8fd4-4904-8439-7d048bac9549 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:50.845419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e97d98ca-8fd4-4904-8439-7d048bac9549 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:50.853220 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e97d98ca-8fd4-4904-8439-7d048bac9549 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.081786 Aug 10 13:08:50.853788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1736/3441] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:50 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:51.874590 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-56c1e247-d872-4db8-9fde-287762e7d2a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:51.875258 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-56c1e247-d872-4db8-9fde-287762e7d2a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:51.881612 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56c1e247-d872-4db8-9fde-287762e7d2a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:51.882091 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56c1e247-d872-4db8-9fde-287762e7d2a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:51.882524 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56c1e247-d872-4db8-9fde-287762e7d2a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:51.883243 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56c1e247-d872-4db8-9fde-287762e7d2a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:51.883908 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56c1e247-d872-4db8-9fde-287762e7d2a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:51.884308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56c1e247-d872-4db8-9fde-287762e7d2a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:51.948064 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-56c1e247-d872-4db8-9fde-287762e7d2a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:51.956673 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-56c1e247-d872-4db8-9fde-287762e7d2a1 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.086070 Aug 10 13:08:51.957233 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1737/3442] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:51 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:52.977640 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-36ad6824-e9a6-4c2e-83dd-4b3adff7614e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:52.978283 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-36ad6824-e9a6-4c2e-83dd-4b3adff7614e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:52.989616 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36ad6824-e9a6-4c2e-83dd-4b3adff7614e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:52.990097 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36ad6824-e9a6-4c2e-83dd-4b3adff7614e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:52.990527 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36ad6824-e9a6-4c2e-83dd-4b3adff7614e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:52.991249 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36ad6824-e9a6-4c2e-83dd-4b3adff7614e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:52.991714 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36ad6824-e9a6-4c2e-83dd-4b3adff7614e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:52.992130 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-36ad6824-e9a6-4c2e-83dd-4b3adff7614e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:53.052842 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-36ad6824-e9a6-4c2e-83dd-4b3adff7614e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:53.060831 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-36ad6824-e9a6-4c2e-83dd-4b3adff7614e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.087071 Aug 10 13:08:53.061395 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1738/3443] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:52 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:54.080823 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9e9dc452-3f62-44d3-bbbb-a62d4c601bba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:54.081456 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9e9dc452-3f62-44d3-bbbb-a62d4c601bba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:54.087759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e9dc452-3f62-44d3-bbbb-a62d4c601bba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:54.088233 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e9dc452-3f62-44d3-bbbb-a62d4c601bba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:54.088658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e9dc452-3f62-44d3-bbbb-a62d4c601bba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:54.089332 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e9dc452-3f62-44d3-bbbb-a62d4c601bba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:54.089813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e9dc452-3f62-44d3-bbbb-a62d4c601bba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:54.090229 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e9dc452-3f62-44d3-bbbb-a62d4c601bba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:54.153133 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9e9dc452-3f62-44d3-bbbb-a62d4c601bba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:54.161235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9e9dc452-3f62-44d3-bbbb-a62d4c601bba tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084139 Aug 10 13:08:54.161603 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1739/3444] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:54 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:55.181777 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-65417199-9953-400f-8c34-3e971d72d225 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:55.182435 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-65417199-9953-400f-8c34-3e971d72d225 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:55.188792 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-65417199-9953-400f-8c34-3e971d72d225 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:55.189275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-65417199-9953-400f-8c34-3e971d72d225 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:55.189708 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-65417199-9953-400f-8c34-3e971d72d225 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:55.190418 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-65417199-9953-400f-8c34-3e971d72d225 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:55.190868 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-65417199-9953-400f-8c34-3e971d72d225 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:55.191318 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-65417199-9953-400f-8c34-3e971d72d225 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:55.251606 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-65417199-9953-400f-8c34-3e971d72d225 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:55.259641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-65417199-9953-400f-8c34-3e971d72d225 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.081659 Aug 10 13:08:55.260218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1740/3445] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:55 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:56.280912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3613a6c7-b497-47c4-870a-b3d1e8423c3b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:56.281526 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3613a6c7-b497-47c4-870a-b3d1e8423c3b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:56.288000 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3613a6c7-b497-47c4-870a-b3d1e8423c3b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:56.288479 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3613a6c7-b497-47c4-870a-b3d1e8423c3b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:56.288914 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3613a6c7-b497-47c4-870a-b3d1e8423c3b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:56.289641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3613a6c7-b497-47c4-870a-b3d1e8423c3b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:56.290093 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3613a6c7-b497-47c4-870a-b3d1e8423c3b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:56.290518 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3613a6c7-b497-47c4-870a-b3d1e8423c3b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:56.354457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3613a6c7-b497-47c4-870a-b3d1e8423c3b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:56.363230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3613a6c7-b497-47c4-870a-b3d1e8423c3b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.086364 Aug 10 13:08:56.363766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1741/3446] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:56 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:57.384946 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-12c1f0bc-0db3-40ad-86aa-305a76899064 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:57.385563 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-12c1f0bc-0db3-40ad-86aa-305a76899064 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:57.388592 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=56 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:08:57.393485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12c1f0bc-0db3-40ad-86aa-305a76899064 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:57.393976 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12c1f0bc-0db3-40ad-86aa-305a76899064 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:57.394412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12c1f0bc-0db3-40ad-86aa-305a76899064 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:57.395114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12c1f0bc-0db3-40ad-86aa-305a76899064 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:57.395594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12c1f0bc-0db3-40ad-86aa-305a76899064 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:57.401677 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-12c1f0bc-0db3-40ad-86aa-305a76899064 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:57.503245 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-12c1f0bc-0db3-40ad-86aa-305a76899064 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:57.511059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-12c1f0bc-0db3-40ad-86aa-305a76899064 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.130090 Aug 10 13:08:57.511661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1742/3447] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:57 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:58.532977 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7e643f46-ef8c-460a-83f6-03126737d8c2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:58.533577 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7e643f46-ef8c-460a-83f6-03126737d8c2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:58.540032 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7e643f46-ef8c-460a-83f6-03126737d8c2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:58.540506 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7e643f46-ef8c-460a-83f6-03126737d8c2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:58.540932 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7e643f46-ef8c-460a-83f6-03126737d8c2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:58.541611 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7e643f46-ef8c-460a-83f6-03126737d8c2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:58.542057 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7e643f46-ef8c-460a-83f6-03126737d8c2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:58.542476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7e643f46-ef8c-460a-83f6-03126737d8c2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:58.602948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7e643f46-ef8c-460a-83f6-03126737d8c2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:58.611443 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7e643f46-ef8c-460a-83f6-03126737d8c2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082476 Aug 10 13:08:58.612009 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1743/3448] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:58 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:08:59.632061 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-aa172476-22b2-41ae-a659-22147aed9b9f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:08:59.632680 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-aa172476-22b2-41ae-a659-22147aed9b9f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:08:59.639632 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa172476-22b2-41ae-a659-22147aed9b9f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:59.640119 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa172476-22b2-41ae-a659-22147aed9b9f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:59.640588 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa172476-22b2-41ae-a659-22147aed9b9f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:59.641273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa172476-22b2-41ae-a659-22147aed9b9f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:08:59.641725 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa172476-22b2-41ae-a659-22147aed9b9f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:08:59.642175 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-aa172476-22b2-41ae-a659-22147aed9b9f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:08:59.705920 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-aa172476-22b2-41ae-a659-22147aed9b9f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:08:59.713766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-aa172476-22b2-41ae-a659-22147aed9b9f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.085671 Aug 10 13:08:59.714331 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1744/3449] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:08:59 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:09:00.735879 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-884c2233-4a7f-452b-9146-3236cd823067 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:09:00.736582 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-884c2233-4a7f-452b-9146-3236cd823067 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:09:00.742755 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-884c2233-4a7f-452b-9146-3236cd823067 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:00.743252 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-884c2233-4a7f-452b-9146-3236cd823067 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:00.743683 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-884c2233-4a7f-452b-9146-3236cd823067 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:00.744356 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-884c2233-4a7f-452b-9146-3236cd823067 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:00.744830 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-884c2233-4a7f-452b-9146-3236cd823067 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:00.745242 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-884c2233-4a7f-452b-9146-3236cd823067 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:00.806117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-884c2233-4a7f-452b-9146-3236cd823067 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:09:00.815148 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-884c2233-4a7f-452b-9146-3236cd823067 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083292 Aug 10 13:09:00.815676 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1745/3450] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:09:00 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:09:01.835834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2e9e2d92-8fe7-472a-a0e3-4b72e89500ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:09:01.836462 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2e9e2d92-8fe7-472a-a0e3-4b72e89500ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:09:01.843521 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e9e2d92-8fe7-472a-a0e3-4b72e89500ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:01.843995 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e9e2d92-8fe7-472a-a0e3-4b72e89500ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:01.844422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e9e2d92-8fe7-472a-a0e3-4b72e89500ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:01.845100 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e9e2d92-8fe7-472a-a0e3-4b72e89500ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:01.845575 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e9e2d92-8fe7-472a-a0e3-4b72e89500ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:01.845997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e9e2d92-8fe7-472a-a0e3-4b72e89500ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:01.908677 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2e9e2d92-8fe7-472a-a0e3-4b72e89500ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:09:01.916569 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2e9e2d92-8fe7-472a-a0e3-4b72e89500ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084541 Aug 10 13:09:01.917139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1746/3451] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:09:01 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:09:02.938759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7c6fcfe7-9d80-4d31-a3d7-dc9eea3eb497 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:09:02.939390 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7c6fcfe7-9d80-4d31-a3d7-dc9eea3eb497 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:09:02.945698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c6fcfe7-9d80-4d31-a3d7-dc9eea3eb497 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:02.946176 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c6fcfe7-9d80-4d31-a3d7-dc9eea3eb497 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:02.946609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c6fcfe7-9d80-4d31-a3d7-dc9eea3eb497 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:02.947320 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c6fcfe7-9d80-4d31-a3d7-dc9eea3eb497 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:02.947770 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c6fcfe7-9d80-4d31-a3d7-dc9eea3eb497 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:02.948192 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c6fcfe7-9d80-4d31-a3d7-dc9eea3eb497 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:03.009986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7c6fcfe7-9d80-4d31-a3d7-dc9eea3eb497 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:09:03.017938 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7c6fcfe7-9d80-4d31-a3d7-dc9eea3eb497 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082983 Aug 10 13:09:03.018499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1747/3452] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:09:02 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:09:04.038887 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fccc7ee3-8e33-43a2-84bb-77fd806df7e9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:09:04.039602 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fccc7ee3-8e33-43a2-84bb-77fd806df7e9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:09:04.046564 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fccc7ee3-8e33-43a2-84bb-77fd806df7e9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:04.047048 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fccc7ee3-8e33-43a2-84bb-77fd806df7e9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:04.047509 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fccc7ee3-8e33-43a2-84bb-77fd806df7e9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:04.048199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fccc7ee3-8e33-43a2-84bb-77fd806df7e9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:04.048656 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fccc7ee3-8e33-43a2-84bb-77fd806df7e9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:04.049079 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fccc7ee3-8e33-43a2-84bb-77fd806df7e9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:04.112067 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fccc7ee3-8e33-43a2-84bb-77fd806df7e9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:09:04.119970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fccc7ee3-8e33-43a2-84bb-77fd806df7e9 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.084987 Aug 10 13:09:04.120541 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1748/3453] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:09:04 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:09:05.140816 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6ee54ae3-7dfb-4858-89f2-55f129ba4fb7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:09:05.141412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6ee54ae3-7dfb-4858-89f2-55f129ba4fb7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:09:05.147733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ee54ae3-7dfb-4858-89f2-55f129ba4fb7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:05.148213 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ee54ae3-7dfb-4858-89f2-55f129ba4fb7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:05.148646 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ee54ae3-7dfb-4858-89f2-55f129ba4fb7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:05.149335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ee54ae3-7dfb-4858-89f2-55f129ba4fb7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:05.149787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ee54ae3-7dfb-4858-89f2-55f129ba4fb7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:05.150213 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ee54ae3-7dfb-4858-89f2-55f129ba4fb7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:05.211033 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6ee54ae3-7dfb-4858-89f2-55f129ba4fb7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:09:05.219164 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6ee54ae3-7dfb-4858-89f2-55f129ba4fb7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082356 Aug 10 13:09:05.219752 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1749/3454] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:09:05 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:09:06.240655 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bcb0be83-9fe9-4afd-9307-5576c6509399 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:09:06.241267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bcb0be83-9fe9-4afd-9307-5576c6509399 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:09:06.247664 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bcb0be83-9fe9-4afd-9307-5576c6509399 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:06.248151 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bcb0be83-9fe9-4afd-9307-5576c6509399 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:06.248578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bcb0be83-9fe9-4afd-9307-5576c6509399 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:06.249257 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bcb0be83-9fe9-4afd-9307-5576c6509399 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:06.249698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bcb0be83-9fe9-4afd-9307-5576c6509399 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:06.250113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bcb0be83-9fe9-4afd-9307-5576c6509399 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:06.310637 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-bcb0be83-9fe9-4afd-9307-5576c6509399 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:09:06.318500 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bcb0be83-9fe9-4afd-9307-5576c6509399 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.081724 Aug 10 13:09:06.319055 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1750/3455] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:09:06 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:09:07.338612 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f2cd6cee-d3f0-4073-a812-c4b8fa1cb450 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:09:07.339283 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f2cd6cee-d3f0-4073-a812-c4b8fa1cb450 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:09:07.346327 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2cd6cee-d3f0-4073-a812-c4b8fa1cb450 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:07.346806 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2cd6cee-d3f0-4073-a812-c4b8fa1cb450 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:07.347264 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2cd6cee-d3f0-4073-a812-c4b8fa1cb450 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:07.347949 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2cd6cee-d3f0-4073-a812-c4b8fa1cb450 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:07.348402 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2cd6cee-d3f0-4073-a812-c4b8fa1cb450 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:07.348824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2cd6cee-d3f0-4073-a812-c4b8fa1cb450 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:07.408915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f2cd6cee-d3f0-4073-a812-c4b8fa1cb450 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:09:07.411024 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:07.417323 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f2cd6cee-d3f0-4073-a812-c4b8fa1cb450 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082573 Aug 10 13:09:07.417884 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1751/3456] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:09:07 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:09:08.438155 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d0b18c00-756a-4106-9bb3-e151dfb0df3f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:09:08.438767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d0b18c00-756a-4106-9bb3-e151dfb0df3f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:09:08.445465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0b18c00-756a-4106-9bb3-e151dfb0df3f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:08.445949 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0b18c00-756a-4106-9bb3-e151dfb0df3f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:08.446382 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0b18c00-756a-4106-9bb3-e151dfb0df3f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:08.447065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0b18c00-756a-4106-9bb3-e151dfb0df3f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:08.447543 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0b18c00-756a-4106-9bb3-e151dfb0df3f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:08.447997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d0b18c00-756a-4106-9bb3-e151dfb0df3f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:08.513097 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d0b18c00-756a-4106-9bb3-e151dfb0df3f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:09:08.521008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d0b18c00-756a-4106-9bb3-e151dfb0df3f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.087217 Aug 10 13:09:08.521581 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1752/3457] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:09:08 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:09:09.542072 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-90bb2b87-9e4e-4d66-8899-3d7cbb8ce2ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:09:09.542661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-90bb2b87-9e4e-4d66-8899-3d7cbb8ce2ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:09:09.549071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90bb2b87-9e4e-4d66-8899-3d7cbb8ce2ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:09.549551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90bb2b87-9e4e-4d66-8899-3d7cbb8ce2ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:09.549986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90bb2b87-9e4e-4d66-8899-3d7cbb8ce2ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:09.550667 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90bb2b87-9e4e-4d66-8899-3d7cbb8ce2ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:09.551135 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90bb2b87-9e4e-4d66-8899-3d7cbb8ce2ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:09.551572 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90bb2b87-9e4e-4d66-8899-3d7cbb8ce2ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:09.611993 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-90bb2b87-9e4e-4d66-8899-3d7cbb8ce2ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:09:09.619745 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-90bb2b87-9e4e-4d66-8899-3d7cbb8ce2ca tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.081602 Aug 10 13:09:09.620314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1753/3458] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:09:09 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:09:10.640471 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ec1ef78e-9833-450a-bef1-8afaad4f6c07 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:09:10.641056 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ec1ef78e-9833-450a-bef1-8afaad4f6c07 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:09:10.647424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec1ef78e-9833-450a-bef1-8afaad4f6c07 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:10.647904 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec1ef78e-9833-450a-bef1-8afaad4f6c07 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:10.648337 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec1ef78e-9833-450a-bef1-8afaad4f6c07 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:10.649050 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec1ef78e-9833-450a-bef1-8afaad4f6c07 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:10.649503 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec1ef78e-9833-450a-bef1-8afaad4f6c07 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:10.649929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec1ef78e-9833-450a-bef1-8afaad4f6c07 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:10.710934 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ec1ef78e-9833-450a-bef1-8afaad4f6c07 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:09:10.719384 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ec1ef78e-9833-450a-bef1-8afaad4f6c07 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.082839 Aug 10 13:09:10.719955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1754/3459] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:09:10 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:09:11.740930 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-775d6bd5-a78b-40fd-b37f-87319dfc49bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:09:11.741610 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-775d6bd5-a78b-40fd-b37f-87319dfc49bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:09:11.748500 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-775d6bd5-a78b-40fd-b37f-87319dfc49bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:11.748980 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-775d6bd5-a78b-40fd-b37f-87319dfc49bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:11.749414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-775d6bd5-a78b-40fd-b37f-87319dfc49bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:11.750100 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-775d6bd5-a78b-40fd-b37f-87319dfc49bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:11.750553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-775d6bd5-a78b-40fd-b37f-87319dfc49bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:11.750974 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-775d6bd5-a78b-40fd-b37f-87319dfc49bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:11.819900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-775d6bd5-a78b-40fd-b37f-87319dfc49bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:09:11.828531 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-775d6bd5-a78b-40fd-b37f-87319dfc49bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.091515 Aug 10 13:09:11.829107 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1755/3460] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:09:11 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:09:12.849924 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-88984059-540d-471d-b6a9-0e9f4424273e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:09:12.850573 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-88984059-540d-471d-b6a9-0e9f4424273e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:09:12.856773 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-88984059-540d-471d-b6a9-0e9f4424273e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:12.857532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-88984059-540d-471d-b6a9-0e9f4424273e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:12.857956 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-88984059-540d-471d-b6a9-0e9f4424273e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:12.858630 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-88984059-540d-471d-b6a9-0e9f4424273e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:12.859073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-88984059-540d-471d-b6a9-0e9f4424273e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:12.859526 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-88984059-540d-471d-b6a9-0e9f4424273e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:12.922236 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-88984059-540d-471d-b6a9-0e9f4424273e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:09:12.929985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-88984059-540d-471d-b6a9-0e9f4424273e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083930 Aug 10 13:09:12.930538 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1756/3461] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:09:12 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:09:13.951874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e56a751a-8b5f-48f8-946c-8542f3b10748 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:09:13.952501 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e56a751a-8b5f-48f8-946c-8542f3b10748 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:09:13.958837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e56a751a-8b5f-48f8-946c-8542f3b10748 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:13.959345 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e56a751a-8b5f-48f8-946c-8542f3b10748 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:13.959777 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e56a751a-8b5f-48f8-946c-8542f3b10748 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:13.960453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e56a751a-8b5f-48f8-946c-8542f3b10748 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:13.960898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e56a751a-8b5f-48f8-946c-8542f3b10748 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:13.961314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e56a751a-8b5f-48f8-946c-8542f3b10748 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:14.022519 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e56a751a-8b5f-48f8-946c-8542f3b10748 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:09:14.031050 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e56a751a-8b5f-48f8-946c-8542f3b10748 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083150 Aug 10 13:09:14.031646 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1757/3462] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:09:13 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:09:15.051929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5e08daab-35b0-44a2-b03e-96918077d6d2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:09:15.052556 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5e08daab-35b0-44a2-b03e-96918077d6d2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:09:15.058884 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e08daab-35b0-44a2-b03e-96918077d6d2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:15.059399 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e08daab-35b0-44a2-b03e-96918077d6d2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:15.059827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e08daab-35b0-44a2-b03e-96918077d6d2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:15.061231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e08daab-35b0-44a2-b03e-96918077d6d2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:15.061663 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e08daab-35b0-44a2-b03e-96918077d6d2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:15.062082 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5e08daab-35b0-44a2-b03e-96918077d6d2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:15.121448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5e08daab-35b0-44a2-b03e-96918077d6d2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:09:15.129878 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5e08daab-35b0-44a2-b03e-96918077d6d2 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.081772 Aug 10 13:09:15.131316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1758/3463] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:09:15 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:09:16.150443 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-914f4d87-9f65-4fac-9246-7a80e19d21f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:09:16.151078 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-914f4d87-9f65-4fac-9246-7a80e19d21f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:09:16.157555 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-914f4d87-9f65-4fac-9246-7a80e19d21f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:16.158030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-914f4d87-9f65-4fac-9246-7a80e19d21f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:16.158459 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-914f4d87-9f65-4fac-9246-7a80e19d21f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:16.159149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-914f4d87-9f65-4fac-9246-7a80e19d21f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:16.159618 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-914f4d87-9f65-4fac-9246-7a80e19d21f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:16.160045 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-914f4d87-9f65-4fac-9246-7a80e19d21f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:16.222363 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-914f4d87-9f65-4fac-9246-7a80e19d21f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:09:16.230185 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-914f4d87-9f65-4fac-9246-7a80e19d21f0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 200 len: 1367 microversion: 2.1 time: 0.083611 Aug 10 13:09:16.230746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1759/3464] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:09:16 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:09:16.251298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b9df5488-35d0-47f1-80c2-b64ed4da3f7d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '.version_select at 0x7fb826accf70>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:09:16.371706 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b9df5488-35d0-47f1-80c2-b64ed4da3f7d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-276155907" status: 202 len: 0 microversion: 2.1 time: 0.124286 Aug 10 13:09:16.372280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1760/3465] 10.222.0.49 () {58 vars in 1218 bytes} [Wed Aug 10 13:09:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-276155907 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 13:09:17.291041 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-35f6442d-03b6-4506-a569-69e0188bf958 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Action: 'create', calling method: .version_select at 0x7fb82b26b040>, body: {"keypair": {"name": "tempest-keypair-789293746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJIvulOhIg+nN41Jbp302JVBsFNdikf4RDM0eqbJcOvpIrGMw/kMAYHxFWyQnhTyez7UX+2/NpDMW7tUtAYMxp+FpBRkgepPhIR8MeCjvKp+AkaJ0WTL3IZIQYamZOhlw=="}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:09:17.310970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-35f6442d-03b6-4506-a569-69e0188bf958 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Getting quotas for project 9a40b36dd9944cb88fd54181f7f29685. Resources: {'key_pairs'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:09:17.315925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-35f6442d-03b6-4506-a569-69e0188bf958 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Getting quotas for user c0ada1accf1742b393e8a12c60074b9e and project 9a40b36dd9944cb88fd54181f7f29685. Resources: {'key_pairs'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:09:17.406471 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-35f6442d-03b6-4506-a569-69e0188bf958 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.119864 Aug 10 13:09:17.407170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1761/3466] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 10 13:09:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:09:19.465970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9aa08276-3f50-4e4d-8042-bba92b3d7853 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1813399920", "imageRef": "674dcf76-6c38-40de-b204-ad2842738058", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90267d37-6f88-42d0-bf81-3486300deb9f"}], "security_groups": [{"name": "tempest-securitygroup--1384507929"}], "key_name": "tempest-keypair-789293746", "user_data": "}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:09:19.568027 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.network.neutron [None req-9aa08276-3f50-4e4d-8042-bba92b3d7853 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] validate_networks() for [('90267d37-6f88-42d0-bf81-3486300deb9f', None, None, None, None, None)] {{(pid=124643) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:09:19.975908 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-9aa08276-3f50-4e4d-8042-bba92b3d7853 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Flavor limits 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:09:19.976332 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-9aa08276-3f50-4e4d-8042-bba92b3d7853 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Image limits 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:09:19.976916 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-9aa08276-3f50-4e4d-8042-bba92b3d7853 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Flavor pref 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:09:19.977326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-9aa08276-3f50-4e4d-8042-bba92b3d7853 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Image pref 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:09:19.977733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-9aa08276-3f50-4e4d-8042-bba92b3d7853 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:09:19.987319 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9aa08276-3f50-4e4d-8042-bba92b3d7853 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:19.987786 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9aa08276-3f50-4e4d-8042-bba92b3d7853 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:19.988238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9aa08276-3f50-4e4d-8042-bba92b3d7853 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:19.989004 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9aa08276-3f50-4e4d-8042-bba92b3d7853 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:19.989400 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9aa08276-3f50-4e4d-8042-bba92b3d7853 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:19.989818 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9aa08276-3f50-4e4d-8042-bba92b3d7853 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:20.006823 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-9aa08276-3f50-4e4d-8042-bba92b3d7853 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Getting quotas for project 9a40b36dd9944cb88fd54181f7f29685. Resources: {'cores', 'ram', 'instances'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:09:20.010743 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-9aa08276-3f50-4e4d-8042-bba92b3d7853 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Getting quotas for user c0ada1accf1742b393e8a12c60074b9e and project 9a40b36dd9944cb88fd54181f7f29685. Resources: {'cores', 'ram', 'instances'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:09:20.021938 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9aa08276-3f50-4e4d-8042-bba92b3d7853 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Going to run 1 instances... {{(pid=124643) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:09:20.024194 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9aa08276-3f50-4e4d-8042-bba92b3d7853 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 2c84c97f-03d4-474e-9a53-714e127d4371] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='674dcf76-6c38-40de-b204-ad2842738058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:09:20.145126 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9aa08276-3f50-4e4d-8042-bba92b3d7853 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.683594 Aug 10 13:09:20.145745 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1762/3467] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 13:09:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 13:09:20.157046 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9077d155-cc5b-4656-9fbc-2cad17f16055 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:09:20.157652 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9077d155-cc5b-4656-9fbc-2cad17f16055 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 2c84c97f-03d4-474e-9a53-714e127d4371] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:09:20.212518 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9077d155-cc5b-4656-9fbc-2cad17f16055 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:09:20.220044 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9077d155-cc5b-4656-9fbc-2cad17f16055 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371" status: 200 len: 1237 microversion: 2.1 time: 0.067307 Aug 10 13:09:20.220649 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1763/3468] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:09:20 2022] GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:09:21.241393 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0609e69d-f371-4559-aa78-255db6956a5d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:09:21.242018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0609e69d-f371-4559-aa78-255db6956a5d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 2c84c97f-03d4-474e-9a53-714e127d4371] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:09:21.248885 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0609e69d-f371-4559-aa78-255db6956a5d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:21.249361 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0609e69d-f371-4559-aa78-255db6956a5d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:21.250375 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0609e69d-f371-4559-aa78-255db6956a5d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:21.251056 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0609e69d-f371-4559-aa78-255db6956a5d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:21.251525 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0609e69d-f371-4559-aa78-255db6956a5d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:21.251944 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0609e69d-f371-4559-aa78-255db6956a5d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:21.313133 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0609e69d-f371-4559-aa78-255db6956a5d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:09:21.320464 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0609e69d-f371-4559-aa78-255db6956a5d tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371" status: 200 len: 1241 microversion: 2.1 time: 0.082990 Aug 10 13:09:21.324082 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1764/3469] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:09:21 2022] GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371 => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:09:22.341282 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-55bc512a-b48a-4449-8d1a-36ebc022e2bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:09:22.341937 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-55bc512a-b48a-4449-8d1a-36ebc022e2bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 2c84c97f-03d4-474e-9a53-714e127d4371] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:09:22.349373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55bc512a-b48a-4449-8d1a-36ebc022e2bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:22.352252 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55bc512a-b48a-4449-8d1a-36ebc022e2bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:22.352252 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55bc512a-b48a-4449-8d1a-36ebc022e2bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:22.352252 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55bc512a-b48a-4449-8d1a-36ebc022e2bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:22.352252 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55bc512a-b48a-4449-8d1a-36ebc022e2bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:22.352591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-55bc512a-b48a-4449-8d1a-36ebc022e2bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:22.419080 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-55bc512a-b48a-4449-8d1a-36ebc022e2bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:09:22.426880 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-55bc512a-b48a-4449-8d1a-36ebc022e2bd tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371" status: 200 len: 1307 microversion: 2.1 time: 0.089486 Aug 10 13:09:22.427515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1765/3470] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:09:22 2022] GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371 => generated 1307 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:09:23.448186 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-526d50b6-26f3-46ec-a7a5-35ab6157fd52 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:09:23.448803 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-526d50b6-26f3-46ec-a7a5-35ab6157fd52 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 2c84c97f-03d4-474e-9a53-714e127d4371] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:09:23.455906 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-526d50b6-26f3-46ec-a7a5-35ab6157fd52 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:23.456473 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-526d50b6-26f3-46ec-a7a5-35ab6157fd52 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:23.456916 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-526d50b6-26f3-46ec-a7a5-35ab6157fd52 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:23.457618 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-526d50b6-26f3-46ec-a7a5-35ab6157fd52 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:23.458075 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-526d50b6-26f3-46ec-a7a5-35ab6157fd52 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:23.458502 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-526d50b6-26f3-46ec-a7a5-35ab6157fd52 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:23.621173 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-526d50b6-26f3-46ec-a7a5-35ab6157fd52 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:09:23.629816 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-526d50b6-26f3-46ec-a7a5-35ab6157fd52 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371" status: 200 len: 1363 microversion: 2.1 time: 0.185595 Aug 10 13:09:23.630391 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1766/3471] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:09:23 2022] GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:09:23.701229 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-ea452cec-a507-4454-b879-b46e263ad845 req-326b8a66-dfe8-418e-b983-109dad785ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c84c97f-03d4-474e-9a53-714e127d4371", "tag": "dd4767a6-ab0d-41b8-9278-e599b8dd05b0"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:09:23.711239 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-ea452cec-a507-4454-b879-b46e263ad845 req-326b8a66-dfe8-418e-b983-109dad785ed7 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:23.711719 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-ea452cec-a507-4454-b879-b46e263ad845 req-326b8a66-dfe8-418e-b983-109dad785ed7 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:23.712154 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-ea452cec-a507-4454-b879-b46e263ad845 req-326b8a66-dfe8-418e-b983-109dad785ed7 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:23.723604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-ea452cec-a507-4454-b879-b46e263ad845 req-326b8a66-dfe8-418e-b983-109dad785ed7 service nova] Creating event network-changed:dd4767a6-ab0d-41b8-9278-e599b8dd05b0 for instance 2c84c97f-03d4-474e-9a53-714e127d4371 on hv-cinder-85199 Aug 10 13:09:23.727026 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR oslo.messaging._drivers.impl_rabbit [req-ea452cec-a507-4454-b879-b46e263ad845 req-326b8a66-dfe8-418e-b983-109dad785ed7 service nova] [7e044c67-15e3-4fc7-bc18-3c975a9c203b] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 13:09:24.734569 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [req-ea452cec-a507-4454-b879-b46e263ad845 req-326b8a66-dfe8-418e-b983-109dad785ed7 service nova] [7e044c67-15e3-4fc7-bc18-3c975a9c203b] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 51228. Aug 10 13:09:24.737658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-ea452cec-a507-4454-b879-b46e263ad845 req-326b8a66-dfe8-418e-b983-109dad785ed7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.106338 Aug 10 13:09:24.738264 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1767/3472] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:09:24.743293 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-26ac5310-c210-4f8c-94e1-13b0abd05503 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:09:24.744012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-26ac5310-c210-4f8c-94e1-13b0abd05503 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 2c84c97f-03d4-474e-9a53-714e127d4371] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:09:24.750141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26ac5310-c210-4f8c-94e1-13b0abd05503 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:24.750614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26ac5310-c210-4f8c-94e1-13b0abd05503 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:24.751046 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26ac5310-c210-4f8c-94e1-13b0abd05503 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:24.751755 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26ac5310-c210-4f8c-94e1-13b0abd05503 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:24.752212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26ac5310-c210-4f8c-94e1-13b0abd05503 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:24.752631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-26ac5310-c210-4f8c-94e1-13b0abd05503 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:24.880057 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-26ac5310-c210-4f8c-94e1-13b0abd05503 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:09:24.887418 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-26ac5310-c210-4f8c-94e1-13b0abd05503 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371" status: 200 len: 1363 microversion: 2.1 time: 0.148031 Aug 10 13:09:24.887984 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1768/3473] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:09:24 2022] GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:09:25.909515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c603accf-bb82-4bf7-9103-feafeb07dc5f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:09:25.910132 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c603accf-bb82-4bf7-9103-feafeb07dc5f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 2c84c97f-03d4-474e-9a53-714e127d4371] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:09:25.917128 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c603accf-bb82-4bf7-9103-feafeb07dc5f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:25.917621 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c603accf-bb82-4bf7-9103-feafeb07dc5f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:25.918057 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c603accf-bb82-4bf7-9103-feafeb07dc5f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:25.918756 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c603accf-bb82-4bf7-9103-feafeb07dc5f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:25.919228 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c603accf-bb82-4bf7-9103-feafeb07dc5f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:25.919656 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c603accf-bb82-4bf7-9103-feafeb07dc5f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:26.050697 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c603accf-bb82-4bf7-9103-feafeb07dc5f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:09:26.058237 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c603accf-bb82-4bf7-9103-feafeb07dc5f tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371" status: 200 len: 1363 microversion: 2.1 time: 0.153265 Aug 10 13:09:26.067809 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1769/3474] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:09:25 2022] GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:09:27.080068 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7458c927-669e-4d03-a1a3-c854585e9a4e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:09:27.080716 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7458c927-669e-4d03-a1a3-c854585e9a4e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 2c84c97f-03d4-474e-9a53-714e127d4371] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:09:27.087115 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7458c927-669e-4d03-a1a3-c854585e9a4e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:27.087623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7458c927-669e-4d03-a1a3-c854585e9a4e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:27.088057 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7458c927-669e-4d03-a1a3-c854585e9a4e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:27.088742 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7458c927-669e-4d03-a1a3-c854585e9a4e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:27.089193 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7458c927-669e-4d03-a1a3-c854585e9a4e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:27.089616 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7458c927-669e-4d03-a1a3-c854585e9a4e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:27.220243 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7458c927-669e-4d03-a1a3-c854585e9a4e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:09:27.227606 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7458c927-669e-4d03-a1a3-c854585e9a4e tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371" status: 200 len: 1363 microversion: 2.1 time: 0.151902 Aug 10 13:09:27.228171 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1770/3475] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:09:27 2022] GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:09:27.875511 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-c8c3de65-6d79-40d0-ad53-2cdae39c8041 req-574e5548-a00a-4001-80a1-6bde6396fc72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c84c97f-03d4-474e-9a53-714e127d4371", "name": "network-vif-plugged", "status": "completed", "tag": "dd4767a6-ab0d-41b8-9278-e599b8dd05b0"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:09:27.880479 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:27.885516 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-c8c3de65-6d79-40d0-ad53-2cdae39c8041 req-574e5548-a00a-4001-80a1-6bde6396fc72 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:27.885991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-c8c3de65-6d79-40d0-ad53-2cdae39c8041 req-574e5548-a00a-4001-80a1-6bde6396fc72 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:27.886416 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-c8c3de65-6d79-40d0-ad53-2cdae39c8041 req-574e5548-a00a-4001-80a1-6bde6396fc72 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:27.897771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-c8c3de65-6d79-40d0-ad53-2cdae39c8041 req-574e5548-a00a-4001-80a1-6bde6396fc72 service nova] Creating event network-vif-plugged:dd4767a6-ab0d-41b8-9278-e599b8dd05b0 for instance 2c84c97f-03d4-474e-9a53-714e127d4371 on hv-cinder-85199 Aug 10 13:09:27.902652 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-c8c3de65-6d79-40d0-ad53-2cdae39c8041 req-574e5548-a00a-4001-80a1-6bde6396fc72 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085027 Aug 10 13:09:27.903261 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1771/3476] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:09:28.250093 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-90a64e32-77c2-4117-b84b-73c84939bf59 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:09:28.250790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-90a64e32-77c2-4117-b84b-73c84939bf59 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 2c84c97f-03d4-474e-9a53-714e127d4371] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:09:28.257480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90a64e32-77c2-4117-b84b-73c84939bf59 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:28.257960 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90a64e32-77c2-4117-b84b-73c84939bf59 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:28.258395 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90a64e32-77c2-4117-b84b-73c84939bf59 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:28.259131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90a64e32-77c2-4117-b84b-73c84939bf59 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:28.259612 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90a64e32-77c2-4117-b84b-73c84939bf59 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:28.260033 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-90a64e32-77c2-4117-b84b-73c84939bf59 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:28.389348 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-90a64e32-77c2-4117-b84b-73c84939bf59 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:09:28.397139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-90a64e32-77c2-4117-b84b-73c84939bf59 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371" status: 200 len: 1363 microversion: 2.1 time: 0.151860 Aug 10 13:09:28.397699 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1772/3477] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:09:28 2022] GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:09:29.419468 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-686beb0d-65d4-42d6-a560-83f15b536851 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:09:29.420096 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-686beb0d-65d4-42d6-a560-83f15b536851 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 2c84c97f-03d4-474e-9a53-714e127d4371] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:09:29.426678 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-686beb0d-65d4-42d6-a560-83f15b536851 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:29.427162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-686beb0d-65d4-42d6-a560-83f15b536851 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:29.427618 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-686beb0d-65d4-42d6-a560-83f15b536851 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:29.428306 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-686beb0d-65d4-42d6-a560-83f15b536851 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:29.428760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-686beb0d-65d4-42d6-a560-83f15b536851 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:29.429185 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-686beb0d-65d4-42d6-a560-83f15b536851 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:29.444063 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:29.559886 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-686beb0d-65d4-42d6-a560-83f15b536851 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:09:29.568033 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-686beb0d-65d4-42d6-a560-83f15b536851 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371" status: 200 len: 1363 microversion: 2.1 time: 0.152629 Aug 10 13:09:29.568605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1773/3478] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:09:29 2022] GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:09:30.588422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7eb7b97b-ae98-42a5-9da1-f1f3b96e5464 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:09:30.588973 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7eb7b97b-ae98-42a5-9da1-f1f3b96e5464 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 2c84c97f-03d4-474e-9a53-714e127d4371] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:09:30.590819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=2 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:30.591523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=12 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:09:30.596855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7eb7b97b-ae98-42a5-9da1-f1f3b96e5464 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:30.597278 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7eb7b97b-ae98-42a5-9da1-f1f3b96e5464 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:30.597708 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7eb7b97b-ae98-42a5-9da1-f1f3b96e5464 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:30.598392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7eb7b97b-ae98-42a5-9da1-f1f3b96e5464 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:30.598843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7eb7b97b-ae98-42a5-9da1-f1f3b96e5464 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:30.599290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7eb7b97b-ae98-42a5-9da1-f1f3b96e5464 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:30.726236 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7eb7b97b-ae98-42a5-9da1-f1f3b96e5464 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:09:30.733840 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7eb7b97b-ae98-42a5-9da1-f1f3b96e5464 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371" status: 200 len: 1548 microversion: 2.1 time: 0.149381 Aug 10 13:09:30.735048 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1774/3479] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:09:30 2022] GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:09:30.754286 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-024613e3-35fd-492d-91d9-be6230582b98 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:09:30.754773 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-024613e3-35fd-492d-91d9-be6230582b98 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 2c84c97f-03d4-474e-9a53-714e127d4371] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:09:30.760453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-024613e3-35fd-492d-91d9-be6230582b98 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:30.760932 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-024613e3-35fd-492d-91d9-be6230582b98 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:30.761368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-024613e3-35fd-492d-91d9-be6230582b98 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:30.762047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-024613e3-35fd-492d-91d9-be6230582b98 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:30.762498 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-024613e3-35fd-492d-91d9-be6230582b98 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:30.762920 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-024613e3-35fd-492d-91d9-be6230582b98 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:30.841342 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-024613e3-35fd-492d-91d9-be6230582b98 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090554 Aug 10 13:09:30.841931 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1775/3480] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 10 13:09:30 2022] GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:09:32.028821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-577359ca-d556-4701-a0e5-4896be929015 req-c815cadd-af3b-4420-a415-be18f8851bfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c84c97f-03d4-474e-9a53-714e127d4371", "tag": "dd4767a6-ab0d-41b8-9278-e599b8dd05b0"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:09:32.039552 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-577359ca-d556-4701-a0e5-4896be929015 req-c815cadd-af3b-4420-a415-be18f8851bfd service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:09:32.040024 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-577359ca-d556-4701-a0e5-4896be929015 req-c815cadd-af3b-4420-a415-be18f8851bfd service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:09:32.040450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-577359ca-d556-4701-a0e5-4896be929015 req-c815cadd-af3b-4420-a415-be18f8851bfd service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:09:32.052488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-577359ca-d556-4701-a0e5-4896be929015 req-c815cadd-af3b-4420-a415-be18f8851bfd service nova] Creating event network-changed:dd4767a6-ab0d-41b8-9278-e599b8dd05b0 for instance 2c84c97f-03d4-474e-9a53-714e127d4371 on hv-cinder-85199 Aug 10 13:09:32.058070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-577359ca-d556-4701-a0e5-4896be929015 req-c815cadd-af3b-4420-a415-be18f8851bfd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033457 Aug 10 13:09:32.058738 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1776/3481] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:10:02.358127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f242d3f6-10a2-47da-900f-291070d27933 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:10:02.358718 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f242d3f6-10a2-47da-900f-291070d27933 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 2c84c97f-03d4-474e-9a53-714e127d4371] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:10:02.361000 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=11 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:10:02.361647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=15 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:10:02.366824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f242d3f6-10a2-47da-900f-291070d27933 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:10:02.367324 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f242d3f6-10a2-47da-900f-291070d27933 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:10:02.367760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f242d3f6-10a2-47da-900f-291070d27933 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:10:02.368539 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f242d3f6-10a2-47da-900f-291070d27933 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:10:02.368991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f242d3f6-10a2-47da-900f-291070d27933 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:10:02.369414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f242d3f6-10a2-47da-900f-291070d27933 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:10:02.394952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f242d3f6-10a2-47da-900f-291070d27933 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371/ips" status: 200 len: 145 microversion: 2.1 time: 0.041318 Aug 10 13:10:02.396314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1777/3482] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 10 13:10:02 2022] GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:11:02.494425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c49ab368-5742-4846-a67d-ca0aa3f55be0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:11:02.495032 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c49ab368-5742-4846-a67d-ca0aa3f55be0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 2c84c97f-03d4-474e-9a53-714e127d4371] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:11:02.501076 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c49ab368-5742-4846-a67d-ca0aa3f55be0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:11:02.507650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c49ab368-5742-4846-a67d-ca0aa3f55be0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:11:02.507650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c49ab368-5742-4846-a67d-ca0aa3f55be0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:11:02.507650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c49ab368-5742-4846-a67d-ca0aa3f55be0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:11:02.507650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c49ab368-5742-4846-a67d-ca0aa3f55be0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:11:02.508054 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c49ab368-5742-4846-a67d-ca0aa3f55be0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:11:02.528030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c49ab368-5742-4846-a67d-ca0aa3f55be0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 2c84c97f-03d4-474e-9a53-714e127d4371] Going to try to terminate instance {{(pid=124643) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:11:02.730717 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c49ab368-5742-4846-a67d-ca0aa3f55be0 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371" status: 204 len: 0 microversion: 2.1 time: 0.242505 Aug 10 13:11:02.731274 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1778/3483] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 13:11:02 2022] DELETE /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 13:11:02.739733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ca074866-784b-4e62-a79c-ec7d6733fb28 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:11:02.740422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ca074866-784b-4e62-a79c-ec7d6733fb28 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 2c84c97f-03d4-474e-9a53-714e127d4371] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:11:02.746029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ca074866-784b-4e62-a79c-ec7d6733fb28 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:11:02.746511 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ca074866-784b-4e62-a79c-ec7d6733fb28 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:11:02.746946 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ca074866-784b-4e62-a79c-ec7d6733fb28 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:11:02.747664 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ca074866-784b-4e62-a79c-ec7d6733fb28 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:11:02.748114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ca074866-784b-4e62-a79c-ec7d6733fb28 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:11:02.748537 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ca074866-784b-4e62-a79c-ec7d6733fb28 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:11:02.880880 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ca074866-784b-4e62-a79c-ec7d6733fb28 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:11:02.888283 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ca074866-784b-4e62-a79c-ec7d6733fb28 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371" status: 200 len: 1673 microversion: 2.1 time: 0.152438 Aug 10 13:11:02.888880 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1779/3484] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:11:02 2022] GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:11:03.966780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-69d166a2-fe4d-40fe-9a72-af94a34191a7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:11:03.967487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-69d166a2-fe4d-40fe-9a72-af94a34191a7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 2c84c97f-03d4-474e-9a53-714e127d4371] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:11:03.974040 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-69d166a2-fe4d-40fe-9a72-af94a34191a7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:11:03.978502 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-69d166a2-fe4d-40fe-9a72-af94a34191a7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:11:03.978502 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-69d166a2-fe4d-40fe-9a72-af94a34191a7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:11:03.978502 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-69d166a2-fe4d-40fe-9a72-af94a34191a7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:11:03.978502 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-69d166a2-fe4d-40fe-9a72-af94a34191a7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:11:03.978850 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-69d166a2-fe4d-40fe-9a72-af94a34191a7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:11:04.175631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-69d166a2-fe4d-40fe-9a72-af94a34191a7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:11:04.183680 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-69d166a2-fe4d-40fe-9a72-af94a34191a7 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371" status: 200 len: 1673 microversion: 2.1 time: 0.220938 Aug 10 13:11:04.184457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1780/3485] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:11:03 2022] GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371 => generated 1673 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:11:04.973860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-b64d3e45-8b5b-4831-ad30-85e436e3373d req-7cf2ef26-e614-4d1c-acdf-72290bddc827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c84c97f-03d4-474e-9a53-714e127d4371", "name": "network-vif-deleted", "tag": "dd4767a6-ab0d-41b8-9278-e599b8dd05b0"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:11:04.983064 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-b64d3e45-8b5b-4831-ad30-85e436e3373d req-7cf2ef26-e614-4d1c-acdf-72290bddc827 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:11:04.983842 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-b64d3e45-8b5b-4831-ad30-85e436e3373d req-7cf2ef26-e614-4d1c-acdf-72290bddc827 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:11:04.984271 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-b64d3e45-8b5b-4831-ad30-85e436e3373d req-7cf2ef26-e614-4d1c-acdf-72290bddc827 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:11:04.995416 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-b64d3e45-8b5b-4831-ad30-85e436e3373d req-7cf2ef26-e614-4d1c-acdf-72290bddc827 service nova] Creating event network-vif-deleted:dd4767a6-ab0d-41b8-9278-e599b8dd05b0 for instance 2c84c97f-03d4-474e-9a53-714e127d4371 on hv-cinder-85199 Aug 10 13:11:05.000658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-b64d3e45-8b5b-4831-ad30-85e436e3373d req-7cf2ef26-e614-4d1c-acdf-72290bddc827 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031289 Aug 10 13:11:05.001493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1781/3486] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:11:05.206335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-50dc32c7-a92f-4711-9dd5-1bb10c47f3bc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:11:05.207113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-50dc32c7-a92f-4711-9dd5-1bb10c47f3bc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 2c84c97f-03d4-474e-9a53-714e127d4371] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:11:05.214796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50dc32c7-a92f-4711-9dd5-1bb10c47f3bc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:11:05.215311 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50dc32c7-a92f-4711-9dd5-1bb10c47f3bc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:11:05.215746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50dc32c7-a92f-4711-9dd5-1bb10c47f3bc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:11:05.216439 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50dc32c7-a92f-4711-9dd5-1bb10c47f3bc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:11:05.217059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50dc32c7-a92f-4711-9dd5-1bb10c47f3bc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:11:05.217517 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50dc32c7-a92f-4711-9dd5-1bb10c47f3bc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:11:05.251341 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50dc32c7-a92f-4711-9dd5-1bb10c47f3bc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:11:05.251831 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50dc32c7-a92f-4711-9dd5-1bb10c47f3bc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:11:05.252270 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50dc32c7-a92f-4711-9dd5-1bb10c47f3bc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:11:05.252720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.objects.instance [None req-50dc32c7-a92f-4711-9dd5-1bb10c47f3bc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lazy-loading 'fault' on Instance uuid 2c84c97f-03d4-474e-9a53-714e127d4371 {{(pid=124643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:11:05.309878 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-50dc32c7-a92f-4711-9dd5-1bb10c47f3bc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0ada1accf1742b393e8a12c60074b9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a40b36dd9944cb88fd54181f7f29685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:11:05.317793 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-50dc32c7-a92f-4711-9dd5-1bb10c47f3bc tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371" status: 200 len: 1327 microversion: 2.1 time: 0.115824 Aug 10 13:11:05.318372 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1782/3487] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:11:05 2022] GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371 => generated 1327 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:11:06.339553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-de5ee9a1-e8cf-4d81-bcf1-ccbee81b902b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:11:06.340168 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-de5ee9a1-e8cf-4d81-bcf1-ccbee81b902b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 2c84c97f-03d4-474e-9a53-714e127d4371] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:11:06.346512 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-de5ee9a1-e8cf-4d81-bcf1-ccbee81b902b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:11:06.346992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-de5ee9a1-e8cf-4d81-bcf1-ccbee81b902b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:11:06.347462 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-de5ee9a1-e8cf-4d81-bcf1-ccbee81b902b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:11:06.348148 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-de5ee9a1-e8cf-4d81-bcf1-ccbee81b902b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:11:06.348601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-de5ee9a1-e8cf-4d81-bcf1-ccbee81b902b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:11:06.349026 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-de5ee9a1-e8cf-4d81-bcf1-ccbee81b902b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:11:06.362296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-de5ee9a1-e8cf-4d81-bcf1-ccbee81b902b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] HTTP exception thrown: Instance 2c84c97f-03d4-474e-9a53-714e127d4371 could not be found. Aug 10 13:11:06.363955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-de5ee9a1-e8cf-4d81-bcf1-ccbee81b902b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Request method failure captured: Aug 10 13:11:06.363955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371 HTTP/1.1 Aug 10 13:11:06.363955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:11:06.363955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:11:06.363955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:11:06.363955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:11:06.363955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:11:06.363955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:11:06.363955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:11:06.363955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:11:06.363955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86eFpMON8wdE-yxypJwKTycnvglCVNPmJYB2havXvPuGSL70SB9u4OgBlHEmwN-ZmdL8944lFIdJdiXf2m6aCIObrjBrWtBJyWznOqNQqePelDp02UcmMUpKpytdCWxlJCiNWB04oQyd3S6x9pv8bL9Qv0OAgLIp1MbIeEKFdB9gQ1g Aug 10 13:11:06.363955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:11:06.363955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:11:06.363955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:11:06.363955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:11:06.363955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:11:06.363955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:11:06.363955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: 9a40b36dd9944cb88fd54181f7f29685 Aug 10 13:11:06.363955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-AttachVolumeTestJSON-1341079228 Aug 10 13:11:06.363955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:11:06.363955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:11:06.365297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9a40b36dd9944cb88fd54181f7f29685"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9a40b36dd9944cb88fd54181f7f29685", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9a40b36dd9944cb88fd54181f7f29685"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9a40b36dd9944cb88fd54181f7f29685"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:11:06.365297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-AttachVolumeTestJSON-1341079228 Aug 10 13:11:06.365297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: 9a40b36dd9944cb88fd54181f7f29685 Aug 10 13:11:06.365297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1341079228 Aug 10 13:11:06.365297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-AttachVolumeTestJSON-1341079228-project Aug 10 13:11:06.365297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:11:06.365297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:11:06.365297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: c0ada1accf1742b393e8a12c60074b9e Aug 10 13:11:06.365297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-AttachVolumeTestJSON-1341079228-project Aug 10 13:11:06.365297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:11:06.365297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance 2c84c97f-03d4-474e-9a53-714e127d4371 could not be found. Aug 10 13:11:06.365297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': '2c84c97f-03d4-474e-9a53-714e127d4371'} Aug 10 13:11:06.366073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:11:06.366073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:11:06.366073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:11:06.366073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:11:06.366073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:11:06.366073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:11:06.366073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:11:06.366073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:11:06.366073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:11:06.366073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:11:06.366073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c84c97f-03d4-474e-9a53-714e127d4371 could not be found. Aug 10 13:11:06.366073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:11:06.366073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:11:06.366073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:11:06.366073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:11:06.366073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:11:06.366073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:11:06.366073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:11:06.366073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:11:06.366073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:11:06.368310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:11:06.368310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:11:06.368310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:11:06.368310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:11:06.368310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:11:06.368310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:11:06.368310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:11:06.368310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c84c97f-03d4-474e-9a53-714e127d4371 could not be found. Aug 10 13:11:06.368310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:11:06.368310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:11:06.368310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:11:06.368310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:11:06.368310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:11:06.368310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:11:06.368310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:11:06.368310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:11:06.368310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c84c97f-03d4-474e-9a53-714e127d4371 could not be found. Aug 10 13:11:06.368310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:11:06.369477 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-de5ee9a1-e8cf-4d81-bcf1-ccbee81b902b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Returning 404 to user: Instance 2c84c97f-03d4-474e-9a53-714e127d4371 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:11:06.369477 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-de5ee9a1-e8cf-4d81-bcf1-ccbee81b902b tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371" status: 404 len: 111 microversion: 2.1 time: 0.029822 Aug 10 13:11:06.369477 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1783/3488] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:11:06 2022] GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:11:06.374109 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e706777f-b511-4914-b195-58d5ea31b991 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '.version_select at 0x7fb8269b5670>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:11:06.480287 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e706777f-b511-4914-b195-58d5ea31b991 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-789293746" status: 202 len: 0 microversion: 2.1 time: 0.109489 Aug 10 13:11:06.483597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1784/3489] 10.222.0.49 () {58 vars in 1218 bytes} [Wed Aug 10 13:11:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-789293746 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:11:07.413013 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1ba0ecaa-468b-4e30-a357-a23619b5d169 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:11:07.414213 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1ba0ecaa-468b-4e30-a357-a23619b5d169 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 2c84c97f-03d4-474e-9a53-714e127d4371] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:11:07.420727 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1ba0ecaa-468b-4e30-a357-a23619b5d169 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:11:07.421206 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1ba0ecaa-468b-4e30-a357-a23619b5d169 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:11:07.421637 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1ba0ecaa-468b-4e30-a357-a23619b5d169 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:11:07.422344 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1ba0ecaa-468b-4e30-a357-a23619b5d169 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:11:07.422793 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1ba0ecaa-468b-4e30-a357-a23619b5d169 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:11:07.423238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1ba0ecaa-468b-4e30-a357-a23619b5d169 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:11:07.438621 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-1ba0ecaa-468b-4e30-a357-a23619b5d169 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] HTTP exception thrown: Instance 2c84c97f-03d4-474e-9a53-714e127d4371 could not be found. Aug 10 13:11:07.440165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1ba0ecaa-468b-4e30-a357-a23619b5d169 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Request method failure captured: Aug 10 13:11:07.440165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: DELETE /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371 HTTP/1.1 Aug 10 13:11:07.440165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:11:07.440165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:11:07.440165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:11:07.440165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:11:07.440165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:11:07.440165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:11:07.440165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:11:07.440165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:11:07.440165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86eFpMON8wdE-yxypJwKTycnvglCVNPmJYB2havXvPuGSL70SB9u4OgBlHEmwN-ZmdL8944lFIdJdiXf2m6aCIObrjBrWtBJyWznOqNQqePelDp02UcmMUpKpytdCWxlJCiNWB04oQyd3S6x9pv8bL9Qv0OAgLIp1MbIeEKFdB9gQ1g Aug 10 13:11:07.440165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:11:07.440165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:11:07.440165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:11:07.440165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:11:07.440165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:11:07.440165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:11:07.440165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: 9a40b36dd9944cb88fd54181f7f29685 Aug 10 13:11:07.440165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-AttachVolumeTestJSON-1341079228 Aug 10 13:11:07.440165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:11:07.440165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:11:07.441446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9a40b36dd9944cb88fd54181f7f29685"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9a40b36dd9944cb88fd54181f7f29685", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9a40b36dd9944cb88fd54181f7f29685"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9a40b36dd9944cb88fd54181f7f29685"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:11:07.441446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-AttachVolumeTestJSON-1341079228 Aug 10 13:11:07.441446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: 9a40b36dd9944cb88fd54181f7f29685 Aug 10 13:11:07.441446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1341079228 Aug 10 13:11:07.441446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-AttachVolumeTestJSON-1341079228-project Aug 10 13:11:07.441446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:11:07.441446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:11:07.441446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: c0ada1accf1742b393e8a12c60074b9e Aug 10 13:11:07.441446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-AttachVolumeTestJSON-1341079228-project Aug 10 13:11:07.441446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:11:07.441446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance 2c84c97f-03d4-474e-9a53-714e127d4371 could not be found. Aug 10 13:11:07.441446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': '2c84c97f-03d4-474e-9a53-714e127d4371'} Aug 10 13:11:07.442487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:11:07.442487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:11:07.442487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:11:07.442487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:11:07.442487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:11:07.442487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:11:07.442487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:11:07.442487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:11:07.442487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:11:07.442487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:11:07.442487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c84c97f-03d4-474e-9a53-714e127d4371 could not be found. Aug 10 13:11:07.442487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:11:07.442487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:11:07.442487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:11:07.442487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:11:07.442487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:11:07.442487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:11:07.442487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:11:07.442487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:11:07.442487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:11:07.443923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:11:07.443923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 13:11:07.443923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 13:11:07.443923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 13:11:07.443923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 13:11:07.443923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:11:07.443923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:11:07.443923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:11:07.443923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:11:07.443923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c84c97f-03d4-474e-9a53-714e127d4371 could not be found. Aug 10 13:11:07.443923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:11:07.443923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:11:07.443923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:11:07.443923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:11:07.443923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:11:07.443923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:11:07.443923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:11:07.443923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:11:07.443923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c84c97f-03d4-474e-9a53-714e127d4371 could not be found. Aug 10 13:11:07.443923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:11:07.445205 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1ba0ecaa-468b-4e30-a357-a23619b5d169 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Returning 404 to user: Instance 2c84c97f-03d4-474e-9a53-714e127d4371 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:11:07.445205 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1ba0ecaa-468b-4e30-a357-a23619b5d169 tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371" status: 404 len: 111 microversion: 2.1 time: 0.032889 Aug 10 13:11:07.445205 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1785/3490] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 13:11:07 2022] DELETE /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:11:07.449683 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3849453c-5d98-454c-849c-97514caf250c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:11:07.450281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3849453c-5d98-454c-849c-97514caf250c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 2c84c97f-03d4-474e-9a53-714e127d4371] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:11:07.455983 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3849453c-5d98-454c-849c-97514caf250c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:11:07.456456 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3849453c-5d98-454c-849c-97514caf250c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:11:07.456886 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3849453c-5d98-454c-849c-97514caf250c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:11:07.457569 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3849453c-5d98-454c-849c-97514caf250c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:11:07.458016 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3849453c-5d98-454c-849c-97514caf250c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:11:07.458435 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3849453c-5d98-454c-849c-97514caf250c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:11:07.471350 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-3849453c-5d98-454c-849c-97514caf250c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] HTTP exception thrown: Instance 2c84c97f-03d4-474e-9a53-714e127d4371 could not be found. Aug 10 13:11:07.472843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3849453c-5d98-454c-849c-97514caf250c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Request method failure captured: Aug 10 13:11:07.472843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371 HTTP/1.1 Aug 10 13:11:07.472843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:11:07.472843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:11:07.472843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:11:07.472843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:11:07.472843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:11:07.472843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:11:07.472843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:11:07.472843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:11:07.472843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86eFpMON8wdE-yxypJwKTycnvglCVNPmJYB2havXvPuGSL70SB9u4OgBlHEmwN-ZmdL8944lFIdJdiXf2m6aCIObrjBrWtBJyWznOqNQqePelDp02UcmMUpKpytdCWxlJCiNWB04oQyd3S6x9pv8bL9Qv0OAgLIp1MbIeEKFdB9gQ1g Aug 10 13:11:07.472843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:11:07.472843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:11:07.472843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:11:07.472843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:11:07.472843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:11:07.472843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:11:07.472843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: 9a40b36dd9944cb88fd54181f7f29685 Aug 10 13:11:07.472843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-AttachVolumeTestJSON-1341079228 Aug 10 13:11:07.472843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:11:07.472843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:11:07.474077 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9a40b36dd9944cb88fd54181f7f29685"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9a40b36dd9944cb88fd54181f7f29685", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9a40b36dd9944cb88fd54181f7f29685"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9a40b36dd9944cb88fd54181f7f29685"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:11:07.474077 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-AttachVolumeTestJSON-1341079228 Aug 10 13:11:07.474077 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: 9a40b36dd9944cb88fd54181f7f29685 Aug 10 13:11:07.474077 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1341079228 Aug 10 13:11:07.474077 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-AttachVolumeTestJSON-1341079228-project Aug 10 13:11:07.474077 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:11:07.474077 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:11:07.474077 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: c0ada1accf1742b393e8a12c60074b9e Aug 10 13:11:07.474077 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-AttachVolumeTestJSON-1341079228-project Aug 10 13:11:07.474077 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:11:07.474077 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance 2c84c97f-03d4-474e-9a53-714e127d4371 could not be found. Aug 10 13:11:07.474077 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': '2c84c97f-03d4-474e-9a53-714e127d4371'} Aug 10 13:11:07.474760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:11:07.474760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:11:07.474760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:11:07.474760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:11:07.474760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:11:07.474760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:11:07.474760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:11:07.474760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:11:07.474760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:11:07.474760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:11:07.474760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c84c97f-03d4-474e-9a53-714e127d4371 could not be found. Aug 10 13:11:07.474760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:11:07.474760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:11:07.474760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:11:07.474760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:11:07.474760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:11:07.474760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:11:07.474760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:11:07.474760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:11:07.474760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:11:07.475905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:11:07.475905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:11:07.475905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:11:07.475905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:11:07.475905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:11:07.475905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:11:07.475905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:11:07.475905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c84c97f-03d4-474e-9a53-714e127d4371 could not be found. Aug 10 13:11:07.475905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:11:07.475905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:11:07.475905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:11:07.475905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:11:07.475905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:11:07.475905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:11:07.475905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:11:07.475905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:11:07.475905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c84c97f-03d4-474e-9a53-714e127d4371 could not be found. Aug 10 13:11:07.475905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:11:07.477690 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3849453c-5d98-454c-849c-97514caf250c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Returning 404 to user: Instance 2c84c97f-03d4-474e-9a53-714e127d4371 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:11:07.477690 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3849453c-5d98-454c-849c-97514caf250c tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371" status: 404 len: 111 microversion: 2.1 time: 0.028013 Aug 10 13:11:07.477690 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1786/3491] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:11:07 2022] GET /compute/v2.1/servers/2c84c97f-03d4-474e-9a53-714e127d4371 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:11:38.550246 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:11:38.550791 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Wed Aug 10 13:11:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:13:34.427891 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:13:34.428490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Wed Aug 10 13:13:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:14:58.557191 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:14:58.557734 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Wed Aug 10 13:14:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:16:13.734315 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b969d2c5-b84b-443d-9024-0907947eeb37] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 10 13:16:13.734315 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:13.734315 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:13.736516 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-48c37b90-6505-4aa7-a0e6-2f40d7025fd1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:13.737307 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-48c37b90-6505-4aa7-a0e6-2f40d7025fd1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 2f8e2b4f-5870-46a3-b826-1b80fb322c73] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:13.744636 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-48c37b90-6505-4aa7-a0e6-2f40d7025fd1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:13.745726 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-48c37b90-6505-4aa7-a0e6-2f40d7025fd1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:13.746352 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-48c37b90-6505-4aa7-a0e6-2f40d7025fd1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:13.747054 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-48c37b90-6505-4aa7-a0e6-2f40d7025fd1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:13.747535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-48c37b90-6505-4aa7-a0e6-2f40d7025fd1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:13.747959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-48c37b90-6505-4aa7-a0e6-2f40d7025fd1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:13.783979 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-48c37b90-6505-4aa7-a0e6-2f40d7025fd1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 2f8e2b4f-5870-46a3-b826-1b80fb322c73] Going to try to terminate instance {{(pid=124643) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:16:14.064078 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-48c37b90-6505-4aa7-a0e6-2f40d7025fd1 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73" status: 204 len: 0 microversion: 2.20 time: 0.335880 Aug 10 13:16:14.070481 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1787/3492] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 10 13:16:13 2022] DELETE /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 10 13:16:14.080680 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-607732be-fe23-4bd3-984b-11a37620e3dc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:14.081263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-607732be-fe23-4bd3-984b-11a37620e3dc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d18ee67-6285-4877-ae40-c30da937c050] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:14.087704 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-607732be-fe23-4bd3-984b-11a37620e3dc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:14.088185 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-607732be-fe23-4bd3-984b-11a37620e3dc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:14.088619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-607732be-fe23-4bd3-984b-11a37620e3dc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:14.089514 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-607732be-fe23-4bd3-984b-11a37620e3dc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:14.090022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-607732be-fe23-4bd3-984b-11a37620e3dc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:14.090444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-607732be-fe23-4bd3-984b-11a37620e3dc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:14.118286 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-607732be-fe23-4bd3-984b-11a37620e3dc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d18ee67-6285-4877-ae40-c30da937c050] Going to try to terminate instance {{(pid=124643) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:16:14.365999 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-607732be-fe23-4bd3-984b-11a37620e3dc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050" status: 204 len: 0 microversion: 2.1 time: 0.293698 Aug 10 13:16:14.366520 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1788/3493] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 13:16:14 2022] DELETE /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:16:14.372259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-403b84a4-3f43-4e8d-b6f1-816622dd939a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:14.372947 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-403b84a4-3f43-4e8d-b6f1-816622dd939a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 2f8e2b4f-5870-46a3-b826-1b80fb322c73] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:14.379363 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-403b84a4-3f43-4e8d-b6f1-816622dd939a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:14.379835 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-403b84a4-3f43-4e8d-b6f1-816622dd939a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:14.380300 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-403b84a4-3f43-4e8d-b6f1-816622dd939a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:14.381071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-403b84a4-3f43-4e8d-b6f1-816622dd939a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:14.381517 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-403b84a4-3f43-4e8d-b6f1-816622dd939a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:14.381933 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-403b84a4-3f43-4e8d-b6f1-816622dd939a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:14.584828 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-403b84a4-3f43-4e8d-b6f1-816622dd939a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:14.593207 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-403b84a4-3f43-4e8d-b6f1-816622dd939a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:14.594732 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-403b84a4-3f43-4e8d-b6f1-816622dd939a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:14.595955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-403b84a4-3f43-4e8d-b6f1-816622dd939a tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73" status: 200 len: 1725 microversion: 2.20 time: 0.228284 Aug 10 13:16:14.596516 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1789/3494] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:16:14 2022] GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73 => generated 1725 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:16:14.601038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-efb5472d-3032-4e99-964d-48c2fefc27af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:14.601634 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-efb5472d-3032-4e99-964d-48c2fefc27af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d18ee67-6285-4877-ae40-c30da937c050] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:14.607334 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-efb5472d-3032-4e99-964d-48c2fefc27af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:14.610164 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-efb5472d-3032-4e99-964d-48c2fefc27af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:14.610164 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-efb5472d-3032-4e99-964d-48c2fefc27af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:14.610164 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-efb5472d-3032-4e99-964d-48c2fefc27af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:14.610164 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-efb5472d-3032-4e99-964d-48c2fefc27af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:14.610465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-efb5472d-3032-4e99-964d-48c2fefc27af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:14.738050 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [-] [b969d2c5-b84b-443d-9024-0907947eeb37] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 51498. Aug 10 13:16:14.741875 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-efb5472d-3032-4e99-964d-48c2fefc27af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:14.750235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-efb5472d-3032-4e99-964d-48c2fefc27af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050" status: 200 len: 1681 microversion: 2.1 time: 0.152754 Aug 10 13:16:14.750805 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1790/3495] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:14 2022] GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:16:15.161598 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2f49d390-29fa-41f3-b51d-e9ec982074e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:15.166108 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2f49d390-29fa-41f3-b51d-e9ec982074e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:15.172476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2f49d390-29fa-41f3-b51d-e9ec982074e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:15.172959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2f49d390-29fa-41f3-b51d-e9ec982074e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:15.173399 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2f49d390-29fa-41f3-b51d-e9ec982074e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:15.174088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2f49d390-29fa-41f3-b51d-e9ec982074e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:15.174539 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2f49d390-29fa-41f3-b51d-e9ec982074e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:15.174961 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2f49d390-29fa-41f3-b51d-e9ec982074e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:15.202614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2f49d390-29fa-41f3-b51d-e9ec982074e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Going to try to terminate instance {{(pid=124643) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:16:15.480603 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2f49d390-29fa-41f3-b51d-e9ec982074e6 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 204 len: 0 microversion: 2.1 time: 0.323854 Aug 10 13:16:15.481274 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1791/3496] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 13:16:15 2022] DELETE /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 13:16:15.490878 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2fd96c51-d2bf-477b-ae2f-32f712a2cd59 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:15.494914 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2fd96c51-d2bf-477b-ae2f-32f712a2cd59 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:15.497902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2fd96c51-d2bf-477b-ae2f-32f712a2cd59 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:15.499098 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2fd96c51-d2bf-477b-ae2f-32f712a2cd59 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:15.499697 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2fd96c51-d2bf-477b-ae2f-32f712a2cd59 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:15.500534 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2fd96c51-d2bf-477b-ae2f-32f712a2cd59 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:15.501003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2fd96c51-d2bf-477b-ae2f-32f712a2cd59 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:15.501441 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2fd96c51-d2bf-477b-ae2f-32f712a2cd59 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:15.739995 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2fd96c51-d2bf-477b-ae2f-32f712a2cd59 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:15.756381 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2fd96c51-d2bf-477b-ae2f-32f712a2cd59 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1508 microversion: 2.1 time: 0.269803 Aug 10 13:16:15.759417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1792/3497] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:15 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1508 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:16:15.765063 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-937e1b65-f27e-41d4-b08f-0e6fa259ef4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:15.766198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-937e1b65-f27e-41d4-b08f-0e6fa259ef4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 2f8e2b4f-5870-46a3-b826-1b80fb322c73] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:15.776647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-937e1b65-f27e-41d4-b08f-0e6fa259ef4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:15.777568 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-937e1b65-f27e-41d4-b08f-0e6fa259ef4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:15.778354 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-937e1b65-f27e-41d4-b08f-0e6fa259ef4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:15.779641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-937e1b65-f27e-41d4-b08f-0e6fa259ef4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:15.780807 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-937e1b65-f27e-41d4-b08f-0e6fa259ef4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:15.788958 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-937e1b65-f27e-41d4-b08f-0e6fa259ef4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:16.000123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-937e1b65-f27e-41d4-b08f-0e6fa259ef4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:16.008151 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-937e1b65-f27e-41d4-b08f-0e6fa259ef4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:16.009689 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-937e1b65-f27e-41d4-b08f-0e6fa259ef4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:16.010836 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-937e1b65-f27e-41d4-b08f-0e6fa259ef4f tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73" status: 200 len: 1725 microversion: 2.20 time: 0.252402 Aug 10 13:16:16.011425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1793/3498] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:16:15 2022] GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73 => generated 1725 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:16:16.016497 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-770ef540-65f8-4758-a1e1-6fc5e03607c0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:16.017095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-770ef540-65f8-4758-a1e1-6fc5e03607c0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d18ee67-6285-4877-ae40-c30da937c050] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:16.023079 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-770ef540-65f8-4758-a1e1-6fc5e03607c0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:16.023601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-770ef540-65f8-4758-a1e1-6fc5e03607c0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:16.024682 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-770ef540-65f8-4758-a1e1-6fc5e03607c0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:16.025371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-770ef540-65f8-4758-a1e1-6fc5e03607c0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:16.025821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-770ef540-65f8-4758-a1e1-6fc5e03607c0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:16.026243 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-770ef540-65f8-4758-a1e1-6fc5e03607c0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:16.341016 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-770ef540-65f8-4758-a1e1-6fc5e03607c0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:16.350349 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-770ef540-65f8-4758-a1e1-6fc5e03607c0 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050" status: 200 len: 1681 microversion: 2.1 time: 0.337920 Aug 10 13:16:16.351223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1794/3499] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:16 2022] GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050 => generated 1681 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:16:16.779143 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7da57252-a7ea-4361-a00d-1aa30c3fa56a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:16.780743 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7da57252-a7ea-4361-a00d-1aa30c3fa56a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:16.794242 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7da57252-a7ea-4361-a00d-1aa30c3fa56a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:16.796487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7da57252-a7ea-4361-a00d-1aa30c3fa56a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:16.797181 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7da57252-a7ea-4361-a00d-1aa30c3fa56a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:16.798314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7da57252-a7ea-4361-a00d-1aa30c3fa56a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:16.798773 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7da57252-a7ea-4361-a00d-1aa30c3fa56a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:16.799217 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7da57252-a7ea-4361-a00d-1aa30c3fa56a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:17.233424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7da57252-a7ea-4361-a00d-1aa30c3fa56a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:17.246892 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7da57252-a7ea-4361-a00d-1aa30c3fa56a tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1508 microversion: 2.1 time: 0.472922 Aug 10 13:16:17.260305 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1795/3500] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:16 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1508 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:16:17.266626 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-471fcfec-93b9-4657-a44e-dd2f524d5ea4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:17.267565 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-471fcfec-93b9-4657-a44e-dd2f524d5ea4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 2f8e2b4f-5870-46a3-b826-1b80fb322c73] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:17.284765 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-471fcfec-93b9-4657-a44e-dd2f524d5ea4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:17.285594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-471fcfec-93b9-4657-a44e-dd2f524d5ea4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:17.286983 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-471fcfec-93b9-4657-a44e-dd2f524d5ea4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:17.287237 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-471fcfec-93b9-4657-a44e-dd2f524d5ea4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:17.287896 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-471fcfec-93b9-4657-a44e-dd2f524d5ea4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:17.288523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-471fcfec-93b9-4657-a44e-dd2f524d5ea4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:17.538790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-471fcfec-93b9-4657-a44e-dd2f524d5ea4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:17.551628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-471fcfec-93b9-4657-a44e-dd2f524d5ea4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:17.558821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-471fcfec-93b9-4657-a44e-dd2f524d5ea4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70010d27b7f44bc699ea5ad8093fec3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fe8b6c27e743eaad5fe6ffc8a40e81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:17.563571 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-471fcfec-93b9-4657-a44e-dd2f524d5ea4 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73" status: 200 len: 1657 microversion: 2.20 time: 0.300557 Aug 10 13:16:17.565103 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1796/3501] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:16:17 2022] GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73 => generated 1657 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 13:16:17.596326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-baece3e7-ae1c-4c03-a353-d9bbb7e3cc59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:17.599535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-baece3e7-ae1c-4c03-a353-d9bbb7e3cc59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d18ee67-6285-4877-ae40-c30da937c050] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:17.608038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-baece3e7-ae1c-4c03-a353-d9bbb7e3cc59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:17.609565 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-baece3e7-ae1c-4c03-a353-d9bbb7e3cc59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:17.610155 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-baece3e7-ae1c-4c03-a353-d9bbb7e3cc59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:17.611169 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-baece3e7-ae1c-4c03-a353-d9bbb7e3cc59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:17.612306 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-baece3e7-ae1c-4c03-a353-d9bbb7e3cc59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:17.612878 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-baece3e7-ae1c-4c03-a353-d9bbb7e3cc59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:18.254111 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-baece3e7-ae1c-4c03-a353-d9bbb7e3cc59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:18.267988 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-baece3e7-ae1c-4c03-a353-d9bbb7e3cc59 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050" status: 200 len: 1614 microversion: 2.1 time: 0.686006 Aug 10 13:16:18.268581 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1797/3502] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:17 2022] GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050 => generated 1614 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:16:18.668957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-d7665032-57a6-4887-a5f7-2786e0b2a897 req-8326b901-0364-4062-9600-964cbec0bc02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f8e2b4f-5870-46a3-b826-1b80fb322c73", "name": "network-vif-deleted", "tag": "2bffdf55-050a-468d-a05d-6fd7af5df24a"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:16:18.684445 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-d7665032-57a6-4887-a5f7-2786e0b2a897 req-8326b901-0364-4062-9600-964cbec0bc02 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:18.688790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-d7665032-57a6-4887-a5f7-2786e0b2a897 req-8326b901-0364-4062-9600-964cbec0bc02 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:18.689263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-d7665032-57a6-4887-a5f7-2786e0b2a897 req-8326b901-0364-4062-9600-964cbec0bc02 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:18.714758 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-d7665032-57a6-4887-a5f7-2786e0b2a897 req-8326b901-0364-4062-9600-964cbec0bc02 service nova] Creating event network-vif-deleted:2bffdf55-050a-468d-a05d-6fd7af5df24a for instance 2f8e2b4f-5870-46a3-b826-1b80fb322c73 on hv-cinder-85199 Aug 10 13:16:18.724704 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-d7665032-57a6-4887-a5f7-2786e0b2a897 req-8326b901-0364-4062-9600-964cbec0bc02 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.452485 Aug 10 13:16:18.725660 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1798/3503] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:16:18.914266 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-72d2ab6c-c99f-4370-905d-8581b753f984 req-cb0ba8a0-38b0-432d-b649-126c589c6fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fad49521-8b28-4a9f-a4a0-88e41b5a1566", "name": "network-vif-deleted", "tag": "63207b81-6588-46d1-8129-1070b16da6a5"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:16:18.925742 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-72d2ab6c-c99f-4370-905d-8581b753f984 req-cb0ba8a0-38b0-432d-b649-126c589c6fd7 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:18.928508 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-72d2ab6c-c99f-4370-905d-8581b753f984 req-cb0ba8a0-38b0-432d-b649-126c589c6fd7 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:18.929128 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-72d2ab6c-c99f-4370-905d-8581b753f984 req-cb0ba8a0-38b0-432d-b649-126c589c6fd7 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:18.933513 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:18.956672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-72d2ab6c-c99f-4370-905d-8581b753f984 req-cb0ba8a0-38b0-432d-b649-126c589c6fd7 service nova] Creating event network-vif-deleted:63207b81-6588-46d1-8129-1070b16da6a5 for instance fad49521-8b28-4a9f-a4a0-88e41b5a1566 on hv-cinder-85199 Aug 10 13:16:18.968015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-72d2ab6c-c99f-4370-905d-8581b753f984 req-cb0ba8a0-38b0-432d-b649-126c589c6fd7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.240085 Aug 10 13:16:18.973574 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1799/3504] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:16:18.986974 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4f942a2f-b66d-4845-aead-e8fcfb95ad99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:18.992144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4f942a2f-b66d-4845-aead-e8fcfb95ad99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:19.009238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f942a2f-b66d-4845-aead-e8fcfb95ad99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:19.009967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f942a2f-b66d-4845-aead-e8fcfb95ad99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:19.010634 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f942a2f-b66d-4845-aead-e8fcfb95ad99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:19.011716 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f942a2f-b66d-4845-aead-e8fcfb95ad99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:19.012342 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f942a2f-b66d-4845-aead-e8fcfb95ad99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:19.012949 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f942a2f-b66d-4845-aead-e8fcfb95ad99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:19.118843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f942a2f-b66d-4845-aead-e8fcfb95ad99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:19.133134 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f942a2f-b66d-4845-aead-e8fcfb95ad99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:19.134533 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f942a2f-b66d-4845-aead-e8fcfb95ad99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:19.137242 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.objects.instance [None req-4f942a2f-b66d-4845-aead-e8fcfb95ad99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lazy-loading 'fault' on Instance uuid e5bd9766-6096-4847-bb63-d90b985902f9 {{(pid=124643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:16:19.284312 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4f942a2f-b66d-4845-aead-e8fcfb95ad99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:19.292382 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4f942a2f-b66d-4845-aead-e8fcfb95ad99 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 200 len: 1312 microversion: 2.1 time: 0.322099 Aug 10 13:16:19.296176 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1800/3505] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:18 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 1312 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:16:19.311262 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e9dc9ba4-1893-4f1e-8a72-52bf2c925b26 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:19.311988 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e9dc9ba4-1893-4f1e-8a72-52bf2c925b26 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 2f8e2b4f-5870-46a3-b826-1b80fb322c73] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:19.320916 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9dc9ba4-1893-4f1e-8a72-52bf2c925b26 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:19.323662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9dc9ba4-1893-4f1e-8a72-52bf2c925b26 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:19.323662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9dc9ba4-1893-4f1e-8a72-52bf2c925b26 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:19.323662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9dc9ba4-1893-4f1e-8a72-52bf2c925b26 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:19.323662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9dc9ba4-1893-4f1e-8a72-52bf2c925b26 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:19.324640 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e9dc9ba4-1893-4f1e-8a72-52bf2c925b26 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:19.347189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-e9dc9ba4-1893-4f1e-8a72-52bf2c925b26 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] HTTP exception thrown: Instance 2f8e2b4f-5870-46a3-b826-1b80fb322c73 could not be found. Aug 10 13:16:19.352290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e9dc9ba4-1893-4f1e-8a72-52bf2c925b26 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Request method failure captured: Aug 10 13:16:19.352290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73 HTTP/1.1 Aug 10 13:16:19.352290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:16:19.352290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:16:19.352290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:16:19.352290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:16:19.352290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:16:19.352290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:16:19.352290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:16:19.352290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:16:19.352290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86eExe_XYDjetvcaWL99DznCMzKUN2jexFUGzw16H67tirKyG-fMeZY22izLsXj4BiquUja4z1R9argb4arZ2ULADO1FPs_gUlMRZ6EVdYIE6Hmg2h3VcyTIZMp8poz-ToaKYbsgl2tYGqTqozjZOTs0gWraF9eX4PUb5tmr1DtyTBc Aug 10 13:16:19.352290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:16:19.352290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:16:19.352290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:16:19.352290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:16:19.352290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 13:16:19.352290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:16:19.352290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:16:19.352290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: d6fe8b6c27e743eaad5fe6ffc8a40e81 Aug 10 13:16:19.352290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1519693959 Aug 10 13:16:19.352290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:16:19.352290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:16:19.353444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d6fe8b6c27e743eaad5fe6ffc8a40e81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d6fe8b6c27e743eaad5fe6ffc8a40e81", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d6fe8b6c27e743eaad5fe6ffc8a40e81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d6fe8b6c27e743eaad5fe6ffc8a40e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:16:19.353444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1519693959 Aug 10 13:16:19.353444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: d6fe8b6c27e743eaad5fe6ffc8a40e81 Aug 10 13:16:19.353444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1519693959 Aug 10 13:16:19.353444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-AttachVolumeShelveTestJSON-1519693959-project Aug 10 13:16:19.353444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:16:19.353444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:16:19.353444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 70010d27b7f44bc699ea5ad8093fec3b Aug 10 13:16:19.353444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1519693959-project Aug 10 13:16:19.353444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:16:19.353444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance 2f8e2b4f-5870-46a3-b826-1b80fb322c73 could not be found. Aug 10 13:16:19.353444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': '2f8e2b4f-5870-46a3-b826-1b80fb322c73'} Aug 10 13:16:19.354127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:16:19.354127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:16:19.354127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:16:19.354127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:16:19.354127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:16:19.354127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:16:19.354127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:16:19.354127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:16:19.354127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:16:19.354127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:16:19.354127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f8e2b4f-5870-46a3-b826-1b80fb322c73 could not be found. Aug 10 13:16:19.354127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:19.354127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:16:19.354127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:19.354127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:16:19.354127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:16:19.354127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:16:19.354127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:16:19.354127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:16:19.354127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:16:19.355145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:16:19.355145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:16:19.355145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:16:19.355145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:16:19.355145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:16:19.355145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:16:19.355145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:16:19.355145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f8e2b4f-5870-46a3-b826-1b80fb322c73 could not be found. Aug 10 13:16:19.355145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:19.355145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:16:19.355145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:19.355145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:16:19.355145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:16:19.355145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:16:19.355145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:16:19.355145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:16:19.355145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f8e2b4f-5870-46a3-b826-1b80fb322c73 could not be found. Aug 10 13:16:19.355145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:19.356154 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e9dc9ba4-1893-4f1e-8a72-52bf2c925b26 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Returning 404 to user: Instance 2f8e2b4f-5870-46a3-b826-1b80fb322c73 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:16:19.356154 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e9dc9ba4-1893-4f1e-8a72-52bf2c925b26 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73" status: 404 len: 111 microversion: 2.20 time: 0.051476 Aug 10 13:16:19.356154 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1801/3506] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:16:19 2022] GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 13:16:19.362869 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-50650404-ba89-427f-bdd8-b3e82eb24382 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:19.363734 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-50650404-ba89-427f-bdd8-b3e82eb24382 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d18ee67-6285-4877-ae40-c30da937c050] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:19.372799 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50650404-ba89-427f-bdd8-b3e82eb24382 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:19.374028 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50650404-ba89-427f-bdd8-b3e82eb24382 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:19.376937 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50650404-ba89-427f-bdd8-b3e82eb24382 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:19.378490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50650404-ba89-427f-bdd8-b3e82eb24382 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:19.379154 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50650404-ba89-427f-bdd8-b3e82eb24382 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:19.379791 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50650404-ba89-427f-bdd8-b3e82eb24382 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:19.496254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-50650404-ba89-427f-bdd8-b3e82eb24382 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:19.522239 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-50650404-ba89-427f-bdd8-b3e82eb24382 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050" status: 200 len: 1326 microversion: 2.1 time: 0.156846 Aug 10 13:16:19.523338 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1802/3507] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:19 2022] GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050 => generated 1326 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:16:19.532760 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8009202c-3c05-4b7e-9bd5-a9984ed148be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '.version_select at 0x7fb8286e9820>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:19.553648 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8009202c-3c05-4b7e-9bd5-a9984ed148be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [486ff1d7-97b0-4c1d-907a-f34363e1ba72] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 13:16:20.562578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [None req-8009202c-3c05-4b7e-9bd5-a9984ed148be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [486ff1d7-97b0-4c1d-907a-f34363e1ba72] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 51634. Aug 10 13:16:20.665118 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8009202c-3c05-4b7e-9bd5-a9984ed148be tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1866697133" status: 204 len: 0 microversion: 2.20 time: 1.139969 Aug 10 13:16:20.666820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1803/3508] 10.222.0.49 () {60 vars in 1262 bytes} [Wed Aug 10 13:16:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1866697133 => generated 0 bytes in 1142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 13:16:20.676611 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-dd53ddf7-7136-4608-8409-af0962a3278d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:20.677403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-dd53ddf7-7136-4608-8409-af0962a3278d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: e5bd9766-6096-4847-bb63-d90b985902f9] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:20.691901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd53ddf7-7136-4608-8409-af0962a3278d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:20.694464 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd53ddf7-7136-4608-8409-af0962a3278d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:20.695138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd53ddf7-7136-4608-8409-af0962a3278d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:20.695678 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd53ddf7-7136-4608-8409-af0962a3278d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:20.696138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd53ddf7-7136-4608-8409-af0962a3278d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:20.696569 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd53ddf7-7136-4608-8409-af0962a3278d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:20.715281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-dd53ddf7-7136-4608-8409-af0962a3278d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] HTTP exception thrown: Instance e5bd9766-6096-4847-bb63-d90b985902f9 could not be found. Aug 10 13:16:20.722746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-dd53ddf7-7136-4608-8409-af0962a3278d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Request method failure captured: Aug 10 13:16:20.722746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 HTTP/1.1 Aug 10 13:16:20.722746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:16:20.722746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:16:20.722746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:16:20.722746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:16:20.722746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:16:20.722746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:16:20.722746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:16:20.722746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:16:20.722746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86d8V7Brrx6jOFb99Co-FDZwmEvtyDVeYnH8_iANB7J0NxUN2f-snlAn2yDbwcWxDSfsOagaBhqRjhpuGGTJmnsBdXVXFojbAKSvab6i25pKG57S3rU9tOP4hLmZxjdwtg8aiJEX4QrfavtV7g9rCLVXL55K3jqoDXD9Uxp38OaL_Fg Aug 10 13:16:20.722746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:16:20.722746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:16:20.722746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:16:20.722746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:16:20.722746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:16:20.722746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:16:20.722746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: e41d5b8acbce44248a45678d1e4f6b71 Aug 10 13:16:20.722746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1112223756 Aug 10 13:16:20.722746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:16:20.722746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:16:20.724122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e41d5b8acbce44248a45678d1e4f6b71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e41d5b8acbce44248a45678d1e4f6b71", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e41d5b8acbce44248a45678d1e4f6b71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e41d5b8acbce44248a45678d1e4f6b71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:16:20.724122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1112223756 Aug 10 13:16:20.724122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: e41d5b8acbce44248a45678d1e4f6b71 Aug 10 13:16:20.724122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1112223756 Aug 10 13:16:20.724122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-ServerRescueNegativeTestJSON-1112223756-project Aug 10 13:16:20.724122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:16:20.724122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:16:20.724122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 39cb7e0c86b3460dbd17c58dc13ef0d9 Aug 10 13:16:20.724122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1112223756-project Aug 10 13:16:20.724122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:16:20.724122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance e5bd9766-6096-4847-bb63-d90b985902f9 could not be found. Aug 10 13:16:20.724122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': 'e5bd9766-6096-4847-bb63-d90b985902f9'} Aug 10 13:16:20.724898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:16:20.724898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:16:20.724898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:16:20.724898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:16:20.724898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:16:20.724898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:16:20.724898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:16:20.724898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:16:20.724898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:16:20.724898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:16:20.724898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5bd9766-6096-4847-bb63-d90b985902f9 could not be found. Aug 10 13:16:20.724898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:20.724898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:16:20.724898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:20.724898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:16:20.724898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:16:20.724898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:16:20.724898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:16:20.724898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:16:20.724898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:16:20.726084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:16:20.726084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:16:20.726084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:16:20.726084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:16:20.726084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:16:20.726084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:16:20.726084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:16:20.726084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5bd9766-6096-4847-bb63-d90b985902f9 could not be found. Aug 10 13:16:20.726084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:20.726084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:16:20.726084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:20.726084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:16:20.726084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:16:20.726084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:16:20.726084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:16:20.726084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:16:20.726084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5bd9766-6096-4847-bb63-d90b985902f9 could not be found. Aug 10 13:16:20.726084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:20.727092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-dd53ddf7-7136-4608-8409-af0962a3278d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Returning 404 to user: Instance e5bd9766-6096-4847-bb63-d90b985902f9 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:16:20.727092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-dd53ddf7-7136-4608-8409-af0962a3278d tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9" status: 404 len: 111 microversion: 2.1 time: 0.050801 Aug 10 13:16:20.727092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1804/3509] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:20 2022] GET /compute/v2.1/servers/e5bd9766-6096-4847-bb63-d90b985902f9 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:16:20.727092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-45c7ebe6-2eb1-455c-adce-cf67863b9eef tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:20.727092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-45c7ebe6-2eb1-455c-adce-cf67863b9eef tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d18ee67-6285-4877-ae40-c30da937c050] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:20.730016 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-45c7ebe6-2eb1-455c-adce-cf67863b9eef tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:20.730501 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-45c7ebe6-2eb1-455c-adce-cf67863b9eef tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:20.730931 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-45c7ebe6-2eb1-455c-adce-cf67863b9eef tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:20.731843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-45c7ebe6-2eb1-455c-adce-cf67863b9eef tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:20.732295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-45c7ebe6-2eb1-455c-adce-cf67863b9eef tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:20.732783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-45c7ebe6-2eb1-455c-adce-cf67863b9eef tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:20.746899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-45c7ebe6-2eb1-455c-adce-cf67863b9eef tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] HTTP exception thrown: Instance 9d18ee67-6285-4877-ae40-c30da937c050 could not be found. Aug 10 13:16:20.749290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-45c7ebe6-2eb1-455c-adce-cf67863b9eef tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Request method failure captured: Aug 10 13:16:20.749290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050 HTTP/1.1 Aug 10 13:16:20.749290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:16:20.749290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:16:20.749290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:16:20.749290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:16:20.749290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:16:20.749290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:16:20.749290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:16:20.749290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:16:20.749290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86eGBGdgG-u30FY8ayuf9_oWfGm9Ue4wmiSD5HqZh9YFv6FZKb_K68ZxcABXBS1rsdBpDNgeZy47c1LKjpCTnjQZpQhdzFdsloDzIBkPWEMNrwJi0km_Dv-TGwCe6OdPlftNtoByFeD3k29rbgMXrfvFX26pc9GnUHHvgZESD2gvxTQ Aug 10 13:16:20.749290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:16:20.749290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:16:20.749290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:16:20.749290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:16:20.749290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:16:20.749290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:16:20.749290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: a2857015013f466d95f3a9037925c6fc Aug 10 13:16:20.749290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:16:20.749290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:16:20.749290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:16:20.750629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2857015013f466d95f3a9037925c6fc", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:16:20.750629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:16:20.750629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: a2857015013f466d95f3a9037925c6fc Aug 10 13:16:20.750629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:16:20.750629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-AttachVolumeNegativeTest-1707265238-project Aug 10 13:16:20.750629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:16:20.750629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:16:20.750629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 570c2a77b862411083b9444f8292192b Aug 10 13:16:20.750629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-AttachVolumeNegativeTest-1707265238-project Aug 10 13:16:20.750629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:16:20.750629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance 9d18ee67-6285-4877-ae40-c30da937c050 could not be found. Aug 10 13:16:20.750629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': '9d18ee67-6285-4877-ae40-c30da937c050'} Aug 10 13:16:20.751415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:16:20.751415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:16:20.751415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:16:20.751415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:16:20.751415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:16:20.751415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:16:20.751415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:16:20.751415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:16:20.751415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:16:20.751415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:16:20.751415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d18ee67-6285-4877-ae40-c30da937c050 could not be found. Aug 10 13:16:20.751415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:20.751415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:16:20.751415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:20.751415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:16:20.751415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:16:20.751415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:16:20.751415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:16:20.751415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:16:20.751415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:16:20.754231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:16:20.754231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:16:20.754231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:16:20.754231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:16:20.754231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:16:20.754231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:16:20.754231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:16:20.754231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d18ee67-6285-4877-ae40-c30da937c050 could not be found. Aug 10 13:16:20.754231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:20.754231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:16:20.754231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:20.754231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:16:20.754231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:16:20.754231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:16:20.754231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:16:20.754231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:16:20.754231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d18ee67-6285-4877-ae40-c30da937c050 could not be found. Aug 10 13:16:20.754231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:20.755370 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-45c7ebe6-2eb1-455c-adce-cf67863b9eef tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Returning 404 to user: Instance 9d18ee67-6285-4877-ae40-c30da937c050 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:16:20.755370 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-45c7ebe6-2eb1-455c-adce-cf67863b9eef tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050" status: 404 len: 111 microversion: 2.1 time: 0.030553 Aug 10 13:16:20.755370 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1805/3510] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:20 2022] GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:16:20.756234 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d02a0d78-90ed-4d1b-8a8d-6454e8aca60f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:20.756720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d02a0d78-90ed-4d1b-8a8d-6454e8aca60f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:20.763347 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d02a0d78-90ed-4d1b-8a8d-6454e8aca60f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:20.764250 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d02a0d78-90ed-4d1b-8a8d-6454e8aca60f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:20.765114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d02a0d78-90ed-4d1b-8a8d-6454e8aca60f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:20.766243 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d02a0d78-90ed-4d1b-8a8d-6454e8aca60f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:20.767146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d02a0d78-90ed-4d1b-8a8d-6454e8aca60f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:20.767888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d02a0d78-90ed-4d1b-8a8d-6454e8aca60f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:20.819368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d02a0d78-90ed-4d1b-8a8d-6454e8aca60f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Going to try to terminate instance {{(pid=124643) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:16:21.110084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d02a0d78-90ed-4d1b-8a8d-6454e8aca60f tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "DELETE /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48" status: 204 len: 0 microversion: 2.1 time: 0.356977 Aug 10 13:16:21.110677 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1806/3511] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 13:16:20 2022] DELETE /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:16:21.118883 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-13597449-8533-4099-8a6c-5caea64efb5b req-5874ef35-deea-41ac-bd59-107f639c5851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5bd9766-6096-4847-bb63-d90b985902f9", "name": "network-vif-deleted", "tag": "2b65d1a0-93b1-490f-9c09-f9f7d35efd68"}, {"server_uuid": "8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a", "name": "network-vif-deleted", "tag": "811605ba-52c3-45e2-85fd-e5d880491764"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:16:21.132027 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-13597449-8533-4099-8a6c-5caea64efb5b req-5874ef35-deea-41ac-bd59-107f639c5851 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:21.132722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-13597449-8533-4099-8a6c-5caea64efb5b req-5874ef35-deea-41ac-bd59-107f639c5851 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:21.133485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-13597449-8533-4099-8a6c-5caea64efb5b req-5874ef35-deea-41ac-bd59-107f639c5851 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:21.151158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-13597449-8533-4099-8a6c-5caea64efb5b req-5874ef35-deea-41ac-bd59-107f639c5851 service nova] Creating event network-vif-deleted:2b65d1a0-93b1-490f-9c09-f9f7d35efd68 for instance e5bd9766-6096-4847-bb63-d90b985902f9 on hv-cinder-85199 Aug 10 13:16:21.151882 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-13597449-8533-4099-8a6c-5caea64efb5b req-5874ef35-deea-41ac-bd59-107f639c5851 service nova] Creating event network-vif-deleted:811605ba-52c3-45e2-85fd-e5d880491764 for instance 8dafa0cc-ecd1-46f5-b97c-6941e40c3d5a on hv-cinder-85199 Aug 10 13:16:21.161594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-13597449-8533-4099-8a6c-5caea64efb5b req-5874ef35-deea-41ac-bd59-107f639c5851 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048745 Aug 10 13:16:21.162689 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1807/3512] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:16:21.170631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f23d3314-fbdc-48ae-ac41-7a046c073887 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '.version_select at 0x7fb82b29f280>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:21.260514 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f23d3314-fbdc-48ae-ac41-7a046c073887 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1017957999" status: 202 len: 0 microversion: 2.1 time: 0.095464 Aug 10 13:16:21.267263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1808/3513] 10.222.0.49 () {58 vars in 1221 bytes} [Wed Aug 10 13:16:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1017957999 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:16:21.273294 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-c282acef-11b9-41b6-9d11-ce7e31dad372 req-6f7a665f-d938-4be7-ad18-50ca68f44058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3181426f-eb81-4712-97c6-8c92b61f53a0", "name": "network-vif-deleted", "tag": "bd12d9c9-bde7-4a2b-92de-b4401e6328ab"}, {"server_uuid": "9d18ee67-6285-4877-ae40-c30da937c050", "name": "network-vif-deleted", "tag": "f21fab9d-9f5a-4151-8777-6c9b96dd7618"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:16:21.293924 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-c282acef-11b9-41b6-9d11-ce7e31dad372 req-6f7a665f-d938-4be7-ad18-50ca68f44058 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:21.295105 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-c282acef-11b9-41b6-9d11-ce7e31dad372 req-6f7a665f-d938-4be7-ad18-50ca68f44058 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:21.297275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-c282acef-11b9-41b6-9d11-ce7e31dad372 req-6f7a665f-d938-4be7-ad18-50ca68f44058 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:21.312725 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-c282acef-11b9-41b6-9d11-ce7e31dad372 req-6f7a665f-d938-4be7-ad18-50ca68f44058 service nova] Creating event network-vif-deleted:bd12d9c9-bde7-4a2b-92de-b4401e6328ab for instance 3181426f-eb81-4712-97c6-8c92b61f53a0 on hv-cinder-85199 Aug 10 13:16:21.313279 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-c282acef-11b9-41b6-9d11-ce7e31dad372 req-6f7a665f-d938-4be7-ad18-50ca68f44058 service nova] Creating event network-vif-deleted:f21fab9d-9f5a-4151-8777-6c9b96dd7618 for instance 9d18ee67-6285-4877-ae40-c30da937c050 on hv-cinder-85199 Aug 10 13:16:21.321473 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-c282acef-11b9-41b6-9d11-ce7e31dad372 req-6f7a665f-d938-4be7-ad18-50ca68f44058 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052863 Aug 10 13:16:21.322852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1809/3514] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:16:21.327709 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d223aad2-ef57-4c43-8ff9-7b76b7f84ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:21.328314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d223aad2-ef57-4c43-8ff9-7b76b7f84ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:21.334358 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d223aad2-ef57-4c43-8ff9-7b76b7f84ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:21.335010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d223aad2-ef57-4c43-8ff9-7b76b7f84ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:21.335619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d223aad2-ef57-4c43-8ff9-7b76b7f84ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:21.336461 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d223aad2-ef57-4c43-8ff9-7b76b7f84ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:21.337067 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d223aad2-ef57-4c43-8ff9-7b76b7f84ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:21.337490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d223aad2-ef57-4c43-8ff9-7b76b7f84ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:21.509266 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d223aad2-ef57-4c43-8ff9-7b76b7f84ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:21.527503 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d223aad2-ef57-4c43-8ff9-7b76b7f84ea7 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48" status: 200 len: 1520 microversion: 2.1 time: 0.198146 Aug 10 13:16:21.527503 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1810/3515] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:21 2022] GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:16:22.544550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a25c511b-3329-473d-90f7-827e94d85bb9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:22.545703 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a25c511b-3329-473d-90f7-827e94d85bb9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:22.553014 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a25c511b-3329-473d-90f7-827e94d85bb9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:22.553559 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a25c511b-3329-473d-90f7-827e94d85bb9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:22.553995 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a25c511b-3329-473d-90f7-827e94d85bb9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:22.555032 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a25c511b-3329-473d-90f7-827e94d85bb9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:22.555146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a25c511b-3329-473d-90f7-827e94d85bb9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:22.555596 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a25c511b-3329-473d-90f7-827e94d85bb9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:22.674462 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a25c511b-3329-473d-90f7-827e94d85bb9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39cb7e0c86b3460dbd17c58dc13ef0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e41d5b8acbce44248a45678d1e4f6b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:22.684467 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a25c511b-3329-473d-90f7-827e94d85bb9 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48" status: 200 len: 1478 microversion: 2.1 time: 0.144195 Aug 10 13:16:22.699151 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1811/3516] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:22 2022] GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48 => generated 1478 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:16:22.851220 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-271535e6-6dcd-49cc-89d4-f5b74d748acc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Action: 'create', calling method: .version_select at 0x7fb82b26b820>, body: {"keypair": {"name": "tempest-keypair-1289996078", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8bAOYIxcq52b8JrU2+ywcQFrANZSToi543x8+oFEbJWcVBe/Svg/EJ9GfkHkFBf2wGTRSka/9KPvh/dNUVt1XFzFTYFHrTWHhxYq+A8+XC4NBQ/4c0KAs0tIe2j+qLkw=="}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:16:22.870309 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-271535e6-6dcd-49cc-89d4-f5b74d748acc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Getting quotas for project a2857015013f466d95f3a9037925c6fc. Resources: {'key_pairs'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:16:22.876053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-271535e6-6dcd-49cc-89d4-f5b74d748acc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Getting quotas for user 570c2a77b862411083b9444f8292192b and project a2857015013f466d95f3a9037925c6fc. Resources: {'key_pairs'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:16:22.973512 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-271535e6-6dcd-49cc-89d4-f5b74d748acc tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.126278 Aug 10 13:16:22.982266 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1812/3517] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 10 13:16:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:16:23.188316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-e3383933-7788-4e19-8ffe-414a9fe936ca req-c334c650-9df4-42c8-87ec-c028886e2887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47011594-f6d9-44a1-9751-c564121b1e48", "name": "network-vif-deleted", "tag": "dd45ef32-2207-4bad-a901-d414e1d86870"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:16:23.204882 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-e3383933-7788-4e19-8ffe-414a9fe936ca req-c334c650-9df4-42c8-87ec-c028886e2887 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:23.214588 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-e3383933-7788-4e19-8ffe-414a9fe936ca req-c334c650-9df4-42c8-87ec-c028886e2887 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:23.214588 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-e3383933-7788-4e19-8ffe-414a9fe936ca req-c334c650-9df4-42c8-87ec-c028886e2887 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:23.237278 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-e3383933-7788-4e19-8ffe-414a9fe936ca req-c334c650-9df4-42c8-87ec-c028886e2887 service nova] Creating event network-vif-deleted:dd45ef32-2207-4bad-a901-d414e1d86870 for instance 47011594-f6d9-44a1-9751-c564121b1e48 on hv-cinder-85199 Aug 10 13:16:23.242509 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-e3383933-7788-4e19-8ffe-414a9fe936ca req-c334c650-9df4-42c8-87ec-c028886e2887 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059697 Aug 10 13:16:23.243119 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1813/3518] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:16:23.419412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-59b0bcb7-482f-4596-9a55-f7ad5af87a64 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:23.420777 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-59b0bcb7-482f-4596-9a55-f7ad5af87a64 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 2f8e2b4f-5870-46a3-b826-1b80fb322c73] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:23.426940 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-59b0bcb7-482f-4596-9a55-f7ad5af87a64 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:23.427464 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-59b0bcb7-482f-4596-9a55-f7ad5af87a64 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:23.427905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-59b0bcb7-482f-4596-9a55-f7ad5af87a64 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:23.428595 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-59b0bcb7-482f-4596-9a55-f7ad5af87a64 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:23.429042 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-59b0bcb7-482f-4596-9a55-f7ad5af87a64 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:23.429460 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-59b0bcb7-482f-4596-9a55-f7ad5af87a64 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:23.443584 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-59b0bcb7-482f-4596-9a55-f7ad5af87a64 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] HTTP exception thrown: Instance 2f8e2b4f-5870-46a3-b826-1b80fb322c73 could not be found. Aug 10 13:16:23.445211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-59b0bcb7-482f-4596-9a55-f7ad5af87a64 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Request method failure captured: Aug 10 13:16:23.445211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: DELETE /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73 HTTP/1.1 Aug 10 13:16:23.445211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:16:23.445211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:16:23.445211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:16:23.445211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:16:23.445211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:16:23.445211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:16:23.445211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:16:23.445211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:16:23.445211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86eExe_XYDjetvcaWL99DznCMzKUN2jexFUGzw16H67tirKyG-fMeZY22izLsXj4BiquUja4z1R9argb4arZ2ULADO1FPs_gUlMRZ6EVdYIE6Hmg2h3VcyTIZMp8poz-ToaKYbsgl2tYGqTqozjZOTs0gWraF9eX4PUb5tmr1DtyTBc Aug 10 13:16:23.445211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:16:23.445211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:16:23.445211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:16:23.445211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:16:23.445211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 13:16:23.445211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:16:23.445211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:16:23.445211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: d6fe8b6c27e743eaad5fe6ffc8a40e81 Aug 10 13:16:23.445211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1519693959 Aug 10 13:16:23.445211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:16:23.445211 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:16:23.446609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d6fe8b6c27e743eaad5fe6ffc8a40e81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d6fe8b6c27e743eaad5fe6ffc8a40e81", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d6fe8b6c27e743eaad5fe6ffc8a40e81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d6fe8b6c27e743eaad5fe6ffc8a40e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:16:23.446609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1519693959 Aug 10 13:16:23.446609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: d6fe8b6c27e743eaad5fe6ffc8a40e81 Aug 10 13:16:23.446609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1519693959 Aug 10 13:16:23.446609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-AttachVolumeShelveTestJSON-1519693959-project Aug 10 13:16:23.446609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:16:23.446609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:16:23.446609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 70010d27b7f44bc699ea5ad8093fec3b Aug 10 13:16:23.446609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1519693959-project Aug 10 13:16:23.446609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:16:23.446609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance 2f8e2b4f-5870-46a3-b826-1b80fb322c73 could not be found. Aug 10 13:16:23.446609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': '2f8e2b4f-5870-46a3-b826-1b80fb322c73'} Aug 10 13:16:23.447419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:16:23.447419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:16:23.447419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:16:23.447419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:16:23.447419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:16:23.447419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:16:23.447419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:16:23.447419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:16:23.447419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:16:23.447419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:16:23.447419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f8e2b4f-5870-46a3-b826-1b80fb322c73 could not be found. Aug 10 13:16:23.447419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:23.447419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:16:23.447419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:23.447419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:16:23.447419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:16:23.447419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:16:23.447419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:16:23.447419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:16:23.447419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:16:23.448447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:16:23.448447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 13:16:23.448447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 13:16:23.448447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 13:16:23.448447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 13:16:23.448447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:16:23.448447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:16:23.448447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:16:23.448447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:16:23.448447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f8e2b4f-5870-46a3-b826-1b80fb322c73 could not be found. Aug 10 13:16:23.448447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:23.448447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:16:23.448447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:23.448447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:16:23.448447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:16:23.448447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:16:23.448447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:16:23.448447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:16:23.448447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f8e2b4f-5870-46a3-b826-1b80fb322c73 could not be found. Aug 10 13:16:23.448447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:23.449424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-59b0bcb7-482f-4596-9a55-f7ad5af87a64 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Returning 404 to user: Instance 2f8e2b4f-5870-46a3-b826-1b80fb322c73 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:16:23.449424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-59b0bcb7-482f-4596-9a55-f7ad5af87a64 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73" status: 404 len: 111 microversion: 2.20 time: 0.031743 Aug 10 13:16:23.449424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1814/3519] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 10 13:16:23 2022] DELETE /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 10 13:16:23.455117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d5e08921-f26a-4dcd-a918-c8c8291300f2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:23.455769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d5e08921-f26a-4dcd-a918-c8c8291300f2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 2f8e2b4f-5870-46a3-b826-1b80fb322c73] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:23.461692 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d5e08921-f26a-4dcd-a918-c8c8291300f2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:23.462166 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d5e08921-f26a-4dcd-a918-c8c8291300f2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:23.470674 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d5e08921-f26a-4dcd-a918-c8c8291300f2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:23.470674 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d5e08921-f26a-4dcd-a918-c8c8291300f2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:23.470674 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d5e08921-f26a-4dcd-a918-c8c8291300f2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:23.470674 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d5e08921-f26a-4dcd-a918-c8c8291300f2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:23.478972 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-d5e08921-f26a-4dcd-a918-c8c8291300f2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] HTTP exception thrown: Instance 2f8e2b4f-5870-46a3-b826-1b80fb322c73 could not be found. Aug 10 13:16:23.480701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d5e08921-f26a-4dcd-a918-c8c8291300f2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Request method failure captured: Aug 10 13:16:23.480701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73 HTTP/1.1 Aug 10 13:16:23.480701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:16:23.480701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:16:23.480701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:16:23.480701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:16:23.480701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:16:23.480701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:16:23.480701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:16:23.480701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:16:23.480701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86eExe_XYDjetvcaWL99DznCMzKUN2jexFUGzw16H67tirKyG-fMeZY22izLsXj4BiquUja4z1R9argb4arZ2ULADO1FPs_gUlMRZ6EVdYIE6Hmg2h3VcyTIZMp8poz-ToaKYbsgl2tYGqTqozjZOTs0gWraF9eX4PUb5tmr1DtyTBc Aug 10 13:16:23.480701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:16:23.480701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:16:23.480701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:16:23.480701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:16:23.480701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 13:16:23.480701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:16:23.480701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:16:23.480701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: d6fe8b6c27e743eaad5fe6ffc8a40e81 Aug 10 13:16:23.480701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1519693959 Aug 10 13:16:23.480701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:16:23.480701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:16:23.481860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d6fe8b6c27e743eaad5fe6ffc8a40e81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d6fe8b6c27e743eaad5fe6ffc8a40e81", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d6fe8b6c27e743eaad5fe6ffc8a40e81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d6fe8b6c27e743eaad5fe6ffc8a40e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:16:23.481860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1519693959 Aug 10 13:16:23.481860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: d6fe8b6c27e743eaad5fe6ffc8a40e81 Aug 10 13:16:23.481860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1519693959 Aug 10 13:16:23.481860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-AttachVolumeShelveTestJSON-1519693959-project Aug 10 13:16:23.481860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:16:23.481860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:16:23.481860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 70010d27b7f44bc699ea5ad8093fec3b Aug 10 13:16:23.481860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1519693959-project Aug 10 13:16:23.481860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:16:23.481860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance 2f8e2b4f-5870-46a3-b826-1b80fb322c73 could not be found. Aug 10 13:16:23.481860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': '2f8e2b4f-5870-46a3-b826-1b80fb322c73'} Aug 10 13:16:23.483550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:16:23.483550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:16:23.483550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:16:23.483550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:16:23.483550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:16:23.483550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:16:23.483550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:16:23.483550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:16:23.483550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:16:23.483550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:16:23.483550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f8e2b4f-5870-46a3-b826-1b80fb322c73 could not be found. Aug 10 13:16:23.483550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:23.483550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:16:23.483550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:23.483550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:16:23.483550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:16:23.483550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:16:23.483550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:16:23.483550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:16:23.483550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:16:23.484747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:16:23.484747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:16:23.484747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:16:23.484747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:16:23.484747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:16:23.484747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:16:23.484747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:16:23.484747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f8e2b4f-5870-46a3-b826-1b80fb322c73 could not be found. Aug 10 13:16:23.484747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:23.484747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:16:23.484747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:23.484747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:16:23.484747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:16:23.484747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:16:23.484747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:16:23.484747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:16:23.484747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f8e2b4f-5870-46a3-b826-1b80fb322c73 could not be found. Aug 10 13:16:23.484747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:23.486095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d5e08921-f26a-4dcd-a918-c8c8291300f2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Returning 404 to user: Instance 2f8e2b4f-5870-46a3-b826-1b80fb322c73 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:16:23.486095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d5e08921-f26a-4dcd-a918-c8c8291300f2 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73" status: 404 len: 111 microversion: 2.20 time: 0.031051 Aug 10 13:16:23.486095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1815/3520] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:16:23 2022] GET /compute/v2.1/servers/2f8e2b4f-5870-46a3-b826-1b80fb322c73 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 10 13:16:23.706899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ff65a3cf-e116-4bb5-9e37-e83ef1be0437 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:23.708372 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ff65a3cf-e116-4bb5-9e37-e83ef1be0437 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] [instance: 47011594-f6d9-44a1-9751-c564121b1e48] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:23.712294 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:23.715939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff65a3cf-e116-4bb5-9e37-e83ef1be0437 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:23.716427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff65a3cf-e116-4bb5-9e37-e83ef1be0437 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:23.716899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff65a3cf-e116-4bb5-9e37-e83ef1be0437 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:23.717668 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff65a3cf-e116-4bb5-9e37-e83ef1be0437 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:23.718179 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff65a3cf-e116-4bb5-9e37-e83ef1be0437 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:23.718758 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff65a3cf-e116-4bb5-9e37-e83ef1be0437 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:23.734516 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-ff65a3cf-e116-4bb5-9e37-e83ef1be0437 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] HTTP exception thrown: Instance 47011594-f6d9-44a1-9751-c564121b1e48 could not be found. Aug 10 13:16:23.739702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ff65a3cf-e116-4bb5-9e37-e83ef1be0437 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Request method failure captured: Aug 10 13:16:23.739702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48 HTTP/1.1 Aug 10 13:16:23.739702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:16:23.739702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:16:23.739702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:16:23.739702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:16:23.739702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:16:23.739702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:16:23.739702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:16:23.739702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:16:23.739702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86d8V7Brrx6jOFb99Co-FDZwmEvtyDVeYnH8_iANB7J0NxUN2f-snlAn2yDbwcWxDSfsOagaBhqRjhpuGGTJmnsBdXVXFojbAKSvab6i25pKG57S3rU9tOP4hLmZxjdwtg8aiJEX4QrfavtV7g9rCLVXL55K3jqoDXD9Uxp38OaL_Fg Aug 10 13:16:23.739702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:16:23.739702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:16:23.739702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:16:23.739702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:16:23.739702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:16:23.739702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:16:23.739702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: e41d5b8acbce44248a45678d1e4f6b71 Aug 10 13:16:23.739702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1112223756 Aug 10 13:16:23.739702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:16:23.739702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:16:23.741487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e41d5b8acbce44248a45678d1e4f6b71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e41d5b8acbce44248a45678d1e4f6b71", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e41d5b8acbce44248a45678d1e4f6b71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e41d5b8acbce44248a45678d1e4f6b71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:16:23.741487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1112223756 Aug 10 13:16:23.741487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: e41d5b8acbce44248a45678d1e4f6b71 Aug 10 13:16:23.741487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1112223756 Aug 10 13:16:23.741487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-ServerRescueNegativeTestJSON-1112223756-project Aug 10 13:16:23.741487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:16:23.741487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:16:23.741487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 39cb7e0c86b3460dbd17c58dc13ef0d9 Aug 10 13:16:23.741487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1112223756-project Aug 10 13:16:23.741487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:16:23.741487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance 47011594-f6d9-44a1-9751-c564121b1e48 could not be found. Aug 10 13:16:23.741487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': '47011594-f6d9-44a1-9751-c564121b1e48'} Aug 10 13:16:23.742232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:16:23.742232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:16:23.742232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:16:23.742232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:16:23.742232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:16:23.742232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:16:23.742232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:16:23.742232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:16:23.742232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:16:23.742232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:16:23.742232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47011594-f6d9-44a1-9751-c564121b1e48 could not be found. Aug 10 13:16:23.742232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:23.742232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:16:23.742232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:23.742232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:16:23.742232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:16:23.742232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:16:23.742232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:16:23.742232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:16:23.742232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:16:23.743628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:16:23.743628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:16:23.743628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:16:23.743628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:16:23.743628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:16:23.743628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:16:23.743628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:16:23.743628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47011594-f6d9-44a1-9751-c564121b1e48 could not be found. Aug 10 13:16:23.743628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:23.743628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:16:23.743628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:23.743628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:16:23.743628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:16:23.743628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:16:23.743628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:16:23.743628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:16:23.743628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47011594-f6d9-44a1-9751-c564121b1e48 could not be found. Aug 10 13:16:23.743628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:23.744752 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ff65a3cf-e116-4bb5-9e37-e83ef1be0437 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] Returning 404 to user: Instance 47011594-f6d9-44a1-9751-c564121b1e48 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:16:23.744752 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ff65a3cf-e116-4bb5-9e37-e83ef1be0437 tempest-ServerRescueNegativeTestJSON-1112223756 tempest-ServerRescueNegativeTestJSON-1112223756-project] 10.222.0.49 "GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48" status: 404 len: 111 microversion: 2.1 time: 0.035344 Aug 10 13:16:23.744752 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1816/3521] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:23 2022] GET /compute/v2.1/servers/47011594-f6d9-44a1-9751-c564121b1e48 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:16:24.839578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7b3d4453-b1c9-447c-b1ca-962fde3fe095 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:24.840765 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7b3d4453-b1c9-447c-b1ca-962fde3fe095 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:24.850125 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b3d4453-b1c9-447c-b1ca-962fde3fe095 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:24.850619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b3d4453-b1c9-447c-b1ca-962fde3fe095 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:24.851053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b3d4453-b1c9-447c-b1ca-962fde3fe095 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:24.851800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b3d4453-b1c9-447c-b1ca-962fde3fe095 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:24.852254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b3d4453-b1c9-447c-b1ca-962fde3fe095 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:24.852681 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b3d4453-b1c9-447c-b1ca-962fde3fe095 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:24.899416 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-7b3d4453-b1c9-447c-b1ca-962fde3fe095 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] HTTP exception thrown: Instance 572a91d2-8a56-4616-97e4-b0d48cc57ea5 could not be found. Aug 10 13:16:24.901267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7b3d4453-b1c9-447c-b1ca-962fde3fe095 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Request method failure captured: Aug 10 13:16:24.901267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: DELETE /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 HTTP/1.1 Aug 10 13:16:24.901267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:16:24.901267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:16:24.901267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:16:24.901267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:16:24.901267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:16:24.901267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:16:24.901267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:16:24.901267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:16:24.901267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86eExe_XYDjetvcaWL99DznCMzKUN2jexFUGzw16H67tirKyG-fMeZY22izLsXj4BiquUja4z1R9argb4arZ2ULADO1FPs_gUlMRZ6EVdYIE6Hmg2h3VcyTIZMp8poz-ToaKYbsgl2tYGqTqozjZOTs0gWraF9eX4PUb5tmr1DtyTBc Aug 10 13:16:24.901267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:16:24.901267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:16:24.901267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:16:24.901267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:16:24.901267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 13:16:24.901267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:16:24.901267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:16:24.901267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: d6fe8b6c27e743eaad5fe6ffc8a40e81 Aug 10 13:16:24.901267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1519693959 Aug 10 13:16:24.901267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:16:24.901267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:16:24.902380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d6fe8b6c27e743eaad5fe6ffc8a40e81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d6fe8b6c27e743eaad5fe6ffc8a40e81", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d6fe8b6c27e743eaad5fe6ffc8a40e81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d6fe8b6c27e743eaad5fe6ffc8a40e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:16:24.902380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1519693959 Aug 10 13:16:24.902380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: d6fe8b6c27e743eaad5fe6ffc8a40e81 Aug 10 13:16:24.902380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1519693959 Aug 10 13:16:24.902380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-AttachVolumeShelveTestJSON-1519693959-project Aug 10 13:16:24.902380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:16:24.902380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:16:24.902380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 70010d27b7f44bc699ea5ad8093fec3b Aug 10 13:16:24.902380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1519693959-project Aug 10 13:16:24.902380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:16:24.902380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance 572a91d2-8a56-4616-97e4-b0d48cc57ea5 could not be found. Aug 10 13:16:24.902380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': '572a91d2-8a56-4616-97e4-b0d48cc57ea5'} Aug 10 13:16:24.902992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:16:24.902992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:16:24.902992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:16:24.902992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:16:24.902992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:16:24.902992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:16:24.902992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:16:24.902992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:16:24.902992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:16:24.902992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:16:24.902992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 572a91d2-8a56-4616-97e4-b0d48cc57ea5 could not be found. Aug 10 13:16:24.902992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:24.902992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:16:24.902992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:24.902992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:16:24.902992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:16:24.902992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:16:24.902992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:16:24.902992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:16:24.902992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:16:24.904672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:16:24.904672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 13:16:24.904672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 13:16:24.904672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 13:16:24.904672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 13:16:24.904672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:16:24.904672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:16:24.904672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:16:24.904672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:16:24.904672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 572a91d2-8a56-4616-97e4-b0d48cc57ea5 could not be found. Aug 10 13:16:24.904672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:24.904672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:16:24.904672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:24.904672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:16:24.904672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:16:24.904672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:16:24.904672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:16:24.904672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:16:24.904672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 572a91d2-8a56-4616-97e4-b0d48cc57ea5 could not be found. Aug 10 13:16:24.904672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:24.906583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7b3d4453-b1c9-447c-b1ca-962fde3fe095 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Returning 404 to user: Instance 572a91d2-8a56-4616-97e4-b0d48cc57ea5 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:16:24.906583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7b3d4453-b1c9-447c-b1ca-962fde3fe095 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "DELETE /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 404 len: 111 microversion: 2.20 time: 0.067158 Aug 10 13:16:24.906583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1817/3522] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 10 13:16:24 2022] DELETE /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 10 13:16:24.911427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-98fae2ff-5909-4441-864e-dcd209479a47 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:24.912260 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-98fae2ff-5909-4441-864e-dcd209479a47 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] [instance: 572a91d2-8a56-4616-97e4-b0d48cc57ea5] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:24.923460 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98fae2ff-5909-4441-864e-dcd209479a47 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:24.929177 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98fae2ff-5909-4441-864e-dcd209479a47 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:24.929177 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98fae2ff-5909-4441-864e-dcd209479a47 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:24.929177 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98fae2ff-5909-4441-864e-dcd209479a47 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:24.929544 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98fae2ff-5909-4441-864e-dcd209479a47 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:24.929981 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98fae2ff-5909-4441-864e-dcd209479a47 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:24.956351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-98fae2ff-5909-4441-864e-dcd209479a47 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] HTTP exception thrown: Instance 572a91d2-8a56-4616-97e4-b0d48cc57ea5 could not be found. Aug 10 13:16:24.960769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-98fae2ff-5909-4441-864e-dcd209479a47 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Request method failure captured: Aug 10 13:16:24.960769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 HTTP/1.1 Aug 10 13:16:24.960769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:16:24.960769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:16:24.960769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:16:24.960769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:16:24.960769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:16:24.960769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:16:24.960769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:16:24.960769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:16:24.960769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86eExe_XYDjetvcaWL99DznCMzKUN2jexFUGzw16H67tirKyG-fMeZY22izLsXj4BiquUja4z1R9argb4arZ2ULADO1FPs_gUlMRZ6EVdYIE6Hmg2h3VcyTIZMp8poz-ToaKYbsgl2tYGqTqozjZOTs0gWraF9eX4PUb5tmr1DtyTBc Aug 10 13:16:24.960769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:16:24.960769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:16:24.960769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:16:24.960769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:16:24.960769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 13:16:24.960769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:16:24.960769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:16:24.960769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: d6fe8b6c27e743eaad5fe6ffc8a40e81 Aug 10 13:16:24.960769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1519693959 Aug 10 13:16:24.960769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:16:24.960769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:16:24.962038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d6fe8b6c27e743eaad5fe6ffc8a40e81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d6fe8b6c27e743eaad5fe6ffc8a40e81", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d6fe8b6c27e743eaad5fe6ffc8a40e81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d6fe8b6c27e743eaad5fe6ffc8a40e81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:16:24.962038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1519693959 Aug 10 13:16:24.962038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: d6fe8b6c27e743eaad5fe6ffc8a40e81 Aug 10 13:16:24.962038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1519693959 Aug 10 13:16:24.962038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-AttachVolumeShelveTestJSON-1519693959-project Aug 10 13:16:24.962038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:16:24.962038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:16:24.962038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 70010d27b7f44bc699ea5ad8093fec3b Aug 10 13:16:24.962038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1519693959-project Aug 10 13:16:24.962038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:16:24.962038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance 572a91d2-8a56-4616-97e4-b0d48cc57ea5 could not be found. Aug 10 13:16:24.962038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': '572a91d2-8a56-4616-97e4-b0d48cc57ea5'} Aug 10 13:16:24.962666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:16:24.962666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:16:24.962666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:16:24.962666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:16:24.962666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:16:24.962666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:16:24.962666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:16:24.962666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:16:24.962666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:16:24.962666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:16:24.962666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 572a91d2-8a56-4616-97e4-b0d48cc57ea5 could not be found. Aug 10 13:16:24.962666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:24.962666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:16:24.962666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:24.962666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:16:24.962666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:16:24.962666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:16:24.962666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:16:24.962666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:16:24.962666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:16:24.963854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:16:24.963854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:16:24.963854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:16:24.963854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:16:24.963854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:16:24.963854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:16:24.963854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:16:24.963854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 572a91d2-8a56-4616-97e4-b0d48cc57ea5 could not be found. Aug 10 13:16:24.963854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:24.963854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:16:24.963854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:24.963854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:16:24.963854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:16:24.963854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:16:24.963854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:16:24.963854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:16:24.963854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 572a91d2-8a56-4616-97e4-b0d48cc57ea5 could not be found. Aug 10 13:16:24.963854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:24.966038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-98fae2ff-5909-4441-864e-dcd209479a47 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] Returning 404 to user: Instance 572a91d2-8a56-4616-97e4-b0d48cc57ea5 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:16:24.967082 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-98fae2ff-5909-4441-864e-dcd209479a47 tempest-AttachVolumeShelveTestJSON-1519693959 tempest-AttachVolumeShelveTestJSON-1519693959-project] 10.222.0.49 "GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5" status: 404 len: 111 microversion: 2.20 time: 0.059502 Aug 10 13:16:24.967715 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1818/3523] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 10 13:16:24 2022] GET /compute/v2.1/servers/572a91d2-8a56-4616-97e4-b0d48cc57ea5 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 13:16:26.850248 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-93975b5f-b63e-441a-b6ba-43bd5aa458e6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-220293440", "imageRef": "674dcf76-6c38-40de-b204-ad2842738058", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7b8fb292-ce0b-4d10-a119-78752ef6ec31"}], "security_groups": [{"name": "tempest-securitygroup--189512563"}], "key_name": "tempest-keypair-1289996078", "user_data": "}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:16:27.216802 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.network.neutron [None req-93975b5f-b63e-441a-b6ba-43bd5aa458e6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] validate_networks() for [('7b8fb292-ce0b-4d10-a119-78752ef6ec31', None, None, None, None, None)] {{(pid=124643) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:16:28.945590 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-93975b5f-b63e-441a-b6ba-43bd5aa458e6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Flavor limits 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:16:28.947800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-93975b5f-b63e-441a-b6ba-43bd5aa458e6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Image limits 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:16:28.948616 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-93975b5f-b63e-441a-b6ba-43bd5aa458e6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Flavor pref 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:16:28.949214 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-93975b5f-b63e-441a-b6ba-43bd5aa458e6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Image pref 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:16:28.949840 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-93975b5f-b63e-441a-b6ba-43bd5aa458e6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:16:28.986958 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93975b5f-b63e-441a-b6ba-43bd5aa458e6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:28.995388 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93975b5f-b63e-441a-b6ba-43bd5aa458e6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:28.996111 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93975b5f-b63e-441a-b6ba-43bd5aa458e6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:28.998496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93975b5f-b63e-441a-b6ba-43bd5aa458e6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:28.999255 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93975b5f-b63e-441a-b6ba-43bd5aa458e6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:29.001657 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-93975b5f-b63e-441a-b6ba-43bd5aa458e6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:29.042877 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-93975b5f-b63e-441a-b6ba-43bd5aa458e6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Getting quotas for project a2857015013f466d95f3a9037925c6fc. Resources: {'cores', 'ram', 'instances'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:16:29.047728 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-93975b5f-b63e-441a-b6ba-43bd5aa458e6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Getting quotas for user 570c2a77b862411083b9444f8292192b and project a2857015013f466d95f3a9037925c6fc. Resources: {'cores', 'ram', 'instances'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:16:29.062528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-93975b5f-b63e-441a-b6ba-43bd5aa458e6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Going to run 1 instances... {{(pid=124643) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:16:29.064979 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-93975b5f-b63e-441a-b6ba-43bd5aa458e6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='674dcf76-6c38-40de-b204-ad2842738058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:16:29.258513 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-93975b5f-b63e-441a-b6ba-43bd5aa458e6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.412437 Aug 10 13:16:29.260257 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1819/3524] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 13:16:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 2415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 13:16:29.271667 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-03748855-7a90-40f6-9cf9-f5f4e7bf4b35 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:29.272628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-03748855-7a90-40f6-9cf9-f5f4e7bf4b35 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:29.390465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-03748855-7a90-40f6-9cf9-f5f4e7bf4b35 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:29.401361 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-03748855-7a90-40f6-9cf9-f5f4e7bf4b35 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82" status: 200 len: 1241 microversion: 2.1 time: 0.133226 Aug 10 13:16:29.401949 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1820/3525] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:29 2022] GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 => generated 1241 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:16:30.423745 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-60f269d9-bd6d-4885-8ea9-c5bcac6556aa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:30.424586 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-60f269d9-bd6d-4885-8ea9-c5bcac6556aa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:30.535230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-60f269d9-bd6d-4885-8ea9-c5bcac6556aa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:30.548699 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-60f269d9-bd6d-4885-8ea9-c5bcac6556aa tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82" status: 200 len: 1241 microversion: 2.1 time: 0.128484 Aug 10 13:16:30.550529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1821/3526] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:30 2022] GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 => generated 1241 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:16:31.575275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-26f2b1f6-d193-41f2-80bb-38bd58830505 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:31.575275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-26f2b1f6-d193-41f2-80bb-38bd58830505 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:31.680575 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-26f2b1f6-d193-41f2-80bb-38bd58830505 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:31.719709 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-26f2b1f6-d193-41f2-80bb-38bd58830505 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82" status: 200 len: 1241 microversion: 2.1 time: 0.152845 Aug 10 13:16:31.721414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1822/3527] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:31 2022] GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 => generated 1241 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:16:32.742547 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f0c068a4-dd3a-49dd-8cae-2c27964d4188 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:32.743162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f0c068a4-dd3a-49dd-8cae-2c27964d4188 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:32.805177 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f0c068a4-dd3a-49dd-8cae-2c27964d4188 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:32.818171 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f0c068a4-dd3a-49dd-8cae-2c27964d4188 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82" status: 200 len: 1241 microversion: 2.1 time: 0.079804 Aug 10 13:16:32.819384 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1823/3528] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:32 2022] GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:16:33.844150 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-de9f445f-a97f-4260-9040-92bf34c1fd1a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:33.844798 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-de9f445f-a97f-4260-9040-92bf34c1fd1a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:33.982155 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-de9f445f-a97f-4260-9040-92bf34c1fd1a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:33.991349 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-de9f445f-a97f-4260-9040-92bf34c1fd1a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82" status: 200 len: 1241 microversion: 2.1 time: 0.151489 Aug 10 13:16:33.992607 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1824/3529] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:33 2022] GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 => generated 1241 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:16:34.891777 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9732d873-5b46-45dd-ace5-20c66a6ee990 tempest-VolumesGetTestJSON-1649932531 tempest-VolumesGetTestJSON-1649932531-project] Action: 'create', calling method: .version_select at 0x7fb82b2b0280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1874329106", "metadata": {"Type": "work"}}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:16:35.812051 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9732d873-5b46-45dd-ace5-20c66a6ee990 tempest-VolumesGetTestJSON-1649932531 tempest-VolumesGetTestJSON-1649932531-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.326705 Aug 10 13:16:35.822362 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1825/3530] 10.222.0.49 () {60 vars in 1156 bytes} [Wed Aug 10 13:16:34 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1337 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 13:16:35.834636 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c9356015-5b62-4e3a-abcb-e4b8a3ad3976 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:35.835778 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c9356015-5b62-4e3a-abcb-e4b8a3ad3976 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:35.855036 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9356015-5b62-4e3a-abcb-e4b8a3ad3976 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:35.855621 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9356015-5b62-4e3a-abcb-e4b8a3ad3976 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:35.856072 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9356015-5b62-4e3a-abcb-e4b8a3ad3976 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:35.856978 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9356015-5b62-4e3a-abcb-e4b8a3ad3976 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:35.857667 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9356015-5b62-4e3a-abcb-e4b8a3ad3976 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:35.858254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9356015-5b62-4e3a-abcb-e4b8a3ad3976 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:35.981143 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c9356015-5b62-4e3a-abcb-e4b8a3ad3976 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:35.990259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c9356015-5b62-4e3a-abcb-e4b8a3ad3976 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82" status: 200 len: 1293 microversion: 2.1 time: 0.166219 Aug 10 13:16:35.990881 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1826/3531] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:35 2022] GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 => generated 1293 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:16:35.995302 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-dd8a39c1-71b2-42f7-9ffa-c0b487b79ef9 tempest-VolumesGetTestJSON-1649932531 tempest-VolumesGetTestJSON-1649932531-project] Calling method '.version_select at 0x7fb82b2b0670>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:36.066861 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-dd8a39c1-71b2-42f7-9ffa-c0b487b79ef9 tempest-VolumesGetTestJSON-1649932531 tempest-VolumesGetTestJSON-1649932531-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/cac7dd4e-a7b0-4366-93b7-4028f0cd6ee2" status: 200 len: 353 microversion: 2.1 time: 0.074900 Aug 10 13:16:36.067787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1827/3532] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 13:16:35 2022] GET /compute/v2.1/os-volumes/cac7dd4e-a7b0-4366-93b7-4028f0cd6ee2 => generated 353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:16:37.011935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8635ede5-4e62-40b4-a8fd-758797a88d47 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:37.012553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8635ede5-4e62-40b4-a8fd-758797a88d47 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:37.023749 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8635ede5-4e62-40b4-a8fd-758797a88d47 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:37.024236 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8635ede5-4e62-40b4-a8fd-758797a88d47 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:37.024677 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8635ede5-4e62-40b4-a8fd-758797a88d47 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:37.025369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8635ede5-4e62-40b4-a8fd-758797a88d47 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:37.025814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8635ede5-4e62-40b4-a8fd-758797a88d47 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:37.027669 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8635ede5-4e62-40b4-a8fd-758797a88d47 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:37.250983 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8635ede5-4e62-40b4-a8fd-758797a88d47 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:37.262715 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8635ede5-4e62-40b4-a8fd-758797a88d47 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82" status: 200 len: 1366 microversion: 2.1 time: 0.254460 Aug 10 13:16:37.264433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1828/3533] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:37 2022] GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:16:37.294846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f5389fb4-b3e4-4858-8976-9dade80f101c tempest-VolumesGetTestJSON-1649932531 tempest-VolumesGetTestJSON-1649932531-project] Calling method '.version_select at 0x7fb8268dcdc0>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:37.403129 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f5389fb4-b3e4-4858-8976-9dade80f101c tempest-VolumesGetTestJSON-1649932531 tempest-VolumesGetTestJSON-1649932531-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/cac7dd4e-a7b0-4366-93b7-4028f0cd6ee2" status: 200 len: 354 microversion: 2.1 time: 0.136758 Aug 10 13:16:37.403937 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1829/3534] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 13:16:37 2022] GET /compute/v2.1/os-volumes/cac7dd4e-a7b0-4366-93b7-4028f0cd6ee2 => generated 354 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:16:37.417006 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6cdfe063-f409-42bd-a365-e3d3e756b07d tempest-VolumesGetTestJSON-1649932531 tempest-VolumesGetTestJSON-1649932531-project] Calling method '.version_select at 0x7fb82b29faf0>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:37.525609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6cdfe063-f409-42bd-a365-e3d3e756b07d tempest-VolumesGetTestJSON-1649932531 tempest-VolumesGetTestJSON-1649932531-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/cac7dd4e-a7b0-4366-93b7-4028f0cd6ee2" status: 200 len: 354 microversion: 2.1 time: 0.112459 Aug 10 13:16:37.526435 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1830/3535] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 13:16:37 2022] GET /compute/v2.1/os-volumes/cac7dd4e-a7b0-4366-93b7-4028f0cd6ee2 => generated 354 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:16:37.545770 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3b8ab374-c349-424b-ba15-680d228f0ef7 tempest-VolumesGetTestJSON-1649932531 tempest-VolumesGetTestJSON-1649932531-project] Calling method '.version_select at 0x7fb82b29f550>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:37.790326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3b8ab374-c349-424b-ba15-680d228f0ef7 tempest-VolumesGetTestJSON-1649932531 tempest-VolumesGetTestJSON-1649932531-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/cac7dd4e-a7b0-4366-93b7-4028f0cd6ee2" status: 202 len: 0 microversion: 2.1 time: 0.248842 Aug 10 13:16:37.790896 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1831/3536] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 10 13:16:37 2022] DELETE /compute/v2.1/os-volumes/cac7dd4e-a7b0-4366-93b7-4028f0cd6ee2 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 13:16:37.806481 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-99332964-5be8-49a1-8517-3639842ffa24 tempest-VolumesGetTestJSON-1649932531 tempest-VolumesGetTestJSON-1649932531-project] Calling method '.version_select at 0x7fb8268dc310>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:37.895465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-99332964-5be8-49a1-8517-3639842ffa24 tempest-VolumesGetTestJSON-1649932531 tempest-VolumesGetTestJSON-1649932531-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/cac7dd4e-a7b0-4366-93b7-4028f0cd6ee2" status: 200 len: 353 microversion: 2.1 time: 0.099400 Aug 10 13:16:37.896875 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1832/3537] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 13:16:37 2022] GET /compute/v2.1/os-volumes/cac7dd4e-a7b0-4366-93b7-4028f0cd6ee2 => generated 353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:16:38.287215 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-65cbbd2e-435f-4881-949b-927a77fe99d1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:38.288524 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-65cbbd2e-435f-4881-949b-927a77fe99d1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:38.302465 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-65cbbd2e-435f-4881-949b-927a77fe99d1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:38.303002 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-65cbbd2e-435f-4881-949b-927a77fe99d1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:38.303439 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-65cbbd2e-435f-4881-949b-927a77fe99d1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:38.304160 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-65cbbd2e-435f-4881-949b-927a77fe99d1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:38.304776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-65cbbd2e-435f-4881-949b-927a77fe99d1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:38.305440 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-65cbbd2e-435f-4881-949b-927a77fe99d1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:38.594288 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-65cbbd2e-435f-4881-949b-927a77fe99d1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:38.602484 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-65cbbd2e-435f-4881-949b-927a77fe99d1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82" status: 200 len: 1366 microversion: 2.1 time: 0.319932 Aug 10 13:16:38.607930 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1833/3538] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:38 2022] GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:16:38.812983 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-43ac4e0c-e94b-48f8-bf48-1fe733cfa208 req-1edc8f70-92e2-41b7-8594-ccdc74aab6ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2fa6f05-af9a-4b5f-b1a6-f569a9717c82", "tag": "76d9025d-4424-41b5-9536-178ffbac2c3d"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:16:38.825920 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-43ac4e0c-e94b-48f8-bf48-1fe733cfa208 req-1edc8f70-92e2-41b7-8594-ccdc74aab6ce service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:38.827518 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-43ac4e0c-e94b-48f8-bf48-1fe733cfa208 req-1edc8f70-92e2-41b7-8594-ccdc74aab6ce service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:38.828218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-43ac4e0c-e94b-48f8-bf48-1fe733cfa208 req-1edc8f70-92e2-41b7-8594-ccdc74aab6ce service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:38.846934 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-43ac4e0c-e94b-48f8-bf48-1fe733cfa208 req-1edc8f70-92e2-41b7-8594-ccdc74aab6ce service nova] Creating event network-changed:76d9025d-4424-41b5-9536-178ffbac2c3d for instance f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 on hv-cinder-85199 Aug 10 13:16:38.854115 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-43ac4e0c-e94b-48f8-bf48-1fe733cfa208 req-1edc8f70-92e2-41b7-8594-ccdc74aab6ce service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045526 Aug 10 13:16:38.855529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1834/3539] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:16:38.913338 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5643053b-7d57-4a99-915f-a1f2d9d43ea2 tempest-VolumesGetTestJSON-1649932531 tempest-VolumesGetTestJSON-1649932531-project] Calling method '.version_select at 0x7fb82b290040>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:38.966723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-5643053b-7d57-4a99-915f-a1f2d9d43ea2 tempest-VolumesGetTestJSON-1649932531 tempest-VolumesGetTestJSON-1649932531-project] HTTP exception thrown: Volume cac7dd4e-a7b0-4366-93b7-4028f0cd6ee2 could not be found. Aug 10 13:16:38.970225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5643053b-7d57-4a99-915f-a1f2d9d43ea2 tempest-VolumesGetTestJSON-1649932531 tempest-VolumesGetTestJSON-1649932531-project] Request method failure captured: Aug 10 13:16:38.970225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: GET /compute/v2.1/os-volumes/cac7dd4e-a7b0-4366-93b7-4028f0cd6ee2 HTTP/1.1 Aug 10 13:16:38.970225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:16:38.970225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:16:38.970225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:16:38.970225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:16:38.970225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:16:38.970225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:16:38.970225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:16:38.970225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:16:38.970225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86-yr00SOmDMYAK3cGK0vOUncWCG-Wy60d9Wnr62q1rME4YaaGDK5ESn37M4qcDF6xmnBGyziSwaHrQGrj5ahY8y5-Zac1ZlFLxHqjDZl2AwZJ-y7iUoW4vxw1qYuvf3aee6827x9oz-WggSKDCdnKIw7fz8FlvUfJd2DrBQiS1kqTk Aug 10 13:16:38.970225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:16:38.970225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:16:38.970225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:16:38.970225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:16:38.970225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:16:38.970225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:16:38.970225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: 99c6da6b75574975bf36d8d3038913e8 Aug 10 13:16:38.970225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-VolumesGetTestJSON-1649932531 Aug 10 13:16:38.970225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:16:38.970225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:16:38.971450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/99c6da6b75574975bf36d8d3038913e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_99c6da6b75574975bf36d8d3038913e8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/99c6da6b75574975bf36d8d3038913e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/99c6da6b75574975bf36d8d3038913e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:16:38.971450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-VolumesGetTestJSON-1649932531 Aug 10 13:16:38.971450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: 99c6da6b75574975bf36d8d3038913e8 Aug 10 13:16:38.971450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-VolumesGetTestJSON-1649932531 Aug 10 13:16:38.971450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-VolumesGetTestJSON-1649932531-project Aug 10 13:16:38.971450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:16:38.971450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:16:38.971450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 9601bade2d3a48b4a731428f9d1c939e Aug 10 13:16:38.971450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-VolumesGetTestJSON-1649932531-project Aug 10 13:16:38.971450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: Aug 10 13:16:38.971450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Volume cac7dd4e-a7b0-4366-93b7-4028f0cd6ee2 could not be found. Aug 10 13:16:38.971450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': 'cac7dd4e-a7b0-4366-93b7-4028f0cd6ee2'} Aug 10 13:16:38.971450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:16:38.972138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:16:38.972138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:16:38.972138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:16:38.972138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 13:16:38.972138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 13:16:38.972138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 13:16:38.972138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 13:16:38.972138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 13:16:38.972138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 13:16:38.972138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 13:16:38.972138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 13:16:38.972138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:16:38.972138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:16:38.972138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:16:38.972138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:16:38.972138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cac7dd4e-a7b0-4366-93b7-4028f0cd6ee2 could not be found. (HTTP 404) (Request-ID: req-89939e48-d03c-4355-b4a4-b0f07f6f2686) Aug 10 13:16:38.972138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:38.972138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:16:38.972138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:38.973256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:16:38.973256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 13:16:38.973256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 13:16:38.973256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 13:16:38.973256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 13:16:38.973256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 13:16:38.973256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 13:16:38.973256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 13:16:38.973256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 13:16:38.973256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:16:38.973256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:16:38.973256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 13:16:38.973256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 13:16:38.973256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 13:16:38.973256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 13:16:38.973256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 13:16:38.973256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 13:16:38.973256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 13:16:38.973256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 13:16:38.975583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:16:38.975583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:16:38.975583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:16:38.975583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:16:38.975583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cac7dd4e-a7b0-4366-93b7-4028f0cd6ee2 could not be found. Aug 10 13:16:38.975583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:38.975583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:16:38.975583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:38.975583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:16:38.975583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:16:38.975583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:16:38.975583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:16:38.975583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:16:38.975583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 13:16:38.975583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 13:16:38.975583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:16:38.975583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:16:38.975583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 13:16:38.975583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:16:38.982303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cac7dd4e-a7b0-4366-93b7-4028f0cd6ee2 could not be found. Aug 10 13:16:38.982303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:38.982303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:16:38.982303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:38.982303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:16:38.982303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:16:38.982303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:16:38.982303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:16:38.982303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:16:38.982303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cac7dd4e-a7b0-4366-93b7-4028f0cd6ee2 could not be found. Aug 10 13:16:38.982303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:16:38.982303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5643053b-7d57-4a99-915f-a1f2d9d43ea2 tempest-VolumesGetTestJSON-1649932531 tempest-VolumesGetTestJSON-1649932531-project] Returning 404 to user: Volume cac7dd4e-a7b0-4366-93b7-4028f0cd6ee2 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:16:38.982303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5643053b-7d57-4a99-915f-a1f2d9d43ea2 tempest-VolumesGetTestJSON-1649932531 tempest-VolumesGetTestJSON-1649932531-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/cac7dd4e-a7b0-4366-93b7-4028f0cd6ee2" status: 404 len: 109 microversion: 2.1 time: 0.070563 Aug 10 13:16:38.982303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1835/3540] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 13:16:38 2022] GET /compute/v2.1/os-volumes/cac7dd4e-a7b0-4366-93b7-4028f0cd6ee2 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:16:39.629277 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-47f73d29-2943-4289-94bf-5daa4c5cf4a4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:39.631406 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-47f73d29-2943-4289-94bf-5daa4c5cf4a4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:39.642288 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=2 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:39.646434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-47f73d29-2943-4289-94bf-5daa4c5cf4a4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:39.652124 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-47f73d29-2943-4289-94bf-5daa4c5cf4a4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:39.654511 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-47f73d29-2943-4289-94bf-5daa4c5cf4a4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:39.661478 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-47f73d29-2943-4289-94bf-5daa4c5cf4a4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:39.661478 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-47f73d29-2943-4289-94bf-5daa4c5cf4a4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:39.661478 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-47f73d29-2943-4289-94bf-5daa4c5cf4a4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:39.996916 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-47f73d29-2943-4289-94bf-5daa4c5cf4a4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:40.013626 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-47f73d29-2943-4289-94bf-5daa4c5cf4a4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82" status: 200 len: 1366 microversion: 2.1 time: 0.388111 Aug 10 13:16:40.032467 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1836/3541] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:39 2022] GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 => generated 1366 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:16:41.038385 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9c867fe3-f3ab-4fef-86bd-231a3ad2a619 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:41.039201 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9c867fe3-f3ab-4fef-86bd-231a3ad2a619 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:41.050765 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9c867fe3-f3ab-4fef-86bd-231a3ad2a619 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:41.053091 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9c867fe3-f3ab-4fef-86bd-231a3ad2a619 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:41.057924 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9c867fe3-f3ab-4fef-86bd-231a3ad2a619 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:41.058921 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9c867fe3-f3ab-4fef-86bd-231a3ad2a619 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:41.059580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9c867fe3-f3ab-4fef-86bd-231a3ad2a619 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:41.060203 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9c867fe3-f3ab-4fef-86bd-231a3ad2a619 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:41.303848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9c867fe3-f3ab-4fef-86bd-231a3ad2a619 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:41.330476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9c867fe3-f3ab-4fef-86bd-231a3ad2a619 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82" status: 200 len: 1366 microversion: 2.1 time: 0.300889 Aug 10 13:16:41.332614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1837/3542] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:41 2022] GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 => generated 1366 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:16:42.353733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9fbd5c29-488b-4fd1-a7e2-336fd3250582 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:42.354389 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9fbd5c29-488b-4fd1-a7e2-336fd3250582 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:42.361368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9fbd5c29-488b-4fd1-a7e2-336fd3250582 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:42.362117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9fbd5c29-488b-4fd1-a7e2-336fd3250582 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:42.362544 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9fbd5c29-488b-4fd1-a7e2-336fd3250582 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:42.363462 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9fbd5c29-488b-4fd1-a7e2-336fd3250582 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:42.364077 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9fbd5c29-488b-4fd1-a7e2-336fd3250582 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:42.364491 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9fbd5c29-488b-4fd1-a7e2-336fd3250582 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:42.371092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:42.568907 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9fbd5c29-488b-4fd1-a7e2-336fd3250582 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:42.580110 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9fbd5c29-488b-4fd1-a7e2-336fd3250582 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82" status: 200 len: 1366 microversion: 2.1 time: 0.230139 Aug 10 13:16:42.581042 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1838/3543] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:42 2022] GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:16:43.600669 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-591ff37d-576b-4aa7-b4ef-9e571c47daa4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:43.601887 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-591ff37d-576b-4aa7-b4ef-9e571c47daa4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:43.609414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-591ff37d-576b-4aa7-b4ef-9e571c47daa4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:43.610073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-591ff37d-576b-4aa7-b4ef-9e571c47daa4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:43.610703 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-591ff37d-576b-4aa7-b4ef-9e571c47daa4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:43.611423 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-591ff37d-576b-4aa7-b4ef-9e571c47daa4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:43.612327 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-591ff37d-576b-4aa7-b4ef-9e571c47daa4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:43.612754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-591ff37d-576b-4aa7-b4ef-9e571c47daa4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:43.797550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-591ff37d-576b-4aa7-b4ef-9e571c47daa4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:43.806874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-591ff37d-576b-4aa7-b4ef-9e571c47daa4 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82" status: 200 len: 1366 microversion: 2.1 time: 0.209756 Aug 10 13:16:43.808533 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1839/3544] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:43 2022] GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:16:44.140570 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=20 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:44.326212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-c648c696-bd19-432b-9cd2-d53161753a2f req-c0dfffae-da12-4dcc-8f5a-4b48ed60587f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2fa6f05-af9a-4b5f-b1a6-f569a9717c82", "name": "network-vif-plugged", "status": "completed", "tag": "76d9025d-4424-41b5-9536-178ffbac2c3d"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:16:44.336727 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-c648c696-bd19-432b-9cd2-d53161753a2f req-c0dfffae-da12-4dcc-8f5a-4b48ed60587f service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:44.337264 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-c648c696-bd19-432b-9cd2-d53161753a2f req-c0dfffae-da12-4dcc-8f5a-4b48ed60587f service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:44.338019 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-c648c696-bd19-432b-9cd2-d53161753a2f req-c0dfffae-da12-4dcc-8f5a-4b48ed60587f service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:44.352003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-c648c696-bd19-432b-9cd2-d53161753a2f req-c0dfffae-da12-4dcc-8f5a-4b48ed60587f service nova] Creating event network-vif-plugged:76d9025d-4424-41b5-9536-178ffbac2c3d for instance f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 on hv-cinder-85199 Aug 10 13:16:44.358165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-c648c696-bd19-432b-9cd2-d53161753a2f req-c0dfffae-da12-4dcc-8f5a-4b48ed60587f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224174 Aug 10 13:16:44.359007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1840/3545] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:16:44.833559 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f2129274-dc14-455e-a99f-fbde756dbbff tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:44.835014 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f2129274-dc14-455e-a99f-fbde756dbbff tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:44.842172 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2129274-dc14-455e-a99f-fbde756dbbff tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:44.842977 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2129274-dc14-455e-a99f-fbde756dbbff tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:44.843668 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2129274-dc14-455e-a99f-fbde756dbbff tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:44.844596 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2129274-dc14-455e-a99f-fbde756dbbff tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:44.845111 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2129274-dc14-455e-a99f-fbde756dbbff tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:44.845756 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f2129274-dc14-455e-a99f-fbde756dbbff tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:45.065661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f2129274-dc14-455e-a99f-fbde756dbbff tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:45.074954 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f2129274-dc14-455e-a99f-fbde756dbbff tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82" status: 200 len: 1366 microversion: 2.1 time: 0.246230 Aug 10 13:16:45.075717 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1841/3546] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:44 2022] GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:16:46.096952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8d87975c-7f66-40da-b7a8-06bbdee19477 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:46.098243 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8d87975c-7f66-40da-b7a8-06bbdee19477 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:46.113180 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d87975c-7f66-40da-b7a8-06bbdee19477 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:46.113954 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d87975c-7f66-40da-b7a8-06bbdee19477 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:46.114404 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d87975c-7f66-40da-b7a8-06bbdee19477 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:46.115222 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d87975c-7f66-40da-b7a8-06bbdee19477 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:46.115691 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d87975c-7f66-40da-b7a8-06bbdee19477 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:46.116117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d87975c-7f66-40da-b7a8-06bbdee19477 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:46.324759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8d87975c-7f66-40da-b7a8-06bbdee19477 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:46.334622 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8d87975c-7f66-40da-b7a8-06bbdee19477 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82" status: 200 len: 1366 microversion: 2.1 time: 0.242462 Aug 10 13:16:46.348326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1842/3547] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:46 2022] GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:16:47.358674 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7d9519a3-b016-48ce-86fb-c60dc597fa13 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:47.360808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7d9519a3-b016-48ce-86fb-c60dc597fa13 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:47.366435 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d9519a3-b016-48ce-86fb-c60dc597fa13 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:47.367471 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d9519a3-b016-48ce-86fb-c60dc597fa13 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:47.367471 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d9519a3-b016-48ce-86fb-c60dc597fa13 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:47.368312 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d9519a3-b016-48ce-86fb-c60dc597fa13 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:47.368925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d9519a3-b016-48ce-86fb-c60dc597fa13 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:47.369674 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7d9519a3-b016-48ce-86fb-c60dc597fa13 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:47.521218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7d9519a3-b016-48ce-86fb-c60dc597fa13 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:47.530019 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7d9519a3-b016-48ce-86fb-c60dc597fa13 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82" status: 200 len: 1556 microversion: 2.1 time: 0.175360 Aug 10 13:16:47.531606 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1843/3548] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:47 2022] GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 => generated 1556 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:16:47.562355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-07fc1fc2-3420-4aab-9828-02b6d8bd388b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:47.562961 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-07fc1fc2-3420-4aab-9828-02b6d8bd388b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:47.569600 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07fc1fc2-3420-4aab-9828-02b6d8bd388b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:47.570137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07fc1fc2-3420-4aab-9828-02b6d8bd388b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:47.570569 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07fc1fc2-3420-4aab-9828-02b6d8bd388b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:47.572723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07fc1fc2-3420-4aab-9828-02b6d8bd388b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:47.572723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07fc1fc2-3420-4aab-9828-02b6d8bd388b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:47.572723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07fc1fc2-3420-4aab-9828-02b6d8bd388b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:47.664852 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-07fc1fc2-3420-4aab-9828-02b6d8bd388b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106431 Aug 10 13:16:47.677224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1844/3549] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 10 13:16:47 2022] GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:16:49.026769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-04e635dc-dd3b-485c-a261-2f1866d52140 req-09fcdd00-3964-4216-8573-3145fca90a48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2fa6f05-af9a-4b5f-b1a6-f569a9717c82", "tag": "76d9025d-4424-41b5-9536-178ffbac2c3d"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:16:49.036143 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-04e635dc-dd3b-485c-a261-2f1866d52140 req-09fcdd00-3964-4216-8573-3145fca90a48 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:49.036624 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-04e635dc-dd3b-485c-a261-2f1866d52140 req-09fcdd00-3964-4216-8573-3145fca90a48 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:49.037048 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-04e635dc-dd3b-485c-a261-2f1866d52140 req-09fcdd00-3964-4216-8573-3145fca90a48 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:49.048607 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-04e635dc-dd3b-485c-a261-2f1866d52140 req-09fcdd00-3964-4216-8573-3145fca90a48 service nova] Creating event network-changed:76d9025d-4424-41b5-9536-178ffbac2c3d for instance f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 on hv-cinder-85199 Aug 10 13:16:49.055746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-04e635dc-dd3b-485c-a261-2f1866d52140 req-09fcdd00-3964-4216-8573-3145fca90a48 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033080 Aug 10 13:16:49.056698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1845/3550] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:16:50.399115 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4e08552d-98ac-4c14-8609-842db64911a9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Action: 'create', calling method: .version_select at 0x7fb82b290ee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1428085936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKTACYlDGpdMrT5aS5k+/hElCQUsx4sGiPf16HZOVYb80tGMIgLHWDGVRmXL1+0xokmUOKVdls2FpjnVg+xtiNVkAlKJqseOBdVzVdAP1Y2Bs8vI0IHsKEbd3JT+9TFmrg=="}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:16:50.420209 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-4e08552d-98ac-4c14-8609-842db64911a9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Getting quotas for project bd9b653c3c794b7192e659f2557e7335. Resources: {'key_pairs'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:16:50.426360 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-4e08552d-98ac-4c14-8609-842db64911a9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Getting quotas for user c025957730c04df5980279aaef8d0807 and project bd9b653c3c794b7192e659f2557e7335. Resources: {'key_pairs'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:16:50.521977 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4e08552d-98ac-4c14-8609-842db64911a9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.128367 Aug 10 13:16:50.522593 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1846/3551] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 10 13:16:50 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:16:50.639424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6c3f3423-fe84-4b84-9705-f91e9b7f30b3 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1836333709", "imageRef": "dfe1dc3c-0c1c-4664-9aff-2088b4e74a24", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1428085936", "networks": [{"uuid": "b11244e5-7e01-430c-add5-ac040169a72e"}]}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:16:50.705174 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.network.neutron [None req-6c3f3423-fe84-4b84-9705-f91e9b7f30b3 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] validate_networks() for [('b11244e5-7e01-430c-add5-ac040169a72e', None, None, None, None, None)] {{(pid=124643) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:16:51.214698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-6c3f3423-fe84-4b84-9705-f91e9b7f30b3 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Flavor limits 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:16:51.215259 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-6c3f3423-fe84-4b84-9705-f91e9b7f30b3 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Image limits 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:16:51.215843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-6c3f3423-fe84-4b84-9705-f91e9b7f30b3 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Flavor pref 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:16:51.217017 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-6c3f3423-fe84-4b84-9705-f91e9b7f30b3 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Image pref 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:16:51.217656 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-6c3f3423-fe84-4b84-9705-f91e9b7f30b3 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:16:51.228141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6c3f3423-fe84-4b84-9705-f91e9b7f30b3 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:51.228618 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6c3f3423-fe84-4b84-9705-f91e9b7f30b3 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:51.229051 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6c3f3423-fe84-4b84-9705-f91e9b7f30b3 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:51.229774 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6c3f3423-fe84-4b84-9705-f91e9b7f30b3 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:51.230223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6c3f3423-fe84-4b84-9705-f91e9b7f30b3 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:51.230645 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6c3f3423-fe84-4b84-9705-f91e9b7f30b3 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:51.247385 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-6c3f3423-fe84-4b84-9705-f91e9b7f30b3 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Getting quotas for project bd9b653c3c794b7192e659f2557e7335. Resources: {'cores', 'ram', 'instances'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:16:51.251953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-6c3f3423-fe84-4b84-9705-f91e9b7f30b3 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Getting quotas for user c025957730c04df5980279aaef8d0807 and project bd9b653c3c794b7192e659f2557e7335. Resources: {'cores', 'ram', 'instances'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:16:51.263599 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6c3f3423-fe84-4b84-9705-f91e9b7f30b3 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Going to run 1 instances... {{(pid=124643) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:16:51.267072 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6c3f3423-fe84-4b84-9705-f91e9b7f30b3 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dfe1dc3c-0c1c-4664-9aff-2088b4e74a24',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:16:51.295024 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:16:51.374829 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6c3f3423-fe84-4b84-9705-f91e9b7f30b3 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.739381 Aug 10 13:16:51.375830 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1847/3552] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 13:16:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 13:16:51.387194 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-903e6440-3fba-47dd-aac6-c5a9421ba85d tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:51.387707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-903e6440-3fba-47dd-aac6-c5a9421ba85d tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:51.450022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-903e6440-3fba-47dd-aac6-c5a9421ba85d tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:51.456827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-903e6440-3fba-47dd-aac6-c5a9421ba85d tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1259 microversion: 2.1 time: 0.074718 Aug 10 13:16:51.457394 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1848/3553] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:51 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1259 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:16:52.477178 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-04ae8f19-141e-4fe0-bf81-f0cd69785b34 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:52.477803 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-04ae8f19-141e-4fe0-bf81-f0cd69785b34 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:52.484765 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04ae8f19-141e-4fe0-bf81-f0cd69785b34 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:52.485244 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04ae8f19-141e-4fe0-bf81-f0cd69785b34 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:52.485680 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04ae8f19-141e-4fe0-bf81-f0cd69785b34 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:52.486386 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04ae8f19-141e-4fe0-bf81-f0cd69785b34 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:52.487099 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04ae8f19-141e-4fe0-bf81-f0cd69785b34 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:52.487573 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04ae8f19-141e-4fe0-bf81-f0cd69785b34 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:52.552474 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-04ae8f19-141e-4fe0-bf81-f0cd69785b34 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:52.559839 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-04ae8f19-141e-4fe0-bf81-f0cd69785b34 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1263 microversion: 2.1 time: 0.086576 Aug 10 13:16:52.560399 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1849/3554] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:52 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1263 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:16:53.581606 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-dc751f0a-7bdc-4ca2-87b8-008a1caa7260 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:53.582233 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-dc751f0a-7bdc-4ca2-87b8-008a1caa7260 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:53.588651 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dc751f0a-7bdc-4ca2-87b8-008a1caa7260 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:53.589124 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dc751f0a-7bdc-4ca2-87b8-008a1caa7260 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:53.589553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dc751f0a-7bdc-4ca2-87b8-008a1caa7260 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:53.590235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dc751f0a-7bdc-4ca2-87b8-008a1caa7260 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:53.590683 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dc751f0a-7bdc-4ca2-87b8-008a1caa7260 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:53.591112 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dc751f0a-7bdc-4ca2-87b8-008a1caa7260 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:53.655911 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-dc751f0a-7bdc-4ca2-87b8-008a1caa7260 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:53.663417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-dc751f0a-7bdc-4ca2-87b8-008a1caa7260 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1263 microversion: 2.1 time: 0.086514 Aug 10 13:16:53.663983 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1850/3555] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:53 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1263 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:16:54.684377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1be5edac-7fbd-4c24-b8c6-2879845dd1fb tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:54.684973 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1be5edac-7fbd-4c24-b8c6-2879845dd1fb tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:54.691961 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1be5edac-7fbd-4c24-b8c6-2879845dd1fb tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:54.692463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1be5edac-7fbd-4c24-b8c6-2879845dd1fb tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:54.692890 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1be5edac-7fbd-4c24-b8c6-2879845dd1fb tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:54.693569 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1be5edac-7fbd-4c24-b8c6-2879845dd1fb tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:54.694020 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1be5edac-7fbd-4c24-b8c6-2879845dd1fb tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:54.694438 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1be5edac-7fbd-4c24-b8c6-2879845dd1fb tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:54.756791 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1be5edac-7fbd-4c24-b8c6-2879845dd1fb tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:54.766601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1be5edac-7fbd-4c24-b8c6-2879845dd1fb tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1319 microversion: 2.1 time: 0.086076 Aug 10 13:16:54.767618 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1851/3556] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:54 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1319 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:16:55.790826 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-974c3bab-a670-4434-b6b8-34e0225e69df tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:55.791593 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-974c3bab-a670-4434-b6b8-34e0225e69df tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:55.802301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-974c3bab-a670-4434-b6b8-34e0225e69df tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:55.803274 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-974c3bab-a670-4434-b6b8-34e0225e69df tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:55.804311 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-974c3bab-a670-4434-b6b8-34e0225e69df tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:55.805453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-974c3bab-a670-4434-b6b8-34e0225e69df tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:55.806320 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-974c3bab-a670-4434-b6b8-34e0225e69df tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:55.807257 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-974c3bab-a670-4434-b6b8-34e0225e69df tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:56.031440 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-974c3bab-a670-4434-b6b8-34e0225e69df tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:56.040728 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-974c3bab-a670-4434-b6b8-34e0225e69df tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1359 microversion: 2.1 time: 0.255039 Aug 10 13:16:56.041645 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1852/3557] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:55 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1359 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:16:56.420335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-c3039033-de75-49d5-8088-e436a2f9888e req-744a1e7f-30a6-43c0-becb-95c0db0b5ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a68803-559f-47cf-9aac-6e8561994419", "tag": "2f5340f4-ecdb-4e30-9fff-c55b41092d6f"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:16:56.455896 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-c3039033-de75-49d5-8088-e436a2f9888e req-744a1e7f-30a6-43c0-becb-95c0db0b5ef6 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:56.456625 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-c3039033-de75-49d5-8088-e436a2f9888e req-744a1e7f-30a6-43c0-becb-95c0db0b5ef6 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:56.458106 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-c3039033-de75-49d5-8088-e436a2f9888e req-744a1e7f-30a6-43c0-becb-95c0db0b5ef6 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:56.483533 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-c3039033-de75-49d5-8088-e436a2f9888e req-744a1e7f-30a6-43c0-becb-95c0db0b5ef6 service nova] Creating event network-changed:2f5340f4-ecdb-4e30-9fff-c55b41092d6f for instance e3a68803-559f-47cf-9aac-6e8561994419 on hv-cinder-85199 Aug 10 13:16:56.496959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-c3039033-de75-49d5-8088-e436a2f9888e req-744a1e7f-30a6-43c0-becb-95c0db0b5ef6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085492 Aug 10 13:16:56.500003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1853/3558] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:16:57.062750 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ff62f6db-3510-4f5a-a8d5-94b8e1ecb62b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:57.064387 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ff62f6db-3510-4f5a-a8d5-94b8e1ecb62b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:57.071900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff62f6db-3510-4f5a-a8d5-94b8e1ecb62b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:57.072520 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff62f6db-3510-4f5a-a8d5-94b8e1ecb62b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:57.073155 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff62f6db-3510-4f5a-a8d5-94b8e1ecb62b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:57.074093 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff62f6db-3510-4f5a-a8d5-94b8e1ecb62b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:57.074609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff62f6db-3510-4f5a-a8d5-94b8e1ecb62b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:57.075145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff62f6db-3510-4f5a-a8d5-94b8e1ecb62b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:57.231614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ff62f6db-3510-4f5a-a8d5-94b8e1ecb62b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:57.239497 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ff62f6db-3510-4f5a-a8d5-94b8e1ecb62b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1359 microversion: 2.1 time: 0.181090 Aug 10 13:16:57.240070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1854/3559] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:57 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:16:58.261054 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-35c39362-7df0-446a-9d42-7101cd4e9fd9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:58.262429 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-35c39362-7df0-446a-9d42-7101cd4e9fd9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:58.270020 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35c39362-7df0-446a-9d42-7101cd4e9fd9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:58.270442 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35c39362-7df0-446a-9d42-7101cd4e9fd9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:58.270897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35c39362-7df0-446a-9d42-7101cd4e9fd9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:58.271673 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35c39362-7df0-446a-9d42-7101cd4e9fd9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:58.272126 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35c39362-7df0-446a-9d42-7101cd4e9fd9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:58.272547 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-35c39362-7df0-446a-9d42-7101cd4e9fd9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:58.409420 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-35c39362-7df0-446a-9d42-7101cd4e9fd9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:58.416746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-35c39362-7df0-446a-9d42-7101cd4e9fd9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1359 microversion: 2.1 time: 0.159971 Aug 10 13:16:58.417329 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1855/3560] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:58 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:16:59.438347 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-935e7c76-c54d-4919-8eb7-f9d9012b53d9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:16:59.439016 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-935e7c76-c54d-4919-8eb7-f9d9012b53d9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:16:59.445419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-935e7c76-c54d-4919-8eb7-f9d9012b53d9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:59.445902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-935e7c76-c54d-4919-8eb7-f9d9012b53d9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:59.446340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-935e7c76-c54d-4919-8eb7-f9d9012b53d9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:59.447028 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-935e7c76-c54d-4919-8eb7-f9d9012b53d9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:16:59.447623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-935e7c76-c54d-4919-8eb7-f9d9012b53d9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:16:59.448053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-935e7c76-c54d-4919-8eb7-f9d9012b53d9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:16:59.583695 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-935e7c76-c54d-4919-8eb7-f9d9012b53d9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:16:59.591713 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-935e7c76-c54d-4919-8eb7-f9d9012b53d9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1359 microversion: 2.1 time: 0.158080 Aug 10 13:16:59.592489 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1856/3561] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:16:59 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:00.614349 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5242b04d-dc4b-4237-97d5-902d3fcf2d3b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:00.615707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5242b04d-dc4b-4237-97d5-902d3fcf2d3b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:00.622402 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5242b04d-dc4b-4237-97d5-902d3fcf2d3b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:00.623112 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5242b04d-dc4b-4237-97d5-902d3fcf2d3b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:00.623742 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5242b04d-dc4b-4237-97d5-902d3fcf2d3b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:00.624766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5242b04d-dc4b-4237-97d5-902d3fcf2d3b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:00.625229 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5242b04d-dc4b-4237-97d5-902d3fcf2d3b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:00.625661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5242b04d-dc4b-4237-97d5-902d3fcf2d3b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:00.795018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5242b04d-dc4b-4237-97d5-902d3fcf2d3b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:00.802809 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5242b04d-dc4b-4237-97d5-902d3fcf2d3b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1359 microversion: 2.1 time: 0.192892 Aug 10 13:17:00.803455 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1857/3562] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:00 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:01.823357 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5f2c4aff-b5c1-4193-a0c9-67559911f284 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:01.824716 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5f2c4aff-b5c1-4193-a0c9-67559911f284 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:01.828008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=2 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:01.829039 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=12 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:01.833715 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5f2c4aff-b5c1-4193-a0c9-67559911f284 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:01.839199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5f2c4aff-b5c1-4193-a0c9-67559911f284 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:01.839199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5f2c4aff-b5c1-4193-a0c9-67559911f284 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:01.839199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5f2c4aff-b5c1-4193-a0c9-67559911f284 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:01.839199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5f2c4aff-b5c1-4193-a0c9-67559911f284 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:01.840335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5f2c4aff-b5c1-4193-a0c9-67559911f284 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:01.991483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5f2c4aff-b5c1-4193-a0c9-67559911f284 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:01.999044 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5f2c4aff-b5c1-4193-a0c9-67559911f284 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1359 microversion: 2.1 time: 0.179655 Aug 10 13:17:02.013007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1858/3563] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:01 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1359 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:17:03.020837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1b7662d2-7abc-48e5-ba60-153b1cc608a4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:03.022125 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1b7662d2-7abc-48e5-ba60-153b1cc608a4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:03.038516 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1b7662d2-7abc-48e5-ba60-153b1cc608a4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:03.039021 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1b7662d2-7abc-48e5-ba60-153b1cc608a4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:03.039505 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1b7662d2-7abc-48e5-ba60-153b1cc608a4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:03.040357 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1b7662d2-7abc-48e5-ba60-153b1cc608a4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:03.040837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1b7662d2-7abc-48e5-ba60-153b1cc608a4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:03.041251 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1b7662d2-7abc-48e5-ba60-153b1cc608a4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:03.318063 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1b7662d2-7abc-48e5-ba60-153b1cc608a4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:03.321487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:03.328389 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1b7662d2-7abc-48e5-ba60-153b1cc608a4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1359 microversion: 2.1 time: 0.310672 Aug 10 13:17:03.349457 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1859/3564] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:03 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1359 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:04.355064 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ded1a1cd-558c-490e-85d4-e891ab0f3a71 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:04.355738 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ded1a1cd-558c-490e-85d4-e891ab0f3a71 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:04.363628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ded1a1cd-558c-490e-85d4-e891ab0f3a71 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:04.364386 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ded1a1cd-558c-490e-85d4-e891ab0f3a71 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:04.365192 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ded1a1cd-558c-490e-85d4-e891ab0f3a71 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:04.366288 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ded1a1cd-558c-490e-85d4-e891ab0f3a71 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:04.366809 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ded1a1cd-558c-490e-85d4-e891ab0f3a71 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:04.367258 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ded1a1cd-558c-490e-85d4-e891ab0f3a71 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:04.588776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ded1a1cd-558c-490e-85d4-e891ab0f3a71 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:04.605511 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ded1a1cd-558c-490e-85d4-e891ab0f3a71 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1359 microversion: 2.1 time: 0.254708 Aug 10 13:17:04.626121 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1860/3565] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:04 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1359 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:17:05.633960 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-abb906ec-53e0-404e-bd7b-9fdf090749fc tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:05.634622 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-abb906ec-53e0-404e-bd7b-9fdf090749fc tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:05.650268 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abb906ec-53e0-404e-bd7b-9fdf090749fc tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:05.650754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abb906ec-53e0-404e-bd7b-9fdf090749fc tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:05.651281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abb906ec-53e0-404e-bd7b-9fdf090749fc tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:05.654408 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abb906ec-53e0-404e-bd7b-9fdf090749fc tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:05.654893 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abb906ec-53e0-404e-bd7b-9fdf090749fc tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:05.656807 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-abb906ec-53e0-404e-bd7b-9fdf090749fc tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:05.823068 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-abb906ec-53e0-404e-bd7b-9fdf090749fc tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:05.832672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-abb906ec-53e0-404e-bd7b-9fdf090749fc tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1359 microversion: 2.1 time: 0.203064 Aug 10 13:17:05.834909 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1861/3566] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:05 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1359 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:06.856160 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a2ddec60-5cdb-42fa-afde-bd6e3c37b7b4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:06.857487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a2ddec60-5cdb-42fa-afde-bd6e3c37b7b4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:06.868387 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a2ddec60-5cdb-42fa-afde-bd6e3c37b7b4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:06.869146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a2ddec60-5cdb-42fa-afde-bd6e3c37b7b4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:06.869708 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a2ddec60-5cdb-42fa-afde-bd6e3c37b7b4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:06.870488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a2ddec60-5cdb-42fa-afde-bd6e3c37b7b4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:06.871008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a2ddec60-5cdb-42fa-afde-bd6e3c37b7b4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:06.871677 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a2ddec60-5cdb-42fa-afde-bd6e3c37b7b4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:07.016676 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a2ddec60-5cdb-42fa-afde-bd6e3c37b7b4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:07.026498 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a2ddec60-5cdb-42fa-afde-bd6e3c37b7b4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1359 microversion: 2.1 time: 0.174695 Aug 10 13:17:07.027095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1862/3567] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:06 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:17:08.053062 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-004b8e97-0d12-460a-8aa7-3fb85798fec9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:08.053687 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-004b8e97-0d12-460a-8aa7-3fb85798fec9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:08.060071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-004b8e97-0d12-460a-8aa7-3fb85798fec9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:08.061546 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-004b8e97-0d12-460a-8aa7-3fb85798fec9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:08.061982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-004b8e97-0d12-460a-8aa7-3fb85798fec9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:08.062668 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-004b8e97-0d12-460a-8aa7-3fb85798fec9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:08.063108 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-004b8e97-0d12-460a-8aa7-3fb85798fec9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:08.063550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-004b8e97-0d12-460a-8aa7-3fb85798fec9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:08.200284 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-004b8e97-0d12-460a-8aa7-3fb85798fec9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:08.209027 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-004b8e97-0d12-460a-8aa7-3fb85798fec9 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1359 microversion: 2.1 time: 0.159852 Aug 10 13:17:08.209745 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1863/3568] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:08 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:09.234872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-07fca59e-824c-489c-b0f1-98a2bb8bedcf tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:09.236549 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-07fca59e-824c-489c-b0f1-98a2bb8bedcf tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:09.243101 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07fca59e-824c-489c-b0f1-98a2bb8bedcf tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:09.244618 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07fca59e-824c-489c-b0f1-98a2bb8bedcf tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:09.245152 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07fca59e-824c-489c-b0f1-98a2bb8bedcf tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:09.245972 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07fca59e-824c-489c-b0f1-98a2bb8bedcf tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:09.246495 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07fca59e-824c-489c-b0f1-98a2bb8bedcf tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:09.246996 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-07fca59e-824c-489c-b0f1-98a2bb8bedcf tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:09.437177 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-07fca59e-824c-489c-b0f1-98a2bb8bedcf tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:09.445058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-07fca59e-824c-489c-b0f1-98a2bb8bedcf tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1359 microversion: 2.1 time: 0.214972 Aug 10 13:17:09.450777 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1864/3569] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:09 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:17:10.471399 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b8422e2d-8269-42e9-83b5-1db93ec94084 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:10.472737 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b8422e2d-8269-42e9-83b5-1db93ec94084 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:10.483007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8422e2d-8269-42e9-83b5-1db93ec94084 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:10.484236 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8422e2d-8269-42e9-83b5-1db93ec94084 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:10.484769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8422e2d-8269-42e9-83b5-1db93ec94084 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:10.485745 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8422e2d-8269-42e9-83b5-1db93ec94084 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:10.486316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8422e2d-8269-42e9-83b5-1db93ec94084 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:10.487310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8422e2d-8269-42e9-83b5-1db93ec94084 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:10.807043 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b8422e2d-8269-42e9-83b5-1db93ec94084 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:10.818020 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b8422e2d-8269-42e9-83b5-1db93ec94084 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1359 microversion: 2.1 time: 0.352165 Aug 10 13:17:10.820740 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1865/3570] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:10 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1359 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:17:11.849115 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4b0af0f9-6941-4348-a265-f25e0d7eca2b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:11.849710 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4b0af0f9-6941-4348-a265-f25e0d7eca2b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:11.856210 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b0af0f9-6941-4348-a265-f25e0d7eca2b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:11.856708 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b0af0f9-6941-4348-a265-f25e0d7eca2b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:11.857174 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b0af0f9-6941-4348-a265-f25e0d7eca2b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:11.857880 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b0af0f9-6941-4348-a265-f25e0d7eca2b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:11.858336 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b0af0f9-6941-4348-a265-f25e0d7eca2b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:11.859754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4b0af0f9-6941-4348-a265-f25e0d7eca2b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:12.096863 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4b0af0f9-6941-4348-a265-f25e0d7eca2b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:12.117976 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4b0af0f9-6941-4348-a265-f25e0d7eca2b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1359 microversion: 2.1 time: 0.272286 Aug 10 13:17:12.120204 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1866/3571] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:11 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1359 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:13.143449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f036001d-4d78-4ad2-95d7-1bfcc5bfccc6 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:13.145058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f036001d-4d78-4ad2-95d7-1bfcc5bfccc6 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:13.157506 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f036001d-4d78-4ad2-95d7-1bfcc5bfccc6 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:13.158758 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f036001d-4d78-4ad2-95d7-1bfcc5bfccc6 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:13.159334 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f036001d-4d78-4ad2-95d7-1bfcc5bfccc6 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:13.160343 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f036001d-4d78-4ad2-95d7-1bfcc5bfccc6 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:13.161007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f036001d-4d78-4ad2-95d7-1bfcc5bfccc6 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:13.161759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f036001d-4d78-4ad2-95d7-1bfcc5bfccc6 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:13.404953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f036001d-4d78-4ad2-95d7-1bfcc5bfccc6 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:13.417826 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f036001d-4d78-4ad2-95d7-1bfcc5bfccc6 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1359 microversion: 2.1 time: 0.279918 Aug 10 13:17:13.420921 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1867/3572] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:13 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1359 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:14.444855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2a0735a4-100b-4948-a1c2-79f37ed3f5f8 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:14.445594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2a0735a4-100b-4948-a1c2-79f37ed3f5f8 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:14.452942 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a0735a4-100b-4948-a1c2-79f37ed3f5f8 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:14.453463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a0735a4-100b-4948-a1c2-79f37ed3f5f8 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:14.453927 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a0735a4-100b-4948-a1c2-79f37ed3f5f8 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:14.455293 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a0735a4-100b-4948-a1c2-79f37ed3f5f8 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:14.455751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a0735a4-100b-4948-a1c2-79f37ed3f5f8 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:14.456366 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a0735a4-100b-4948-a1c2-79f37ed3f5f8 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:14.606889 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2a0735a4-100b-4948-a1c2-79f37ed3f5f8 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:14.614545 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2a0735a4-100b-4948-a1c2-79f37ed3f5f8 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1359 microversion: 2.1 time: 0.176387 Aug 10 13:17:14.615222 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1868/3573] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:14 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:14.794747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7e09bdc9-0d83-4952-8930-0205f9573afc tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Action: 'create', calling method: .version_select at 0x7fb8268b2c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-591943327", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrgrZgfgOjanr0YFj0rgPVxXYTVxdHFKqbRW6M8SO0Ttf38QQbWis6H9lFvt0JiZAvyq9OeUx8bOopEuJJ58Kgmx8JaM361q5q/ML/ZcGUn6772tndHJCD0IK4w1vEfNw=="}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:17:14.809998 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-7e09bdc9-0d83-4952-8930-0205f9573afc tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Getting quotas for project 0874b1e036b34f9188b4b5b003d59742. Resources: {'key_pairs'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:17:14.814899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-7e09bdc9-0d83-4952-8930-0205f9573afc tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Getting quotas for user 40c6361443a14e9ebd71855ba11cee10 and project 0874b1e036b34f9188b4b5b003d59742. Resources: {'key_pairs'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:17:14.887960 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7e09bdc9-0d83-4952-8930-0205f9573afc tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.271631 Aug 10 13:17:14.888813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1869/3574] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 10 13:17:14 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:17:15.636045 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f10c256a-4fbf-4b9e-b206-79051bbcbfc5 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:15.636709 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f10c256a-4fbf-4b9e-b206-79051bbcbfc5 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:15.642764 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f10c256a-4fbf-4b9e-b206-79051bbcbfc5 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:15.643274 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f10c256a-4fbf-4b9e-b206-79051bbcbfc5 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:15.643705 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f10c256a-4fbf-4b9e-b206-79051bbcbfc5 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:15.644388 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f10c256a-4fbf-4b9e-b206-79051bbcbfc5 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:15.644832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f10c256a-4fbf-4b9e-b206-79051bbcbfc5 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:15.645255 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f10c256a-4fbf-4b9e-b206-79051bbcbfc5 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:15.829693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f10c256a-4fbf-4b9e-b206-79051bbcbfc5 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:15.837961 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f10c256a-4fbf-4b9e-b206-79051bbcbfc5 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1359 microversion: 2.1 time: 0.205721 Aug 10 13:17:15.838605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1870/3575] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:15 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:16.767353 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-96c7c31e-0781-419f-93b8-b37056aec989 req-a254a943-c5a0-4516-9d36-4b648cfbe843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a68803-559f-47cf-9aac-6e8561994419", "name": "network-vif-plugged", "status": "completed", "tag": "2f5340f4-ecdb-4e30-9fff-c55b41092d6f"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:17:16.786036 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-96c7c31e-0781-419f-93b8-b37056aec989 req-a254a943-c5a0-4516-9d36-4b648cfbe843 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:16.786036 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-96c7c31e-0781-419f-93b8-b37056aec989 req-a254a943-c5a0-4516-9d36-4b648cfbe843 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:16.786036 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-96c7c31e-0781-419f-93b8-b37056aec989 req-a254a943-c5a0-4516-9d36-4b648cfbe843 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:16.794332 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-96c7c31e-0781-419f-93b8-b37056aec989 req-a254a943-c5a0-4516-9d36-4b648cfbe843 service nova] Creating event network-vif-plugged:2f5340f4-ecdb-4e30-9fff-c55b41092d6f for instance e3a68803-559f-47cf-9aac-6e8561994419 on hv-cinder-85199 Aug 10 13:17:16.800527 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-96c7c31e-0781-419f-93b8-b37056aec989 req-a254a943-c5a0-4516-9d36-4b648cfbe843 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037993 Aug 10 13:17:16.801428 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1871/3576] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:17:16.861082 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9f8b7df8-9b90-4230-9b2b-1465e6a7de69 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:16.861783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9f8b7df8-9b90-4230-9b2b-1465e6a7de69 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:16.868607 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f8b7df8-9b90-4230-9b2b-1465e6a7de69 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:16.869449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f8b7df8-9b90-4230-9b2b-1465e6a7de69 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:16.870030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f8b7df8-9b90-4230-9b2b-1465e6a7de69 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:16.871156 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f8b7df8-9b90-4230-9b2b-1465e6a7de69 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:16.871796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f8b7df8-9b90-4230-9b2b-1465e6a7de69 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:16.872262 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f8b7df8-9b90-4230-9b2b-1465e6a7de69 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:17.063021 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9f8b7df8-9b90-4230-9b2b-1465e6a7de69 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:17.072468 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9f8b7df8-9b90-4230-9b2b-1465e6a7de69 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1359 microversion: 2.1 time: 0.215811 Aug 10 13:17:17.073144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1872/3577] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:16 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:17:18.093726 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9ce912fc-8423-4c53-b4b7-1f58bb77bf85 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:18.094342 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9ce912fc-8423-4c53-b4b7-1f58bb77bf85 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:18.100973 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ce912fc-8423-4c53-b4b7-1f58bb77bf85 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:18.101381 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ce912fc-8423-4c53-b4b7-1f58bb77bf85 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:18.101806 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ce912fc-8423-4c53-b4b7-1f58bb77bf85 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:18.102484 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ce912fc-8423-4c53-b4b7-1f58bb77bf85 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:18.102925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ce912fc-8423-4c53-b4b7-1f58bb77bf85 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:18.103382 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9ce912fc-8423-4c53-b4b7-1f58bb77bf85 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:18.234925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9ce912fc-8423-4c53-b4b7-1f58bb77bf85 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:18.244586 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9ce912fc-8423-4c53-b4b7-1f58bb77bf85 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1359 microversion: 2.1 time: 0.154592 Aug 10 13:17:18.245175 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1873/3578] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:18 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:19.269432 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-02c1ddd3-a6ca-4598-a82c-4446ca7dea01 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:19.270040 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-02c1ddd3-a6ca-4598-a82c-4446ca7dea01 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:19.282767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-02c1ddd3-a6ca-4598-a82c-4446ca7dea01 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:19.282886 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-02c1ddd3-a6ca-4598-a82c-4446ca7dea01 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:19.283453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-02c1ddd3-a6ca-4598-a82c-4446ca7dea01 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:19.284158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-02c1ddd3-a6ca-4598-a82c-4446ca7dea01 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:19.284609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-02c1ddd3-a6ca-4598-a82c-4446ca7dea01 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:19.285036 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-02c1ddd3-a6ca-4598-a82c-4446ca7dea01 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:19.435262 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-02c1ddd3-a6ca-4598-a82c-4446ca7dea01 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:19.443729 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-02c1ddd3-a6ca-4598-a82c-4446ca7dea01 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1550 microversion: 2.1 time: 0.181003 Aug 10 13:17:19.444454 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1874/3579] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:19 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1550 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:17:19.468863 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-521a1da5-4b94-408b-882c-acaa1ea0cfd1 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:19.469487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-521a1da5-4b94-408b-882c-acaa1ea0cfd1 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:19.476070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-521a1da5-4b94-408b-882c-acaa1ea0cfd1 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:19.477292 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-521a1da5-4b94-408b-882c-acaa1ea0cfd1 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:19.477750 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-521a1da5-4b94-408b-882c-acaa1ea0cfd1 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:19.478531 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-521a1da5-4b94-408b-882c-acaa1ea0cfd1 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:19.478996 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-521a1da5-4b94-408b-882c-acaa1ea0cfd1 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:19.479532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-521a1da5-4b94-408b-882c-acaa1ea0cfd1 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:19.615780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-521a1da5-4b94-408b-882c-acaa1ea0cfd1 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:19.623325 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-521a1da5-4b94-408b-882c-acaa1ea0cfd1 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1550 microversion: 2.1 time: 0.159144 Aug 10 13:17:19.623893 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1875/3580] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:19 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:19.643697 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-40bb73d1-6f8b-4d2c-99ed-e31e4cf4e3a5 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:19.648346 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-40bb73d1-6f8b-4d2c-99ed-e31e4cf4e3a5 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:19.649102 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-40bb73d1-6f8b-4d2c-99ed-e31e4cf4e3a5 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Searching by: {'deleted': False, 'project_id': 'bd9b653c3c794b7192e659f2557e7335'} {{(pid=124643) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 13:17:19.655666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40bb73d1-6f8b-4d2c-99ed-e31e4cf4e3a5 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:19.656137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40bb73d1-6f8b-4d2c-99ed-e31e4cf4e3a5 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:19.656565 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40bb73d1-6f8b-4d2c-99ed-e31e4cf4e3a5 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:19.657356 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40bb73d1-6f8b-4d2c-99ed-e31e4cf4e3a5 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:19.657895 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40bb73d1-6f8b-4d2c-99ed-e31e4cf4e3a5 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:19.658245 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40bb73d1-6f8b-4d2c-99ed-e31e4cf4e3a5 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:19.750106 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.multi_cell_list [None req-40bb73d1-6f8b-4d2c-99ed-e31e4cf4e3a5 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124643) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 13:17:19.859290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-40bb73d1-6f8b-4d2c-99ed-e31e4cf4e3a5 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.219564 Aug 10 13:17:19.859879 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1876/3581] 10.222.0.49 () {58 vars in 1125 bytes} [Wed Aug 10 13:17:19 2022] GET /compute/v2.1/servers => generated 343 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:17:19.871590 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5a70c63c-87a1-47bd-b96b-467ccc89b357 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:19.872204 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5a70c63c-87a1-47bd-b96b-467ccc89b357 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:19.878111 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a70c63c-87a1-47bd-b96b-467ccc89b357 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:19.878592 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a70c63c-87a1-47bd-b96b-467ccc89b357 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:19.879026 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a70c63c-87a1-47bd-b96b-467ccc89b357 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:19.879752 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a70c63c-87a1-47bd-b96b-467ccc89b357 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:19.880206 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a70c63c-87a1-47bd-b96b-467ccc89b357 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:19.880631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a70c63c-87a1-47bd-b96b-467ccc89b357 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:20.179200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5a70c63c-87a1-47bd-b96b-467ccc89b357 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:20.182746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:20.187168 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5a70c63c-87a1-47bd-b96b-467ccc89b357 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1550 microversion: 2.1 time: 0.319164 Aug 10 13:17:20.187828 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1877/3582] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:19 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1550 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:22.109336 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-cb002313-4a6e-4935-9640-5c3a8f60f91d tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eba120db-8265-4bf8-89a7-a079fc969935"}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:17:22.111658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-cb002313-4a6e-4935-9640-5c3a8f60f91d tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:22.115059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:22.119997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb002313-4a6e-4935-9640-5c3a8f60f91d tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:22.120484 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb002313-4a6e-4935-9640-5c3a8f60f91d tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:22.120925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb002313-4a6e-4935-9640-5c3a8f60f91d tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:22.121647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb002313-4a6e-4935-9640-5c3a8f60f91d tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:22.122102 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb002313-4a6e-4935-9640-5c3a8f60f91d tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:22.122526 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cb002313-4a6e-4935-9640-5c3a8f60f91d tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:22.828995 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-cb002313-4a6e-4935-9640-5c3a8f60f91d tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "POST /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.722658 Aug 10 13:17:22.828995 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1878/3583] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 10 13:17:22 2022] POST /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419/os-volume_attachments => generated 194 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:17:31.592278 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=4 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:31.593145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=2 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:31.597155 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-54087f1c-9794-418b-b35d-78cda6ed64ed tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:31.597998 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-54087f1c-9794-418b-b35d-78cda6ed64ed tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:31.605004 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-54087f1c-9794-418b-b35d-78cda6ed64ed tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:31.605485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-54087f1c-9794-418b-b35d-78cda6ed64ed tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:31.605913 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-54087f1c-9794-418b-b35d-78cda6ed64ed tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:31.606596 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-54087f1c-9794-418b-b35d-78cda6ed64ed tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:31.607073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-54087f1c-9794-418b-b35d-78cda6ed64ed tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:31.607517 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-54087f1c-9794-418b-b35d-78cda6ed64ed tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:31.740684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-54087f1c-9794-418b-b35d-78cda6ed64ed tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:31.749464 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-54087f1c-9794-418b-b35d-78cda6ed64ed tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1596 microversion: 2.1 time: 0.158652 Aug 10 13:17:31.750027 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1879/3584] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:31 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1596 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:31.754525 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a7ddd254-6c60-4a81-a29e-c4716cfb08af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:31.755069 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a7ddd254-6c60-4a81-a29e-c4716cfb08af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:31.761185 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a7ddd254-6c60-4a81-a29e-c4716cfb08af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:31.761683 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a7ddd254-6c60-4a81-a29e-c4716cfb08af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:31.762091 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a7ddd254-6c60-4a81-a29e-c4716cfb08af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:31.762771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a7ddd254-6c60-4a81-a29e-c4716cfb08af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:31.763232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a7ddd254-6c60-4a81-a29e-c4716cfb08af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:31.763694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a7ddd254-6c60-4a81-a29e-c4716cfb08af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:31.787770 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a7ddd254-6c60-4a81-a29e-c4716cfb08af tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82/ips" status: 200 len: 150 microversion: 2.1 time: 0.036720 Aug 10 13:17:31.789658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1880/3585] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 10 13:17:31 2022] GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:17:33.449244 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b19f65ab-a88b-4079-8565-10dc0b733fdb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "552b7a87-e92b-415e-974f-b148e0e18148"}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:17:33.451934 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b19f65ab-a88b-4079-8565-10dc0b733fdb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:33.458592 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b19f65ab-a88b-4079-8565-10dc0b733fdb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:33.459146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b19f65ab-a88b-4079-8565-10dc0b733fdb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:33.459696 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b19f65ab-a88b-4079-8565-10dc0b733fdb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:33.460522 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b19f65ab-a88b-4079-8565-10dc0b733fdb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:33.461061 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b19f65ab-a88b-4079-8565-10dc0b733fdb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:33.461903 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b19f65ab-a88b-4079-8565-10dc0b733fdb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:34.222149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b19f65ab-a88b-4079-8565-10dc0b733fdb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "POST /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.777715 Aug 10 13:17:34.223401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1881/3586] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 10 13:17:33 2022] POST /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82/os-volume_attachments => generated 194 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:17:34.228946 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-3d197438-0d27-4dd0-818e-24790b569047 req-d3470e31-3853-4751-be75-b74d092742b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a68803-559f-47cf-9aac-6e8561994419", "tag": "2f5340f4-ecdb-4e30-9fff-c55b41092d6f"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:17:34.256780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-3d197438-0d27-4dd0-818e-24790b569047 req-d3470e31-3853-4751-be75-b74d092742b0 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:34.263258 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-3d197438-0d27-4dd0-818e-24790b569047 req-d3470e31-3853-4751-be75-b74d092742b0 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:34.263951 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-3d197438-0d27-4dd0-818e-24790b569047 req-d3470e31-3853-4751-be75-b74d092742b0 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:34.282799 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-3d197438-0d27-4dd0-818e-24790b569047 req-d3470e31-3853-4751-be75-b74d092742b0 service nova] Creating event network-changed:2f5340f4-ecdb-4e30-9fff-c55b41092d6f for instance e3a68803-559f-47cf-9aac-6e8561994419 on hv-cinder-85199 Aug 10 13:17:34.292116 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-3d197438-0d27-4dd0-818e-24790b569047 req-d3470e31-3853-4751-be75-b74d092742b0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066810 Aug 10 13:17:34.293119 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1882/3587] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:17:36.420836 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8287d477-68bd-4cf3-a18f-5d912be03d5c tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-520283205"}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:17:36.421559 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8287d477-68bd-4cf3-a18f-5d912be03d5c tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:36.427478 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8287d477-68bd-4cf3-a18f-5d912be03d5c tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:36.427959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8287d477-68bd-4cf3-a18f-5d912be03d5c tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:36.428388 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8287d477-68bd-4cf3-a18f-5d912be03d5c tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:36.431476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8287d477-68bd-4cf3-a18f-5d912be03d5c tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:36.431959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8287d477-68bd-4cf3-a18f-5d912be03d5c tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:36.432528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8287d477-68bd-4cf3-a18f-5d912be03d5c tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:36.564102 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.network.security_group_api [None req-8287d477-68bd-4cf3-a18f-5d912be03d5c tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Adding security group 6a49e73d-3b36-44e2-8b26-ef34e3791597 to port 2f5340f4-ecdb-4e30-9fff-c55b41092d6f Aug 10 13:17:36.940658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8287d477-68bd-4cf3-a18f-5d912be03d5c tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "POST /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419/action" status: 202 len: 0 microversion: 2.1 time: 0.524591 Aug 10 13:17:36.942739 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1883/3588] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 10 13:17:36 2022] POST /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419/action => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 13:17:36.949971 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6b1494bd-53eb-4cc5-b8c2-a99876bcf44e tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:36.950654 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6b1494bd-53eb-4cc5-b8c2-a99876bcf44e tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:36.956712 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b1494bd-53eb-4cc5-b8c2-a99876bcf44e tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:36.957195 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b1494bd-53eb-4cc5-b8c2-a99876bcf44e tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:36.957632 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b1494bd-53eb-4cc5-b8c2-a99876bcf44e tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:36.958326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b1494bd-53eb-4cc5-b8c2-a99876bcf44e tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:36.958780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b1494bd-53eb-4cc5-b8c2-a99876bcf44e tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:36.959231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b1494bd-53eb-4cc5-b8c2-a99876bcf44e tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:37.132323 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6b1494bd-53eb-4cc5-b8c2-a99876bcf44e tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:37.140435 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6b1494bd-53eb-4cc5-b8c2-a99876bcf44e tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1760 microversion: 2.1 time: 0.194588 Aug 10 13:17:37.141012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1884/3589] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:36 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1760 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:37.160486 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-c4d063aa-70e3-499b-9dc4-55147918fb23 req-a729affb-20d5-471a-9c1a-27a807add839 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a68803-559f-47cf-9aac-6e8561994419", "tag": "2f5340f4-ecdb-4e30-9fff-c55b41092d6f"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:17:37.170096 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-c4d063aa-70e3-499b-9dc4-55147918fb23 req-a729affb-20d5-471a-9c1a-27a807add839 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:37.170572 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-c4d063aa-70e3-499b-9dc4-55147918fb23 req-a729affb-20d5-471a-9c1a-27a807add839 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:37.171002 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-c4d063aa-70e3-499b-9dc4-55147918fb23 req-a729affb-20d5-471a-9c1a-27a807add839 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:37.182772 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-c4d063aa-70e3-499b-9dc4-55147918fb23 req-a729affb-20d5-471a-9c1a-27a807add839 service nova] Creating event network-changed:2f5340f4-ecdb-4e30-9fff-c55b41092d6f for instance e3a68803-559f-47cf-9aac-6e8561994419 on hv-cinder-85199 Aug 10 13:17:37.187728 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-c4d063aa-70e3-499b-9dc4-55147918fb23 req-a729affb-20d5-471a-9c1a-27a807add839 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030774 Aug 10 13:17:37.188319 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1885/3590] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:17:37.924965 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-291cbd90-3290-4480-9728-9bf8e0b9f2ab tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2135665441", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-591943327", "security_groups": [{"name": "tempest-secgroup-smoke-53394415"}], "networks": [{"uuid": "fc57b16b-8f8e-4446-8d72-3b9117e4e727"}], "block_device_mapping_v2": [{"uuid": "6afeec3d-723c-4fbc-aa1d-9e826a5ea080", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:17:38.043036 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.network.neutron [None req-291cbd90-3290-4480-9728-9bf8e0b9f2ab tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] validate_networks() for [('fc57b16b-8f8e-4446-8d72-3b9117e4e727', None, None, None, None, None)] {{(pid=124643) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:17:38.417597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-291cbd90-3290-4480-9728-9bf8e0b9f2ab tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Flavor limits 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:17:38.418019 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-291cbd90-3290-4480-9728-9bf8e0b9f2ab tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Image limits 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:17:38.418491 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-291cbd90-3290-4480-9728-9bf8e0b9f2ab tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Flavor pref 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:17:38.418900 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-291cbd90-3290-4480-9728-9bf8e0b9f2ab tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Image pref 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:17:38.419353 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-291cbd90-3290-4480-9728-9bf8e0b9f2ab tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:17:38.427953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-291cbd90-3290-4480-9728-9bf8e0b9f2ab tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:38.428425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-291cbd90-3290-4480-9728-9bf8e0b9f2ab tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:38.429458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-291cbd90-3290-4480-9728-9bf8e0b9f2ab tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:38.430509 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-291cbd90-3290-4480-9728-9bf8e0b9f2ab tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:38.430964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-291cbd90-3290-4480-9728-9bf8e0b9f2ab tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:38.431412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-291cbd90-3290-4480-9728-9bf8e0b9f2ab tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:38.448069 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-291cbd90-3290-4480-9728-9bf8e0b9f2ab tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Getting quotas for project 0874b1e036b34f9188b4b5b003d59742. Resources: {'cores', 'ram', 'instances'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:17:38.451962 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-291cbd90-3290-4480-9728-9bf8e0b9f2ab tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Getting quotas for user 40c6361443a14e9ebd71855ba11cee10 and project 0874b1e036b34f9188b4b5b003d59742. Resources: {'cores', 'ram', 'instances'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:17:38.510529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-291cbd90-3290-4480-9728-9bf8e0b9f2ab tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Going to run 1 instances... {{(pid=124643) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:17:38.512734 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-291cbd90-3290-4480-9728-9bf8e0b9f2ab tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6afeec3d-723c-4fbc-aa1d-9e826a5ea080',volume_size=None,volume_type=None)] {{(pid=124643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:17:38.909729 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-291cbd90-3290-4480-9728-9bf8e0b9f2ab tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.989339 Aug 10 13:17:38.910382 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1886/3591] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 13:17:37 2022] POST /compute/v2.1/servers => generated 404 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 13:17:38.921679 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7155f285-eba0-4a09-96e1-9cd68e687c4a tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:38.922287 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7155f285-eba0-4a09-96e1-9cd68e687c4a tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:38.976826 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7155f285-eba0-4a09-96e1-9cd68e687c4a tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:38.983638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7155f285-eba0-4a09-96e1-9cd68e687c4a tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1088 microversion: 2.1 time: 0.065789 Aug 10 13:17:38.984695 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1887/3592] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:38 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:40.005306 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1c87cb35-45b9-4617-a390-cd7e7af9d43e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:40.005976 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1c87cb35-45b9-4617-a390-cd7e7af9d43e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:40.014552 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1c87cb35-45b9-4617-a390-cd7e7af9d43e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:40.015037 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1c87cb35-45b9-4617-a390-cd7e7af9d43e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:40.015495 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1c87cb35-45b9-4617-a390-cd7e7af9d43e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:40.016186 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1c87cb35-45b9-4617-a390-cd7e7af9d43e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:40.016635 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1c87cb35-45b9-4617-a390-cd7e7af9d43e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:40.017057 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1c87cb35-45b9-4617-a390-cd7e7af9d43e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:40.084435 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1c87cb35-45b9-4617-a390-cd7e7af9d43e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:40.091908 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1c87cb35-45b9-4617-a390-cd7e7af9d43e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1138 microversion: 2.1 time: 0.091132 Aug 10 13:17:40.092472 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1888/3593] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:39 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1138 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:41.115038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8d06532d-0695-467f-9c0f-98f71041d9f5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:41.115648 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8d06532d-0695-467f-9c0f-98f71041d9f5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:41.122736 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d06532d-0695-467f-9c0f-98f71041d9f5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:41.123652 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d06532d-0695-467f-9c0f-98f71041d9f5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:41.123652 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d06532d-0695-467f-9c0f-98f71041d9f5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:41.124335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d06532d-0695-467f-9c0f-98f71041d9f5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:41.125261 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d06532d-0695-467f-9c0f-98f71041d9f5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:41.125687 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d06532d-0695-467f-9c0f-98f71041d9f5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:41.194100 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8d06532d-0695-467f-9c0f-98f71041d9f5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:41.202780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8d06532d-0695-467f-9c0f-98f71041d9f5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1186 microversion: 2.1 time: 0.091972 Aug 10 13:17:41.203293 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1889/3594] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:41 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1186 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:41.956311 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7c82d79c-36ec-4d6b-ad07-8e01513a28e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:41.956886 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7c82d79c-36ec-4d6b-ad07-8e01513a28e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:41.963682 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c82d79c-36ec-4d6b-ad07-8e01513a28e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:41.964174 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c82d79c-36ec-4d6b-ad07-8e01513a28e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:41.964608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c82d79c-36ec-4d6b-ad07-8e01513a28e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:41.965308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c82d79c-36ec-4d6b-ad07-8e01513a28e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:41.965759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c82d79c-36ec-4d6b-ad07-8e01513a28e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:41.966191 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7c82d79c-36ec-4d6b-ad07-8e01513a28e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:42.055480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.objects.instance [None req-7c82d79c-36ec-4d6b-ad07-8e01513a28e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lazy-loading 'services' on Instance uuid f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 {{(pid=124643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:17:42.274432 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7c82d79c-36ec-4d6b-ad07-8e01513a28e1 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82/os-volume_attachments/552b7a87-e92b-415e-974f-b148e0e18148" status: 202 len: 0 microversion: 2.1 time: 0.321829 Aug 10 13:17:42.276036 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1890/3595] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 10 13:17:41 2022] DELETE /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82/os-volume_attachments/552b7a87-e92b-415e-974f-b148e0e18148 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 13:17:42.281750 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a85c4dd6-7da7-499c-90af-f8aeb6fcb8e4 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:42.282459 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a85c4dd6-7da7-499c-90af-f8aeb6fcb8e4 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:42.288970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a85c4dd6-7da7-499c-90af-f8aeb6fcb8e4 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:42.289523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a85c4dd6-7da7-499c-90af-f8aeb6fcb8e4 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:42.289939 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a85c4dd6-7da7-499c-90af-f8aeb6fcb8e4 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:42.290654 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a85c4dd6-7da7-499c-90af-f8aeb6fcb8e4 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:42.291327 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a85c4dd6-7da7-499c-90af-f8aeb6fcb8e4 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:42.291921 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a85c4dd6-7da7-499c-90af-f8aeb6fcb8e4 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:42.519938 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a85c4dd6-7da7-499c-90af-f8aeb6fcb8e4 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:42.528561 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a85c4dd6-7da7-499c-90af-f8aeb6fcb8e4 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1270 microversion: 2.1 time: 0.251036 Aug 10 13:17:42.529223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1891/3596] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:42 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1270 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:17:42.534498 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-143695e7-05d7-4226-90e9-b0d7b15925d6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:42.537150 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-143695e7-05d7-4226-90e9-b0d7b15925d6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:42.544249 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-143695e7-05d7-4226-90e9-b0d7b15925d6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:42.544733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-143695e7-05d7-4226-90e9-b0d7b15925d6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:42.545160 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-143695e7-05d7-4226-90e9-b0d7b15925d6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:42.545881 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-143695e7-05d7-4226-90e9-b0d7b15925d6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:42.546344 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-143695e7-05d7-4226-90e9-b0d7b15925d6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:42.546793 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-143695e7-05d7-4226-90e9-b0d7b15925d6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:42.589075 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-143695e7-05d7-4226-90e9-b0d7b15925d6 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058576 Aug 10 13:17:42.593743 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1892/3597] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 13:17:42 2022] GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:17:43.295261 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-0684a762-74b0-4215-abce-d430b03557f3 req-7ad35102-8c89-4634-aec9-39e1192c0d28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4131b7e-9198-48f7-a8f5-86d691d37c11", "tag": "bdc043f9-2aa5-46cf-83d0-1101d7125972"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:17:43.308364 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-0684a762-74b0-4215-abce-d430b03557f3 req-7ad35102-8c89-4634-aec9-39e1192c0d28 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:43.308364 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-0684a762-74b0-4215-abce-d430b03557f3 req-7ad35102-8c89-4634-aec9-39e1192c0d28 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:43.308364 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-0684a762-74b0-4215-abce-d430b03557f3 req-7ad35102-8c89-4634-aec9-39e1192c0d28 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:43.316967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-0684a762-74b0-4215-abce-d430b03557f3 req-7ad35102-8c89-4634-aec9-39e1192c0d28 service nova] Creating event network-changed:bdc043f9-2aa5-46cf-83d0-1101d7125972 for instance d4131b7e-9198-48f7-a8f5-86d691d37c11 on hv-cinder-85199 Aug 10 13:17:43.321604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-0684a762-74b0-4215-abce-d430b03557f3 req-7ad35102-8c89-4634-aec9-39e1192c0d28 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030583 Aug 10 13:17:43.325530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1893/3598] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:17:43.550551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fe3cf130-d612-44e7-be95-bc52793a5fbb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:43.551275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fe3cf130-d612-44e7-be95-bc52793a5fbb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:43.558054 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe3cf130-d612-44e7-be95-bc52793a5fbb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:43.558676 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe3cf130-d612-44e7-be95-bc52793a5fbb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:43.559450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe3cf130-d612-44e7-be95-bc52793a5fbb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:43.560311 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe3cf130-d612-44e7-be95-bc52793a5fbb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:43.560781 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe3cf130-d612-44e7-be95-bc52793a5fbb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:43.561188 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fe3cf130-d612-44e7-be95-bc52793a5fbb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:43.745951 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fe3cf130-d612-44e7-be95-bc52793a5fbb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:43.753771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fe3cf130-d612-44e7-be95-bc52793a5fbb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1258 microversion: 2.1 time: 0.207544 Aug 10 13:17:43.754341 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1894/3599] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:43 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1258 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:43.759029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4f66346f-f98d-43df-a6c4-e14252f792b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:43.762773 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4f66346f-f98d-43df-a6c4-e14252f792b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:43.770187 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f66346f-f98d-43df-a6c4-e14252f792b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:43.770187 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f66346f-f98d-43df-a6c4-e14252f792b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:43.770187 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f66346f-f98d-43df-a6c4-e14252f792b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:43.770607 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f66346f-f98d-43df-a6c4-e14252f792b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:43.771274 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f66346f-f98d-43df-a6c4-e14252f792b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:43.771703 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4f66346f-f98d-43df-a6c4-e14252f792b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:43.792740 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:43.807944 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4f66346f-f98d-43df-a6c4-e14252f792b3 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052011 Aug 10 13:17:43.808522 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1895/3600] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 13:17:43 2022] GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 13:17:43.881082 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-96aadcfa-4aae-456d-a567-186e657811e9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:43.881611 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-96aadcfa-4aae-456d-a567-186e657811e9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:43.889280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-96aadcfa-4aae-456d-a567-186e657811e9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:43.889761 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-96aadcfa-4aae-456d-a567-186e657811e9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:43.890184 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-96aadcfa-4aae-456d-a567-186e657811e9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:43.890870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-96aadcfa-4aae-456d-a567-186e657811e9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:43.891337 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-96aadcfa-4aae-456d-a567-186e657811e9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:43.894548 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-96aadcfa-4aae-456d-a567-186e657811e9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:43.918368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-96aadcfa-4aae-456d-a567-186e657811e9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Going to try to terminate instance {{(pid=124643) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:17:44.234922 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-96aadcfa-4aae-456d-a567-186e657811e9 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82" status: 204 len: 0 microversion: 2.1 time: 0.357578 Aug 10 13:17:44.235547 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1896/3601] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 13:17:43 2022] DELETE /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 13:17:44.245147 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ea23074d-bf6f-4c25-81dd-2b6095545c1a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:44.245862 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ea23074d-bf6f-4c25-81dd-2b6095545c1a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:44.251961 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ea23074d-bf6f-4c25-81dd-2b6095545c1a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:44.252439 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ea23074d-bf6f-4c25-81dd-2b6095545c1a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:44.252864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ea23074d-bf6f-4c25-81dd-2b6095545c1a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:44.253554 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ea23074d-bf6f-4c25-81dd-2b6095545c1a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:44.254000 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ea23074d-bf6f-4c25-81dd-2b6095545c1a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:44.254414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ea23074d-bf6f-4c25-81dd-2b6095545c1a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:44.389034 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ea23074d-bf6f-4c25-81dd-2b6095545c1a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:44.397009 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ea23074d-bf6f-4c25-81dd-2b6095545c1a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82" status: 200 len: 1681 microversion: 2.1 time: 0.156625 Aug 10 13:17:44.397594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1897/3602] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:44 2022] GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:44.778738 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a4a91743-8007-48f8-8dc6-eb1690a91380 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:44.779404 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a4a91743-8007-48f8-8dc6-eb1690a91380 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:44.785698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4a91743-8007-48f8-8dc6-eb1690a91380 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:44.786184 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4a91743-8007-48f8-8dc6-eb1690a91380 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:44.786615 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4a91743-8007-48f8-8dc6-eb1690a91380 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:44.787357 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4a91743-8007-48f8-8dc6-eb1690a91380 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:44.787805 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4a91743-8007-48f8-8dc6-eb1690a91380 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:44.788230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a4a91743-8007-48f8-8dc6-eb1690a91380 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:44.921861 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a4a91743-8007-48f8-8dc6-eb1690a91380 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:44.930480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a4a91743-8007-48f8-8dc6-eb1690a91380 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1258 microversion: 2.1 time: 0.156335 Aug 10 13:17:44.931083 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1898/3603] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:44 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:45.419693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9bcdfd6c-38c1-47bd-ae94-a69e8803f5ba tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:45.420306 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9bcdfd6c-38c1-47bd-ae94-a69e8803f5ba tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:45.426818 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9bcdfd6c-38c1-47bd-ae94-a69e8803f5ba tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:45.427335 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9bcdfd6c-38c1-47bd-ae94-a69e8803f5ba tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:45.427768 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9bcdfd6c-38c1-47bd-ae94-a69e8803f5ba tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:45.428528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9bcdfd6c-38c1-47bd-ae94-a69e8803f5ba tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:45.428976 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9bcdfd6c-38c1-47bd-ae94-a69e8803f5ba tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:45.429402 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9bcdfd6c-38c1-47bd-ae94-a69e8803f5ba tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:45.560208 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9bcdfd6c-38c1-47bd-ae94-a69e8803f5ba tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:45.567502 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9bcdfd6c-38c1-47bd-ae94-a69e8803f5ba tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82" status: 200 len: 1681 microversion: 2.1 time: 0.152470 Aug 10 13:17:45.568065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1899/3604] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:45 2022] GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:45.952076 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1692c298-cf0c-407a-bd6c-e332b6ff9e61 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:45.952666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1692c298-cf0c-407a-bd6c-e332b6ff9e61 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:45.958539 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1692c298-cf0c-407a-bd6c-e332b6ff9e61 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:45.959020 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1692c298-cf0c-407a-bd6c-e332b6ff9e61 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:45.959485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1692c298-cf0c-407a-bd6c-e332b6ff9e61 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:45.960170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1692c298-cf0c-407a-bd6c-e332b6ff9e61 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:45.960639 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1692c298-cf0c-407a-bd6c-e332b6ff9e61 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:45.961063 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1692c298-cf0c-407a-bd6c-e332b6ff9e61 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:46.093813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1692c298-cf0c-407a-bd6c-e332b6ff9e61 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:46.101162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1692c298-cf0c-407a-bd6c-e332b6ff9e61 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1258 microversion: 2.1 time: 0.153006 Aug 10 13:17:46.101723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1900/3605] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:45 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:46.589733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-04ecfb0a-3643-4f9f-b332-011e6290a05d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:46.590357 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-04ecfb0a-3643-4f9f-b332-011e6290a05d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:46.596642 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04ecfb0a-3643-4f9f-b332-011e6290a05d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:46.597128 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04ecfb0a-3643-4f9f-b332-011e6290a05d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:46.597560 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04ecfb0a-3643-4f9f-b332-011e6290a05d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:46.598282 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04ecfb0a-3643-4f9f-b332-011e6290a05d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:46.598722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04ecfb0a-3643-4f9f-b332-011e6290a05d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:46.599149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-04ecfb0a-3643-4f9f-b332-011e6290a05d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:47.094373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-04ecfb0a-3643-4f9f-b332-011e6290a05d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:47.102011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-04ecfb0a-3643-4f9f-b332-011e6290a05d tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82" status: 200 len: 1681 microversion: 2.1 time: 0.516957 Aug 10 13:17:47.104001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1901/3606] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:46 2022] GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 => generated 1681 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:47.122924 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fc158a69-68ed-4ff7-b0bf-fd9c09ec62e4 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:47.123558 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fc158a69-68ed-4ff7-b0bf-fd9c09ec62e4 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:47.129659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fc158a69-68ed-4ff7-b0bf-fd9c09ec62e4 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:47.130239 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fc158a69-68ed-4ff7-b0bf-fd9c09ec62e4 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:47.130717 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fc158a69-68ed-4ff7-b0bf-fd9c09ec62e4 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:47.131625 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fc158a69-68ed-4ff7-b0bf-fd9c09ec62e4 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:47.132080 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fc158a69-68ed-4ff7-b0bf-fd9c09ec62e4 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:47.132501 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fc158a69-68ed-4ff7-b0bf-fd9c09ec62e4 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:47.318006 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fc158a69-68ed-4ff7-b0bf-fd9c09ec62e4 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:47.325864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fc158a69-68ed-4ff7-b0bf-fd9c09ec62e4 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1258 microversion: 2.1 time: 0.207483 Aug 10 13:17:47.327359 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1902/3607] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:47 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1258 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:47.638244 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-c4fae366-fef8-4f2d-a177-2ab49a3a00f9 req-3e3aa298-bed9-46ef-a110-dc80f0041248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2fa6f05-af9a-4b5f-b1a6-f569a9717c82", "name": "network-vif-deleted", "tag": "76d9025d-4424-41b5-9536-178ffbac2c3d"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:17:47.649256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-c4fae366-fef8-4f2d-a177-2ab49a3a00f9 req-3e3aa298-bed9-46ef-a110-dc80f0041248 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:47.649743 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-c4fae366-fef8-4f2d-a177-2ab49a3a00f9 req-3e3aa298-bed9-46ef-a110-dc80f0041248 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:47.651399 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-c4fae366-fef8-4f2d-a177-2ab49a3a00f9 req-3e3aa298-bed9-46ef-a110-dc80f0041248 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:47.662775 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-c4fae366-fef8-4f2d-a177-2ab49a3a00f9 req-3e3aa298-bed9-46ef-a110-dc80f0041248 service nova] Creating event network-vif-deleted:76d9025d-4424-41b5-9536-178ffbac2c3d for instance f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 on hv-cinder-85199 Aug 10 13:17:47.668209 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-c4fae366-fef8-4f2d-a177-2ab49a3a00f9 req-3e3aa298-bed9-46ef-a110-dc80f0041248 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035637 Aug 10 13:17:47.669762 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1903/3608] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:17:48.127936 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-be33841c-68ba-49e5-97d7-4a3db6b1c0fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:48.128550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-be33841c-68ba-49e5-97d7-4a3db6b1c0fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:48.134763 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be33841c-68ba-49e5-97d7-4a3db6b1c0fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:48.135331 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be33841c-68ba-49e5-97d7-4a3db6b1c0fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:48.135790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be33841c-68ba-49e5-97d7-4a3db6b1c0fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:48.136483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be33841c-68ba-49e5-97d7-4a3db6b1c0fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:48.136932 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be33841c-68ba-49e5-97d7-4a3db6b1c0fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:48.137354 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be33841c-68ba-49e5-97d7-4a3db6b1c0fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:48.168332 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be33841c-68ba-49e5-97d7-4a3db6b1c0fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:48.168808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be33841c-68ba-49e5-97d7-4a3db6b1c0fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:48.169251 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be33841c-68ba-49e5-97d7-4a3db6b1c0fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:48.169696 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.objects.instance [None req-be33841c-68ba-49e5-97d7-4a3db6b1c0fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lazy-loading 'fault' on Instance uuid f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 {{(pid=124643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:17:48.211492 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-be33841c-68ba-49e5-97d7-4a3db6b1c0fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570c2a77b862411083b9444f8292192b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2857015013f466d95f3a9037925c6fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:48.219058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-be33841c-68ba-49e5-97d7-4a3db6b1c0fb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82" status: 200 len: 1331 microversion: 2.1 time: 0.095410 Aug 10 13:17:48.219661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1904/3609] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:48 2022] GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:48.348308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-294904e3-2b70-47cd-acb9-01492330f0c8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:48.349032 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-294904e3-2b70-47cd-acb9-01492330f0c8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:48.355229 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-294904e3-2b70-47cd-acb9-01492330f0c8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:48.355712 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-294904e3-2b70-47cd-acb9-01492330f0c8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:48.356200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-294904e3-2b70-47cd-acb9-01492330f0c8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:48.356807 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-294904e3-2b70-47cd-acb9-01492330f0c8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:48.357252 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-294904e3-2b70-47cd-acb9-01492330f0c8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:48.357668 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-294904e3-2b70-47cd-acb9-01492330f0c8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:48.443941 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=2 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:48.513684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-294904e3-2b70-47cd-acb9-01492330f0c8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:48.522633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-294904e3-2b70-47cd-acb9-01492330f0c8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1258 microversion: 2.1 time: 0.178180 Aug 10 13:17:48.538296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1905/3610] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:48 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1258 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:49.241218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9413bb4f-72a2-4656-9cdf-b2317513d92b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:49.241856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9413bb4f-72a2-4656-9cdf-b2317513d92b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:49.244735 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=8 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:49.249670 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9413bb4f-72a2-4656-9cdf-b2317513d92b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:49.250152 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9413bb4f-72a2-4656-9cdf-b2317513d92b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:49.250587 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9413bb4f-72a2-4656-9cdf-b2317513d92b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:49.251300 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9413bb4f-72a2-4656-9cdf-b2317513d92b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:49.251752 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9413bb4f-72a2-4656-9cdf-b2317513d92b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:49.252174 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9413bb4f-72a2-4656-9cdf-b2317513d92b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:49.266516 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-9413bb4f-72a2-4656-9cdf-b2317513d92b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] HTTP exception thrown: Instance f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 could not be found. Aug 10 13:17:49.268144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9413bb4f-72a2-4656-9cdf-b2317513d92b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Request method failure captured: Aug 10 13:17:49.268144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 HTTP/1.1 Aug 10 13:17:49.268144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:17:49.268144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:17:49.268144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:17:49.268144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:17:49.268144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:17:49.268144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:17:49.268144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:17:49.268144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:17:49.268144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86eGBGdgG-u30FY8ayuf9_oWfGm9Ue4wmiSD5HqZh9YFv6FZKb_K68ZxcABXBS1rsdBpDNgeZy47c1LKjpCTnjQZpQhdzFdsloDzIBkPWEMNrwJi0km_Dv-TGwCe6OdPlftNtoByFeD3k29rbgMXrfvFX26pc9GnUHHvgZESD2gvxTQ Aug 10 13:17:49.268144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:17:49.268144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:17:49.268144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:17:49.268144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:17:49.268144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:17:49.268144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:17:49.268144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: a2857015013f466d95f3a9037925c6fc Aug 10 13:17:49.268144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:17:49.268144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:17:49.268144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:17:49.269417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2857015013f466d95f3a9037925c6fc", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:17:49.269417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:17:49.269417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: a2857015013f466d95f3a9037925c6fc Aug 10 13:17:49.269417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:17:49.269417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-AttachVolumeNegativeTest-1707265238-project Aug 10 13:17:49.269417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:17:49.269417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:17:49.269417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 570c2a77b862411083b9444f8292192b Aug 10 13:17:49.269417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-AttachVolumeNegativeTest-1707265238-project Aug 10 13:17:49.269417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:17:49.269417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 could not be found. Aug 10 13:17:49.269417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': 'f2fa6f05-af9a-4b5f-b1a6-f569a9717c82'} Aug 10 13:17:49.270149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:17:49.270149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:17:49.270149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:17:49.270149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:17:49.270149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:17:49.270149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:17:49.270149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:17:49.270149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:17:49.270149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:17:49.270149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:17:49.270149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 could not be found. Aug 10 13:17:49.270149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:49.270149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:17:49.270149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:49.270149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:17:49.270149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:17:49.270149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:17:49.270149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:17:49.270149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:17:49.270149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:17:49.271641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:17:49.271641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:17:49.271641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:17:49.271641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:17:49.271641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:17:49.271641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:17:49.271641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:17:49.271641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 could not be found. Aug 10 13:17:49.271641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:49.271641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:17:49.271641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:49.271641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:17:49.271641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:17:49.271641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:17:49.271641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:17:49.271641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:17:49.271641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 could not be found. Aug 10 13:17:49.271641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:49.272837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9413bb4f-72a2-4656-9cdf-b2317513d92b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Returning 404 to user: Instance f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:17:49.272837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9413bb4f-72a2-4656-9cdf-b2317513d92b tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82" status: 404 len: 111 microversion: 2.1 time: 0.032497 Aug 10 13:17:49.272837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1906/3611] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:49 2022] GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:17:49.278512 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-946ddc41-76bd-4ff3-a6d3-e2e23b3ff31a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '.version_select at 0x7fb826c4baf0>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:49.367354 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-946ddc41-76bd-4ff3-a6d3-e2e23b3ff31a tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1289996078" status: 202 len: 0 microversion: 2.1 time: 0.092767 Aug 10 13:17:49.367859 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1907/3612] 10.222.0.49 () {58 vars in 1221 bytes} [Wed Aug 10 13:17:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1289996078 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 13:17:49.546544 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5a2e8e54-3f70-4a76-a2af-c6caf7e52bff tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:49.547159 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5a2e8e54-3f70-4a76-a2af-c6caf7e52bff tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:49.553056 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a2e8e54-3f70-4a76-a2af-c6caf7e52bff tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:49.553533 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a2e8e54-3f70-4a76-a2af-c6caf7e52bff tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:49.553965 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a2e8e54-3f70-4a76-a2af-c6caf7e52bff tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:49.554643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a2e8e54-3f70-4a76-a2af-c6caf7e52bff tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:49.555092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a2e8e54-3f70-4a76-a2af-c6caf7e52bff tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:49.555541 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a2e8e54-3f70-4a76-a2af-c6caf7e52bff tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:49.838845 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5a2e8e54-3f70-4a76-a2af-c6caf7e52bff tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:49.848222 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5a2e8e54-3f70-4a76-a2af-c6caf7e52bff tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1258 microversion: 2.1 time: 0.305031 Aug 10 13:17:49.849000 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1908/3613] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:49 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1258 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:50.869265 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-83b8fcd1-b4f6-45c1-9b94-ccf416c1a3a9 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:50.870658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-83b8fcd1-b4f6-45c1-9b94-ccf416c1a3a9 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:50.877069 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83b8fcd1-b4f6-45c1-9b94-ccf416c1a3a9 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:50.877548 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83b8fcd1-b4f6-45c1-9b94-ccf416c1a3a9 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:50.877983 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83b8fcd1-b4f6-45c1-9b94-ccf416c1a3a9 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:50.878677 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83b8fcd1-b4f6-45c1-9b94-ccf416c1a3a9 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:50.879126 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83b8fcd1-b4f6-45c1-9b94-ccf416c1a3a9 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:50.879591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-83b8fcd1-b4f6-45c1-9b94-ccf416c1a3a9 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:51.012488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-83b8fcd1-b4f6-45c1-9b94-ccf416c1a3a9 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:51.020124 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-83b8fcd1-b4f6-45c1-9b94-ccf416c1a3a9 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1258 microversion: 2.1 time: 0.154870 Aug 10 13:17:51.020693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1909/3614] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:50 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:51.475495 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9f66258a-ab98-4be4-8496-baeecdc3394c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:51.475928 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9f66258a-ab98-4be4-8496-baeecdc3394c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:51.482710 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f66258a-ab98-4be4-8496-baeecdc3394c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:51.483199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f66258a-ab98-4be4-8496-baeecdc3394c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:51.483656 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f66258a-ab98-4be4-8496-baeecdc3394c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:51.484332 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f66258a-ab98-4be4-8496-baeecdc3394c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:51.484772 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f66258a-ab98-4be4-8496-baeecdc3394c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:51.485193 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9f66258a-ab98-4be4-8496-baeecdc3394c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:51.498922 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-9f66258a-ab98-4be4-8496-baeecdc3394c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] HTTP exception thrown: Instance f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 could not be found. Aug 10 13:17:51.500483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9f66258a-ab98-4be4-8496-baeecdc3394c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Request method failure captured: Aug 10 13:17:51.500483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: DELETE /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 HTTP/1.1 Aug 10 13:17:51.500483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:17:51.500483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:17:51.500483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:17:51.500483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:17:51.500483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:17:51.500483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:17:51.500483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:17:51.500483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:17:51.500483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86eGBGdgG-u30FY8ayuf9_oWfGm9Ue4wmiSD5HqZh9YFv6FZKb_K68ZxcABXBS1rsdBpDNgeZy47c1LKjpCTnjQZpQhdzFdsloDzIBkPWEMNrwJi0km_Dv-TGwCe6OdPlftNtoByFeD3k29rbgMXrfvFX26pc9GnUHHvgZESD2gvxTQ Aug 10 13:17:51.500483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:17:51.500483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:17:51.500483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:17:51.500483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:17:51.500483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:17:51.500483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:17:51.500483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: a2857015013f466d95f3a9037925c6fc Aug 10 13:17:51.500483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:17:51.500483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:17:51.500483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:17:51.501849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2857015013f466d95f3a9037925c6fc", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:17:51.501849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:17:51.501849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: a2857015013f466d95f3a9037925c6fc Aug 10 13:17:51.501849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:17:51.501849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-AttachVolumeNegativeTest-1707265238-project Aug 10 13:17:51.501849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:17:51.501849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:17:51.501849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 570c2a77b862411083b9444f8292192b Aug 10 13:17:51.501849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-AttachVolumeNegativeTest-1707265238-project Aug 10 13:17:51.501849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:17:51.501849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 could not be found. Aug 10 13:17:51.501849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': 'f2fa6f05-af9a-4b5f-b1a6-f569a9717c82'} Aug 10 13:17:51.502619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:17:51.502619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:17:51.502619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:17:51.502619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:17:51.502619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:17:51.502619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:17:51.502619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:17:51.502619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:17:51.502619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:17:51.502619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:17:51.502619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 could not be found. Aug 10 13:17:51.502619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:51.502619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:17:51.502619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:51.502619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:17:51.502619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:17:51.502619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:17:51.502619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:17:51.502619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:17:51.502619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:17:51.503787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:17:51.503787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 13:17:51.503787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 13:17:51.503787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 13:17:51.503787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 13:17:51.503787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:17:51.503787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:17:51.503787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:17:51.503787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:17:51.503787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 could not be found. Aug 10 13:17:51.503787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:51.503787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:17:51.503787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:51.503787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:17:51.503787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:17:51.503787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:17:51.503787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:17:51.503787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:17:51.503787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 could not be found. Aug 10 13:17:51.503787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:51.504839 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9f66258a-ab98-4be4-8496-baeecdc3394c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Returning 404 to user: Instance f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:17:51.504839 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9f66258a-ab98-4be4-8496-baeecdc3394c tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82" status: 404 len: 111 microversion: 2.1 time: 0.030333 Aug 10 13:17:51.504839 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1910/3615] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 13:17:51 2022] DELETE /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:17:51.509790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-42842604-8581-49c7-a583-5395be1cfa51 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:51.510952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-42842604-8581-49c7-a583-5395be1cfa51 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: f2fa6f05-af9a-4b5f-b1a6-f569a9717c82] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:51.516394 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-42842604-8581-49c7-a583-5395be1cfa51 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:51.516864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-42842604-8581-49c7-a583-5395be1cfa51 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:51.517289 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-42842604-8581-49c7-a583-5395be1cfa51 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:51.517955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-42842604-8581-49c7-a583-5395be1cfa51 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:51.518403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-42842604-8581-49c7-a583-5395be1cfa51 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:51.518816 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-42842604-8581-49c7-a583-5395be1cfa51 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:51.532396 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-42842604-8581-49c7-a583-5395be1cfa51 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] HTTP exception thrown: Instance f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 could not be found. Aug 10 13:17:51.533864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-42842604-8581-49c7-a583-5395be1cfa51 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Request method failure captured: Aug 10 13:17:51.533864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 HTTP/1.1 Aug 10 13:17:51.533864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:17:51.533864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:17:51.533864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:17:51.533864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:17:51.533864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:17:51.533864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:17:51.533864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:17:51.533864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:17:51.533864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86eGBGdgG-u30FY8ayuf9_oWfGm9Ue4wmiSD5HqZh9YFv6FZKb_K68ZxcABXBS1rsdBpDNgeZy47c1LKjpCTnjQZpQhdzFdsloDzIBkPWEMNrwJi0km_Dv-TGwCe6OdPlftNtoByFeD3k29rbgMXrfvFX26pc9GnUHHvgZESD2gvxTQ Aug 10 13:17:51.533864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:17:51.533864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:17:51.533864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:17:51.533864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:17:51.533864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:17:51.533864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:17:51.533864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: a2857015013f466d95f3a9037925c6fc Aug 10 13:17:51.533864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:17:51.533864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:17:51.533864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:17:51.535297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2857015013f466d95f3a9037925c6fc", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:17:51.535297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:17:51.535297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: a2857015013f466d95f3a9037925c6fc Aug 10 13:17:51.535297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:17:51.535297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-AttachVolumeNegativeTest-1707265238-project Aug 10 13:17:51.535297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:17:51.535297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:17:51.535297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 570c2a77b862411083b9444f8292192b Aug 10 13:17:51.535297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-AttachVolumeNegativeTest-1707265238-project Aug 10 13:17:51.535297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:17:51.535297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 could not be found. Aug 10 13:17:51.535297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': 'f2fa6f05-af9a-4b5f-b1a6-f569a9717c82'} Aug 10 13:17:51.536170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:17:51.536170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:17:51.536170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:17:51.536170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:17:51.536170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:17:51.536170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:17:51.536170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:17:51.536170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:17:51.536170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:17:51.536170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:17:51.536170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 could not be found. Aug 10 13:17:51.536170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:51.536170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:17:51.536170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:51.536170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:17:51.536170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:17:51.536170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:17:51.536170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:17:51.536170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:17:51.536170 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:17:51.537426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:17:51.537426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:17:51.537426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:17:51.537426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:17:51.537426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:17:51.537426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:17:51.537426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:17:51.537426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 could not be found. Aug 10 13:17:51.537426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:51.537426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:17:51.537426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:51.537426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:17:51.537426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:17:51.537426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:17:51.537426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:17:51.537426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:17:51.537426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 could not be found. Aug 10 13:17:51.537426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:51.538607 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-42842604-8581-49c7-a583-5395be1cfa51 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Returning 404 to user: Instance f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:17:51.538607 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-42842604-8581-49c7-a583-5395be1cfa51 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82" status: 404 len: 111 microversion: 2.1 time: 0.028889 Aug 10 13:17:51.538607 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1911/3616] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:51 2022] GET /compute/v2.1/servers/f2fa6f05-af9a-4b5f-b1a6-f569a9717c82 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:17:52.040514 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a99b0540-b9af-4592-b31b-0c89dba78976 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:52.041123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a99b0540-b9af-4592-b31b-0c89dba78976 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:52.047865 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a99b0540-b9af-4592-b31b-0c89dba78976 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:52.048351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a99b0540-b9af-4592-b31b-0c89dba78976 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:52.048782 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a99b0540-b9af-4592-b31b-0c89dba78976 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:52.049524 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a99b0540-b9af-4592-b31b-0c89dba78976 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:52.049969 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a99b0540-b9af-4592-b31b-0c89dba78976 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:52.050384 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a99b0540-b9af-4592-b31b-0c89dba78976 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:52.187491 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a99b0540-b9af-4592-b31b-0c89dba78976 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:52.195725 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a99b0540-b9af-4592-b31b-0c89dba78976 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1258 microversion: 2.1 time: 0.159110 Aug 10 13:17:52.196493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1912/3617] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:52 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:52.763395 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b33c1e01-43b7-443b-ad30-3cfe9de398cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:52.763891 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b33c1e01-43b7-443b-ad30-3cfe9de398cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d18ee67-6285-4877-ae40-c30da937c050] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:52.765843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:52.770488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b33c1e01-43b7-443b-ad30-3cfe9de398cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:52.770966 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b33c1e01-43b7-443b-ad30-3cfe9de398cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:52.771429 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b33c1e01-43b7-443b-ad30-3cfe9de398cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:52.772280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b33c1e01-43b7-443b-ad30-3cfe9de398cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:52.772762 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b33c1e01-43b7-443b-ad30-3cfe9de398cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:52.773351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b33c1e01-43b7-443b-ad30-3cfe9de398cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:52.787097 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-b33c1e01-43b7-443b-ad30-3cfe9de398cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] HTTP exception thrown: Instance 9d18ee67-6285-4877-ae40-c30da937c050 could not be found. Aug 10 13:17:52.788783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b33c1e01-43b7-443b-ad30-3cfe9de398cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Request method failure captured: Aug 10 13:17:52.788783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: DELETE /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050 HTTP/1.1 Aug 10 13:17:52.788783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:17:52.788783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:17:52.788783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:17:52.788783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:17:52.788783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:17:52.788783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:17:52.788783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:17:52.788783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:17:52.788783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86eGBGdgG-u30FY8ayuf9_oWfGm9Ue4wmiSD5HqZh9YFv6FZKb_K68ZxcABXBS1rsdBpDNgeZy47c1LKjpCTnjQZpQhdzFdsloDzIBkPWEMNrwJi0km_Dv-TGwCe6OdPlftNtoByFeD3k29rbgMXrfvFX26pc9GnUHHvgZESD2gvxTQ Aug 10 13:17:52.788783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:17:52.788783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:17:52.788783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:17:52.788783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:17:52.788783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:17:52.788783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:17:52.788783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: a2857015013f466d95f3a9037925c6fc Aug 10 13:17:52.788783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:17:52.788783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:17:52.788783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:17:52.790200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2857015013f466d95f3a9037925c6fc", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:17:52.790200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:17:52.790200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: a2857015013f466d95f3a9037925c6fc Aug 10 13:17:52.790200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:17:52.790200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-AttachVolumeNegativeTest-1707265238-project Aug 10 13:17:52.790200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:17:52.790200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:17:52.790200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 570c2a77b862411083b9444f8292192b Aug 10 13:17:52.790200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-AttachVolumeNegativeTest-1707265238-project Aug 10 13:17:52.790200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:17:52.790200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance 9d18ee67-6285-4877-ae40-c30da937c050 could not be found. Aug 10 13:17:52.790200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': '9d18ee67-6285-4877-ae40-c30da937c050'} Aug 10 13:17:52.791070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:17:52.791070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:17:52.791070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:17:52.791070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:17:52.791070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:17:52.791070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:17:52.791070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:17:52.791070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:17:52.791070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:17:52.791070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:17:52.791070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d18ee67-6285-4877-ae40-c30da937c050 could not be found. Aug 10 13:17:52.791070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:52.791070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:17:52.791070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:52.791070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:17:52.791070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:17:52.791070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:17:52.791070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:17:52.791070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:17:52.791070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:17:52.793434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:17:52.793434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 13:17:52.793434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 13:17:52.793434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 13:17:52.793434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 13:17:52.793434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:17:52.793434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:17:52.793434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:17:52.793434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:17:52.793434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d18ee67-6285-4877-ae40-c30da937c050 could not be found. Aug 10 13:17:52.793434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:52.793434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:17:52.793434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:52.793434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:17:52.793434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:17:52.793434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:17:52.793434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:17:52.793434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:17:52.793434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d18ee67-6285-4877-ae40-c30da937c050 could not be found. Aug 10 13:17:52.793434 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:52.794692 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b33c1e01-43b7-443b-ad30-3cfe9de398cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Returning 404 to user: Instance 9d18ee67-6285-4877-ae40-c30da937c050 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:17:52.794692 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b33c1e01-43b7-443b-ad30-3cfe9de398cb tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050" status: 404 len: 111 microversion: 2.1 time: 0.031347 Aug 10 13:17:52.794692 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1913/3618] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 13:17:52 2022] DELETE /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:17:52.799078 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-dca9c597-90d8-4841-8ebf-7217af4ee427 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:52.799714 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-dca9c597-90d8-4841-8ebf-7217af4ee427 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d18ee67-6285-4877-ae40-c30da937c050] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:52.806142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dca9c597-90d8-4841-8ebf-7217af4ee427 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:52.806614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dca9c597-90d8-4841-8ebf-7217af4ee427 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:52.807038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dca9c597-90d8-4841-8ebf-7217af4ee427 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:52.808677 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dca9c597-90d8-4841-8ebf-7217af4ee427 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:52.809111 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dca9c597-90d8-4841-8ebf-7217af4ee427 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:52.809533 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dca9c597-90d8-4841-8ebf-7217af4ee427 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:52.822966 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-dca9c597-90d8-4841-8ebf-7217af4ee427 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] HTTP exception thrown: Instance 9d18ee67-6285-4877-ae40-c30da937c050 could not be found. Aug 10 13:17:52.824771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-dca9c597-90d8-4841-8ebf-7217af4ee427 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Request method failure captured: Aug 10 13:17:52.824771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050 HTTP/1.1 Aug 10 13:17:52.824771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:17:52.824771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:17:52.824771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:17:52.824771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:17:52.824771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:17:52.824771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:17:52.824771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:17:52.824771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:17:52.824771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86eGBGdgG-u30FY8ayuf9_oWfGm9Ue4wmiSD5HqZh9YFv6FZKb_K68ZxcABXBS1rsdBpDNgeZy47c1LKjpCTnjQZpQhdzFdsloDzIBkPWEMNrwJi0km_Dv-TGwCe6OdPlftNtoByFeD3k29rbgMXrfvFX26pc9GnUHHvgZESD2gvxTQ Aug 10 13:17:52.824771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:17:52.824771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:17:52.824771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:17:52.824771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:17:52.824771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:17:52.824771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:17:52.824771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: a2857015013f466d95f3a9037925c6fc Aug 10 13:17:52.824771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:17:52.824771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:17:52.824771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:17:52.826189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2857015013f466d95f3a9037925c6fc", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:17:52.826189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:17:52.826189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: a2857015013f466d95f3a9037925c6fc Aug 10 13:17:52.826189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:17:52.826189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-AttachVolumeNegativeTest-1707265238-project Aug 10 13:17:52.826189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:17:52.826189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:17:52.826189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 570c2a77b862411083b9444f8292192b Aug 10 13:17:52.826189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-AttachVolumeNegativeTest-1707265238-project Aug 10 13:17:52.826189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:17:52.826189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance 9d18ee67-6285-4877-ae40-c30da937c050 could not be found. Aug 10 13:17:52.826189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': '9d18ee67-6285-4877-ae40-c30da937c050'} Aug 10 13:17:52.826967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:17:52.826967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:17:52.826967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:17:52.826967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:17:52.826967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:17:52.826967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:17:52.826967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:17:52.826967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:17:52.826967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:17:52.826967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:17:52.826967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d18ee67-6285-4877-ae40-c30da937c050 could not be found. Aug 10 13:17:52.826967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:52.826967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:17:52.826967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:52.826967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:17:52.826967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:17:52.826967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:17:52.826967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:17:52.826967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:17:52.826967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:17:52.828012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:17:52.828012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:17:52.828012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:17:52.828012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:17:52.828012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:17:52.828012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:17:52.828012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:17:52.828012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d18ee67-6285-4877-ae40-c30da937c050 could not be found. Aug 10 13:17:52.828012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:52.828012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:17:52.828012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:52.828012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:17:52.828012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:17:52.828012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:17:52.828012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:17:52.828012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:17:52.828012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d18ee67-6285-4877-ae40-c30da937c050 could not be found. Aug 10 13:17:52.828012 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:52.828953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-dca9c597-90d8-4841-8ebf-7217af4ee427 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Returning 404 to user: Instance 9d18ee67-6285-4877-ae40-c30da937c050 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:17:52.828953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-dca9c597-90d8-4841-8ebf-7217af4ee427 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050" status: 404 len: 111 microversion: 2.1 time: 0.030826 Aug 10 13:17:52.828953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1914/3619] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:52 2022] GET /compute/v2.1/servers/9d18ee67-6285-4877-ae40-c30da937c050 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:17:52.834243 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-84400b96-d5fa-4940-b48c-be6109549732 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:52.836284 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-84400b96-d5fa-4940-b48c-be6109549732 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:52.841092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84400b96-d5fa-4940-b48c-be6109549732 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:52.841547 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84400b96-d5fa-4940-b48c-be6109549732 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:52.842147 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84400b96-d5fa-4940-b48c-be6109549732 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:52.842808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84400b96-d5fa-4940-b48c-be6109549732 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:52.843282 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84400b96-d5fa-4940-b48c-be6109549732 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:52.843703 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-84400b96-d5fa-4940-b48c-be6109549732 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:52.849184 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:17:52.858530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-84400b96-d5fa-4940-b48c-be6109549732 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] HTTP exception thrown: Instance 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 could not be found. Aug 10 13:17:52.860074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-84400b96-d5fa-4940-b48c-be6109549732 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Request method failure captured: Aug 10 13:17:52.860074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: DELETE /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 HTTP/1.1 Aug 10 13:17:52.860074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:17:52.860074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:17:52.860074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:17:52.860074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:17:52.860074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:17:52.860074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:17:52.860074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:17:52.860074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:17:52.860074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86eGBGdgG-u30FY8ayuf9_oWfGm9Ue4wmiSD5HqZh9YFv6FZKb_K68ZxcABXBS1rsdBpDNgeZy47c1LKjpCTnjQZpQhdzFdsloDzIBkPWEMNrwJi0km_Dv-TGwCe6OdPlftNtoByFeD3k29rbgMXrfvFX26pc9GnUHHvgZESD2gvxTQ Aug 10 13:17:52.860074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:17:52.860074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:17:52.860074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:17:52.860074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:17:52.860074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:17:52.860074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:17:52.860074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: a2857015013f466d95f3a9037925c6fc Aug 10 13:17:52.860074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:17:52.860074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:17:52.860074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:17:52.861720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2857015013f466d95f3a9037925c6fc", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:17:52.861720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:17:52.861720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: a2857015013f466d95f3a9037925c6fc Aug 10 13:17:52.861720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:17:52.861720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-AttachVolumeNegativeTest-1707265238-project Aug 10 13:17:52.861720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:17:52.861720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:17:52.861720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 570c2a77b862411083b9444f8292192b Aug 10 13:17:52.861720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-AttachVolumeNegativeTest-1707265238-project Aug 10 13:17:52.861720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:17:52.861720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 could not be found. Aug 10 13:17:52.861720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': '9d0315a8-29f9-4d6e-9298-f5a1d0d69e36'} Aug 10 13:17:52.862767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:17:52.862767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:17:52.862767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:17:52.862767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:17:52.862767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:17:52.862767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:17:52.862767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:17:52.862767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:17:52.862767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:17:52.862767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:17:52.862767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 could not be found. Aug 10 13:17:52.862767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:52.862767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:17:52.862767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:52.862767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:17:52.862767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:17:52.862767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:17:52.862767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:17:52.862767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:17:52.862767 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:17:52.864463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:17:52.864463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 13:17:52.864463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 13:17:52.864463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 13:17:52.864463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 13:17:52.864463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:17:52.864463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:17:52.864463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:17:52.864463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:17:52.864463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 could not be found. Aug 10 13:17:52.864463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:52.864463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:17:52.864463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:52.864463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:17:52.864463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:17:52.864463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:17:52.864463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:17:52.864463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:17:52.864463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 could not be found. Aug 10 13:17:52.864463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:52.866112 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-84400b96-d5fa-4940-b48c-be6109549732 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Returning 404 to user: Instance 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:17:52.866112 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-84400b96-d5fa-4940-b48c-be6109549732 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 404 len: 111 microversion: 2.1 time: 0.030711 Aug 10 13:17:52.866112 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1915/3620] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 13:17:52 2022] DELETE /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:17:52.871729 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e65e39eb-b099-4422-98d1-7c1240817961 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:52.872381 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e65e39eb-b099-4422-98d1-7c1240817961 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:52.878488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e65e39eb-b099-4422-98d1-7c1240817961 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:52.878920 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e65e39eb-b099-4422-98d1-7c1240817961 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:52.879385 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e65e39eb-b099-4422-98d1-7c1240817961 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:52.880066 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e65e39eb-b099-4422-98d1-7c1240817961 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:52.880510 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e65e39eb-b099-4422-98d1-7c1240817961 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:52.880969 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e65e39eb-b099-4422-98d1-7c1240817961 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:52.895882 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-e65e39eb-b099-4422-98d1-7c1240817961 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] HTTP exception thrown: Instance 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 could not be found. Aug 10 13:17:52.897427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e65e39eb-b099-4422-98d1-7c1240817961 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Request method failure captured: Aug 10 13:17:52.897427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 HTTP/1.1 Aug 10 13:17:52.897427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:17:52.897427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:17:52.897427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:17:52.897427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:17:52.897427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:17:52.897427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:17:52.897427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:17:52.897427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:17:52.897427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86eGBGdgG-u30FY8ayuf9_oWfGm9Ue4wmiSD5HqZh9YFv6FZKb_K68ZxcABXBS1rsdBpDNgeZy47c1LKjpCTnjQZpQhdzFdsloDzIBkPWEMNrwJi0km_Dv-TGwCe6OdPlftNtoByFeD3k29rbgMXrfvFX26pc9GnUHHvgZESD2gvxTQ Aug 10 13:17:52.897427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:17:52.897427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:17:52.897427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:17:52.897427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:17:52.897427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:17:52.897427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:17:52.897427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: a2857015013f466d95f3a9037925c6fc Aug 10 13:17:52.897427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:17:52.897427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:17:52.897427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:17:52.898838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2857015013f466d95f3a9037925c6fc", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:17:52.898838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:17:52.898838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: a2857015013f466d95f3a9037925c6fc Aug 10 13:17:52.898838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:17:52.898838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-AttachVolumeNegativeTest-1707265238-project Aug 10 13:17:52.898838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:17:52.898838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:17:52.898838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 570c2a77b862411083b9444f8292192b Aug 10 13:17:52.898838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-AttachVolumeNegativeTest-1707265238-project Aug 10 13:17:52.898838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:17:52.898838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 could not be found. Aug 10 13:17:52.898838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': '9d0315a8-29f9-4d6e-9298-f5a1d0d69e36'} Aug 10 13:17:52.899623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:17:52.899623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:17:52.899623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:17:52.899623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:17:52.899623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:17:52.899623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:17:52.899623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:17:52.899623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:17:52.899623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:17:52.899623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:17:52.899623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 could not be found. Aug 10 13:17:52.899623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:52.899623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:17:52.899623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:52.899623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:17:52.899623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:17:52.899623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:17:52.899623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:17:52.899623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:17:52.899623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:17:52.900985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:17:52.900985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:17:52.900985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:17:52.900985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:17:52.900985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:17:52.900985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:17:52.900985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:17:52.900985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 could not be found. Aug 10 13:17:52.900985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:52.900985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:17:52.900985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:52.900985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:17:52.900985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:17:52.900985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:17:52.900985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:17:52.900985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:17:52.900985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 could not be found. Aug 10 13:17:52.900985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:52.902104 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e65e39eb-b099-4422-98d1-7c1240817961 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Returning 404 to user: Instance 9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:17:52.902104 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e65e39eb-b099-4422-98d1-7c1240817961 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36" status: 404 len: 111 microversion: 2.1 time: 0.032394 Aug 10 13:17:52.902828 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1916/3621] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:52 2022] GET /compute/v2.1/servers/9d0315a8-29f9-4d6e-9298-f5a1d0d69e36 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:17:53.219295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3292f15e-0592-4951-9177-089e6a2fe7c5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:53.220230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3292f15e-0592-4951-9177-089e6a2fe7c5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:53.227519 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3292f15e-0592-4951-9177-089e6a2fe7c5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:53.228120 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3292f15e-0592-4951-9177-089e6a2fe7c5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:53.228842 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3292f15e-0592-4951-9177-089e6a2fe7c5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:53.230624 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3292f15e-0592-4951-9177-089e6a2fe7c5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:53.231313 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3292f15e-0592-4951-9177-089e6a2fe7c5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:53.231901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3292f15e-0592-4951-9177-089e6a2fe7c5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:53.381137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3292f15e-0592-4951-9177-089e6a2fe7c5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:53.388826 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3292f15e-0592-4951-9177-089e6a2fe7c5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1258 microversion: 2.1 time: 0.175090 Aug 10 13:17:53.389438 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1917/3622] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:53 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1258 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:54.160148 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8c9fd650-b474-445f-ae3b-4ec11f4775ed tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:54.160603 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8c9fd650-b474-445f-ae3b-4ec11f4775ed tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:54.166615 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c9fd650-b474-445f-ae3b-4ec11f4775ed tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:54.167222 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c9fd650-b474-445f-ae3b-4ec11f4775ed tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:54.167653 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c9fd650-b474-445f-ae3b-4ec11f4775ed tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:54.168340 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c9fd650-b474-445f-ae3b-4ec11f4775ed tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:54.168819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c9fd650-b474-445f-ae3b-4ec11f4775ed tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:54.169241 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c9fd650-b474-445f-ae3b-4ec11f4775ed tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:54.182146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-8c9fd650-b474-445f-ae3b-4ec11f4775ed tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] HTTP exception thrown: Instance fad49521-8b28-4a9f-a4a0-88e41b5a1566 could not be found. Aug 10 13:17:54.183684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8c9fd650-b474-445f-ae3b-4ec11f4775ed tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Request method failure captured: Aug 10 13:17:54.183684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: DELETE /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 HTTP/1.1 Aug 10 13:17:54.183684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:17:54.183684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:17:54.183684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:17:54.183684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:17:54.183684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:17:54.183684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:17:54.183684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:17:54.183684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:17:54.183684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86eGBGdgG-u30FY8ayuf9_oWfGm9Ue4wmiSD5HqZh9YFv6FZKb_K68ZxcABXBS1rsdBpDNgeZy47c1LKjpCTnjQZpQhdzFdsloDzIBkPWEMNrwJi0km_Dv-TGwCe6OdPlftNtoByFeD3k29rbgMXrfvFX26pc9GnUHHvgZESD2gvxTQ Aug 10 13:17:54.183684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:17:54.183684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:17:54.183684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:17:54.183684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:17:54.183684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:17:54.183684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:17:54.183684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: a2857015013f466d95f3a9037925c6fc Aug 10 13:17:54.183684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:17:54.183684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:17:54.183684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:17:54.185142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2857015013f466d95f3a9037925c6fc", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:17:54.185142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:17:54.185142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: a2857015013f466d95f3a9037925c6fc Aug 10 13:17:54.185142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:17:54.185142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-AttachVolumeNegativeTest-1707265238-project Aug 10 13:17:54.185142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:17:54.185142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:17:54.185142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 570c2a77b862411083b9444f8292192b Aug 10 13:17:54.185142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-AttachVolumeNegativeTest-1707265238-project Aug 10 13:17:54.185142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:17:54.185142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance fad49521-8b28-4a9f-a4a0-88e41b5a1566 could not be found. Aug 10 13:17:54.185142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': 'fad49521-8b28-4a9f-a4a0-88e41b5a1566'} Aug 10 13:17:54.185959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:17:54.185959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:17:54.185959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:17:54.185959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:17:54.185959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:17:54.185959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:17:54.185959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:17:54.185959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:17:54.185959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:17:54.185959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:17:54.185959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fad49521-8b28-4a9f-a4a0-88e41b5a1566 could not be found. Aug 10 13:17:54.185959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:54.185959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:17:54.185959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:54.185959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:17:54.185959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:17:54.185959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:17:54.185959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:17:54.185959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:17:54.185959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:17:54.187308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:17:54.187308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 13:17:54.187308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 13:17:54.187308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 13:17:54.187308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 13:17:54.187308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:17:54.187308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:17:54.187308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:17:54.187308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:17:54.187308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fad49521-8b28-4a9f-a4a0-88e41b5a1566 could not be found. Aug 10 13:17:54.187308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:54.187308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:17:54.187308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:54.187308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:17:54.187308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:17:54.187308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:17:54.187308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:17:54.187308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:17:54.187308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fad49521-8b28-4a9f-a4a0-88e41b5a1566 could not be found. Aug 10 13:17:54.187308 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:54.188487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8c9fd650-b474-445f-ae3b-4ec11f4775ed tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Returning 404 to user: Instance fad49521-8b28-4a9f-a4a0-88e41b5a1566 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:17:54.188487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8c9fd650-b474-445f-ae3b-4ec11f4775ed tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 404 len: 111 microversion: 2.1 time: 0.029057 Aug 10 13:17:54.188487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1918/3623] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 13:17:54 2022] DELETE /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:17:54.192961 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5add4ead-7e03-4c8f-94a2-b5d1ba10ac86 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:54.193560 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5add4ead-7e03-4c8f-94a2-b5d1ba10ac86 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] [instance: fad49521-8b28-4a9f-a4a0-88e41b5a1566] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:54.199833 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5add4ead-7e03-4c8f-94a2-b5d1ba10ac86 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:54.200304 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5add4ead-7e03-4c8f-94a2-b5d1ba10ac86 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:54.200735 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5add4ead-7e03-4c8f-94a2-b5d1ba10ac86 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:54.201405 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5add4ead-7e03-4c8f-94a2-b5d1ba10ac86 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:54.201854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5add4ead-7e03-4c8f-94a2-b5d1ba10ac86 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:54.202272 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5add4ead-7e03-4c8f-94a2-b5d1ba10ac86 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:54.216883 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-5add4ead-7e03-4c8f-94a2-b5d1ba10ac86 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] HTTP exception thrown: Instance fad49521-8b28-4a9f-a4a0-88e41b5a1566 could not be found. Aug 10 13:17:54.218378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5add4ead-7e03-4c8f-94a2-b5d1ba10ac86 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Request method failure captured: Aug 10 13:17:54.218378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 HTTP/1.1 Aug 10 13:17:54.218378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:17:54.218378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:17:54.218378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:17:54.218378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:17:54.218378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:17:54.218378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:17:54.218378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:17:54.218378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:17:54.218378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86eGBGdgG-u30FY8ayuf9_oWfGm9Ue4wmiSD5HqZh9YFv6FZKb_K68ZxcABXBS1rsdBpDNgeZy47c1LKjpCTnjQZpQhdzFdsloDzIBkPWEMNrwJi0km_Dv-TGwCe6OdPlftNtoByFeD3k29rbgMXrfvFX26pc9GnUHHvgZESD2gvxTQ Aug 10 13:17:54.218378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:17:54.218378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:17:54.218378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:17:54.218378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:17:54.218378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:17:54.218378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:17:54.218378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: a2857015013f466d95f3a9037925c6fc Aug 10 13:17:54.218378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:17:54.218378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:17:54.218378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:17:54.220225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a2857015013f466d95f3a9037925c6fc", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a2857015013f466d95f3a9037925c6fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:17:54.220225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:17:54.220225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: a2857015013f466d95f3a9037925c6fc Aug 10 13:17:54.220225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707265238 Aug 10 13:17:54.220225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-AttachVolumeNegativeTest-1707265238-project Aug 10 13:17:54.220225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:17:54.220225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:17:54.220225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 570c2a77b862411083b9444f8292192b Aug 10 13:17:54.220225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-AttachVolumeNegativeTest-1707265238-project Aug 10 13:17:54.220225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:17:54.220225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance fad49521-8b28-4a9f-a4a0-88e41b5a1566 could not be found. Aug 10 13:17:54.220225 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': 'fad49521-8b28-4a9f-a4a0-88e41b5a1566'} Aug 10 13:17:54.221011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:17:54.221011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:17:54.221011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:17:54.221011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:17:54.221011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:17:54.221011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:17:54.221011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:17:54.221011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:17:54.221011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:17:54.221011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:17:54.221011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fad49521-8b28-4a9f-a4a0-88e41b5a1566 could not be found. Aug 10 13:17:54.221011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:54.221011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:17:54.221011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:54.221011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:17:54.221011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:17:54.221011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:17:54.221011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:17:54.221011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:17:54.221011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:17:54.222235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:17:54.222235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:17:54.222235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:17:54.222235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:17:54.222235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:17:54.222235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:17:54.222235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:17:54.222235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fad49521-8b28-4a9f-a4a0-88e41b5a1566 could not be found. Aug 10 13:17:54.222235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:54.222235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:17:54.222235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:54.222235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:17:54.222235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:17:54.222235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:17:54.222235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:17:54.222235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:17:54.222235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fad49521-8b28-4a9f-a4a0-88e41b5a1566 could not be found. Aug 10 13:17:54.222235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:17:54.223386 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5add4ead-7e03-4c8f-94a2-b5d1ba10ac86 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] Returning 404 to user: Instance fad49521-8b28-4a9f-a4a0-88e41b5a1566 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:17:54.223386 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5add4ead-7e03-4c8f-94a2-b5d1ba10ac86 tempest-AttachVolumeNegativeTest-1707265238 tempest-AttachVolumeNegativeTest-1707265238-project] 10.222.0.49 "GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566" status: 404 len: 111 microversion: 2.1 time: 0.030273 Aug 10 13:17:54.223386 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1919/3624] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:54 2022] GET /compute/v2.1/servers/fad49521-8b28-4a9f-a4a0-88e41b5a1566 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:17:54.409713 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0cb684c1-1e00-40bc-bb36-33d861e60e20 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:54.410402 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0cb684c1-1e00-40bc-bb36-33d861e60e20 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:54.417715 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0cb684c1-1e00-40bc-bb36-33d861e60e20 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:54.418433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0cb684c1-1e00-40bc-bb36-33d861e60e20 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:54.418874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0cb684c1-1e00-40bc-bb36-33d861e60e20 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:54.419592 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0cb684c1-1e00-40bc-bb36-33d861e60e20 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:54.420231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0cb684c1-1e00-40bc-bb36-33d861e60e20 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:54.420783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0cb684c1-1e00-40bc-bb36-33d861e60e20 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:54.658439 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0cb684c1-1e00-40bc-bb36-33d861e60e20 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:54.670652 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0cb684c1-1e00-40bc-bb36-33d861e60e20 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1258 microversion: 2.1 time: 0.264372 Aug 10 13:17:54.671527 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1920/3625] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:54 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1258 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:54.847208 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-9b3ca861-4987-4a6c-a0c6-7af98c28eaf9 req-f38a83b5-124a-4683-8af7-e13f39f2f65e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4131b7e-9198-48f7-a8f5-86d691d37c11", "name": "network-vif-plugged", "status": "completed", "tag": "bdc043f9-2aa5-46cf-83d0-1101d7125972"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:17:54.859289 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-9b3ca861-4987-4a6c-a0c6-7af98c28eaf9 req-f38a83b5-124a-4683-8af7-e13f39f2f65e service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:54.859768 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-9b3ca861-4987-4a6c-a0c6-7af98c28eaf9 req-f38a83b5-124a-4683-8af7-e13f39f2f65e service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:54.860199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-9b3ca861-4987-4a6c-a0c6-7af98c28eaf9 req-f38a83b5-124a-4683-8af7-e13f39f2f65e service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:54.872471 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-9b3ca861-4987-4a6c-a0c6-7af98c28eaf9 req-f38a83b5-124a-4683-8af7-e13f39f2f65e service nova] Creating event network-vif-plugged:bdc043f9-2aa5-46cf-83d0-1101d7125972 for instance d4131b7e-9198-48f7-a8f5-86d691d37c11 on hv-cinder-85199 Aug 10 13:17:54.878098 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-9b3ca861-4987-4a6c-a0c6-7af98c28eaf9 req-f38a83b5-124a-4683-8af7-e13f39f2f65e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035288 Aug 10 13:17:54.878693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1921/3626] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:17:55.693301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-03626bdf-671c-4c0f-82fb-3f4d7f481d86 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:55.693996 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-03626bdf-671c-4c0f-82fb-3f4d7f481d86 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:55.700875 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03626bdf-671c-4c0f-82fb-3f4d7f481d86 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:55.701352 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03626bdf-671c-4c0f-82fb-3f4d7f481d86 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:55.701781 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03626bdf-671c-4c0f-82fb-3f4d7f481d86 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:55.702503 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03626bdf-671c-4c0f-82fb-3f4d7f481d86 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:55.702947 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03626bdf-671c-4c0f-82fb-3f4d7f481d86 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:55.703404 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-03626bdf-671c-4c0f-82fb-3f4d7f481d86 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:55.907805 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-03626bdf-671c-4c0f-82fb-3f4d7f481d86 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:55.915443 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-03626bdf-671c-4c0f-82fb-3f4d7f481d86 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1258 microversion: 2.1 time: 0.226804 Aug 10 13:17:55.916018 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1922/3627] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:55 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1258 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:56.937669 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-980da9b2-f55f-48ea-a34e-99f6e7541e2e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:56.938355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-980da9b2-f55f-48ea-a34e-99f6e7541e2e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:56.962426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-980da9b2-f55f-48ea-a34e-99f6e7541e2e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:56.962923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-980da9b2-f55f-48ea-a34e-99f6e7541e2e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:56.963419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-980da9b2-f55f-48ea-a34e-99f6e7541e2e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:56.964696 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-980da9b2-f55f-48ea-a34e-99f6e7541e2e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:56.965169 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-980da9b2-f55f-48ea-a34e-99f6e7541e2e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:56.965623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-980da9b2-f55f-48ea-a34e-99f6e7541e2e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:57.183533 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-980da9b2-f55f-48ea-a34e-99f6e7541e2e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:57.191642 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-980da9b2-f55f-48ea-a34e-99f6e7541e2e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1258 microversion: 2.1 time: 0.257980 Aug 10 13:17:57.195846 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1923/3628] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:56 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1258 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:58.228008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5ac3f692-1e3b-4809-a34e-af769e92ff62 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:58.228625 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5ac3f692-1e3b-4809-a34e-af769e92ff62 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:58.235598 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ac3f692-1e3b-4809-a34e-af769e92ff62 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:58.236655 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ac3f692-1e3b-4809-a34e-af769e92ff62 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:58.242313 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ac3f692-1e3b-4809-a34e-af769e92ff62 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:58.242313 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ac3f692-1e3b-4809-a34e-af769e92ff62 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:58.242313 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ac3f692-1e3b-4809-a34e-af769e92ff62 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:58.242313 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ac3f692-1e3b-4809-a34e-af769e92ff62 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:58.454750 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5ac3f692-1e3b-4809-a34e-af769e92ff62 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:58.465894 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5ac3f692-1e3b-4809-a34e-af769e92ff62 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1258 microversion: 2.1 time: 0.243691 Aug 10 13:17:58.472791 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1924/3629] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:58 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1258 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:59.486303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ffa1deb2-90f1-46be-8653-04a194c9680b tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:59.486985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ffa1deb2-90f1-46be-8653-04a194c9680b tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:59.493588 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ffa1deb2-90f1-46be-8653-04a194c9680b tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:59.494067 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ffa1deb2-90f1-46be-8653-04a194c9680b tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:59.494505 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ffa1deb2-90f1-46be-8653-04a194c9680b tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:59.495936 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ffa1deb2-90f1-46be-8653-04a194c9680b tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:59.496672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ffa1deb2-90f1-46be-8653-04a194c9680b tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:59.497469 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ffa1deb2-90f1-46be-8653-04a194c9680b tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:59.654658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ffa1deb2-90f1-46be-8653-04a194c9680b tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:59.662162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ffa1deb2-90f1-46be-8653-04a194c9680b tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1442 microversion: 2.1 time: 0.179755 Aug 10 13:17:59.662730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1925/3630] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:59 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1442 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:17:59.681821 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a716857c-ee16-44fb-82ce-244a010a58a9 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:17:59.683068 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a716857c-ee16-44fb-82ce-244a010a58a9 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:17:59.688869 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a716857c-ee16-44fb-82ce-244a010a58a9 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:59.695599 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a716857c-ee16-44fb-82ce-244a010a58a9 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:59.695599 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a716857c-ee16-44fb-82ce-244a010a58a9 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:59.695599 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a716857c-ee16-44fb-82ce-244a010a58a9 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:17:59.695599 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a716857c-ee16-44fb-82ce-244a010a58a9 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:17:59.696374 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a716857c-ee16-44fb-82ce-244a010a58a9 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:17:59.842084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a716857c-ee16-44fb-82ce-244a010a58a9 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:17:59.849930 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a716857c-ee16-44fb-82ce-244a010a58a9 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1442 microversion: 2.1 time: 0.171540 Aug 10 13:17:59.853965 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1926/3631] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:17:59 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1442 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:18:02.032082 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-b56fef47-0c9c-4607-929b-9a5043d8939a req-8df10b5f-274d-46ca-816a-4b7ee2b24c55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4131b7e-9198-48f7-a8f5-86d691d37c11", "tag": "bdc043f9-2aa5-46cf-83d0-1101d7125972"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:18:02.042561 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-b56fef47-0c9c-4607-929b-9a5043d8939a req-8df10b5f-274d-46ca-816a-4b7ee2b24c55 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:02.043048 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-b56fef47-0c9c-4607-929b-9a5043d8939a req-8df10b5f-274d-46ca-816a-4b7ee2b24c55 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:02.043550 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-b56fef47-0c9c-4607-929b-9a5043d8939a req-8df10b5f-274d-46ca-816a-4b7ee2b24c55 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:02.056407 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-b56fef47-0c9c-4607-929b-9a5043d8939a req-8df10b5f-274d-46ca-816a-4b7ee2b24c55 service nova] Creating event network-changed:bdc043f9-2aa5-46cf-83d0-1101d7125972 for instance d4131b7e-9198-48f7-a8f5-86d691d37c11 on hv-cinder-85199 Aug 10 13:18:02.061702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-b56fef47-0c9c-4607-929b-9a5043d8939a req-8df10b5f-274d-46ca-816a-4b7ee2b24c55 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033213 Aug 10 13:18:02.063991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1927/3632] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:18:09.234602 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-cd77ce24-ce2b-4a53-a6ce-eb6ecc63d555 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-53784662", "imageRef": "674dcf76-6c38-40de-b204-ad2842738058", "flavorRef": "452"}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:18:09.287777 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.network.neutron [None req-cd77ce24-ce2b-4a53-a6ce-eb6ecc63d555 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] validate_networks() for None {{(pid=124643) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:18:09.812262 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-cd77ce24-ce2b-4a53-a6ce-eb6ecc63d555 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Flavor limits 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:18:09.816005 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-cd77ce24-ce2b-4a53-a6ce-eb6ecc63d555 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Image limits 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:18:09.816005 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-cd77ce24-ce2b-4a53-a6ce-eb6ecc63d555 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Flavor pref 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:18:09.816005 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-cd77ce24-ce2b-4a53-a6ce-eb6ecc63d555 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Image pref 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:18:09.816005 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-cd77ce24-ce2b-4a53-a6ce-eb6ecc63d555 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:18:09.824371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd77ce24-ce2b-4a53-a6ce-eb6ecc63d555 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:09.824856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd77ce24-ce2b-4a53-a6ce-eb6ecc63d555 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:09.825293 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd77ce24-ce2b-4a53-a6ce-eb6ecc63d555 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:09.826028 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd77ce24-ce2b-4a53-a6ce-eb6ecc63d555 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:09.826482 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd77ce24-ce2b-4a53-a6ce-eb6ecc63d555 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:09.826909 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cd77ce24-ce2b-4a53-a6ce-eb6ecc63d555 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:09.844175 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-cd77ce24-ce2b-4a53-a6ce-eb6ecc63d555 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Getting quotas for project 2a1915ca912a42b88145ea1bf2dbc049. Resources: {'cores', 'ram', 'instances'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:18:09.848123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-cd77ce24-ce2b-4a53-a6ce-eb6ecc63d555 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Getting quotas for user 41368bdb7a1648848f483eb4a12e3c38 and project 2a1915ca912a42b88145ea1bf2dbc049. Resources: {'cores', 'ram', 'instances'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:18:09.858992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-cd77ce24-ce2b-4a53-a6ce-eb6ecc63d555 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Going to run 1 instances... {{(pid=124643) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:18:09.861371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-cd77ce24-ce2b-4a53-a6ce-eb6ecc63d555 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] [instance: 2bfbcd19-7e99-4adc-a9ed-afd4da91f688] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='674dcf76-6c38-40de-b204-ad2842738058',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:18:09.961475 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-cd77ce24-ce2b-4a53-a6ce-eb6ecc63d555 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.732270 Aug 10 13:18:09.962039 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1928/3633] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 13:18:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 13:18:09.973198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-450b7f13-8b65-461a-9757-662e25bbb07b tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:09.973798 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-450b7f13-8b65-461a-9757-662e25bbb07b tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] [instance: 2bfbcd19-7e99-4adc-a9ed-afd4da91f688] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:10.029533 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-450b7f13-8b65-461a-9757-662e25bbb07b tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41368bdb7a1648848f483eb4a12e3c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1915ca912a42b88145ea1bf2dbc049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:10.037274 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-450b7f13-8b65-461a-9757-662e25bbb07b tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] 10.222.0.49 "GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688" status: 200 len: 1213 microversion: 2.1 time: 0.067722 Aug 10 13:18:10.037849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1929/3634] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:09 2022] GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688 => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:18:11.058394 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-87dc58ee-efc6-45d8-8e8e-79bbf4a7ff93 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:11.059035 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-87dc58ee-efc6-45d8-8e8e-79bbf4a7ff93 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] [instance: 2bfbcd19-7e99-4adc-a9ed-afd4da91f688] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:11.110801 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-87dc58ee-efc6-45d8-8e8e-79bbf4a7ff93 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41368bdb7a1648848f483eb4a12e3c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1915ca912a42b88145ea1bf2dbc049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:11.117787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-87dc58ee-efc6-45d8-8e8e-79bbf4a7ff93 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] 10.222.0.49 "GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688" status: 200 len: 1213 microversion: 2.1 time: 0.063870 Aug 10 13:18:11.118420 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1930/3635] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:11 2022] GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688 => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:18:12.147491 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-71b0587f-0048-451f-84e2-c65ff940c7fe tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:12.148153 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-71b0587f-0048-451f-84e2-c65ff940c7fe tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] [instance: 2bfbcd19-7e99-4adc-a9ed-afd4da91f688] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:12.155836 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71b0587f-0048-451f-84e2-c65ff940c7fe tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:12.156316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71b0587f-0048-451f-84e2-c65ff940c7fe tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:12.156752 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71b0587f-0048-451f-84e2-c65ff940c7fe tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:12.157444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71b0587f-0048-451f-84e2-c65ff940c7fe tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:12.157930 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71b0587f-0048-451f-84e2-c65ff940c7fe tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:12.158318 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71b0587f-0048-451f-84e2-c65ff940c7fe tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:12.225954 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-71b0587f-0048-451f-84e2-c65ff940c7fe tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41368bdb7a1648848f483eb4a12e3c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1915ca912a42b88145ea1bf2dbc049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:12.235791 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-71b0587f-0048-451f-84e2-c65ff940c7fe tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] 10.222.0.49 "GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688" status: 200 len: 1265 microversion: 2.1 time: 0.092245 Aug 10 13:18:12.236834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1931/3636] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:12 2022] GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688 => generated 1265 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:18:13.260054 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-259700da-2458-4d52-8eda-021e3dd50528 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:13.260776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-259700da-2458-4d52-8eda-021e3dd50528 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] [instance: 2bfbcd19-7e99-4adc-a9ed-afd4da91f688] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:13.269145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-259700da-2458-4d52-8eda-021e3dd50528 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:13.269803 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-259700da-2458-4d52-8eda-021e3dd50528 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:13.270330 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-259700da-2458-4d52-8eda-021e3dd50528 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:13.271158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-259700da-2458-4d52-8eda-021e3dd50528 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:13.272008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-259700da-2458-4d52-8eda-021e3dd50528 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:13.272778 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-259700da-2458-4d52-8eda-021e3dd50528 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:13.478041 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-259700da-2458-4d52-8eda-021e3dd50528 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41368bdb7a1648848f483eb4a12e3c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1915ca912a42b88145ea1bf2dbc049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:13.485389 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-259700da-2458-4d52-8eda-021e3dd50528 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] 10.222.0.49 "GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688" status: 200 len: 1313 microversion: 2.1 time: 0.229432 Aug 10 13:18:13.486165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1932/3637] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:13 2022] GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:18:14.183776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-aaff833a-71e3-4fc1-bb48-ca762cc23cbf req-8057fd3d-9c44-4ca1-928c-0706896fce9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bfbcd19-7e99-4adc-a9ed-afd4da91f688", "tag": "82a82794-c196-4361-bfc9-5fb4e67adda3"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:18:14.194117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-aaff833a-71e3-4fc1-bb48-ca762cc23cbf req-8057fd3d-9c44-4ca1-928c-0706896fce9f service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:14.198159 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-aaff833a-71e3-4fc1-bb48-ca762cc23cbf req-8057fd3d-9c44-4ca1-928c-0706896fce9f service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:14.198159 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-aaff833a-71e3-4fc1-bb48-ca762cc23cbf req-8057fd3d-9c44-4ca1-928c-0706896fce9f service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:14.206685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-aaff833a-71e3-4fc1-bb48-ca762cc23cbf req-8057fd3d-9c44-4ca1-928c-0706896fce9f service nova] Creating event network-changed:82a82794-c196-4361-bfc9-5fb4e67adda3 for instance 2bfbcd19-7e99-4adc-a9ed-afd4da91f688 on hv-cinder-85199 Aug 10 13:18:14.211769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-aaff833a-71e3-4fc1-bb48-ca762cc23cbf req-8057fd3d-9c44-4ca1-928c-0706896fce9f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031595 Aug 10 13:18:14.212621 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1933/3638] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:18:14.509029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-76d3a37f-1455-4279-b0e3-f0ef8eda4946 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:14.509761 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-76d3a37f-1455-4279-b0e3-f0ef8eda4946 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] [instance: 2bfbcd19-7e99-4adc-a9ed-afd4da91f688] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:14.516158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76d3a37f-1455-4279-b0e3-f0ef8eda4946 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:14.516632 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76d3a37f-1455-4279-b0e3-f0ef8eda4946 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:14.517056 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76d3a37f-1455-4279-b0e3-f0ef8eda4946 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:14.517734 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76d3a37f-1455-4279-b0e3-f0ef8eda4946 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:14.518175 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76d3a37f-1455-4279-b0e3-f0ef8eda4946 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:14.518592 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76d3a37f-1455-4279-b0e3-f0ef8eda4946 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:14.724920 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-76d3a37f-1455-4279-b0e3-f0ef8eda4946 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41368bdb7a1648848f483eb4a12e3c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1915ca912a42b88145ea1bf2dbc049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:14.734459 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-76d3a37f-1455-4279-b0e3-f0ef8eda4946 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] 10.222.0.49 "GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688" status: 200 len: 1313 microversion: 2.1 time: 0.230004 Aug 10 13:18:14.735139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1934/3639] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:14 2022] GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:18:15.755520 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e00dc975-bd67-4e89-8de3-7df9f6539327 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:15.756201 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e00dc975-bd67-4e89-8de3-7df9f6539327 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] [instance: 2bfbcd19-7e99-4adc-a9ed-afd4da91f688] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:15.762216 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e00dc975-bd67-4e89-8de3-7df9f6539327 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:15.762701 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e00dc975-bd67-4e89-8de3-7df9f6539327 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:15.763137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e00dc975-bd67-4e89-8de3-7df9f6539327 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:15.763890 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e00dc975-bd67-4e89-8de3-7df9f6539327 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:15.764343 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e00dc975-bd67-4e89-8de3-7df9f6539327 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:15.764774 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e00dc975-bd67-4e89-8de3-7df9f6539327 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:15.906140 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e00dc975-bd67-4e89-8de3-7df9f6539327 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41368bdb7a1648848f483eb4a12e3c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1915ca912a42b88145ea1bf2dbc049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:15.914016 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e00dc975-bd67-4e89-8de3-7df9f6539327 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] 10.222.0.49 "GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688" status: 200 len: 1313 microversion: 2.1 time: 0.162541 Aug 10 13:18:15.914580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1935/3640] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:15 2022] GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:18:16.600069 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b8b976bf-6dd9-44ce-b6d3-c09564ce1ba6 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:18:16.602410 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b8b976bf-6dd9-44ce-b6d3-c09564ce1ba6 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:16.608503 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8b976bf-6dd9-44ce-b6d3-c09564ce1ba6 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:16.608981 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8b976bf-6dd9-44ce-b6d3-c09564ce1ba6 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:16.609411 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8b976bf-6dd9-44ce-b6d3-c09564ce1ba6 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:16.610091 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8b976bf-6dd9-44ce-b6d3-c09564ce1ba6 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:16.610535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8b976bf-6dd9-44ce-b6d3-c09564ce1ba6 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:16.610952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b8b976bf-6dd9-44ce-b6d3-c09564ce1ba6 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:16.839680 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b8b976bf-6dd9-44ce-b6d3-c09564ce1ba6 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "POST /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419/action" status: 202 len: 0 microversion: 2.1 time: 0.243227 Aug 10 13:18:16.841504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1936/3641] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 10 13:18:16 2022] POST /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 13:18:16.855053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8601c248-7eeb-4e6f-9d8c-decac8504872 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:16.861406 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8601c248-7eeb-4e6f-9d8c-decac8504872 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:16.872815 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8601c248-7eeb-4e6f-9d8c-decac8504872 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:16.875119 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8601c248-7eeb-4e6f-9d8c-decac8504872 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:16.875766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8601c248-7eeb-4e6f-9d8c-decac8504872 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:16.876730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8601c248-7eeb-4e6f-9d8c-decac8504872 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:16.877377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8601c248-7eeb-4e6f-9d8c-decac8504872 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:16.877962 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8601c248-7eeb-4e6f-9d8c-decac8504872 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:17.131112 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8601c248-7eeb-4e6f-9d8c-decac8504872 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:17.141440 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8601c248-7eeb-4e6f-9d8c-decac8504872 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1752 microversion: 2.1 time: 0.295889 Aug 10 13:18:17.146697 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1937/3642] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:16 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1752 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:18:17.146945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-34b3d3ec-9430-4c2c-a3a2-8d14941cb911 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:17.147719 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-34b3d3ec-9430-4c2c-a3a2-8d14941cb911 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] [instance: 2bfbcd19-7e99-4adc-a9ed-afd4da91f688] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:17.154715 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34b3d3ec-9430-4c2c-a3a2-8d14941cb911 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:17.155454 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34b3d3ec-9430-4c2c-a3a2-8d14941cb911 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:17.156037 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34b3d3ec-9430-4c2c-a3a2-8d14941cb911 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:17.156950 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34b3d3ec-9430-4c2c-a3a2-8d14941cb911 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:17.157204 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34b3d3ec-9430-4c2c-a3a2-8d14941cb911 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:17.157627 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34b3d3ec-9430-4c2c-a3a2-8d14941cb911 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:17.161872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:17.374784 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-34b3d3ec-9430-4c2c-a3a2-8d14941cb911 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41368bdb7a1648848f483eb4a12e3c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1915ca912a42b88145ea1bf2dbc049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:17.383201 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-34b3d3ec-9430-4c2c-a3a2-8d14941cb911 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] 10.222.0.49 "GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688" status: 200 len: 1313 microversion: 2.1 time: 0.239824 Aug 10 13:18:17.383977 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1938/3643] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:17 2022] GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:18:18.163749 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8f16ffeb-fc91-4d45-a223-eb13631c25eb tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:18.164358 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8f16ffeb-fc91-4d45-a223-eb13631c25eb tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:18.171059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f16ffeb-fc91-4d45-a223-eb13631c25eb tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:18.171571 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f16ffeb-fc91-4d45-a223-eb13631c25eb tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:18.172003 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f16ffeb-fc91-4d45-a223-eb13631c25eb tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:18.172688 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f16ffeb-fc91-4d45-a223-eb13631c25eb tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:18.173135 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f16ffeb-fc91-4d45-a223-eb13631c25eb tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:18.173558 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8f16ffeb-fc91-4d45-a223-eb13631c25eb tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:18.322139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8f16ffeb-fc91-4d45-a223-eb13631c25eb tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:18.331402 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8f16ffeb-fc91-4d45-a223-eb13631c25eb tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1757 microversion: 2.1 time: 0.171665 Aug 10 13:18:18.332832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1939/3644] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:18 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:18:18.405847 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5b5578e4-ae91-4fb5-9684-d5a74d8856e4 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:18.406638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5b5578e4-ae91-4fb5-9684-d5a74d8856e4 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] [instance: 2bfbcd19-7e99-4adc-a9ed-afd4da91f688] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:18.413594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5b5578e4-ae91-4fb5-9684-d5a74d8856e4 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:18.414071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5b5578e4-ae91-4fb5-9684-d5a74d8856e4 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:18.414501 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5b5578e4-ae91-4fb5-9684-d5a74d8856e4 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:18.415352 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5b5578e4-ae91-4fb5-9684-d5a74d8856e4 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:18.415817 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5b5578e4-ae91-4fb5-9684-d5a74d8856e4 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:18.416233 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5b5578e4-ae91-4fb5-9684-d5a74d8856e4 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:18.570144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5b5578e4-ae91-4fb5-9684-d5a74d8856e4 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41368bdb7a1648848f483eb4a12e3c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1915ca912a42b88145ea1bf2dbc049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:18.579956 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5b5578e4-ae91-4fb5-9684-d5a74d8856e4 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] 10.222.0.49 "GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688" status: 200 len: 1313 microversion: 2.1 time: 0.178782 Aug 10 13:18:18.580536 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1940/3645] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:18 2022] GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:18:19.042539 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-1dc56374-dc62-45b5-8bee-111a63230441 req-a0b48f22-c017-4c82-991b-0e79e1efec0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bfbcd19-7e99-4adc-a9ed-afd4da91f688", "name": "network-vif-plugged", "status": "completed", "tag": "82a82794-c196-4361-bfc9-5fb4e67adda3"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:18:19.054619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-1dc56374-dc62-45b5-8bee-111a63230441 req-a0b48f22-c017-4c82-991b-0e79e1efec0c service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:19.054619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-1dc56374-dc62-45b5-8bee-111a63230441 req-a0b48f22-c017-4c82-991b-0e79e1efec0c service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:19.054619 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-1dc56374-dc62-45b5-8bee-111a63230441 req-a0b48f22-c017-4c82-991b-0e79e1efec0c service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:19.071078 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-1dc56374-dc62-45b5-8bee-111a63230441 req-a0b48f22-c017-4c82-991b-0e79e1efec0c service nova] Creating event network-vif-plugged:82a82794-c196-4361-bfc9-5fb4e67adda3 for instance 2bfbcd19-7e99-4adc-a9ed-afd4da91f688 on hv-cinder-85199 Aug 10 13:18:19.080281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-1dc56374-dc62-45b5-8bee-111a63230441 req-a0b48f22-c017-4c82-991b-0e79e1efec0c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045012 Aug 10 13:18:19.080824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1941/3646] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:18:19.354150 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3eaad5d6-5e0f-42e8-a115-58ba65bf9aee tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:19.354902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3eaad5d6-5e0f-42e8-a115-58ba65bf9aee tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:19.361532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3eaad5d6-5e0f-42e8-a115-58ba65bf9aee tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:19.362020 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3eaad5d6-5e0f-42e8-a115-58ba65bf9aee tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:19.362455 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3eaad5d6-5e0f-42e8-a115-58ba65bf9aee tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:19.363502 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3eaad5d6-5e0f-42e8-a115-58ba65bf9aee tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:19.363989 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3eaad5d6-5e0f-42e8-a115-58ba65bf9aee tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:19.364529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3eaad5d6-5e0f-42e8-a115-58ba65bf9aee tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:19.549248 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3eaad5d6-5e0f-42e8-a115-58ba65bf9aee tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:19.557322 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3eaad5d6-5e0f-42e8-a115-58ba65bf9aee tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1757 microversion: 2.1 time: 0.207997 Aug 10 13:18:19.557889 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1942/3647] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:19 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1757 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:18:19.603547 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-015fffa9-b864-48f3-8571-bfefb17f68b9 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:19.603680 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-015fffa9-b864-48f3-8571-bfefb17f68b9 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] [instance: 2bfbcd19-7e99-4adc-a9ed-afd4da91f688] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:19.610155 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-015fffa9-b864-48f3-8571-bfefb17f68b9 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:19.611463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-015fffa9-b864-48f3-8571-bfefb17f68b9 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:19.611463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-015fffa9-b864-48f3-8571-bfefb17f68b9 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:19.611917 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-015fffa9-b864-48f3-8571-bfefb17f68b9 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:19.612187 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-015fffa9-b864-48f3-8571-bfefb17f68b9 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:19.612866 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-015fffa9-b864-48f3-8571-bfefb17f68b9 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:19.745285 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-015fffa9-b864-48f3-8571-bfefb17f68b9 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41368bdb7a1648848f483eb4a12e3c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1915ca912a42b88145ea1bf2dbc049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:19.753355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-015fffa9-b864-48f3-8571-bfefb17f68b9 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] 10.222.0.49 "GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688" status: 200 len: 1313 microversion: 2.1 time: 0.154154 Aug 10 13:18:19.753921 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1943/3648] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:19 2022] GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:18:20.580105 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-011edafb-e86a-4a04-b4d1-77fd39ce6313 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:20.580983 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-011edafb-e86a-4a04-b4d1-77fd39ce6313 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:20.585169 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=2 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:20.589424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-011edafb-e86a-4a04-b4d1-77fd39ce6313 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:20.590539 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-011edafb-e86a-4a04-b4d1-77fd39ce6313 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:20.591499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-011edafb-e86a-4a04-b4d1-77fd39ce6313 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:20.592764 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-011edafb-e86a-4a04-b4d1-77fd39ce6313 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:20.593496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-011edafb-e86a-4a04-b4d1-77fd39ce6313 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:20.593948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-011edafb-e86a-4a04-b4d1-77fd39ce6313 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:20.758197 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-011edafb-e86a-4a04-b4d1-77fd39ce6313 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:20.766376 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-011edafb-e86a-4a04-b4d1-77fd39ce6313 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1757 microversion: 2.1 time: 0.192005 Aug 10 13:18:20.779165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1944/3649] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:20 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:18:20.779165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5fe1906e-bfd1-443f-8ae7-5947adb9b5dc tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:20.779165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5fe1906e-bfd1-443f-8ae7-5947adb9b5dc tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] [instance: 2bfbcd19-7e99-4adc-a9ed-afd4da91f688] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:20.780732 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5fe1906e-bfd1-443f-8ae7-5947adb9b5dc tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:20.781208 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5fe1906e-bfd1-443f-8ae7-5947adb9b5dc tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:20.781631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5fe1906e-bfd1-443f-8ae7-5947adb9b5dc tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:20.782327 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5fe1906e-bfd1-443f-8ae7-5947adb9b5dc tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:20.782769 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5fe1906e-bfd1-443f-8ae7-5947adb9b5dc tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:20.783216 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5fe1906e-bfd1-443f-8ae7-5947adb9b5dc tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:20.917632 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5fe1906e-bfd1-443f-8ae7-5947adb9b5dc tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41368bdb7a1648848f483eb4a12e3c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1915ca912a42b88145ea1bf2dbc049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:20.925306 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5fe1906e-bfd1-443f-8ae7-5947adb9b5dc tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] 10.222.0.49 "GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688" status: 200 len: 1313 microversion: 2.1 time: 0.155351 Aug 10 13:18:20.925889 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1945/3650] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:20 2022] GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:18:21.787672 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d6451ce4-3375-4b49-b292-5b33ca22cba1 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:21.788391 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d6451ce4-3375-4b49-b292-5b33ca22cba1 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:21.790147 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=10 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:21.795955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6451ce4-3375-4b49-b292-5b33ca22cba1 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:21.796454 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6451ce4-3375-4b49-b292-5b33ca22cba1 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:21.796879 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6451ce4-3375-4b49-b292-5b33ca22cba1 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:21.797555 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6451ce4-3375-4b49-b292-5b33ca22cba1 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:21.798057 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6451ce4-3375-4b49-b292-5b33ca22cba1 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:21.798476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6451ce4-3375-4b49-b292-5b33ca22cba1 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:21.951650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d6451ce4-3375-4b49-b292-5b33ca22cba1 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:21.955568 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d6451ce4-3375-4b49-b292-5b33ca22cba1 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1757 microversion: 2.1 time: 0.171684 Aug 10 13:18:21.956201 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1946/3651] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:21 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:18:21.960576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-24bf1bd7-988f-447e-9216-e157e17e390e tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:21.961175 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-24bf1bd7-988f-447e-9216-e157e17e390e tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] [instance: 2bfbcd19-7e99-4adc-a9ed-afd4da91f688] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:21.967299 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24bf1bd7-988f-447e-9216-e157e17e390e tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:21.967779 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24bf1bd7-988f-447e-9216-e157e17e390e tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:21.968244 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24bf1bd7-988f-447e-9216-e157e17e390e tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:21.968931 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24bf1bd7-988f-447e-9216-e157e17e390e tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:21.969535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24bf1bd7-988f-447e-9216-e157e17e390e tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:21.969958 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24bf1bd7-988f-447e-9216-e157e17e390e tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:22.103323 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-24bf1bd7-988f-447e-9216-e157e17e390e tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41368bdb7a1648848f483eb4a12e3c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1915ca912a42b88145ea1bf2dbc049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:22.111635 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-24bf1bd7-988f-447e-9216-e157e17e390e tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] 10.222.0.49 "GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688" status: 200 len: 1463 microversion: 2.1 time: 0.154443 Aug 10 13:18:22.112331 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1947/3652] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:21 2022] GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688 => generated 1463 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:18:22.158132 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-70ec2202-bdb0-4490-9edf-4cca07625a9a tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:22.158833 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-70ec2202-bdb0-4490-9edf-4cca07625a9a tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] [instance: 2bfbcd19-7e99-4adc-a9ed-afd4da91f688] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:22.166399 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-70ec2202-bdb0-4490-9edf-4cca07625a9a tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:22.166883 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-70ec2202-bdb0-4490-9edf-4cca07625a9a tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:22.167369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-70ec2202-bdb0-4490-9edf-4cca07625a9a tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:22.168055 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-70ec2202-bdb0-4490-9edf-4cca07625a9a tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:22.168494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-70ec2202-bdb0-4490-9edf-4cca07625a9a tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:22.169086 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-70ec2202-bdb0-4490-9edf-4cca07625a9a tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:22.201098 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-70ec2202-bdb0-4490-9edf-4cca07625a9a tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] [instance: 2bfbcd19-7e99-4adc-a9ed-afd4da91f688] Going to try to terminate instance {{(pid=124643) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:18:22.417782 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-70ec2202-bdb0-4490-9edf-4cca07625a9a tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688" status: 204 len: 0 microversion: 2.1 time: 0.263190 Aug 10 13:18:22.418724 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1948/3653] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 13:18:22 2022] DELETE /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 13:18:22.428906 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-be9ea71c-5244-44a7-9ef9-10ca9d5e69a7 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:22.429593 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-be9ea71c-5244-44a7-9ef9-10ca9d5e69a7 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] [instance: 2bfbcd19-7e99-4adc-a9ed-afd4da91f688] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:22.435833 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be9ea71c-5244-44a7-9ef9-10ca9d5e69a7 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:22.436304 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be9ea71c-5244-44a7-9ef9-10ca9d5e69a7 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:22.436733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be9ea71c-5244-44a7-9ef9-10ca9d5e69a7 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:22.437416 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be9ea71c-5244-44a7-9ef9-10ca9d5e69a7 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:22.437862 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be9ea71c-5244-44a7-9ef9-10ca9d5e69a7 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:22.438453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be9ea71c-5244-44a7-9ef9-10ca9d5e69a7 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:22.576941 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-be9ea71c-5244-44a7-9ef9-10ca9d5e69a7 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41368bdb7a1648848f483eb4a12e3c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1915ca912a42b88145ea1bf2dbc049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:22.584439 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-be9ea71c-5244-44a7-9ef9-10ca9d5e69a7 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] 10.222.0.49 "GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688" status: 200 len: 1469 microversion: 2.1 time: 0.159851 Aug 10 13:18:22.585102 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1949/3654] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:22 2022] GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688 => generated 1469 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:18:22.977254 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-451f467b-760b-4ed5-8774-d6b5dcda1c98 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:22.978041 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-451f467b-760b-4ed5-8774-d6b5dcda1c98 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:22.985631 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-451f467b-760b-4ed5-8774-d6b5dcda1c98 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:22.986119 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-451f467b-760b-4ed5-8774-d6b5dcda1c98 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:22.986558 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-451f467b-760b-4ed5-8774-d6b5dcda1c98 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:22.987290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-451f467b-760b-4ed5-8774-d6b5dcda1c98 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:22.988002 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-451f467b-760b-4ed5-8774-d6b5dcda1c98 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:22.988427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-451f467b-760b-4ed5-8774-d6b5dcda1c98 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:23.135518 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-451f467b-760b-4ed5-8774-d6b5dcda1c98 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:23.144042 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-451f467b-760b-4ed5-8774-d6b5dcda1c98 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1757 microversion: 2.1 time: 0.170878 Aug 10 13:18:23.144597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1950/3655] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:22 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:18:23.606536 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-82cdf84c-eb91-41cf-a5d4-95e5eab11eb5 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:23.607131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-82cdf84c-eb91-41cf-a5d4-95e5eab11eb5 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] [instance: 2bfbcd19-7e99-4adc-a9ed-afd4da91f688] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:23.609403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:23.614310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-82cdf84c-eb91-41cf-a5d4-95e5eab11eb5 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:23.614789 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-82cdf84c-eb91-41cf-a5d4-95e5eab11eb5 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:23.615364 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-82cdf84c-eb91-41cf-a5d4-95e5eab11eb5 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:23.616058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-82cdf84c-eb91-41cf-a5d4-95e5eab11eb5 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:23.616509 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-82cdf84c-eb91-41cf-a5d4-95e5eab11eb5 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:23.616942 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-82cdf84c-eb91-41cf-a5d4-95e5eab11eb5 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:23.756981 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-82cdf84c-eb91-41cf-a5d4-95e5eab11eb5 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41368bdb7a1648848f483eb4a12e3c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1915ca912a42b88145ea1bf2dbc049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:23.761135 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-82cdf84c-eb91-41cf-a5d4-95e5eab11eb5 tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] 10.222.0.49 "GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688" status: 200 len: 1469 microversion: 2.1 time: 0.158731 Aug 10 13:18:23.761839 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1951/3656] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:23 2022] GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688 => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:18:24.166005 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-22a1ea19-6aba-4f5f-a06a-a02283916e0a tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:24.167323 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-22a1ea19-6aba-4f5f-a06a-a02283916e0a tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:24.174415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-22a1ea19-6aba-4f5f-a06a-a02283916e0a tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:24.174892 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-22a1ea19-6aba-4f5f-a06a-a02283916e0a tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:24.175376 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-22a1ea19-6aba-4f5f-a06a-a02283916e0a tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:24.176063 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-22a1ea19-6aba-4f5f-a06a-a02283916e0a tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:24.176507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-22a1ea19-6aba-4f5f-a06a-a02283916e0a tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:24.176949 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-22a1ea19-6aba-4f5f-a06a-a02283916e0a tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:24.349092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-22a1ea19-6aba-4f5f-a06a-a02283916e0a tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:24.355844 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-22a1ea19-6aba-4f5f-a06a-a02283916e0a tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1757 microversion: 2.1 time: 0.194239 Aug 10 13:18:24.356416 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1952/3657] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:24 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1757 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:18:24.479275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-ed740d62-b157-41ba-a423-1474478b329e req-3900c45a-a66a-41c1-8aa5-6c82e3be1326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bfbcd19-7e99-4adc-a9ed-afd4da91f688", "name": "network-vif-deleted", "tag": "82a82794-c196-4361-bfc9-5fb4e67adda3"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:18:24.490156 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-ed740d62-b157-41ba-a423-1474478b329e req-3900c45a-a66a-41c1-8aa5-6c82e3be1326 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:24.494020 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-ed740d62-b157-41ba-a423-1474478b329e req-3900c45a-a66a-41c1-8aa5-6c82e3be1326 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:24.494020 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-ed740d62-b157-41ba-a423-1474478b329e req-3900c45a-a66a-41c1-8aa5-6c82e3be1326 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:24.505094 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-ed740d62-b157-41ba-a423-1474478b329e req-3900c45a-a66a-41c1-8aa5-6c82e3be1326 service nova] Creating event network-vif-deleted:82a82794-c196-4361-bfc9-5fb4e67adda3 for instance 2bfbcd19-7e99-4adc-a9ed-afd4da91f688 on hv-cinder-85199 Aug 10 13:18:24.510847 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-ed740d62-b157-41ba-a423-1474478b329e req-3900c45a-a66a-41c1-8aa5-6c82e3be1326 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051559 Aug 10 13:18:24.511494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1953/3658] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:18:24.784001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9e596355-b5f4-4d61-94e9-0d30a3632fac tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:24.784696 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9e596355-b5f4-4d61-94e9-0d30a3632fac tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] [instance: 2bfbcd19-7e99-4adc-a9ed-afd4da91f688] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:24.790864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e596355-b5f4-4d61-94e9-0d30a3632fac tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:24.791449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e596355-b5f4-4d61-94e9-0d30a3632fac tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:24.791886 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e596355-b5f4-4d61-94e9-0d30a3632fac tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:24.792571 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e596355-b5f4-4d61-94e9-0d30a3632fac tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:24.793021 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e596355-b5f4-4d61-94e9-0d30a3632fac tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:24.793443 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e596355-b5f4-4d61-94e9-0d30a3632fac tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:24.812459 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:18:24.825101 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e596355-b5f4-4d61-94e9-0d30a3632fac tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:24.826109 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e596355-b5f4-4d61-94e9-0d30a3632fac tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:24.826616 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9e596355-b5f4-4d61-94e9-0d30a3632fac tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:24.827055 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.objects.instance [None req-9e596355-b5f4-4d61-94e9-0d30a3632fac tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lazy-loading 'fault' on Instance uuid 2bfbcd19-7e99-4adc-a9ed-afd4da91f688 {{(pid=124643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:18:24.869843 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9e596355-b5f4-4d61-94e9-0d30a3632fac tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41368bdb7a1648848f483eb4a12e3c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a1915ca912a42b88145ea1bf2dbc049', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:24.877576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9e596355-b5f4-4d61-94e9-0d30a3632fac tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] 10.222.0.49 "GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688" status: 200 len: 1303 microversion: 2.1 time: 0.097831 Aug 10 13:18:24.878229 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1954/3659] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:24 2022] GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688 => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:18:25.377524 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-cc0ad3bd-aef6-4b77-8e01-c5d834e9eef2 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:25.378758 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-cc0ad3bd-aef6-4b77-8e01-c5d834e9eef2 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:25.387694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cc0ad3bd-aef6-4b77-8e01-c5d834e9eef2 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:25.390774 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cc0ad3bd-aef6-4b77-8e01-c5d834e9eef2 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:25.390774 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cc0ad3bd-aef6-4b77-8e01-c5d834e9eef2 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:25.390774 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cc0ad3bd-aef6-4b77-8e01-c5d834e9eef2 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:25.391411 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cc0ad3bd-aef6-4b77-8e01-c5d834e9eef2 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:25.391992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cc0ad3bd-aef6-4b77-8e01-c5d834e9eef2 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:25.545689 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-cc0ad3bd-aef6-4b77-8e01-c5d834e9eef2 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:25.553740 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-cc0ad3bd-aef6-4b77-8e01-c5d834e9eef2 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1757 microversion: 2.1 time: 0.180407 Aug 10 13:18:25.554313 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1955/3660] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:25 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:18:25.899404 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8c29ceb3-24d2-4144-998b-7edf7b1a1a5a tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:25.900017 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8c29ceb3-24d2-4144-998b-7edf7b1a1a5a tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] [instance: 2bfbcd19-7e99-4adc-a9ed-afd4da91f688] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:25.907133 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c29ceb3-24d2-4144-998b-7edf7b1a1a5a tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:25.917361 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c29ceb3-24d2-4144-998b-7edf7b1a1a5a tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:25.917361 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c29ceb3-24d2-4144-998b-7edf7b1a1a5a tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:25.917361 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c29ceb3-24d2-4144-998b-7edf7b1a1a5a tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:25.917361 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c29ceb3-24d2-4144-998b-7edf7b1a1a5a tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:25.917682 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8c29ceb3-24d2-4144-998b-7edf7b1a1a5a tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:25.923543 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-8c29ceb3-24d2-4144-998b-7edf7b1a1a5a tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] HTTP exception thrown: Instance 2bfbcd19-7e99-4adc-a9ed-afd4da91f688 could not be found. Aug 10 13:18:25.925224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8c29ceb3-24d2-4144-998b-7edf7b1a1a5a tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Request method failure captured: Aug 10 13:18:25.925224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688 HTTP/1.1 Aug 10 13:18:25.925224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:18:25.925224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:18:25.925224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:18:25.925224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:18:25.925224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:18:25.925224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:18:25.925224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:18:25.925224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:18:25.925224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi87AOWqcmfPm7pBR0uLMQoCAiXDtCNCXg2j2d3Iy6_6GmQLoJlgFcCnTEXVY0uxHyFvYOcYWOXJ6Fv2xYr3i2d4kaGWjbYwwXVxpNUQRbjml_9yjF3km8jXJMlop9e-ne-N0-NXs_xET4AduvRhH6J65ujSMJ_Ka7yr_QarHWppEC6oo Aug 10 13:18:25.925224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:18:25.925224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:18:25.925224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:18:25.925224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:18:25.925224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:18:25.925224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:18:25.925224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: 2a1915ca912a42b88145ea1bf2dbc049 Aug 10 13:18:25.925224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-VolumesNegativeTest-102431850 Aug 10 13:18:25.925224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:18:25.925224 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:18:25.926614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2a1915ca912a42b88145ea1bf2dbc049"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2a1915ca912a42b88145ea1bf2dbc049", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2a1915ca912a42b88145ea1bf2dbc049"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2a1915ca912a42b88145ea1bf2dbc049"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:18:25.926614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-VolumesNegativeTest-102431850 Aug 10 13:18:25.926614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: 2a1915ca912a42b88145ea1bf2dbc049 Aug 10 13:18:25.926614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-VolumesNegativeTest-102431850 Aug 10 13:18:25.926614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-VolumesNegativeTest-102431850-project Aug 10 13:18:25.926614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:18:25.926614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:18:25.926614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 41368bdb7a1648848f483eb4a12e3c38 Aug 10 13:18:25.926614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-VolumesNegativeTest-102431850-project Aug 10 13:18:25.926614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:18:25.926614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance 2bfbcd19-7e99-4adc-a9ed-afd4da91f688 could not be found. Aug 10 13:18:25.926614 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': '2bfbcd19-7e99-4adc-a9ed-afd4da91f688'} Aug 10 13:18:25.927494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:18:25.927494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:18:25.927494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:18:25.927494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:18:25.927494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:18:25.927494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:18:25.927494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:18:25.927494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:18:25.927494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:18:25.927494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:18:25.927494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bfbcd19-7e99-4adc-a9ed-afd4da91f688 could not be found. Aug 10 13:18:25.927494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:18:25.927494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:18:25.927494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:18:25.927494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:18:25.927494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:18:25.927494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:18:25.927494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:18:25.927494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:18:25.927494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:18:25.928870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:18:25.928870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:18:25.928870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:18:25.928870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:18:25.928870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:18:25.928870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:18:25.928870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:18:25.928870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bfbcd19-7e99-4adc-a9ed-afd4da91f688 could not be found. Aug 10 13:18:25.928870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:18:25.928870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:18:25.928870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:18:25.928870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:18:25.928870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:18:25.928870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:18:25.928870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:18:25.928870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:18:25.928870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bfbcd19-7e99-4adc-a9ed-afd4da91f688 could not be found. Aug 10 13:18:25.928870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:18:25.930113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8c29ceb3-24d2-4144-998b-7edf7b1a1a5a tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] Returning 404 to user: Instance 2bfbcd19-7e99-4adc-a9ed-afd4da91f688 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:18:25.930113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8c29ceb3-24d2-4144-998b-7edf7b1a1a5a tempest-VolumesNegativeTest-102431850 tempest-VolumesNegativeTest-102431850-project] 10.222.0.49 "GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688" status: 404 len: 111 microversion: 2.1 time: 0.031196 Aug 10 13:18:25.930113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1956/3661] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:25 2022] GET /compute/v2.1/servers/2bfbcd19-7e99-4adc-a9ed-afd4da91f688 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:18:26.577263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d04dc226-44fa-40d0-80c9-d29a77e49469 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:26.577920 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d04dc226-44fa-40d0-80c9-d29a77e49469 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:26.584864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d04dc226-44fa-40d0-80c9-d29a77e49469 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:26.585349 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d04dc226-44fa-40d0-80c9-d29a77e49469 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:26.585784 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d04dc226-44fa-40d0-80c9-d29a77e49469 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:26.586471 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d04dc226-44fa-40d0-80c9-d29a77e49469 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:26.586922 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d04dc226-44fa-40d0-80c9-d29a77e49469 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:26.587384 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d04dc226-44fa-40d0-80c9-d29a77e49469 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:26.741800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d04dc226-44fa-40d0-80c9-d29a77e49469 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:26.751421 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d04dc226-44fa-40d0-80c9-d29a77e49469 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1757 microversion: 2.1 time: 0.178687 Aug 10 13:18:26.756120 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1957/3662] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:26 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:18:27.777284 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7222757b-8b31-4f52-b78d-ebc825b9fb3c tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:27.777907 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7222757b-8b31-4f52-b78d-ebc825b9fb3c tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:27.785338 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7222757b-8b31-4f52-b78d-ebc825b9fb3c tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:27.792597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7222757b-8b31-4f52-b78d-ebc825b9fb3c tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:27.792597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7222757b-8b31-4f52-b78d-ebc825b9fb3c tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:27.792597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7222757b-8b31-4f52-b78d-ebc825b9fb3c tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:27.792597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7222757b-8b31-4f52-b78d-ebc825b9fb3c tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:27.796680 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7222757b-8b31-4f52-b78d-ebc825b9fb3c tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:27.939133 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7222757b-8b31-4f52-b78d-ebc825b9fb3c tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:27.947895 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7222757b-8b31-4f52-b78d-ebc825b9fb3c tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1757 microversion: 2.1 time: 0.174666 Aug 10 13:18:27.961970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1958/3663] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:27 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:18:28.968661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-08386992-8eaf-4dae-ad08-47e7f3b0a41f tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:28.969290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-08386992-8eaf-4dae-ad08-47e7f3b0a41f tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:28.975303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08386992-8eaf-4dae-ad08-47e7f3b0a41f tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:28.975818 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08386992-8eaf-4dae-ad08-47e7f3b0a41f tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:28.976203 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08386992-8eaf-4dae-ad08-47e7f3b0a41f tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:28.976878 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08386992-8eaf-4dae-ad08-47e7f3b0a41f tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:28.977321 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08386992-8eaf-4dae-ad08-47e7f3b0a41f tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:28.977735 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-08386992-8eaf-4dae-ad08-47e7f3b0a41f tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:29.127795 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-08386992-8eaf-4dae-ad08-47e7f3b0a41f tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:29.136154 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-08386992-8eaf-4dae-ad08-47e7f3b0a41f tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1757 microversion: 2.1 time: 0.171376 Aug 10 13:18:29.136812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1959/3664] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:28 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:18:30.157946 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9c44365b-f8e1-4315-a1fa-067079826486 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:30.158549 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9c44365b-f8e1-4315-a1fa-067079826486 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:30.164807 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9c44365b-f8e1-4315-a1fa-067079826486 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:30.165284 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9c44365b-f8e1-4315-a1fa-067079826486 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:30.165706 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9c44365b-f8e1-4315-a1fa-067079826486 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:30.166391 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9c44365b-f8e1-4315-a1fa-067079826486 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:30.166952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9c44365b-f8e1-4315-a1fa-067079826486 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:30.167408 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9c44365b-f8e1-4315-a1fa-067079826486 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:30.312949 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9c44365b-f8e1-4315-a1fa-067079826486 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:30.320783 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9c44365b-f8e1-4315-a1fa-067079826486 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1757 microversion: 2.1 time: 0.166909 Aug 10 13:18:30.321423 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1960/3665] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:30 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:18:31.342038 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-50e63325-bb9d-400d-99f1-d7adceddb7b7 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:31.342734 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-50e63325-bb9d-400d-99f1-d7adceddb7b7 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:31.349183 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50e63325-bb9d-400d-99f1-d7adceddb7b7 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:31.349658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50e63325-bb9d-400d-99f1-d7adceddb7b7 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:31.350087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50e63325-bb9d-400d-99f1-d7adceddb7b7 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:31.351053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50e63325-bb9d-400d-99f1-d7adceddb7b7 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:31.351217 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50e63325-bb9d-400d-99f1-d7adceddb7b7 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:31.351641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-50e63325-bb9d-400d-99f1-d7adceddb7b7 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:31.504278 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-50e63325-bb9d-400d-99f1-d7adceddb7b7 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:31.512661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-50e63325-bb9d-400d-99f1-d7adceddb7b7 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1757 microversion: 2.1 time: 0.174757 Aug 10 13:18:31.513239 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1961/3666] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:31 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:18:32.535156 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ae452f7d-cf19-4c7f-aee5-93966efe0952 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:32.535933 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ae452f7d-cf19-4c7f-aee5-93966efe0952 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:32.542782 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ae452f7d-cf19-4c7f-aee5-93966efe0952 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:32.544571 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ae452f7d-cf19-4c7f-aee5-93966efe0952 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:32.544571 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ae452f7d-cf19-4c7f-aee5-93966efe0952 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:32.544571 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ae452f7d-cf19-4c7f-aee5-93966efe0952 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:32.545215 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ae452f7d-cf19-4c7f-aee5-93966efe0952 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:32.545870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ae452f7d-cf19-4c7f-aee5-93966efe0952 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:32.694972 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ae452f7d-cf19-4c7f-aee5-93966efe0952 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:32.705479 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ae452f7d-cf19-4c7f-aee5-93966efe0952 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1757 microversion: 2.1 time: 0.174270 Aug 10 13:18:32.706060 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1962/3667] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:32 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:18:33.726615 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0b3ade59-f55a-4b5b-9ff0-1f73bcbbd85b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:33.727266 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0b3ade59-f55a-4b5b-9ff0-1f73bcbbd85b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:33.733754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b3ade59-f55a-4b5b-9ff0-1f73bcbbd85b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:33.734230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b3ade59-f55a-4b5b-9ff0-1f73bcbbd85b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:33.734663 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b3ade59-f55a-4b5b-9ff0-1f73bcbbd85b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:33.735397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b3ade59-f55a-4b5b-9ff0-1f73bcbbd85b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:33.735848 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b3ade59-f55a-4b5b-9ff0-1f73bcbbd85b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:33.736281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0b3ade59-f55a-4b5b-9ff0-1f73bcbbd85b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:33.901266 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-0b3ade59-f55a-4b5b-9ff0-1f73bcbbd85b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:33.910395 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0b3ade59-f55a-4b5b-9ff0-1f73bcbbd85b tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1757 microversion: 2.1 time: 0.187693 Aug 10 13:18:33.910964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1963/3668] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:33 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:18:34.931837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-56ce6696-6ae6-4597-a797-83546e11482e tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:34.932653 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-56ce6696-6ae6-4597-a797-83546e11482e tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:34.939240 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56ce6696-6ae6-4597-a797-83546e11482e tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:34.939826 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56ce6696-6ae6-4597-a797-83546e11482e tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:34.940590 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56ce6696-6ae6-4597-a797-83546e11482e tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:34.941471 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56ce6696-6ae6-4597-a797-83546e11482e tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:34.942148 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56ce6696-6ae6-4597-a797-83546e11482e tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:34.942768 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-56ce6696-6ae6-4597-a797-83546e11482e tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:35.098395 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-56ce6696-6ae6-4597-a797-83546e11482e tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:35.106566 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-56ce6696-6ae6-4597-a797-83546e11482e tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1757 microversion: 2.1 time: 0.179005 Aug 10 13:18:35.107195 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1964/3669] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:34 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:18:36.130094 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d6d797d2-8410-4bdd-b4a5-bdc0b599567a tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:18:36.130700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d6d797d2-8410-4bdd-b4a5-bdc0b599567a tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:18:36.137261 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6d797d2-8410-4bdd-b4a5-bdc0b599567a tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:36.137812 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6d797d2-8410-4bdd-b4a5-bdc0b599567a tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:36.138281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6d797d2-8410-4bdd-b4a5-bdc0b599567a tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:36.138978 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6d797d2-8410-4bdd-b4a5-bdc0b599567a tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:18:36.139454 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6d797d2-8410-4bdd-b4a5-bdc0b599567a tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:18:36.139910 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d6d797d2-8410-4bdd-b4a5-bdc0b599567a tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:18:36.291117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d6d797d2-8410-4bdd-b4a5-bdc0b599567a tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:18:36.299381 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d6d797d2-8410-4bdd-b4a5-bdc0b599567a tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1760 microversion: 2.1 time: 0.173060 Aug 10 13:18:36.299937 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1965/3670] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:18:36 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1760 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:19:09.058419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b1f06549-f337-406a-9268-44232e7aeaba tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-520283205"}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:19:09.059124 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b1f06549-f337-406a-9268-44232e7aeaba tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:19:09.061257 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=31 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:19:09.061896 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=66 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:19:09.067101 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1f06549-f337-406a-9268-44232e7aeaba tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:19:09.067621 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1f06549-f337-406a-9268-44232e7aeaba tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:19:09.068060 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1f06549-f337-406a-9268-44232e7aeaba tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:19:09.068814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1f06549-f337-406a-9268-44232e7aeaba tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:19:09.069264 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1f06549-f337-406a-9268-44232e7aeaba tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:19:09.069688 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b1f06549-f337-406a-9268-44232e7aeaba tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:19:09.271206 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.network.security_group_api [None req-b1f06549-f337-406a-9268-44232e7aeaba tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Removing security group 6a49e73d-3b36-44e2-8b26-ef34e3791597 from port 2f5340f4-ecdb-4e30-9fff-c55b41092d6f Aug 10 13:19:09.706814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b1f06549-f337-406a-9268-44232e7aeaba tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "POST /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419/action" status: 202 len: 0 microversion: 2.1 time: 0.650988 Aug 10 13:19:09.706814 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1966/3671] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 10 13:19:09 2022] POST /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419/action => generated 0 bytes in 652 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 13:19:09.714899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-f4bbc711-7b64-478d-a933-c77ffd68f5b2 req-2c2f4429-1f80-448c-ba83-b9217421ba2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a68803-559f-47cf-9aac-6e8561994419", "tag": "2f5340f4-ecdb-4e30-9fff-c55b41092d6f"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:19:09.739930 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-f4bbc711-7b64-478d-a933-c77ffd68f5b2 req-2c2f4429-1f80-448c-ba83-b9217421ba2d service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:19:09.740697 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-f4bbc711-7b64-478d-a933-c77ffd68f5b2 req-2c2f4429-1f80-448c-ba83-b9217421ba2d service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:19:09.741132 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-f4bbc711-7b64-478d-a933-c77ffd68f5b2 req-2c2f4429-1f80-448c-ba83-b9217421ba2d service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:19:09.755549 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-f4bbc711-7b64-478d-a933-c77ffd68f5b2 req-2c2f4429-1f80-448c-ba83-b9217421ba2d service nova] Creating event network-changed:2f5340f4-ecdb-4e30-9fff-c55b41092d6f for instance e3a68803-559f-47cf-9aac-6e8561994419 on hv-cinder-85199 Aug 10 13:19:09.761976 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-f4bbc711-7b64-478d-a933-c77ffd68f5b2 req-2c2f4429-1f80-448c-ba83-b9217421ba2d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050597 Aug 10 13:19:09.763664 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1967/3672] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:19:10.843686 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-98cf7fc8-1ab0-454c-870e-ea3833057be4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:10.844287 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-98cf7fc8-1ab0-454c-870e-ea3833057be4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:19:10.851159 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98cf7fc8-1ab0-454c-870e-ea3833057be4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:19:10.851677 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98cf7fc8-1ab0-454c-870e-ea3833057be4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:19:10.852149 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98cf7fc8-1ab0-454c-870e-ea3833057be4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:19:10.853041 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98cf7fc8-1ab0-454c-870e-ea3833057be4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:19:10.853485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98cf7fc8-1ab0-454c-870e-ea3833057be4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:19:10.854107 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98cf7fc8-1ab0-454c-870e-ea3833057be4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:19:10.939075 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.objects.instance [None req-98cf7fc8-1ab0-454c-870e-ea3833057be4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lazy-loading 'services' on Instance uuid e3a68803-559f-47cf-9aac-6e8561994419 {{(pid=124643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:19:11.160856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-98cf7fc8-1ab0-454c-870e-ea3833057be4 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419/os-volume_attachments/eba120db-8265-4bf8-89a7-a079fc969935" status: 202 len: 0 microversion: 2.1 time: 0.321717 Aug 10 13:19:11.161627 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1968/3673] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 10 13:19:10 2022] DELETE /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419/os-volume_attachments/eba120db-8265-4bf8-89a7-a079fc969935 => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 13:19:11.171709 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-bd518acd-39f6-4c73-9212-552d3e005e6c req-f6aaf1d9-122c-4611-b391-51e089544241 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a68803-559f-47cf-9aac-6e8561994419", "tag": "2f5340f4-ecdb-4e30-9fff-c55b41092d6f"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:19:11.181028 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-bd518acd-39f6-4c73-9212-552d3e005e6c req-f6aaf1d9-122c-4611-b391-51e089544241 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:19:11.181556 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-bd518acd-39f6-4c73-9212-552d3e005e6c req-f6aaf1d9-122c-4611-b391-51e089544241 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:19:11.181981 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-bd518acd-39f6-4c73-9212-552d3e005e6c req-f6aaf1d9-122c-4611-b391-51e089544241 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:19:11.195535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-bd518acd-39f6-4c73-9212-552d3e005e6c req-f6aaf1d9-122c-4611-b391-51e089544241 service nova] Creating event network-changed:2f5340f4-ecdb-4e30-9fff-c55b41092d6f for instance e3a68803-559f-47cf-9aac-6e8561994419 on hv-cinder-85199 Aug 10 13:19:11.200452 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-bd518acd-39f6-4c73-9212-552d3e005e6c req-f6aaf1d9-122c-4611-b391-51e089544241 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033492 Aug 10 13:19:11.201053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1969/3674] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:19:11.206316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8164915b-611f-4e40-9f8c-84ee8157c787 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:11.210235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8164915b-611f-4e40-9f8c-84ee8157c787 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:19:11.216580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8164915b-611f-4e40-9f8c-84ee8157c787 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:19:11.217062 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8164915b-611f-4e40-9f8c-84ee8157c787 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:19:11.217492 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8164915b-611f-4e40-9f8c-84ee8157c787 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:19:11.218727 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8164915b-611f-4e40-9f8c-84ee8157c787 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:19:11.219201 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8164915b-611f-4e40-9f8c-84ee8157c787 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:19:11.219613 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8164915b-611f-4e40-9f8c-84ee8157c787 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:19:11.255693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8164915b-611f-4e40-9f8c-84ee8157c787 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053336 Aug 10 13:19:11.256295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1970/3675] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 13:19:11 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:19:12.268310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-acc0d792-4dd5-43a1-b9e9-0b1832f8b096 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:12.271113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-acc0d792-4dd5-43a1-b9e9-0b1832f8b096 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:19:12.277623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-acc0d792-4dd5-43a1-b9e9-0b1832f8b096 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:19:12.278108 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-acc0d792-4dd5-43a1-b9e9-0b1832f8b096 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:19:12.278542 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-acc0d792-4dd5-43a1-b9e9-0b1832f8b096 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:19:12.279257 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-acc0d792-4dd5-43a1-b9e9-0b1832f8b096 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:19:12.279706 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-acc0d792-4dd5-43a1-b9e9-0b1832f8b096 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:19:12.280127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-acc0d792-4dd5-43a1-b9e9-0b1832f8b096 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:19:12.308727 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-acc0d792-4dd5-43a1-b9e9-0b1832f8b096 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044324 Aug 10 13:19:12.309272 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1971/3676] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 10 13:19:12 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 13:19:12.319143 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0065da9a-7fcf-4cdd-9242-278a1112e936 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:12.319884 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0065da9a-7fcf-4cdd-9242-278a1112e936 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:19:12.325730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0065da9a-7fcf-4cdd-9242-278a1112e936 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:19:12.326207 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0065da9a-7fcf-4cdd-9242-278a1112e936 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:19:12.326639 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0065da9a-7fcf-4cdd-9242-278a1112e936 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:19:12.327350 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0065da9a-7fcf-4cdd-9242-278a1112e936 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:19:12.327801 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0065da9a-7fcf-4cdd-9242-278a1112e936 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:19:12.328266 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0065da9a-7fcf-4cdd-9242-278a1112e936 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:19:12.402295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-0065da9a-7fcf-4cdd-9242-278a1112e936 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] HTTP exception thrown: Instance e3a68803-559f-47cf-9aac-6e8561994419 is not attached to volume eba120db-8265-4bf8-89a7-a079fc969935 Aug 10 13:19:12.408991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0065da9a-7fcf-4cdd-9242-278a1112e936 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Request method failure captured: Aug 10 13:19:12.408991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: DELETE /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419/os-volume_attachments/eba120db-8265-4bf8-89a7-a079fc969935 HTTP/1.1 Aug 10 13:19:12.408991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:19:12.408991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:19:12.408991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:19:12.408991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:19:12.408991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:19:12.408991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:19:12.408991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:19:12.408991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:19:12.408991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86-r86EHVLHel24EBxZqWcudqdrA8KohaYnP9xZW6QBPaJYWOit8IbSGgppEUJQms-oWa8OyRxvSZvImXhuSmVdYeIDuQVRgdt5Jh0F8Dp4fnzHH-3vfDeOnaEpXCf8KwEZ6UJwsZT_2bciPbfdd7Tw8xXjsueIcXjTkspdEmRHIGyY Aug 10 13:19:12.408991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:19:12.408991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:19:12.408991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:19:12.408991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:19:12.408991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:19:12.408991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:19:12.408991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: bd9b653c3c794b7192e659f2557e7335 Aug 10 13:19:12.408991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-TestMinimumBasicScenario-552000932 Aug 10 13:19:12.408991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:19:12.408991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:19:12.411029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd9b653c3c794b7192e659f2557e7335"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bd9b653c3c794b7192e659f2557e7335", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bd9b653c3c794b7192e659f2557e7335"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd9b653c3c794b7192e659f2557e7335"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:19:12.411029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-TestMinimumBasicScenario-552000932 Aug 10 13:19:12.411029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: bd9b653c3c794b7192e659f2557e7335 Aug 10 13:19:12.411029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-TestMinimumBasicScenario-552000932 Aug 10 13:19:12.411029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-TestMinimumBasicScenario-552000932-project Aug 10 13:19:12.411029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:19:12.411029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:19:12.411029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: c025957730c04df5980279aaef8d0807 Aug 10 13:19:12.411029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-TestMinimumBasicScenario-552000932-project Aug 10 13:19:12.411029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:19:12.411029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance e3a68803-559f-47cf-9aac-6e8561994419 is not attached to volume eba120db-8265-4bf8-89a7-a079fc969935 Aug 10 13:19:12.411876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'server_id': 'e3a68803-559f-47cf-9aac-6e8561994419', 'id': 'eba120db-8265-4bf8-89a7-a079fc969935'} Aug 10 13:19:12.411876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:19:12.411876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:19:12.411876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 10 13:19:12.411876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 10 13:19:12.411876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 13:19:12.411876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 13:19:12.411876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 10 13:19:12.411876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 10 13:19:12.411876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id eba120db-8265-4bf8-89a7-a079fc969935. Aug 10 13:19:12.411876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:19:12.411876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:19:12.411876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:19:12.411876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:19:12.411876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:19:12.411876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:19:12.411876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:19:12.411876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:19:12.411876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:19:12.413219 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:19:12.413219 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 10 13:19:12.413219 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 10 13:19:12.413219 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a68803-559f-47cf-9aac-6e8561994419 is not attached to volume eba120db-8265-4bf8-89a7-a079fc969935 Aug 10 13:19:12.413219 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:19:12.413219 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:19:12.413219 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:19:12.413219 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:19:12.413219 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:19:12.413219 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:19:12.413219 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:19:12.413219 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:19:12.413219 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a68803-559f-47cf-9aac-6e8561994419 is not attached to volume eba120db-8265-4bf8-89a7-a079fc969935 Aug 10 13:19:12.413219 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:19:12.413219 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0065da9a-7fcf-4cdd-9242-278a1112e936 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Returning 404 to user: Instance e3a68803-559f-47cf-9aac-6e8561994419 is not attached to volume eba120db-8265-4bf8-89a7-a079fc969935 {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:19:12.414117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0065da9a-7fcf-4cdd-9242-278a1112e936 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419/os-volume_attachments/eba120db-8265-4bf8-89a7-a079fc969935" status: 404 len: 154 microversion: 2.1 time: 0.096066 Aug 10 13:19:12.414117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1972/3677] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 10 13:19:12 2022] DELETE /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419/os-volume_attachments/eba120db-8265-4bf8-89a7-a079fc969935 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:19:13.722836 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7b6f6b9f-b575-42d6-a89b-872d39154cf0 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:13.723516 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7b6f6b9f-b575-42d6-a89b-872d39154cf0 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:19:13.729871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b6f6b9f-b575-42d6-a89b-872d39154cf0 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:19:13.730355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b6f6b9f-b575-42d6-a89b-872d39154cf0 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:19:13.730796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b6f6b9f-b575-42d6-a89b-872d39154cf0 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:19:13.731511 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b6f6b9f-b575-42d6-a89b-872d39154cf0 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:19:13.731966 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b6f6b9f-b575-42d6-a89b-872d39154cf0 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:19:13.734119 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7b6f6b9f-b575-42d6-a89b-872d39154cf0 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:19:13.758165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7b6f6b9f-b575-42d6-a89b-872d39154cf0 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Going to try to terminate instance {{(pid=124643) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:19:14.053021 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7b6f6b9f-b575-42d6-a89b-872d39154cf0 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 204 len: 0 microversion: 2.1 time: 0.333961 Aug 10 13:19:14.056602 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1973/3678] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 13:19:13 2022] DELETE /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 13:19:14.062325 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fb598735-f682-4e88-b692-bce5cf10f6be tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:14.063076 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fb598735-f682-4e88-b692-bce5cf10f6be tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:19:14.069175 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fb598735-f682-4e88-b692-bce5cf10f6be tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:19:14.069650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fb598735-f682-4e88-b692-bce5cf10f6be tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:19:14.070095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fb598735-f682-4e88-b692-bce5cf10f6be tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:19:14.070761 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fb598735-f682-4e88-b692-bce5cf10f6be tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:19:14.071227 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fb598735-f682-4e88-b692-bce5cf10f6be tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:19:14.071657 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fb598735-f682-4e88-b692-bce5cf10f6be tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:19:14.213322 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fb598735-f682-4e88-b692-bce5cf10f6be tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:19:14.221261 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fb598735-f682-4e88-b692-bce5cf10f6be tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1556 microversion: 2.1 time: 0.163041 Aug 10 13:19:14.221820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1974/3679] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:19:14 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:19:15.244991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ab398f7d-ebbb-4e51-8c0c-4152cfae78ab tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:15.245603 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ab398f7d-ebbb-4e51-8c0c-4152cfae78ab tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:19:15.252385 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ab398f7d-ebbb-4e51-8c0c-4152cfae78ab tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:19:15.252862 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ab398f7d-ebbb-4e51-8c0c-4152cfae78ab tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:19:15.254086 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ab398f7d-ebbb-4e51-8c0c-4152cfae78ab tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:19:15.256409 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ab398f7d-ebbb-4e51-8c0c-4152cfae78ab tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:19:15.256409 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ab398f7d-ebbb-4e51-8c0c-4152cfae78ab tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:19:15.256409 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ab398f7d-ebbb-4e51-8c0c-4152cfae78ab tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:19:15.387523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ab398f7d-ebbb-4e51-8c0c-4152cfae78ab tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:19:15.395992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ab398f7d-ebbb-4e51-8c0c-4152cfae78ab tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1556 microversion: 2.1 time: 0.155005 Aug 10 13:19:15.396569 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1975/3680] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:19:15 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:19:16.283973 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-d0446ebf-7b07-412a-9f4d-6ececda64b47 req-53f1006c-217a-4e49-b47a-382d2f40d9ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a68803-559f-47cf-9aac-6e8561994419", "name": "network-vif-deleted", "tag": "2f5340f4-ecdb-4e30-9fff-c55b41092d6f"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:19:16.294744 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-d0446ebf-7b07-412a-9f4d-6ececda64b47 req-53f1006c-217a-4e49-b47a-382d2f40d9ce service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:19:16.298907 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-d0446ebf-7b07-412a-9f4d-6ececda64b47 req-53f1006c-217a-4e49-b47a-382d2f40d9ce service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:19:16.298907 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-d0446ebf-7b07-412a-9f4d-6ececda64b47 req-53f1006c-217a-4e49-b47a-382d2f40d9ce service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:19:16.307612 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-d0446ebf-7b07-412a-9f4d-6ececda64b47 req-53f1006c-217a-4e49-b47a-382d2f40d9ce service nova] Creating event network-vif-deleted:2f5340f4-ecdb-4e30-9fff-c55b41092d6f for instance e3a68803-559f-47cf-9aac-6e8561994419 on hv-cinder-85199 Aug 10 13:19:16.312504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-d0446ebf-7b07-412a-9f4d-6ececda64b47 req-53f1006c-217a-4e49-b47a-382d2f40d9ce service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032303 Aug 10 13:19:16.313089 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1976/3681] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:19:16.422415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-cf15b5ac-dc00-4787-aa54-d330a553ff09 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:16.423598 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-cf15b5ac-dc00-4787-aa54-d330a553ff09 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:19:16.434590 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cf15b5ac-dc00-4787-aa54-d330a553ff09 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:19:16.435417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cf15b5ac-dc00-4787-aa54-d330a553ff09 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:19:16.436177 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cf15b5ac-dc00-4787-aa54-d330a553ff09 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:19:16.437356 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cf15b5ac-dc00-4787-aa54-d330a553ff09 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:19:16.438160 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cf15b5ac-dc00-4787-aa54-d330a553ff09 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:19:16.438915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-cf15b5ac-dc00-4787-aa54-d330a553ff09 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:19:16.507409 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-cf15b5ac-dc00-4787-aa54-d330a553ff09 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c025957730c04df5980279aaef8d0807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd9b653c3c794b7192e659f2557e7335', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:19:16.514872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-cf15b5ac-dc00-4787-aa54-d330a553ff09 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 200 len: 1344 microversion: 2.1 time: 0.100424 Aug 10 13:19:16.515478 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1977/3682] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:19:16 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 1344 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:19:17.537437 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bfd38920-3050-4b6f-8b40-0d9450e4e256 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:17.538063 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bfd38920-3050-4b6f-8b40-0d9450e4e256 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] [instance: e3a68803-559f-47cf-9aac-6e8561994419] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:19:17.544394 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bfd38920-3050-4b6f-8b40-0d9450e4e256 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:19:17.544871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bfd38920-3050-4b6f-8b40-0d9450e4e256 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:19:17.545298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bfd38920-3050-4b6f-8b40-0d9450e4e256 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:19:17.545968 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bfd38920-3050-4b6f-8b40-0d9450e4e256 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:19:17.546412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bfd38920-3050-4b6f-8b40-0d9450e4e256 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:19:17.546831 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bfd38920-3050-4b6f-8b40-0d9450e4e256 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:19:17.560678 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-bfd38920-3050-4b6f-8b40-0d9450e4e256 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] HTTP exception thrown: Instance e3a68803-559f-47cf-9aac-6e8561994419 could not be found. Aug 10 13:19:17.562301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bfd38920-3050-4b6f-8b40-0d9450e4e256 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Request method failure captured: Aug 10 13:19:17.562301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 HTTP/1.1 Aug 10 13:19:17.562301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:19:17.562301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:19:17.562301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:19:17.562301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:19:17.562301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:19:17.562301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:19:17.562301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:19:17.562301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:19:17.562301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86-r86EHVLHel24EBxZqWcudqdrA8KohaYnP9xZW6QBPaJYWOit8IbSGgppEUJQms-oWa8OyRxvSZvImXhuSmVdYeIDuQVRgdt5Jh0F8Dp4fnzHH-3vfDeOnaEpXCf8KwEZ6UJwsZT_2bciPbfdd7Tw8xXjsueIcXjTkspdEmRHIGyY Aug 10 13:19:17.562301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:19:17.562301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:19:17.562301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:19:17.562301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:19:17.562301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:19:17.562301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:19:17.562301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: bd9b653c3c794b7192e659f2557e7335 Aug 10 13:19:17.562301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-TestMinimumBasicScenario-552000932 Aug 10 13:19:17.562301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:19:17.562301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:19:17.563827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd9b653c3c794b7192e659f2557e7335"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_bd9b653c3c794b7192e659f2557e7335", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/bd9b653c3c794b7192e659f2557e7335"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/bd9b653c3c794b7192e659f2557e7335"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:19:17.563827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-TestMinimumBasicScenario-552000932 Aug 10 13:19:17.563827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: bd9b653c3c794b7192e659f2557e7335 Aug 10 13:19:17.563827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-TestMinimumBasicScenario-552000932 Aug 10 13:19:17.563827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-TestMinimumBasicScenario-552000932-project Aug 10 13:19:17.563827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:19:17.563827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:19:17.563827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: c025957730c04df5980279aaef8d0807 Aug 10 13:19:17.563827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-TestMinimumBasicScenario-552000932-project Aug 10 13:19:17.563827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:19:17.563827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance e3a68803-559f-47cf-9aac-6e8561994419 could not be found. Aug 10 13:19:17.563827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': 'e3a68803-559f-47cf-9aac-6e8561994419'} Aug 10 13:19:17.564591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:19:17.564591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:19:17.564591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:19:17.564591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:19:17.564591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:19:17.564591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:19:17.564591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:19:17.564591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:19:17.564591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:19:17.564591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:19:17.564591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3a68803-559f-47cf-9aac-6e8561994419 could not be found. Aug 10 13:19:17.564591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:19:17.564591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:19:17.564591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:19:17.564591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:19:17.564591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:19:17.564591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:19:17.564591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:19:17.564591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:19:17.564591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:19:17.566328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:19:17.566328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:19:17.566328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:19:17.566328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:19:17.566328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:19:17.566328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:19:17.566328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:19:17.566328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a68803-559f-47cf-9aac-6e8561994419 could not be found. Aug 10 13:19:17.566328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:19:17.566328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:19:17.566328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:19:17.566328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:19:17.566328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:19:17.566328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:19:17.566328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:19:17.566328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:19:17.566328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a68803-559f-47cf-9aac-6e8561994419 could not be found. Aug 10 13:19:17.566328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:19:17.567414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bfd38920-3050-4b6f-8b40-0d9450e4e256 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Returning 404 to user: Instance e3a68803-559f-47cf-9aac-6e8561994419 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:19:17.567414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bfd38920-3050-4b6f-8b40-0d9450e4e256 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419" status: 404 len: 111 microversion: 2.1 time: 0.030577 Aug 10 13:19:17.567414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1978/3683] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:19:17 2022] GET /compute/v2.1/servers/e3a68803-559f-47cf-9aac-6e8561994419 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:19:17.572512 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0d6b1b82-693c-4b38-b773-86a2fd17c2b0 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] Calling method '.version_select at 0x7fb826926040>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:19:17.652266 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0d6b1b82-693c-4b38-b773-86a2fd17c2b0 tempest-TestMinimumBasicScenario-552000932 tempest-TestMinimumBasicScenario-552000932-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1428085936" status: 202 len: 0 microversion: 2.1 time: 0.083209 Aug 10 13:19:17.652869 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1979/3684] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 10 13:19:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1428085936 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 13:20:09.932516 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:20:09.933422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:20:09.937325 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fdacb3b9-d5cf-463c-b57d-de5b9368ae76 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:20:09.937855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fdacb3b9-d5cf-463c-b57d-de5b9368ae76 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:09.944599 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdacb3b9-d5cf-463c-b57d-de5b9368ae76 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:09.945089 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdacb3b9-d5cf-463c-b57d-de5b9368ae76 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:09.945521 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdacb3b9-d5cf-463c-b57d-de5b9368ae76 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:09.946229 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdacb3b9-d5cf-463c-b57d-de5b9368ae76 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:09.946706 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdacb3b9-d5cf-463c-b57d-de5b9368ae76 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:09.947164 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fdacb3b9-d5cf-463c-b57d-de5b9368ae76 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:09.971320 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.objects.instance [None req-fdacb3b9-d5cf-463c-b57d-de5b9368ae76 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lazy-loading 'flavor' on Instance uuid d4131b7e-9198-48f7-a8f5-86d691d37c11 {{(pid=124643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:20:10.215954 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fdacb3b9-d5cf-463c-b57d-de5b9368ae76 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "POST /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11/action" status: 202 len: 0 microversion: 2.1 time: 0.285147 Aug 10 13:20:10.216564 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1980/3685] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 10 13:20:09 2022] POST /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 13:20:10.226464 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a1bc85a3-9526-43e5-b162-590abc62e853 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:10.227164 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a1bc85a3-9526-43e5-b162-590abc62e853 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:10.233447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a1bc85a3-9526-43e5-b162-590abc62e853 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:10.233931 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a1bc85a3-9526-43e5-b162-590abc62e853 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:10.234368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a1bc85a3-9526-43e5-b162-590abc62e853 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:10.235058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a1bc85a3-9526-43e5-b162-590abc62e853 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:10.235544 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a1bc85a3-9526-43e5-b162-590abc62e853 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:10.235967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a1bc85a3-9526-43e5-b162-590abc62e853 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:10.372103 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a1bc85a3-9526-43e5-b162-590abc62e853 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:10.379996 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a1bc85a3-9526-43e5-b162-590abc62e853 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1566 microversion: 2.1 time: 0.158956 Aug 10 13:20:10.380568 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1981/3686] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:10 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:20:11.401976 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5599797d-0eef-4668-8339-2295ac8c9493 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:11.402569 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5599797d-0eef-4668-8339-2295ac8c9493 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:11.409834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5599797d-0eef-4668-8339-2295ac8c9493 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:11.410309 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5599797d-0eef-4668-8339-2295ac8c9493 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:11.410739 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5599797d-0eef-4668-8339-2295ac8c9493 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:11.411449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5599797d-0eef-4668-8339-2295ac8c9493 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:11.411897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5599797d-0eef-4668-8339-2295ac8c9493 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:11.412316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5599797d-0eef-4668-8339-2295ac8c9493 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:11.543135 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5599797d-0eef-4668-8339-2295ac8c9493 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:11.551143 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5599797d-0eef-4668-8339-2295ac8c9493 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1566 microversion: 2.1 time: 0.153170 Aug 10 13:20:11.551729 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1982/3687] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:11 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:20:12.572070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5ea83026-bf2f-4841-a89d-a6bacb4a61c1 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:12.572703 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5ea83026-bf2f-4841-a89d-a6bacb4a61c1 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:12.578964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ea83026-bf2f-4841-a89d-a6bacb4a61c1 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:12.579467 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ea83026-bf2f-4841-a89d-a6bacb4a61c1 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:12.579898 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ea83026-bf2f-4841-a89d-a6bacb4a61c1 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:12.581007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ea83026-bf2f-4841-a89d-a6bacb4a61c1 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:12.581455 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ea83026-bf2f-4841-a89d-a6bacb4a61c1 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:12.581874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5ea83026-bf2f-4841-a89d-a6bacb4a61c1 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:12.715768 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5ea83026-bf2f-4841-a89d-a6bacb4a61c1 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:12.721218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5ea83026-bf2f-4841-a89d-a6bacb4a61c1 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1566 microversion: 2.1 time: 0.152495 Aug 10 13:20:12.721779 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1983/3688] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:12 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:20:13.742816 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5a94dabc-42a5-46fc-b50e-3e35573129a8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:13.743518 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5a94dabc-42a5-46fc-b50e-3e35573129a8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:13.749714 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a94dabc-42a5-46fc-b50e-3e35573129a8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:13.754054 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a94dabc-42a5-46fc-b50e-3e35573129a8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:13.754054 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a94dabc-42a5-46fc-b50e-3e35573129a8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:13.754054 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a94dabc-42a5-46fc-b50e-3e35573129a8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:13.754054 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a94dabc-42a5-46fc-b50e-3e35573129a8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:13.754401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5a94dabc-42a5-46fc-b50e-3e35573129a8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:13.884624 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5a94dabc-42a5-46fc-b50e-3e35573129a8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:13.892065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5a94dabc-42a5-46fc-b50e-3e35573129a8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1566 microversion: 2.1 time: 0.153155 Aug 10 13:20:13.892626 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1984/3689] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:13 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:20:14.917699 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7f38c40f-9d3e-4510-94d6-92ed8f89efc5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:14.917699 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7f38c40f-9d3e-4510-94d6-92ed8f89efc5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:14.920289 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f38c40f-9d3e-4510-94d6-92ed8f89efc5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:14.920850 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f38c40f-9d3e-4510-94d6-92ed8f89efc5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:14.921284 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f38c40f-9d3e-4510-94d6-92ed8f89efc5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:14.921969 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f38c40f-9d3e-4510-94d6-92ed8f89efc5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:14.922424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f38c40f-9d3e-4510-94d6-92ed8f89efc5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:14.922847 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7f38c40f-9d3e-4510-94d6-92ed8f89efc5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:15.052449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7f38c40f-9d3e-4510-94d6-92ed8f89efc5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:15.059837 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7f38c40f-9d3e-4510-94d6-92ed8f89efc5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1566 microversion: 2.1 time: 0.150886 Aug 10 13:20:15.060403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1985/3690] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:14 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:20:16.081418 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6c9770db-7d53-4a7f-8dd5-2221af68e7ce tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:16.082055 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6c9770db-7d53-4a7f-8dd5-2221af68e7ce tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:16.088417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6c9770db-7d53-4a7f-8dd5-2221af68e7ce tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:16.088902 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6c9770db-7d53-4a7f-8dd5-2221af68e7ce tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:16.089339 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6c9770db-7d53-4a7f-8dd5-2221af68e7ce tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:16.090030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6c9770db-7d53-4a7f-8dd5-2221af68e7ce tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:16.090484 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6c9770db-7d53-4a7f-8dd5-2221af68e7ce tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:16.090910 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6c9770db-7d53-4a7f-8dd5-2221af68e7ce tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:16.226405 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6c9770db-7d53-4a7f-8dd5-2221af68e7ce tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:16.234199 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6c9770db-7d53-4a7f-8dd5-2221af68e7ce tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1566 microversion: 2.1 time: 0.156977 Aug 10 13:20:16.234772 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1986/3691] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:16 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:20:17.255809 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bd6d5427-8398-4462-8378-9210955222a7 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:17.256436 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bd6d5427-8398-4462-8378-9210955222a7 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:17.262888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd6d5427-8398-4462-8378-9210955222a7 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:17.263417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd6d5427-8398-4462-8378-9210955222a7 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:17.263854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd6d5427-8398-4462-8378-9210955222a7 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:17.264603 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd6d5427-8398-4462-8378-9210955222a7 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:17.264991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd6d5427-8398-4462-8378-9210955222a7 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:17.265414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd6d5427-8398-4462-8378-9210955222a7 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:17.395405 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-bd6d5427-8398-4462-8378-9210955222a7 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:17.402977 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bd6d5427-8398-4462-8378-9210955222a7 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1566 microversion: 2.1 time: 0.151026 Aug 10 13:20:17.403605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1987/3692] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:17 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:20:18.425702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c93f0ee0-6f81-4467-af6c-521ca257e519 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:18.426407 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c93f0ee0-6f81-4467-af6c-521ca257e519 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:18.433304 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c93f0ee0-6f81-4467-af6c-521ca257e519 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:18.434096 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c93f0ee0-6f81-4467-af6c-521ca257e519 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:18.434560 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c93f0ee0-6f81-4467-af6c-521ca257e519 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:18.435284 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c93f0ee0-6f81-4467-af6c-521ca257e519 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:18.435737 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c93f0ee0-6f81-4467-af6c-521ca257e519 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:18.436158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c93f0ee0-6f81-4467-af6c-521ca257e519 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:18.596352 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c93f0ee0-6f81-4467-af6c-521ca257e519 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:18.604127 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c93f0ee0-6f81-4467-af6c-521ca257e519 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1566 microversion: 2.1 time: 0.182824 Aug 10 13:20:18.604730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1988/3693] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:18 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1566 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:20:19.628693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e1bcbfe9-8313-49d2-867d-31165a690bc3 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:19.629333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e1bcbfe9-8313-49d2-867d-31165a690bc3 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:19.635458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e1bcbfe9-8313-49d2-867d-31165a690bc3 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:19.635944 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e1bcbfe9-8313-49d2-867d-31165a690bc3 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:19.636379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e1bcbfe9-8313-49d2-867d-31165a690bc3 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:19.637081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e1bcbfe9-8313-49d2-867d-31165a690bc3 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:19.637532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e1bcbfe9-8313-49d2-867d-31165a690bc3 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:19.637957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e1bcbfe9-8313-49d2-867d-31165a690bc3 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:19.769425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e1bcbfe9-8313-49d2-867d-31165a690bc3 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:19.776994 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e1bcbfe9-8313-49d2-867d-31165a690bc3 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1566 microversion: 2.1 time: 0.153300 Aug 10 13:20:19.777591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1989/3694] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:19 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:20:20.797877 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-833a7b1e-f887-4131-bcf2-eb726dfe5cb1 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:20.798486 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-833a7b1e-f887-4131-bcf2-eb726dfe5cb1 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:20.805053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-833a7b1e-f887-4131-bcf2-eb726dfe5cb1 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:20.805532 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-833a7b1e-f887-4131-bcf2-eb726dfe5cb1 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:20.805994 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-833a7b1e-f887-4131-bcf2-eb726dfe5cb1 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:20.806708 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-833a7b1e-f887-4131-bcf2-eb726dfe5cb1 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:20.807155 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-833a7b1e-f887-4131-bcf2-eb726dfe5cb1 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:20.807598 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-833a7b1e-f887-4131-bcf2-eb726dfe5cb1 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:20.937913 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-833a7b1e-f887-4131-bcf2-eb726dfe5cb1 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:20.946087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-833a7b1e-f887-4131-bcf2-eb726dfe5cb1 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1566 microversion: 2.1 time: 0.152085 Aug 10 13:20:20.946646 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1990/3695] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:20 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:20:21.967673 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ec5be01a-aa35-40ef-99e0-cb3164eaee59 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:21.968294 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ec5be01a-aa35-40ef-99e0-cb3164eaee59 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:21.975208 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec5be01a-aa35-40ef-99e0-cb3164eaee59 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:21.975697 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec5be01a-aa35-40ef-99e0-cb3164eaee59 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:21.976128 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec5be01a-aa35-40ef-99e0-cb3164eaee59 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:21.976813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec5be01a-aa35-40ef-99e0-cb3164eaee59 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:21.977261 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec5be01a-aa35-40ef-99e0-cb3164eaee59 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:21.977680 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec5be01a-aa35-40ef-99e0-cb3164eaee59 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:22.109414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ec5be01a-aa35-40ef-99e0-cb3164eaee59 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:22.117080 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ec5be01a-aa35-40ef-99e0-cb3164eaee59 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1566 microversion: 2.1 time: 0.153328 Aug 10 13:20:22.117647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1991/3696] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:21 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:20:23.137593 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-be6f970d-3117-4226-b17d-2621d6850561 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:23.138223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-be6f970d-3117-4226-b17d-2621d6850561 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:23.144587 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be6f970d-3117-4226-b17d-2621d6850561 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:23.145062 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be6f970d-3117-4226-b17d-2621d6850561 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:23.145491 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be6f970d-3117-4226-b17d-2621d6850561 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:23.146175 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be6f970d-3117-4226-b17d-2621d6850561 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:23.146625 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be6f970d-3117-4226-b17d-2621d6850561 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:23.147049 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-be6f970d-3117-4226-b17d-2621d6850561 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:23.276510 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-be6f970d-3117-4226-b17d-2621d6850561 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:23.284665 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-be6f970d-3117-4226-b17d-2621d6850561 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1566 microversion: 2.1 time: 0.151023 Aug 10 13:20:23.285226 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1992/3697] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:23 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:20:24.305778 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-044979dc-cee3-428f-b03a-343036af3044 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:24.306394 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-044979dc-cee3-428f-b03a-343036af3044 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:24.312834 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-044979dc-cee3-428f-b03a-343036af3044 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:24.313311 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-044979dc-cee3-428f-b03a-343036af3044 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:24.313743 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-044979dc-cee3-428f-b03a-343036af3044 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:24.314593 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-044979dc-cee3-428f-b03a-343036af3044 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:24.314998 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-044979dc-cee3-428f-b03a-343036af3044 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:24.315447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-044979dc-cee3-428f-b03a-343036af3044 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:24.448150 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-044979dc-cee3-428f-b03a-343036af3044 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:24.456155 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-044979dc-cee3-428f-b03a-343036af3044 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1566 microversion: 2.1 time: 0.154269 Aug 10 13:20:24.456723 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1993/3698] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:24 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:20:25.477654 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-81b41efc-6777-4b97-b64d-04705c6a65b5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:25.478264 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-81b41efc-6777-4b97-b64d-04705c6a65b5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:25.485046 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81b41efc-6777-4b97-b64d-04705c6a65b5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:25.485529 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81b41efc-6777-4b97-b64d-04705c6a65b5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:25.486666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81b41efc-6777-4b97-b64d-04705c6a65b5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:25.487360 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81b41efc-6777-4b97-b64d-04705c6a65b5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:25.487811 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81b41efc-6777-4b97-b64d-04705c6a65b5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:25.488233 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-81b41efc-6777-4b97-b64d-04705c6a65b5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:25.506373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:20:25.683924 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-81b41efc-6777-4b97-b64d-04705c6a65b5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:25.691988 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-81b41efc-6777-4b97-b64d-04705c6a65b5 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1566 microversion: 2.1 time: 0.218296 Aug 10 13:20:25.692580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1994/3699] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:25 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1566 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:20:26.713771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-470f70d3-51b9-46ef-8270-757b5a5d3c72 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:26.714388 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-470f70d3-51b9-46ef-8270-757b5a5d3c72 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:26.720850 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-470f70d3-51b9-46ef-8270-757b5a5d3c72 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:26.721323 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-470f70d3-51b9-46ef-8270-757b5a5d3c72 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:26.721751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-470f70d3-51b9-46ef-8270-757b5a5d3c72 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:26.722424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-470f70d3-51b9-46ef-8270-757b5a5d3c72 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:26.722962 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-470f70d3-51b9-46ef-8270-757b5a5d3c72 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:26.723404 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-470f70d3-51b9-46ef-8270-757b5a5d3c72 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:26.857998 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-470f70d3-51b9-46ef-8270-757b5a5d3c72 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:26.865698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-470f70d3-51b9-46ef-8270-757b5a5d3c72 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1566 microversion: 2.1 time: 0.155953 Aug 10 13:20:26.866271 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1995/3700] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:26 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:20:27.886951 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b955cf69-9ba1-48e5-ade5-19970cd3996f tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:27.887647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b955cf69-9ba1-48e5-ade5-19970cd3996f tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:27.894357 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b955cf69-9ba1-48e5-ade5-19970cd3996f tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:27.894828 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b955cf69-9ba1-48e5-ade5-19970cd3996f tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:27.899341 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b955cf69-9ba1-48e5-ade5-19970cd3996f tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:27.899341 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b955cf69-9ba1-48e5-ade5-19970cd3996f tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:27.899341 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b955cf69-9ba1-48e5-ade5-19970cd3996f tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:27.899341 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b955cf69-9ba1-48e5-ade5-19970cd3996f tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:28.030275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b955cf69-9ba1-48e5-ade5-19970cd3996f tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:28.038970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b955cf69-9ba1-48e5-ade5-19970cd3996f tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1566 microversion: 2.1 time: 0.155840 Aug 10 13:20:28.039553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1996/3701] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:27 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:20:29.060711 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3451a347-f1cb-4951-8f5c-646a0459d36d tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:29.061349 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3451a347-f1cb-4951-8f5c-646a0459d36d tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:29.067663 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3451a347-f1cb-4951-8f5c-646a0459d36d tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:29.068143 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3451a347-f1cb-4951-8f5c-646a0459d36d tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:29.068579 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3451a347-f1cb-4951-8f5c-646a0459d36d tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:29.069267 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3451a347-f1cb-4951-8f5c-646a0459d36d tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:29.069718 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3451a347-f1cb-4951-8f5c-646a0459d36d tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:29.070142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3451a347-f1cb-4951-8f5c-646a0459d36d tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:29.199420 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3451a347-f1cb-4951-8f5c-646a0459d36d tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:29.206927 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3451a347-f1cb-4951-8f5c-646a0459d36d tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1507 microversion: 2.1 time: 0.150153 Aug 10 13:20:29.207553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1997/3702] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:29 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:20:29.227132 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-172d3bf7-4a00-4a67-bd67-9ef95b282b16 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:20:29.227750 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-172d3bf7-4a00-4a67-bd67-9ef95b282b16 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:29.233579 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-172d3bf7-4a00-4a67-bd67-9ef95b282b16 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:29.234059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-172d3bf7-4a00-4a67-bd67-9ef95b282b16 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:29.234501 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-172d3bf7-4a00-4a67-bd67-9ef95b282b16 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:29.235200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-172d3bf7-4a00-4a67-bd67-9ef95b282b16 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:29.236269 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-172d3bf7-4a00-4a67-bd67-9ef95b282b16 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:29.236698 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-172d3bf7-4a00-4a67-bd67-9ef95b282b16 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:29.276394 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-172d3bf7-4a00-4a67-bd67-9ef95b282b16 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124643) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 13:20:29.577478 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-172d3bf7-4a00-4a67-bd67-9ef95b282b16 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "POST /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11/action" status: 202 len: 0 microversion: 2.1 time: 0.353913 Aug 10 13:20:29.578083 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1998/3703] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 10 13:20:29 2022] POST /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 13:20:29.586413 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fb0d6b80-09bc-4ad1-9f66-8a75b6e7c6fb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:29.587015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fb0d6b80-09bc-4ad1-9f66-8a75b6e7c6fb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:29.592978 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fb0d6b80-09bc-4ad1-9f66-8a75b6e7c6fb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:29.593458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fb0d6b80-09bc-4ad1-9f66-8a75b6e7c6fb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:29.593907 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fb0d6b80-09bc-4ad1-9f66-8a75b6e7c6fb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:29.594577 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fb0d6b80-09bc-4ad1-9f66-8a75b6e7c6fb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:29.595621 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fb0d6b80-09bc-4ad1-9f66-8a75b6e7c6fb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:29.596058 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fb0d6b80-09bc-4ad1-9f66-8a75b6e7c6fb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:29.739524 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fb0d6b80-09bc-4ad1-9f66-8a75b6e7c6fb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:29.746918 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fb0d6b80-09bc-4ad1-9f66-8a75b6e7c6fb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1515 microversion: 2.1 time: 0.164165 Aug 10 13:20:29.747515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 1999/3704] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:29 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:20:30.769952 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-877ae69d-267a-49be-ad1a-d1a98ad28689 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:30.771153 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-877ae69d-267a-49be-ad1a-d1a98ad28689 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:30.777365 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-877ae69d-267a-49be-ad1a-d1a98ad28689 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:30.777992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-877ae69d-267a-49be-ad1a-d1a98ad28689 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:30.778295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-877ae69d-267a-49be-ad1a-d1a98ad28689 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:30.778979 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-877ae69d-267a-49be-ad1a-d1a98ad28689 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:30.779518 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-877ae69d-267a-49be-ad1a-d1a98ad28689 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:30.779912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-877ae69d-267a-49be-ad1a-d1a98ad28689 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:30.916435 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-877ae69d-267a-49be-ad1a-d1a98ad28689 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:30.924048 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-877ae69d-267a-49be-ad1a-d1a98ad28689 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1517 microversion: 2.1 time: 0.159160 Aug 10 13:20:30.924617 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2000/3705] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:30 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:20:31.769444 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-f8b7b433-7a0b-4bc9-9921-8792aa7432a4 req-20ecc5c4-d4c7-4bc4-89f0-971992d9dd48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4131b7e-9198-48f7-a8f5-86d691d37c11", "name": "network-vif-unplugged", "status": "completed", "tag": "bdc043f9-2aa5-46cf-83d0-1101d7125972"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:20:31.780890 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-f8b7b433-7a0b-4bc9-9921-8792aa7432a4 req-20ecc5c4-d4c7-4bc4-89f0-971992d9dd48 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:31.783107 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-f8b7b433-7a0b-4bc9-9921-8792aa7432a4 req-20ecc5c4-d4c7-4bc4-89f0-971992d9dd48 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:31.783107 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-f8b7b433-7a0b-4bc9-9921-8792aa7432a4 req-20ecc5c4-d4c7-4bc4-89f0-971992d9dd48 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:31.794955 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.compute.server_external_events [req-f8b7b433-7a0b-4bc9-9921-8792aa7432a4 req-20ecc5c4-d4c7-4bc4-89f0-971992d9dd48 service nova] Unable to find a host for instance d4131b7e-9198-48f7-a8f5-86d691d37c11. Dropping event network-vif-unplugged {{(pid=124643) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 10 13:20:31.796333 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-f8b7b433-7a0b-4bc9-9921-8792aa7432a4 req-20ecc5c4-d4c7-4bc4-89f0-971992d9dd48 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031988 Aug 10 13:20:31.797041 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2001/3706] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 10 13:20:31.945451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bb2d9c8c-17e1-4d8e-979f-ec07be37ec3e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:31.946186 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bb2d9c8c-17e1-4d8e-979f-ec07be37ec3e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:31.952746 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bb2d9c8c-17e1-4d8e-979f-ec07be37ec3e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:31.953239 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bb2d9c8c-17e1-4d8e-979f-ec07be37ec3e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:31.953675 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bb2d9c8c-17e1-4d8e-979f-ec07be37ec3e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:31.955281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bb2d9c8c-17e1-4d8e-979f-ec07be37ec3e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:31.955771 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bb2d9c8c-17e1-4d8e-979f-ec07be37ec3e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:31.956200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bb2d9c8c-17e1-4d8e-979f-ec07be37ec3e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:32.092090 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-bb2d9c8c-17e1-4d8e-979f-ec07be37ec3e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:32.099964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bb2d9c8c-17e1-4d8e-979f-ec07be37ec3e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1573 microversion: 2.1 time: 0.158463 Aug 10 13:20:32.100533 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2002/3707] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:31 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:20:33.121155 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bddc0695-92ac-4d35-b72c-5ad4c5ace1c0 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:33.121838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bddc0695-92ac-4d35-b72c-5ad4c5ace1c0 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:33.129263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bddc0695-92ac-4d35-b72c-5ad4c5ace1c0 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:33.129734 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bddc0695-92ac-4d35-b72c-5ad4c5ace1c0 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:33.130165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bddc0695-92ac-4d35-b72c-5ad4c5ace1c0 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:33.130839 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bddc0695-92ac-4d35-b72c-5ad4c5ace1c0 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:33.131314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bddc0695-92ac-4d35-b72c-5ad4c5ace1c0 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:33.131734 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bddc0695-92ac-4d35-b72c-5ad4c5ace1c0 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:33.263927 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-bddc0695-92ac-4d35-b72c-5ad4c5ace1c0 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:33.272084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bddc0695-92ac-4d35-b72c-5ad4c5ace1c0 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1573 microversion: 2.1 time: 0.154802 Aug 10 13:20:33.272855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2003/3708] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:33 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:20:34.293569 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2c45a059-c963-4f6d-8a46-dd45ca92c8cf tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:34.294179 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2c45a059-c963-4f6d-8a46-dd45ca92c8cf tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:34.300542 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c45a059-c963-4f6d-8a46-dd45ca92c8cf tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:34.301023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c45a059-c963-4f6d-8a46-dd45ca92c8cf tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:34.301453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c45a059-c963-4f6d-8a46-dd45ca92c8cf tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:34.302134 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c45a059-c963-4f6d-8a46-dd45ca92c8cf tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:34.302581 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c45a059-c963-4f6d-8a46-dd45ca92c8cf tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:34.303001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2c45a059-c963-4f6d-8a46-dd45ca92c8cf tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:34.435451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2c45a059-c963-4f6d-8a46-dd45ca92c8cf tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:34.443633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2c45a059-c963-4f6d-8a46-dd45ca92c8cf tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1573 microversion: 2.1 time: 0.153930 Aug 10 13:20:34.444195 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2004/3709] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:34 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:20:35.465430 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-dab0e632-fbbc-4f42-ab19-60ecaa8e39bc tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:35.466027 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-dab0e632-fbbc-4f42-ab19-60ecaa8e39bc tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:35.473006 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dab0e632-fbbc-4f42-ab19-60ecaa8e39bc tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:35.473487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dab0e632-fbbc-4f42-ab19-60ecaa8e39bc tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:35.473925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dab0e632-fbbc-4f42-ab19-60ecaa8e39bc tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:35.474621 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dab0e632-fbbc-4f42-ab19-60ecaa8e39bc tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:35.475092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dab0e632-fbbc-4f42-ab19-60ecaa8e39bc tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:35.475523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dab0e632-fbbc-4f42-ab19-60ecaa8e39bc tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:35.602467 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-dab0e632-fbbc-4f42-ab19-60ecaa8e39bc tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:35.610142 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-dab0e632-fbbc-4f42-ab19-60ecaa8e39bc tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1573 microversion: 2.1 time: 0.148531 Aug 10 13:20:35.610722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2005/3710] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:35 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:20:36.629866 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ac09ef1f-8da4-436d-a03a-f3d74f853e8e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:36.630504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ac09ef1f-8da4-436d-a03a-f3d74f853e8e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:36.636768 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac09ef1f-8da4-436d-a03a-f3d74f853e8e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:36.637240 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac09ef1f-8da4-436d-a03a-f3d74f853e8e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:36.637667 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac09ef1f-8da4-436d-a03a-f3d74f853e8e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:36.638337 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac09ef1f-8da4-436d-a03a-f3d74f853e8e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:36.638779 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac09ef1f-8da4-436d-a03a-f3d74f853e8e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:36.639212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ac09ef1f-8da4-436d-a03a-f3d74f853e8e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:36.772116 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ac09ef1f-8da4-436d-a03a-f3d74f853e8e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:36.781780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ac09ef1f-8da4-436d-a03a-f3d74f853e8e tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1573 microversion: 2.1 time: 0.153676 Aug 10 13:20:36.781780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2006/3711] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:36 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:20:37.802534 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9861293b-e87d-4015-b454-8a9d06606cdb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:37.803203 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-9861293b-e87d-4015-b454-8a9d06606cdb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:37.809453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9861293b-e87d-4015-b454-8a9d06606cdb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:37.809934 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9861293b-e87d-4015-b454-8a9d06606cdb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:37.810364 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9861293b-e87d-4015-b454-8a9d06606cdb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:37.811046 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9861293b-e87d-4015-b454-8a9d06606cdb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:37.811523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9861293b-e87d-4015-b454-8a9d06606cdb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:37.811947 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-9861293b-e87d-4015-b454-8a9d06606cdb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:37.941997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-9861293b-e87d-4015-b454-8a9d06606cdb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:37.949433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9861293b-e87d-4015-b454-8a9d06606cdb tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1573 microversion: 2.1 time: 0.151595 Aug 10 13:20:37.949993 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2007/3712] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:37 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:20:38.969849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-debe8687-ade2-4ebe-9af1-9df26e7fe9d8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:38.970464 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-debe8687-ade2-4ebe-9af1-9df26e7fe9d8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:38.976923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-debe8687-ade2-4ebe-9af1-9df26e7fe9d8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:38.977411 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-debe8687-ade2-4ebe-9af1-9df26e7fe9d8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:38.977845 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-debe8687-ade2-4ebe-9af1-9df26e7fe9d8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:38.978526 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-debe8687-ade2-4ebe-9af1-9df26e7fe9d8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:38.978974 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-debe8687-ade2-4ebe-9af1-9df26e7fe9d8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:38.979417 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-debe8687-ade2-4ebe-9af1-9df26e7fe9d8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:39.112062 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-debe8687-ade2-4ebe-9af1-9df26e7fe9d8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:39.119549 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-debe8687-ade2-4ebe-9af1-9df26e7fe9d8 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1573 microversion: 2.1 time: 0.153619 Aug 10 13:20:39.120114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2008/3713] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:38 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:20:40.140828 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d970d4e9-a4e9-4d8e-88d2-6bf68b3e54ed tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:40.141464 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d970d4e9-a4e9-4d8e-88d2-6bf68b3e54ed tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:40.143827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:20:40.148523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d970d4e9-a4e9-4d8e-88d2-6bf68b3e54ed tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:40.149021 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d970d4e9-a4e9-4d8e-88d2-6bf68b3e54ed tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:40.149442 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d970d4e9-a4e9-4d8e-88d2-6bf68b3e54ed tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:40.150126 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d970d4e9-a4e9-4d8e-88d2-6bf68b3e54ed tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:40.150579 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d970d4e9-a4e9-4d8e-88d2-6bf68b3e54ed tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:40.151005 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d970d4e9-a4e9-4d8e-88d2-6bf68b3e54ed tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:40.284054 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d970d4e9-a4e9-4d8e-88d2-6bf68b3e54ed tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:40.291450 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d970d4e9-a4e9-4d8e-88d2-6bf68b3e54ed tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1573 microversion: 2.1 time: 0.154516 Aug 10 13:20:40.292023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2009/3714] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:40 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:20:41.313392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8ea959ee-e336-46e9-a0cf-c8c037acc650 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:41.314025 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8ea959ee-e336-46e9-a0cf-c8c037acc650 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:41.320485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ea959ee-e336-46e9-a0cf-c8c037acc650 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:41.320963 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ea959ee-e336-46e9-a0cf-c8c037acc650 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:41.321393 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ea959ee-e336-46e9-a0cf-c8c037acc650 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:41.322075 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ea959ee-e336-46e9-a0cf-c8c037acc650 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:41.322524 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ea959ee-e336-46e9-a0cf-c8c037acc650 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:41.322947 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8ea959ee-e336-46e9-a0cf-c8c037acc650 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:41.454699 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8ea959ee-e336-46e9-a0cf-c8c037acc650 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:41.458125 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:20:41.462456 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8ea959ee-e336-46e9-a0cf-c8c037acc650 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1573 microversion: 2.1 time: 0.152961 Aug 10 13:20:41.463029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2010/3715] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:41 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:20:41.867001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-a2d22f7d-b980-4057-af53-66213059539c req-6ed96200-4cb7-43be-8323-357136fc9a20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4131b7e-9198-48f7-a8f5-86d691d37c11", "name": "network-vif-plugged", "status": "completed", "tag": "bdc043f9-2aa5-46cf-83d0-1101d7125972"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:20:41.877006 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-a2d22f7d-b980-4057-af53-66213059539c req-6ed96200-4cb7-43be-8323-357136fc9a20 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:41.877480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-a2d22f7d-b980-4057-af53-66213059539c req-6ed96200-4cb7-43be-8323-357136fc9a20 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:41.877910 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-a2d22f7d-b980-4057-af53-66213059539c req-6ed96200-4cb7-43be-8323-357136fc9a20 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:41.889009 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-a2d22f7d-b980-4057-af53-66213059539c req-6ed96200-4cb7-43be-8323-357136fc9a20 service nova] Creating event network-vif-plugged:bdc043f9-2aa5-46cf-83d0-1101d7125972 for instance d4131b7e-9198-48f7-a8f5-86d691d37c11 on hv-cinder-85199 Aug 10 13:20:41.894355 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-a2d22f7d-b980-4057-af53-66213059539c req-6ed96200-4cb7-43be-8323-357136fc9a20 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031310 Aug 10 13:20:41.894940 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2011/3716] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:20:42.485666 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ff1f5d34-4f17-4de4-aee9-961d05606099 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:42.486779 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ff1f5d34-4f17-4de4-aee9-961d05606099 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:42.493327 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff1f5d34-4f17-4de4-aee9-961d05606099 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:42.493791 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff1f5d34-4f17-4de4-aee9-961d05606099 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:42.494227 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff1f5d34-4f17-4de4-aee9-961d05606099 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:42.494913 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff1f5d34-4f17-4de4-aee9-961d05606099 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:42.495392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff1f5d34-4f17-4de4-aee9-961d05606099 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:42.495826 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff1f5d34-4f17-4de4-aee9-961d05606099 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:42.626195 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ff1f5d34-4f17-4de4-aee9-961d05606099 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:42.634587 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ff1f5d34-4f17-4de4-aee9-961d05606099 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1573 microversion: 2.1 time: 0.153617 Aug 10 13:20:42.635155 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2012/3717] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:42 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:20:43.656492 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e7179b7f-fcab-41db-8e46-372a7121a580 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:20:43.657135 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e7179b7f-fcab-41db-8e46-372a7121a580 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:20:43.663436 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e7179b7f-fcab-41db-8e46-372a7121a580 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:43.663915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e7179b7f-fcab-41db-8e46-372a7121a580 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:43.664347 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e7179b7f-fcab-41db-8e46-372a7121a580 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:43.665075 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e7179b7f-fcab-41db-8e46-372a7121a580 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:20:43.665505 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e7179b7f-fcab-41db-8e46-372a7121a580 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:20:43.665926 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e7179b7f-fcab-41db-8e46-372a7121a580 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:20:43.802854 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e7179b7f-fcab-41db-8e46-372a7121a580 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:20:43.810299 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e7179b7f-fcab-41db-8e46-372a7121a580 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1560 microversion: 2.1 time: 0.157837 Aug 10 13:20:43.810867 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2013/3718] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:20:43 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:21:41.515169 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:21:41.515813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Wed Aug 10 13:21:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:22:00.494039 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=9 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:00.494866 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=14 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:22:00.499446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-dd2ed447-6621-4f4a-9211-5aad005dc377 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:22:00.500120 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-dd2ed447-6621-4f4a-9211-5aad005dc377 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:22:00.506053 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd2ed447-6621-4f4a-9211-5aad005dc377 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:22:00.520642 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd2ed447-6621-4f4a-9211-5aad005dc377 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:22:00.520642 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd2ed447-6621-4f4a-9211-5aad005dc377 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:22:00.520642 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd2ed447-6621-4f4a-9211-5aad005dc377 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:22:00.520642 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd2ed447-6621-4f4a-9211-5aad005dc377 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:22:00.521021 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-dd2ed447-6621-4f4a-9211-5aad005dc377 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:22:00.533207 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-dd2ed447-6621-4f4a-9211-5aad005dc377 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Going to try to terminate instance {{(pid=124643) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:22:00.831420 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-dd2ed447-6621-4f4a-9211-5aad005dc377 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 204 len: 0 microversion: 2.1 time: 0.339045 Aug 10 13:22:00.832029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2014/3719] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 13:22:00 2022] DELETE /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 13:22:00.930962 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-44740627-bd5e-4348-957e-577a5fafeec8 req-47c02eda-51f8-43ba-917c-472f3bb7582b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4131b7e-9198-48f7-a8f5-86d691d37c11", "tag": "bdc043f9-2aa5-46cf-83d0-1101d7125972"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:22:00.941008 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-44740627-bd5e-4348-957e-577a5fafeec8 req-47c02eda-51f8-43ba-917c-472f3bb7582b service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:22:00.941493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-44740627-bd5e-4348-957e-577a5fafeec8 req-47c02eda-51f8-43ba-917c-472f3bb7582b service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:22:00.941925 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-44740627-bd5e-4348-957e-577a5fafeec8 req-47c02eda-51f8-43ba-917c-472f3bb7582b service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:22:00.953476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-44740627-bd5e-4348-957e-577a5fafeec8 req-47c02eda-51f8-43ba-917c-472f3bb7582b service nova] Creating event network-changed:bdc043f9-2aa5-46cf-83d0-1101d7125972 for instance d4131b7e-9198-48f7-a8f5-86d691d37c11 on hv-cinder-85199 Aug 10 13:22:00.958641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-44740627-bd5e-4348-957e-577a5fafeec8 req-47c02eda-51f8-43ba-917c-472f3bb7582b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125199 Aug 10 13:22:00.959278 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2015/3720] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:22:00.964515 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2b86e7a7-4599-4eb8-be01-0caa8c829009 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:22:00.965234 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2b86e7a7-4599-4eb8-be01-0caa8c829009 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:22:00.972184 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b86e7a7-4599-4eb8-be01-0caa8c829009 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:22:00.972759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b86e7a7-4599-4eb8-be01-0caa8c829009 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:22:00.973084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b86e7a7-4599-4eb8-be01-0caa8c829009 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:22:00.973770 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b86e7a7-4599-4eb8-be01-0caa8c829009 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:22:00.974481 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b86e7a7-4599-4eb8-be01-0caa8c829009 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:22:00.974896 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2b86e7a7-4599-4eb8-be01-0caa8c829009 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:22:01.190552 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2b86e7a7-4599-4eb8-be01-0caa8c829009 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:22:01.198212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2b86e7a7-4599-4eb8-be01-0caa8c829009 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1566 microversion: 2.1 time: 0.237803 Aug 10 13:22:01.198781 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2016/3721] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:22:00 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1566 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:22:02.221959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4daf7025-02be-4b8f-b314-b69638ee2052 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:22:02.221959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4daf7025-02be-4b8f-b314-b69638ee2052 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:22:02.228193 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4daf7025-02be-4b8f-b314-b69638ee2052 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:22:02.228748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4daf7025-02be-4b8f-b314-b69638ee2052 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:22:02.229184 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4daf7025-02be-4b8f-b314-b69638ee2052 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:22:02.229872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4daf7025-02be-4b8f-b314-b69638ee2052 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:22:02.230319 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4daf7025-02be-4b8f-b314-b69638ee2052 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:22:02.230741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4daf7025-02be-4b8f-b314-b69638ee2052 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:22:02.441934 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4daf7025-02be-4b8f-b314-b69638ee2052 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:22:02.452731 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4daf7025-02be-4b8f-b314-b69638ee2052 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1566 microversion: 2.1 time: 0.235983 Aug 10 13:22:02.459315 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2017/3722] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:22:02 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1566 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:22:02.974688 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-46bd0518-a280-4fe7-b92b-2f74d1540581 req-22f10300-a468-4008-8a7c-8119e6f3d9d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4131b7e-9198-48f7-a8f5-86d691d37c11", "name": "network-vif-deleted", "tag": "bdc043f9-2aa5-46cf-83d0-1101d7125972"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:22:02.984456 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-46bd0518-a280-4fe7-b92b-2f74d1540581 req-22f10300-a468-4008-8a7c-8119e6f3d9d2 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:22:02.989021 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-46bd0518-a280-4fe7-b92b-2f74d1540581 req-22f10300-a468-4008-8a7c-8119e6f3d9d2 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:22:02.989021 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-46bd0518-a280-4fe7-b92b-2f74d1540581 req-22f10300-a468-4008-8a7c-8119e6f3d9d2 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:22:02.996256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-46bd0518-a280-4fe7-b92b-2f74d1540581 req-22f10300-a468-4008-8a7c-8119e6f3d9d2 service nova] Creating event network-vif-deleted:bdc043f9-2aa5-46cf-83d0-1101d7125972 for instance d4131b7e-9198-48f7-a8f5-86d691d37c11 on hv-cinder-85199 Aug 10 13:22:03.002409 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-46bd0518-a280-4fe7-b92b-2f74d1540581 req-22f10300-a468-4008-8a7c-8119e6f3d9d2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031671 Aug 10 13:22:03.002982 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2018/3723] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:22:03.475198 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d53b488c-dd7a-4c86-8b83-850896620b8f tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:22:03.475872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d53b488c-dd7a-4c86-8b83-850896620b8f tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:22:03.481973 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d53b488c-dd7a-4c86-8b83-850896620b8f tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:22:03.482446 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d53b488c-dd7a-4c86-8b83-850896620b8f tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:22:03.482874 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d53b488c-dd7a-4c86-8b83-850896620b8f tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:22:03.483583 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d53b488c-dd7a-4c86-8b83-850896620b8f tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:22:03.484109 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d53b488c-dd7a-4c86-8b83-850896620b8f tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:22:03.484566 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-d53b488c-dd7a-4c86-8b83-850896620b8f tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:22:03.547794 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d53b488c-dd7a-4c86-8b83-850896620b8f tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40c6361443a14e9ebd71855ba11cee10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874b1e036b34f9188b4b5b003d59742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:22:03.555530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d53b488c-dd7a-4c86-8b83-850896620b8f tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 200 len: 1219 microversion: 2.1 time: 0.085158 Aug 10 13:22:03.556295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2019/3724] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:22:03 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:22:04.576889 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-583101ae-e868-413c-81f5-b488d175d768 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:22:04.578180 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-583101ae-e868-413c-81f5-b488d175d768 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] [instance: d4131b7e-9198-48f7-a8f5-86d691d37c11] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:22:04.584547 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-583101ae-e868-413c-81f5-b488d175d768 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:22:04.585026 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-583101ae-e868-413c-81f5-b488d175d768 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:22:04.585456 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-583101ae-e868-413c-81f5-b488d175d768 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:22:04.586139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-583101ae-e868-413c-81f5-b488d175d768 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:22:04.586587 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-583101ae-e868-413c-81f5-b488d175d768 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:22:04.587011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-583101ae-e868-413c-81f5-b488d175d768 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:22:04.600879 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-583101ae-e868-413c-81f5-b488d175d768 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] HTTP exception thrown: Instance d4131b7e-9198-48f7-a8f5-86d691d37c11 could not be found. Aug 10 13:22:04.604872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-583101ae-e868-413c-81f5-b488d175d768 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Request method failure captured: Aug 10 13:22:04.604872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 HTTP/1.1 Aug 10 13:22:04.604872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:22:04.604872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:22:04.604872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:22:04.604872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:22:04.604872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:22:04.604872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:22:04.604872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:22:04.604872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:22:04.604872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86_Tt8-R5isdeAyiaWPNyK3VuSa_IGDVZGOyAkY2l31csFsXwdvb8UT36rH_S9nnkU-dgl8BVu12ILHts0Kr5nuTGvFeFc70dwOQR5E1_OH9fnJI9HVUg49WwTb09EI3_1N4UPminM6iZ8nYzl3-LNX33wl0Lz2HL8vN7RoCSlWsiuA Aug 10 13:22:04.604872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:22:04.604872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:22:04.604872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:22:04.604872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:22:04.604872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:22:04.604872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:22:04.604872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: 0874b1e036b34f9188b4b5b003d59742 Aug 10 13:22:04.604872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-TestShelveInstance-1011863809 Aug 10 13:22:04.604872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:22:04.604872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:22:04.606530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0874b1e036b34f9188b4b5b003d59742"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0874b1e036b34f9188b4b5b003d59742", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0874b1e036b34f9188b4b5b003d59742"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0874b1e036b34f9188b4b5b003d59742"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:22:04.606530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-TestShelveInstance-1011863809 Aug 10 13:22:04.606530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: 0874b1e036b34f9188b4b5b003d59742 Aug 10 13:22:04.606530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-TestShelveInstance-1011863809 Aug 10 13:22:04.606530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-TestShelveInstance-1011863809-project Aug 10 13:22:04.606530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:22:04.606530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:22:04.606530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 40c6361443a14e9ebd71855ba11cee10 Aug 10 13:22:04.606530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-TestShelveInstance-1011863809-project Aug 10 13:22:04.606530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:22:04.606530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance d4131b7e-9198-48f7-a8f5-86d691d37c11 could not be found. Aug 10 13:22:04.606530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': 'd4131b7e-9198-48f7-a8f5-86d691d37c11'} Aug 10 13:22:04.607535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:22:04.607535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:04.607535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:22:04.607535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:22:04.607535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:22:04.607535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:22:04.607535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:22:04.607535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:22:04.607535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:22:04.607535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:22:04.607535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4131b7e-9198-48f7-a8f5-86d691d37c11 could not be found. Aug 10 13:22:04.607535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:04.607535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:22:04.607535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:04.607535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:04.607535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:22:04.607535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:22:04.607535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:22:04.607535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:22:04.607535 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:22:04.609010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:22:04.609010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:22:04.609010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:22:04.609010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:22:04.609010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:22:04.609010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:22:04.609010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:22:04.609010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4131b7e-9198-48f7-a8f5-86d691d37c11 could not be found. Aug 10 13:22:04.609010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:04.609010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:22:04.609010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:04.609010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:04.609010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:22:04.609010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:22:04.609010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:22:04.609010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:22:04.609010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4131b7e-9198-48f7-a8f5-86d691d37c11 could not be found. Aug 10 13:22:04.609010 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:04.610855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-583101ae-e868-413c-81f5-b488d175d768 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Returning 404 to user: Instance d4131b7e-9198-48f7-a8f5-86d691d37c11 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:22:04.610855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-583101ae-e868-413c-81f5-b488d175d768 tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11" status: 404 len: 111 microversion: 2.1 time: 0.030999 Aug 10 13:22:04.610855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2020/3725] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:22:04 2022] GET /compute/v2.1/servers/d4131b7e-9198-48f7-a8f5-86d691d37c11 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:22:04.853494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-9d43b558-a443-4daa-9da7-4d71b05013cc tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] Calling method '.version_select at 0x7fb82690a820>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:22:04.940994 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-9d43b558-a443-4daa-9da7-4d71b05013cc tempest-TestShelveInstance-1011863809 tempest-TestShelveInstance-1011863809-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-591943327" status: 202 len: 0 microversion: 2.1 time: 0.091706 Aug 10 13:22:04.941575 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2021/3726] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 10 13:22:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-591943327 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 13:22:14.019007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5debbb17-d227-4cb2-8f25-3ae1022defee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:22:14.019816 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5debbb17-d227-4cb2-8f25-3ae1022defee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:22:14.027358 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5debbb17-d227-4cb2-8f25-3ae1022defee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:22:14.031311 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5debbb17-d227-4cb2-8f25-3ae1022defee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:22:14.031311 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5debbb17-d227-4cb2-8f25-3ae1022defee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:22:14.031311 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5debbb17-d227-4cb2-8f25-3ae1022defee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:22:14.031311 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5debbb17-d227-4cb2-8f25-3ae1022defee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:22:14.031681 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5debbb17-d227-4cb2-8f25-3ae1022defee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:22:14.043137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-5debbb17-d227-4cb2-8f25-3ae1022defee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] HTTP exception thrown: Instance 88f016f1-19e1-466c-9e03-5a125f281e25 could not be found. Aug 10 13:22:14.044722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5debbb17-d227-4cb2-8f25-3ae1022defee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Request method failure captured: Aug 10 13:22:14.044722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: DELETE /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 HTTP/1.1 Aug 10 13:22:14.044722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:22:14.044722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:22:14.044722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:22:14.044722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:22:14.044722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:22:14.044722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:22:14.044722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:22:14.044722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:22:14.044722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86eFpMON8wdE-yxypJwKTycnvglCVNPmJYB2havXvPuGSL70SB9u4OgBlHEmwN-ZmdL8944lFIdJdiXf2m6aCIObrjBrWtBJyWznOqNQqePelDp02UcmMUpKpytdCWxlJCiNWB04oQyd3S6x9pv8bL9Qv0OAgLIp1MbIeEKFdB9gQ1g Aug 10 13:22:14.044722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:22:14.044722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:22:14.044722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:22:14.044722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:22:14.044722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:22:14.044722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:22:14.044722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: 9a40b36dd9944cb88fd54181f7f29685 Aug 10 13:22:14.044722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-AttachVolumeTestJSON-1341079228 Aug 10 13:22:14.044722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:22:14.044722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:22:14.046137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9a40b36dd9944cb88fd54181f7f29685"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9a40b36dd9944cb88fd54181f7f29685", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9a40b36dd9944cb88fd54181f7f29685"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9a40b36dd9944cb88fd54181f7f29685"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:22:14.046137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-AttachVolumeTestJSON-1341079228 Aug 10 13:22:14.046137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: 9a40b36dd9944cb88fd54181f7f29685 Aug 10 13:22:14.046137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1341079228 Aug 10 13:22:14.046137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-AttachVolumeTestJSON-1341079228-project Aug 10 13:22:14.046137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:22:14.046137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:22:14.046137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: c0ada1accf1742b393e8a12c60074b9e Aug 10 13:22:14.046137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-AttachVolumeTestJSON-1341079228-project Aug 10 13:22:14.046137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:22:14.046137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance 88f016f1-19e1-466c-9e03-5a125f281e25 could not be found. Aug 10 13:22:14.046137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': '88f016f1-19e1-466c-9e03-5a125f281e25'} Aug 10 13:22:14.047022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:22:14.047022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:14.047022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:22:14.047022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:22:14.047022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:22:14.047022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:22:14.047022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:22:14.047022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:22:14.047022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:22:14.047022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:22:14.047022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88f016f1-19e1-466c-9e03-5a125f281e25 could not be found. Aug 10 13:22:14.047022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:14.047022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:22:14.047022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:14.047022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:14.047022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:22:14.047022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:22:14.047022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:22:14.047022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:22:14.047022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:22:14.053114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:22:14.053114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 13:22:14.053114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 13:22:14.053114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 13:22:14.053114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 13:22:14.053114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:22:14.053114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:22:14.053114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:22:14.053114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:22:14.053114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88f016f1-19e1-466c-9e03-5a125f281e25 could not be found. Aug 10 13:22:14.053114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:14.053114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:22:14.053114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:14.053114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:14.053114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:22:14.053114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:22:14.053114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:22:14.053114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:22:14.053114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88f016f1-19e1-466c-9e03-5a125f281e25 could not be found. Aug 10 13:22:14.053114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:14.054511 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5debbb17-d227-4cb2-8f25-3ae1022defee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Returning 404 to user: Instance 88f016f1-19e1-466c-9e03-5a125f281e25 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:22:14.054511 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5debbb17-d227-4cb2-8f25-3ae1022defee tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "DELETE /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 404 len: 111 microversion: 2.1 time: 0.031756 Aug 10 13:22:14.054511 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2022/3727] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 13:22:14 2022] DELETE /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:22:14.054747 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-01cc1d42-ef07-48e2-bb95-190938395fdf tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:22:14.055317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-01cc1d42-ef07-48e2-bb95-190938395fdf tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] [instance: 88f016f1-19e1-466c-9e03-5a125f281e25] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:22:14.061426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01cc1d42-ef07-48e2-bb95-190938395fdf tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:22:14.062617 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01cc1d42-ef07-48e2-bb95-190938395fdf tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:22:14.063338 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01cc1d42-ef07-48e2-bb95-190938395fdf tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:22:14.064290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01cc1d42-ef07-48e2-bb95-190938395fdf tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:22:14.064754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01cc1d42-ef07-48e2-bb95-190938395fdf tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:22:14.065214 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01cc1d42-ef07-48e2-bb95-190938395fdf tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:22:14.079549 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-01cc1d42-ef07-48e2-bb95-190938395fdf tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] HTTP exception thrown: Instance 88f016f1-19e1-466c-9e03-5a125f281e25 could not be found. Aug 10 13:22:14.081223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-01cc1d42-ef07-48e2-bb95-190938395fdf tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Request method failure captured: Aug 10 13:22:14.081223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 HTTP/1.1 Aug 10 13:22:14.081223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:22:14.081223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:22:14.081223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:22:14.081223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:22:14.081223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:22:14.081223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:22:14.081223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:22:14.081223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:22:14.081223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi86eFpMON8wdE-yxypJwKTycnvglCVNPmJYB2havXvPuGSL70SB9u4OgBlHEmwN-ZmdL8944lFIdJdiXf2m6aCIObrjBrWtBJyWznOqNQqePelDp02UcmMUpKpytdCWxlJCiNWB04oQyd3S6x9pv8bL9Qv0OAgLIp1MbIeEKFdB9gQ1g Aug 10 13:22:14.081223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:22:14.081223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:22:14.081223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:22:14.081223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:22:14.081223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:22:14.081223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:22:14.081223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: 9a40b36dd9944cb88fd54181f7f29685 Aug 10 13:22:14.081223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-AttachVolumeTestJSON-1341079228 Aug 10 13:22:14.081223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:22:14.081223 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:22:14.082451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9a40b36dd9944cb88fd54181f7f29685"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9a40b36dd9944cb88fd54181f7f29685", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9a40b36dd9944cb88fd54181f7f29685"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9a40b36dd9944cb88fd54181f7f29685"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:22:14.082451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-AttachVolumeTestJSON-1341079228 Aug 10 13:22:14.082451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: 9a40b36dd9944cb88fd54181f7f29685 Aug 10 13:22:14.082451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1341079228 Aug 10 13:22:14.082451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-AttachVolumeTestJSON-1341079228-project Aug 10 13:22:14.082451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:22:14.082451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:22:14.082451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: c0ada1accf1742b393e8a12c60074b9e Aug 10 13:22:14.082451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-AttachVolumeTestJSON-1341079228-project Aug 10 13:22:14.082451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:22:14.082451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance 88f016f1-19e1-466c-9e03-5a125f281e25 could not be found. Aug 10 13:22:14.082451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': '88f016f1-19e1-466c-9e03-5a125f281e25'} Aug 10 13:22:14.083137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:22:14.083137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:14.083137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:22:14.083137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:22:14.083137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:22:14.083137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:22:14.083137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:22:14.083137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:22:14.083137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:22:14.083137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:22:14.083137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88f016f1-19e1-466c-9e03-5a125f281e25 could not be found. Aug 10 13:22:14.083137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:14.083137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:22:14.083137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:14.083137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:14.083137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:22:14.083137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:22:14.083137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:22:14.083137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:22:14.083137 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:22:14.084280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:22:14.084280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:22:14.084280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:22:14.084280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:22:14.084280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:22:14.084280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:22:14.084280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:22:14.084280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88f016f1-19e1-466c-9e03-5a125f281e25 could not be found. Aug 10 13:22:14.084280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:14.084280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:22:14.084280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:14.084280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:14.084280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:22:14.084280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:22:14.084280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:22:14.084280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:22:14.084280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88f016f1-19e1-466c-9e03-5a125f281e25 could not be found. Aug 10 13:22:14.084280 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:14.085372 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-01cc1d42-ef07-48e2-bb95-190938395fdf tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] Returning 404 to user: Instance 88f016f1-19e1-466c-9e03-5a125f281e25 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:22:14.085372 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-01cc1d42-ef07-48e2-bb95-190938395fdf tempest-AttachVolumeTestJSON-1341079228 tempest-AttachVolumeTestJSON-1341079228-project] 10.222.0.49 "GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25" status: 404 len: 111 microversion: 2.1 time: 0.031751 Aug 10 13:22:14.085372 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2023/3728] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:22:14 2022] GET /compute/v2.1/servers/88f016f1-19e1-466c-9e03-5a125f281e25 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:22:19.629470 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c242ae79-51e9-4d75-81ad-bbcfc7e6931e tempest-VolumesNegativeTest-227218831 tempest-VolumesNegativeTest-227218831-project] Action: 'create', calling method: .version_select at 0x7fb826acc430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1662140354", "metadata": {"Type": "work"}}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:22:19.653496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c242ae79-51e9-4d75-81ad-bbcfc7e6931e tempest-VolumesNegativeTest-227218831 tempest-VolumesNegativeTest-227218831-project] Request method failure captured: Aug 10 13:22:19.653496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 13:22:19.653496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:22:19.653496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:22:19.653496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:22:19.653496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 122 Aug 10 13:22:19.653496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:22:19.653496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:22:19.653496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:22:19.653496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:22:19.653496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi87ELbj7lLwPGoKYl1uW3inmqB7wH2MmooD0KyVRNQOggji67nd5gqQ2SVdOxlWfOUcWxfGGmjiVVtUsEx6idrrBWEZTdouqrB6ZTDEAth2PqO53uCt68zyx1ZGOvSZY2Z2STk-gvzGfS8c0KaONnxa6tDSLjzX5WxZSa3rSnZ0JPvUo Aug 10 13:22:19.653496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:22:19.653496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:22:19.653496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:22:19.653496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:22:19.653496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:22:19.653496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:22:19.653496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: 97f38fc27a764f499abdd2133d0c4a4b Aug 10 13:22:19.653496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-VolumesNegativeTest-227218831 Aug 10 13:22:19.653496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:22:19.653496 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:22:19.655023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/97f38fc27a764f499abdd2133d0c4a4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_97f38fc27a764f499abdd2133d0c4a4b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/97f38fc27a764f499abdd2133d0c4a4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/97f38fc27a764f499abdd2133d0c4a4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:22:19.655023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-VolumesNegativeTest-227218831 Aug 10 13:22:19.655023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: 97f38fc27a764f499abdd2133d0c4a4b Aug 10 13:22:19.655023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-VolumesNegativeTest-227218831 Aug 10 13:22:19.655023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-VolumesNegativeTest-227218831-project Aug 10 13:22:19.655023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:22:19.655023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:22:19.655023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 5d17c654bade41c58d2c34372bee5adf Aug 10 13:22:19.655023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-VolumesNegativeTest-227218831-project Aug 10 13:22:19.655023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Aug 10 13:22:19.655023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1662140354", "metadata": {"Type": "work"}}} Aug 10 13:22:19.655023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: Aug 10 13:22:19.655023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 13:22:19.656856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1662140354', 'metadata': {'Type': 'work'}}}} Aug 10 13:22:19.656856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:22:19.656856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:19.656856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 13:22:19.656856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 13:22:19.656856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 13:22:19.656856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise error Aug 10 13:22:19.656856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 10 13:22:19.656856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.656856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 13:22:19.656856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 13:22:19.656856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.656856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 13:22:19.656856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi '#$%' Aug 10 13:22:19.656856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.656856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:22:19.656856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.656856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:19.656856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:22:19.656856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:22:19.656856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:22:19.656856 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:22:19.658997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 13:22:19.658997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 13:22:19.658997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:22:19.658997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:22:19.658997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 13:22:19.658997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 13:22:19.658997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 13:22:19.658997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 13:22:19.658997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 13:22:19.658997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 13:22:19.658997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 13:22:19.658997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.658997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:22:19.658997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.658997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:19.658997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:22:19.658997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:22:19.658997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 13:22:19.658997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 13:22:19.663584 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 13:22:19.663584 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.663584 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c242ae79-51e9-4d75-81ad-bbcfc7e6931e tempest-VolumesNegativeTest-227218831 tempest-VolumesNegativeTest-227218831-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:22:19.663584 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c242ae79-51e9-4d75-81ad-bbcfc7e6931e tempest-VolumesNegativeTest-227218831 tempest-VolumesNegativeTest-227218831-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.153728 Aug 10 13:22:19.663584 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2024/3729] 10.222.0.49 () {60 vars in 1156 bytes} [Wed Aug 10 13:22:19 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 13:22:19.665661 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-cf67ed01-60a3-423d-8aab-69177f8390a0 tempest-VolumesNegativeTest-227218831 tempest-VolumesNegativeTest-227218831-project] Action: 'create', calling method: .version_select at 0x7fb8268dc5e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1275047191", "metadata": {"Type": "work"}}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:22:19.670200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-cf67ed01-60a3-423d-8aab-69177f8390a0 tempest-VolumesNegativeTest-227218831 tempest-VolumesNegativeTest-227218831-project] Request method failure captured: Aug 10 13:22:19.670200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 13:22:19.670200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:22:19.670200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:22:19.670200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:22:19.670200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 120 Aug 10 13:22:19.670200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:22:19.670200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:22:19.670200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:22:19.670200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:22:19.670200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi87ELbj7lLwPGoKYl1uW3inmqB7wH2MmooD0KyVRNQOggji67nd5gqQ2SVdOxlWfOUcWxfGGmjiVVtUsEx6idrrBWEZTdouqrB6ZTDEAth2PqO53uCt68zyx1ZGOvSZY2Z2STk-gvzGfS8c0KaONnxa6tDSLjzX5WxZSa3rSnZ0JPvUo Aug 10 13:22:19.670200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:22:19.670200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:22:19.670200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:22:19.670200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:22:19.670200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:22:19.670200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:22:19.670200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: 97f38fc27a764f499abdd2133d0c4a4b Aug 10 13:22:19.670200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-VolumesNegativeTest-227218831 Aug 10 13:22:19.670200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:22:19.670200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:22:19.671751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/97f38fc27a764f499abdd2133d0c4a4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_97f38fc27a764f499abdd2133d0c4a4b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/97f38fc27a764f499abdd2133d0c4a4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/97f38fc27a764f499abdd2133d0c4a4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:22:19.671751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-VolumesNegativeTest-227218831 Aug 10 13:22:19.671751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: 97f38fc27a764f499abdd2133d0c4a4b Aug 10 13:22:19.671751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-VolumesNegativeTest-227218831 Aug 10 13:22:19.671751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-VolumesNegativeTest-227218831-project Aug 10 13:22:19.671751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:22:19.671751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:22:19.671751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 5d17c654bade41c58d2c34372bee5adf Aug 10 13:22:19.671751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-VolumesNegativeTest-227218831-project Aug 10 13:22:19.671751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Aug 10 13:22:19.671751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1275047191", "metadata": {"Type": "work"}}} Aug 10 13:22:19.671751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: Aug 10 13:22:19.671751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 13:22:19.672800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1275047191', 'metadata': {'Type': 'work'}}}} Aug 10 13:22:19.672800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:22:19.672800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:19.672800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 13:22:19.672800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 13:22:19.672800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 13:22:19.672800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise error Aug 10 13:22:19.672800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 10 13:22:19.672800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.672800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 10 13:22:19.672800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 13:22:19.672800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.672800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 13:22:19.672800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi '0' Aug 10 13:22:19.672800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.672800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:22:19.672800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.672800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:19.672800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:22:19.672800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:22:19.672800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:22:19.672800 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:22:19.674238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 13:22:19.674238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 13:22:19.674238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:22:19.674238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:22:19.674238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 13:22:19.674238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 13:22:19.674238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 13:22:19.674238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 13:22:19.674238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 13:22:19.674238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 13:22:19.674238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 13:22:19.674238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.674238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:22:19.674238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.674238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:19.674238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:22:19.674238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:22:19.674238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 13:22:19.674238 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 13:22:19.675851 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 13:22:19.675851 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.675851 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-cf67ed01-60a3-423d-8aab-69177f8390a0 tempest-VolumesNegativeTest-227218831 tempest-VolumesNegativeTest-227218831-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:22:19.675851 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-cf67ed01-60a3-423d-8aab-69177f8390a0 tempest-VolumesNegativeTest-227218831 tempest-VolumesNegativeTest-227218831-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009762 Aug 10 13:22:19.675851 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2025/3730] 10.222.0.49 () {60 vars in 1156 bytes} [Wed Aug 10 13:22:19 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 13:22:19.684729 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e3718bb2-503c-474a-bd21-d2f5abb8a199 tempest-VolumesNegativeTest-227218831 tempest-VolumesNegativeTest-227218831-project] Action: 'create', calling method: .version_select at 0x7fb826a4c700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1451646739", "metadata": {"Type": "work"}}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:22:19.688298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e3718bb2-503c-474a-bd21-d2f5abb8a199 tempest-VolumesNegativeTest-227218831 tempest-VolumesNegativeTest-227218831-project] Request method failure captured: Aug 10 13:22:19.688298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 13:22:19.688298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:22:19.688298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:22:19.688298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:22:19.688298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 119 Aug 10 13:22:19.688298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:22:19.688298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:22:19.688298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:22:19.688298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:22:19.688298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi87ELbj7lLwPGoKYl1uW3inmqB7wH2MmooD0KyVRNQOggji67nd5gqQ2SVdOxlWfOUcWxfGGmjiVVtUsEx6idrrBWEZTdouqrB6ZTDEAth2PqO53uCt68zyx1ZGOvSZY2Z2STk-gvzGfS8c0KaONnxa6tDSLjzX5WxZSa3rSnZ0JPvUo Aug 10 13:22:19.688298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:22:19.688298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:22:19.688298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:22:19.688298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:22:19.688298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:22:19.688298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:22:19.688298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: 97f38fc27a764f499abdd2133d0c4a4b Aug 10 13:22:19.688298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-VolumesNegativeTest-227218831 Aug 10 13:22:19.688298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:22:19.688298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:22:19.689788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/97f38fc27a764f499abdd2133d0c4a4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_97f38fc27a764f499abdd2133d0c4a4b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/97f38fc27a764f499abdd2133d0c4a4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/97f38fc27a764f499abdd2133d0c4a4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:22:19.689788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-VolumesNegativeTest-227218831 Aug 10 13:22:19.689788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: 97f38fc27a764f499abdd2133d0c4a4b Aug 10 13:22:19.689788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-VolumesNegativeTest-227218831 Aug 10 13:22:19.689788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-VolumesNegativeTest-227218831-project Aug 10 13:22:19.689788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:22:19.689788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:22:19.689788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 5d17c654bade41c58d2c34372bee5adf Aug 10 13:22:19.689788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-VolumesNegativeTest-227218831-project Aug 10 13:22:19.689788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Aug 10 13:22:19.689788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1451646739", "metadata": {"Type": "work"}}} Aug 10 13:22:19.689788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: Aug 10 13:22:19.689788 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 13:22:19.690766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1451646739', 'metadata': {'Type': 'work'}}}} Aug 10 13:22:19.690766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:22:19.690766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:19.690766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 13:22:19.690766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 13:22:19.690766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 13:22:19.690766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise error Aug 10 13:22:19.690766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 10 13:22:19.690766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.690766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 13:22:19.690766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 13:22:19.690766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.690766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 13:22:19.690766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi '' Aug 10 13:22:19.690766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.690766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:22:19.690766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.690766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:19.690766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:22:19.690766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:22:19.690766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:22:19.690766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:22:19.693162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 13:22:19.693162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 13:22:19.693162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:22:19.693162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:22:19.693162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 13:22:19.693162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 13:22:19.693162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 13:22:19.693162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 13:22:19.693162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 13:22:19.693162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 13:22:19.693162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 13:22:19.693162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.693162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:22:19.693162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.693162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:19.693162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:22:19.693162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:22:19.693162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 13:22:19.693162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 13:22:19.694326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 13:22:19.694326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.694326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e3718bb2-503c-474a-bd21-d2f5abb8a199 tempest-VolumesNegativeTest-227218831 tempest-VolumesNegativeTest-227218831-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:22:19.694326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e3718bb2-503c-474a-bd21-d2f5abb8a199 tempest-VolumesNegativeTest-227218831 tempest-VolumesNegativeTest-227218831-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008703 Aug 10 13:22:19.694326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2026/3731] 10.222.0.49 () {60 vars in 1156 bytes} [Wed Aug 10 13:22:19 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 13:22:19.699894 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a389f7f4-488d-4abd-b414-fe31f5b3f81e tempest-VolumesNegativeTest-227218831 tempest-VolumesNegativeTest-227218831-project] Calling method '.version_select at 0x7fb826b0a1f0>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:22:19.731120 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-a389f7f4-488d-4abd-b414-fe31f5b3f81e tempest-VolumesNegativeTest-227218831 tempest-VolumesNegativeTest-227218831-project] HTTP exception thrown: Volume tempest-invalid-783274222 could not be found. Aug 10 13:22:19.733114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a389f7f4-488d-4abd-b414-fe31f5b3f81e tempest-VolumesNegativeTest-227218831 tempest-VolumesNegativeTest-227218831-project] Request method failure captured: Aug 10 13:22:19.733114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-783274222 HTTP/1.1 Aug 10 13:22:19.733114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:22:19.733114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:22:19.733114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:22:19.733114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:22:19.733114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:22:19.733114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:22:19.733114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:22:19.733114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:22:19.733114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi87ELbj7lLwPGoKYl1uW3inmqB7wH2MmooD0KyVRNQOggji67nd5gqQ2SVdOxlWfOUcWxfGGmjiVVtUsEx6idrrBWEZTdouqrB6ZTDEAth2PqO53uCt68zyx1ZGOvSZY2Z2STk-gvzGfS8c0KaONnxa6tDSLjzX5WxZSa3rSnZ0JPvUo Aug 10 13:22:19.733114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:22:19.733114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:22:19.733114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:22:19.733114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:22:19.733114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:22:19.733114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:22:19.733114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: 97f38fc27a764f499abdd2133d0c4a4b Aug 10 13:22:19.733114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-VolumesNegativeTest-227218831 Aug 10 13:22:19.733114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:22:19.733114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:22:19.734403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/97f38fc27a764f499abdd2133d0c4a4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_97f38fc27a764f499abdd2133d0c4a4b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/97f38fc27a764f499abdd2133d0c4a4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/97f38fc27a764f499abdd2133d0c4a4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:22:19.734403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-VolumesNegativeTest-227218831 Aug 10 13:22:19.734403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: 97f38fc27a764f499abdd2133d0c4a4b Aug 10 13:22:19.734403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-VolumesNegativeTest-227218831 Aug 10 13:22:19.734403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-VolumesNegativeTest-227218831-project Aug 10 13:22:19.734403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:22:19.734403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:22:19.734403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 5d17c654bade41c58d2c34372bee5adf Aug 10 13:22:19.734403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-VolumesNegativeTest-227218831-project Aug 10 13:22:19.734403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: Aug 10 13:22:19.734403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Volume tempest-invalid-783274222 could not be found. Aug 10 13:22:19.734403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': 'tempest-invalid-783274222'} Aug 10 13:22:19.734403 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:22:19.735131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:19.735131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:22:19.735131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:22:19.735131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 13:22:19.735131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 13:22:19.735131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 13:22:19.735131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 13:22:19.735131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 13:22:19.735131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 13:22:19.735131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 13:22:19.735131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 13:22:19.735131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:22:19.735131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:22:19.735131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:22:19.735131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:22:19.735131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-783274222 could not be found. (HTTP 404) (Request-ID: req-af1ca57f-26b0-424d-beac-27f9e378a3af) Aug 10 13:22:19.735131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.735131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:22:19.735131 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.736808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:19.736808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 13:22:19.736808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 13:22:19.736808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 13:22:19.736808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 13:22:19.736808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 13:22:19.736808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 13:22:19.736808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 13:22:19.736808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 13:22:19.736808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:22:19.736808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:22:19.736808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 13:22:19.736808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 13:22:19.736808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 13:22:19.736808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 13:22:19.736808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 13:22:19.736808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 13:22:19.736808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 13:22:19.736808 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 13:22:19.738633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:22:19.738633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:22:19.738633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:22:19.738633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:22:19.738633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-783274222 could not be found. Aug 10 13:22:19.738633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.738633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:22:19.738633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.738633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:19.738633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:22:19.738633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:22:19.738633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:22:19.738633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:22:19.738633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 13:22:19.738633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 13:22:19.738633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:22:19.738633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:22:19.738633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 13:22:19.738633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:22:19.738633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-783274222 could not be found. Aug 10 13:22:19.740722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.740722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:22:19.740722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.740722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:19.740722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:22:19.740722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:22:19.740722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:22:19.740722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:22:19.740722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-783274222 could not be found. Aug 10 13:22:19.740722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.740722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a389f7f4-488d-4abd-b414-fe31f5b3f81e tempest-VolumesNegativeTest-227218831 tempest-VolumesNegativeTest-227218831-project] Returning 404 to user: Volume tempest-invalid-783274222 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:22:19.740722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a389f7f4-488d-4abd-b414-fe31f5b3f81e tempest-VolumesNegativeTest-227218831 tempest-VolumesNegativeTest-227218831-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-783274222" status: 404 len: 98 microversion: 2.1 time: 0.039504 Aug 10 13:22:19.740722 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2027/3732] 10.222.0.49 () {58 vars in 1215 bytes} [Wed Aug 10 13:22:19 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-783274222 => generated 98 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 10 13:22:19.744929 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4738c162-f3d0-442d-bb8f-543719994995 tempest-VolumesNegativeTest-227218831 tempest-VolumesNegativeTest-227218831-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003857 Aug 10 13:22:19.745430 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2028/3733] 10.222.0.49 () {58 vars in 1140 bytes} [Wed Aug 10 13:22:19 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 13:22:19.754292 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7e9d9e36-ab3a-4756-83c5-0e94a071f8c4 tempest-VolumesNegativeTest-227218831 tempest-VolumesNegativeTest-227218831-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003584 Aug 10 13:22:19.754782 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2029/3734] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 10 13:22:19 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 10 13:22:19.762390 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e1fc9c70-4043-4277-a8c8-cb5bfa26982d tempest-VolumesNegativeTest-227218831 tempest-VolumesNegativeTest-227218831-project] Calling method '.version_select at 0x7fb826a5c9d0>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:22:19.792117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-e1fc9c70-4043-4277-a8c8-cb5bfa26982d tempest-VolumesNegativeTest-227218831 tempest-VolumesNegativeTest-227218831-project] HTTP exception thrown: Volume 40cdfd43-de96-4d00-a401-88fafcc708f5 could not be found. Aug 10 13:22:19.794059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e1fc9c70-4043-4277-a8c8-cb5bfa26982d tempest-VolumesNegativeTest-227218831 tempest-VolumesNegativeTest-227218831-project] Request method failure captured: Aug 10 13:22:19.794059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: DELETE /compute/v2.1/os-volumes/40cdfd43-de96-4d00-a401-88fafcc708f5 HTTP/1.1 Aug 10 13:22:19.794059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:22:19.794059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:22:19.794059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:22:19.794059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:22:19.794059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:22:19.794059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:22:19.794059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:22:19.794059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:22:19.794059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi87ELbj7lLwPGoKYl1uW3inmqB7wH2MmooD0KyVRNQOggji67nd5gqQ2SVdOxlWfOUcWxfGGmjiVVtUsEx6idrrBWEZTdouqrB6ZTDEAth2PqO53uCt68zyx1ZGOvSZY2Z2STk-gvzGfS8c0KaONnxa6tDSLjzX5WxZSa3rSnZ0JPvUo Aug 10 13:22:19.794059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:22:19.794059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:22:19.794059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:22:19.794059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:22:19.794059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:22:19.794059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:22:19.794059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: 97f38fc27a764f499abdd2133d0c4a4b Aug 10 13:22:19.794059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-VolumesNegativeTest-227218831 Aug 10 13:22:19.794059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:22:19.794059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:22:19.795476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/97f38fc27a764f499abdd2133d0c4a4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_97f38fc27a764f499abdd2133d0c4a4b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/97f38fc27a764f499abdd2133d0c4a4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/97f38fc27a764f499abdd2133d0c4a4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:22:19.795476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-VolumesNegativeTest-227218831 Aug 10 13:22:19.795476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: 97f38fc27a764f499abdd2133d0c4a4b Aug 10 13:22:19.795476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-VolumesNegativeTest-227218831 Aug 10 13:22:19.795476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-VolumesNegativeTest-227218831-project Aug 10 13:22:19.795476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:22:19.795476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:22:19.795476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 5d17c654bade41c58d2c34372bee5adf Aug 10 13:22:19.795476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-VolumesNegativeTest-227218831-project Aug 10 13:22:19.795476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: Aug 10 13:22:19.795476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Volume 40cdfd43-de96-4d00-a401-88fafcc708f5 could not be found. Aug 10 13:22:19.795476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': '40cdfd43-de96-4d00-a401-88fafcc708f5'} Aug 10 13:22:19.795476 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:22:19.796263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:19.796263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:22:19.796263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:22:19.796263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 13:22:19.796263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 13:22:19.796263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 13:22:19.796263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 13:22:19.796263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 13:22:19.796263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 13:22:19.796263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 13:22:19.796263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 13:22:19.796263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:22:19.796263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:22:19.796263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:22:19.796263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:22:19.796263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 40cdfd43-de96-4d00-a401-88fafcc708f5 could not be found. (HTTP 404) (Request-ID: req-d7c7b7c5-e59b-4453-8ab7-0882e419a21d) Aug 10 13:22:19.796263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.796263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:22:19.796263 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.798144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:19.798144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 13:22:19.798144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 13:22:19.798144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 13:22:19.798144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 13:22:19.798144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 13:22:19.798144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 13:22:19.798144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 13:22:19.798144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 13:22:19.798144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:22:19.798144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:22:19.798144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 13:22:19.798144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 13:22:19.798144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 13:22:19.798144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 13:22:19.798144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 13:22:19.798144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 13:22:19.798144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 13:22:19.798144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 13:22:19.800088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:22:19.800088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:22:19.800088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:22:19.800088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:22:19.800088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 40cdfd43-de96-4d00-a401-88fafcc708f5 could not be found. Aug 10 13:22:19.800088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.800088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:22:19.800088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.800088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:19.800088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:22:19.800088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:22:19.800088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:22:19.800088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:22:19.800088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 13:22:19.800088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 13:22:19.800088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:22:19.800088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:22:19.800088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 13:22:19.800088 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:22:19.801200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 40cdfd43-de96-4d00-a401-88fafcc708f5 could not be found. Aug 10 13:22:19.801200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.801200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:22:19.801200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.801200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:19.801200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:22:19.801200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:22:19.801200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:22:19.801200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:22:19.801200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 40cdfd43-de96-4d00-a401-88fafcc708f5 could not be found. Aug 10 13:22:19.801200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.801200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e1fc9c70-4043-4277-a8c8-cb5bfa26982d tempest-VolumesNegativeTest-227218831 tempest-VolumesNegativeTest-227218831-project] Returning 404 to user: Volume 40cdfd43-de96-4d00-a401-88fafcc708f5 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:22:19.801200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e1fc9c70-4043-4277-a8c8-cb5bfa26982d tempest-VolumesNegativeTest-227218831 tempest-VolumesNegativeTest-227218831-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/40cdfd43-de96-4d00-a401-88fafcc708f5" status: 404 len: 109 microversion: 2.1 time: 0.036338 Aug 10 13:22:19.801200 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2030/3735] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 10 13:22:19 2022] DELETE /compute/v2.1/os-volumes/40cdfd43-de96-4d00-a401-88fafcc708f5 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:22:19.806429 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-45b0d127-8381-4a67-8bfa-671e994a90a8 tempest-VolumesNegativeTest-227218831 tempest-VolumesNegativeTest-227218831-project] Calling method '.version_select at 0x7fb82690a820>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:22:19.836359 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-45b0d127-8381-4a67-8bfa-671e994a90a8 tempest-VolumesNegativeTest-227218831 tempest-VolumesNegativeTest-227218831-project] HTTP exception thrown: Volume 60c17d94-7ad5-4415-8794-152ccc80e5d6 could not be found. Aug 10 13:22:19.838310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-45b0d127-8381-4a67-8bfa-671e994a90a8 tempest-VolumesNegativeTest-227218831 tempest-VolumesNegativeTest-227218831-project] Request method failure captured: Aug 10 13:22:19.838310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: GET /compute/v2.1/os-volumes/60c17d94-7ad5-4415-8794-152ccc80e5d6 HTTP/1.1 Aug 10 13:22:19.838310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:22:19.838310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:22:19.838310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:22:19.838310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:22:19.838310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:22:19.838310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:22:19.838310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:22:19.838310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:22:19.838310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi87ELbj7lLwPGoKYl1uW3inmqB7wH2MmooD0KyVRNQOggji67nd5gqQ2SVdOxlWfOUcWxfGGmjiVVtUsEx6idrrBWEZTdouqrB6ZTDEAth2PqO53uCt68zyx1ZGOvSZY2Z2STk-gvzGfS8c0KaONnxa6tDSLjzX5WxZSa3rSnZ0JPvUo Aug 10 13:22:19.838310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:22:19.838310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:22:19.838310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:22:19.838310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:22:19.838310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:22:19.838310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:22:19.838310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: 97f38fc27a764f499abdd2133d0c4a4b Aug 10 13:22:19.838310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-VolumesNegativeTest-227218831 Aug 10 13:22:19.838310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:22:19.838310 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:22:19.839810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/97f38fc27a764f499abdd2133d0c4a4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_97f38fc27a764f499abdd2133d0c4a4b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/97f38fc27a764f499abdd2133d0c4a4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/97f38fc27a764f499abdd2133d0c4a4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:22:19.839810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-VolumesNegativeTest-227218831 Aug 10 13:22:19.839810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: 97f38fc27a764f499abdd2133d0c4a4b Aug 10 13:22:19.839810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-VolumesNegativeTest-227218831 Aug 10 13:22:19.839810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-VolumesNegativeTest-227218831-project Aug 10 13:22:19.839810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:22:19.839810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:22:19.839810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: 5d17c654bade41c58d2c34372bee5adf Aug 10 13:22:19.839810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-VolumesNegativeTest-227218831-project Aug 10 13:22:19.839810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: Aug 10 13:22:19.839810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Volume 60c17d94-7ad5-4415-8794-152ccc80e5d6 could not be found. Aug 10 13:22:19.839810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': '60c17d94-7ad5-4415-8794-152ccc80e5d6'} Aug 10 13:22:19.839810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:22:19.840694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:19.840694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:22:19.840694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:22:19.840694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 13:22:19.840694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 13:22:19.840694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 13:22:19.840694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 13:22:19.840694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 13:22:19.840694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 13:22:19.840694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 13:22:19.840694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 13:22:19.840694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:22:19.840694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:22:19.840694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:22:19.840694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:22:19.840694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 60c17d94-7ad5-4415-8794-152ccc80e5d6 could not be found. (HTTP 404) (Request-ID: req-836341dc-4c40-46f4-94cf-30a9727fa6eb) Aug 10 13:22:19.840694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.840694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:22:19.840694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.842047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:19.842047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 13:22:19.842047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 13:22:19.842047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 13:22:19.842047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 13:22:19.842047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 13:22:19.842047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 13:22:19.842047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 13:22:19.842047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 13:22:19.842047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 13:22:19.842047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 13:22:19.842047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 13:22:19.842047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 13:22:19.842047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 13:22:19.842047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 13:22:19.842047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 13:22:19.842047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 13:22:19.842047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 13:22:19.842047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 13:22:19.843528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 13:22:19.843528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 13:22:19.843528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 13:22:19.843528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 13:22:19.843528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 60c17d94-7ad5-4415-8794-152ccc80e5d6 could not be found. Aug 10 13:22:19.843528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.843528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:22:19.843528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.843528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:19.843528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:22:19.843528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:22:19.843528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:22:19.843528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:22:19.843528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 13:22:19.843528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 13:22:19.843528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:22:19.843528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:22:19.843528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 13:22:19.843528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:22:19.845123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 60c17d94-7ad5-4415-8794-152ccc80e5d6 could not be found. Aug 10 13:22:19.845123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.845123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:22:19.845123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.845123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:22:19.845123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:22:19.845123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:22:19.845123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:22:19.845123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:22:19.845123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 60c17d94-7ad5-4415-8794-152ccc80e5d6 could not be found. Aug 10 13:22:19.845123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:22:19.845123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-45b0d127-8381-4a67-8bfa-671e994a90a8 tempest-VolumesNegativeTest-227218831 tempest-VolumesNegativeTest-227218831-project] Returning 404 to user: Volume 60c17d94-7ad5-4415-8794-152ccc80e5d6 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:22:19.845123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-45b0d127-8381-4a67-8bfa-671e994a90a8 tempest-VolumesNegativeTest-227218831 tempest-VolumesNegativeTest-227218831-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/60c17d94-7ad5-4415-8794-152ccc80e5d6" status: 404 len: 109 microversion: 2.1 time: 0.037771 Aug 10 13:22:19.845123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2031/3736] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 10 13:22:19 2022] GET /compute/v2.1/os-volumes/60c17d94-7ad5-4415-8794-152ccc80e5d6 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 13:23:18.571234 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:23:18.571833 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Wed Aug 10 13:23:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:24:08.420628 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:24:08.421391 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:24:08.595414 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fe23f1a4-4d83-4209-8dcd-1c7752f26b14 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Action: 'create', calling method: .version_select at 0x7fb8268ec310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1539369100", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlTAF3S+6PpDL3y5O8/ycsIzKwBHaTz4vWDXvd47likGme6fg386wF23kTLsaVxVgLEpx2nkdoXkbJa8DztVQbCxVFogCWSnGXh01wzIw1sbID46eIWvpamVetsXGIL3Q=="}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:24:08.611764 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-fe23f1a4-4d83-4209-8dcd-1c7752f26b14 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Getting quotas for project 2a40aefbd17f4dbc911527a917f03976. Resources: {'key_pairs'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:24:08.615983 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-fe23f1a4-4d83-4209-8dcd-1c7752f26b14 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Getting quotas for user eaa1bdd8c2f34ebc90d7f5b6ec4c2d51 and project 2a40aefbd17f4dbc911527a917f03976. Resources: {'key_pairs'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:24:08.721375 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fe23f1a4-4d83-4209-8dcd-1c7752f26b14 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.302594 Aug 10 13:24:08.722001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2032/3737] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 10 13:24:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:24:27.557401 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=4 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:24:27.558920 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:24:27.562748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-0100bf17-9b82-4630-b009-99027a0df6ed tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1187030879", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1539369100", "security_groups": [{"name": "tempest-secgroup-smoke-625718518"}], "block_device_mapping_v2": [{"uuid": "ceee8649-2b45-4187-8c1e-f80d82b4f7a8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "906fbc8d-0bd6-4281-ad75-5028e24e27ce"}]}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:24:27.675345 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.network.neutron [None req-0100bf17-9b82-4630-b009-99027a0df6ed tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] validate_networks() for [('906fbc8d-0bd6-4281-ad75-5028e24e27ce', None, None, None, None, None)] {{(pid=124643) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:24:28.132302 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-0100bf17-9b82-4630-b009-99027a0df6ed tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Flavor limits 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:24:28.132863 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-0100bf17-9b82-4630-b009-99027a0df6ed tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Image limits 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:24:28.133336 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-0100bf17-9b82-4630-b009-99027a0df6ed tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Flavor pref 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:24:28.133776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-0100bf17-9b82-4630-b009-99027a0df6ed tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Image pref 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:24:28.134182 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-0100bf17-9b82-4630-b009-99027a0df6ed tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:24:28.143901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0100bf17-9b82-4630-b009-99027a0df6ed tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:28.144369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0100bf17-9b82-4630-b009-99027a0df6ed tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:28.144801 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0100bf17-9b82-4630-b009-99027a0df6ed tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:28.145511 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0100bf17-9b82-4630-b009-99027a0df6ed tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:28.145956 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0100bf17-9b82-4630-b009-99027a0df6ed tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:28.146372 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-0100bf17-9b82-4630-b009-99027a0df6ed tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:28.163973 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-0100bf17-9b82-4630-b009-99027a0df6ed tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Getting quotas for project 2a40aefbd17f4dbc911527a917f03976. Resources: {'cores', 'ram', 'instances'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:24:28.168057 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-0100bf17-9b82-4630-b009-99027a0df6ed tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Getting quotas for user eaa1bdd8c2f34ebc90d7f5b6ec4c2d51 and project 2a40aefbd17f4dbc911527a917f03976. Resources: {'cores', 'ram', 'instances'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:24:28.223954 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0100bf17-9b82-4630-b009-99027a0df6ed tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Going to run 1 instances... {{(pid=124643) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:24:28.226054 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-0100bf17-9b82-4630-b009-99027a0df6ed tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3a522348-e70d-4810-91a7-cf469801dbf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ceee8649-2b45-4187-8c1e-f80d82b4f7a8',volume_size=None,volume_type=None)] {{(pid=124643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:24:28.585084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-0100bf17-9b82-4630-b009-99027a0df6ed tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.028812 Aug 10 13:24:28.586017 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2033/3738] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 13:24:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 13:24:28.597528 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-d7c8917d-2574-4783-803f-2e90f166b458 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:24:28.598256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-d7c8917d-2574-4783-803f-2e90f166b458 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3a522348-e70d-4810-91a7-cf469801dbf8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:24:28.653579 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-d7c8917d-2574-4783-803f-2e90f166b458 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:24:28.661177 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-d7c8917d-2574-4783-803f-2e90f166b458 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8" status: 200 len: 1095 microversion: 2.1 time: 0.067449 Aug 10 13:24:28.661753 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2034/3739] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:24:28 2022] GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:24:29.683027 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-27f8eea4-52d0-42b3-8398-53a2c4b53fc7 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:24:29.683879 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-27f8eea4-52d0-42b3-8398-53a2c4b53fc7 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3a522348-e70d-4810-91a7-cf469801dbf8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:24:29.690055 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27f8eea4-52d0-42b3-8398-53a2c4b53fc7 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:29.694675 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27f8eea4-52d0-42b3-8398-53a2c4b53fc7 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:29.694675 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27f8eea4-52d0-42b3-8398-53a2c4b53fc7 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:29.694675 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27f8eea4-52d0-42b3-8398-53a2c4b53fc7 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:29.694675 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27f8eea4-52d0-42b3-8398-53a2c4b53fc7 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:29.694992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-27f8eea4-52d0-42b3-8398-53a2c4b53fc7 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:29.758540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-27f8eea4-52d0-42b3-8398-53a2c4b53fc7 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:24:29.766604 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-27f8eea4-52d0-42b3-8398-53a2c4b53fc7 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8" status: 200 len: 1145 microversion: 2.1 time: 0.088205 Aug 10 13:24:29.767168 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2035/3740] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:24:29 2022] GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:24:30.788687 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-fd0f6f78-0f31-4dae-b9d8-55272eac15d4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:24:30.789422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-fd0f6f78-0f31-4dae-b9d8-55272eac15d4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3a522348-e70d-4810-91a7-cf469801dbf8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:24:30.796068 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fd0f6f78-0f31-4dae-b9d8-55272eac15d4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:30.802143 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fd0f6f78-0f31-4dae-b9d8-55272eac15d4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:30.802143 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fd0f6f78-0f31-4dae-b9d8-55272eac15d4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:30.802143 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fd0f6f78-0f31-4dae-b9d8-55272eac15d4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:30.802143 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fd0f6f78-0f31-4dae-b9d8-55272eac15d4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:30.802480 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-fd0f6f78-0f31-4dae-b9d8-55272eac15d4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:30.862059 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-fd0f6f78-0f31-4dae-b9d8-55272eac15d4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:24:30.869883 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-fd0f6f78-0f31-4dae-b9d8-55272eac15d4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8" status: 200 len: 1201 microversion: 2.1 time: 0.085128 Aug 10 13:24:30.870433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2036/3741] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:24:30 2022] GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8 => generated 1201 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:24:31.892228 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8a27977a-c7f3-4fe8-83a5-fb3ca461d584 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:24:31.893248 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8a27977a-c7f3-4fe8-83a5-fb3ca461d584 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3a522348-e70d-4810-91a7-cf469801dbf8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:24:31.899506 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8a27977a-c7f3-4fe8-83a5-fb3ca461d584 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:31.899986 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8a27977a-c7f3-4fe8-83a5-fb3ca461d584 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:31.900415 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8a27977a-c7f3-4fe8-83a5-fb3ca461d584 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:31.901099 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8a27977a-c7f3-4fe8-83a5-fb3ca461d584 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:31.901606 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8a27977a-c7f3-4fe8-83a5-fb3ca461d584 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:31.902026 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8a27977a-c7f3-4fe8-83a5-fb3ca461d584 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:32.040464 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8a27977a-c7f3-4fe8-83a5-fb3ca461d584 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:24:32.049193 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8a27977a-c7f3-4fe8-83a5-fb3ca461d584 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8" status: 200 len: 1278 microversion: 2.1 time: 0.160705 Aug 10 13:24:32.049776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2037/3742] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:24:31 2022] GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8 => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:24:32.249502 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-f1c4ad25-4e29-47a5-8786-636224888d90 req-75bdf62b-55bc-4e3b-bd13-60db28cb3862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a522348-e70d-4810-91a7-cf469801dbf8", "tag": "c6b04d39-a9d3-4cb1-810a-c1e71748e204"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:24:32.260235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-f1c4ad25-4e29-47a5-8786-636224888d90 req-75bdf62b-55bc-4e3b-bd13-60db28cb3862 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:32.260716 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-f1c4ad25-4e29-47a5-8786-636224888d90 req-75bdf62b-55bc-4e3b-bd13-60db28cb3862 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:32.261780 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-f1c4ad25-4e29-47a5-8786-636224888d90 req-75bdf62b-55bc-4e3b-bd13-60db28cb3862 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:32.273022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-f1c4ad25-4e29-47a5-8786-636224888d90 req-75bdf62b-55bc-4e3b-bd13-60db28cb3862 service nova] Creating event network-changed:c6b04d39-a9d3-4cb1-810a-c1e71748e204 for instance 3a522348-e70d-4810-91a7-cf469801dbf8 on hv-cinder-85199 Aug 10 13:24:32.281613 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-f1c4ad25-4e29-47a5-8786-636224888d90 req-75bdf62b-55bc-4e3b-bd13-60db28cb3862 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036672 Aug 10 13:24:32.283060 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2038/3743] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:24:33.072182 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-420e533c-0dd3-4a30-8e54-3c197a8617f1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:24:33.072903 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-420e533c-0dd3-4a30-8e54-3c197a8617f1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3a522348-e70d-4810-91a7-cf469801dbf8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:24:33.079868 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-420e533c-0dd3-4a30-8e54-3c197a8617f1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:33.080668 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-420e533c-0dd3-4a30-8e54-3c197a8617f1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:33.080835 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-420e533c-0dd3-4a30-8e54-3c197a8617f1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:33.081449 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-420e533c-0dd3-4a30-8e54-3c197a8617f1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:33.081901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-420e533c-0dd3-4a30-8e54-3c197a8617f1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:33.082330 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-420e533c-0dd3-4a30-8e54-3c197a8617f1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:33.213452 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-420e533c-0dd3-4a30-8e54-3c197a8617f1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:24:33.221288 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-420e533c-0dd3-4a30-8e54-3c197a8617f1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8" status: 200 len: 1266 microversion: 2.1 time: 0.153933 Aug 10 13:24:33.221863 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2039/3744] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:24:33 2022] GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:24:34.242028 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-01cdd741-d792-4a3d-9eeb-ec5bd9b83a14 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:24:34.242730 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-01cdd741-d792-4a3d-9eeb-ec5bd9b83a14 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3a522348-e70d-4810-91a7-cf469801dbf8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:24:34.249114 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01cdd741-d792-4a3d-9eeb-ec5bd9b83a14 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:34.249594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01cdd741-d792-4a3d-9eeb-ec5bd9b83a14 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:34.250025 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01cdd741-d792-4a3d-9eeb-ec5bd9b83a14 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:34.250707 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01cdd741-d792-4a3d-9eeb-ec5bd9b83a14 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:34.251155 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01cdd741-d792-4a3d-9eeb-ec5bd9b83a14 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:34.251600 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-01cdd741-d792-4a3d-9eeb-ec5bd9b83a14 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:34.383389 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-01cdd741-d792-4a3d-9eeb-ec5bd9b83a14 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:24:34.391372 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-01cdd741-d792-4a3d-9eeb-ec5bd9b83a14 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8" status: 200 len: 1266 microversion: 2.1 time: 0.153177 Aug 10 13:24:34.391948 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2040/3745] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:24:34 2022] GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:24:35.413095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-98803bd1-db0c-4777-8d83-923813f7e018 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:24:35.413782 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-98803bd1-db0c-4777-8d83-923813f7e018 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3a522348-e70d-4810-91a7-cf469801dbf8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:24:35.420215 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98803bd1-db0c-4777-8d83-923813f7e018 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:35.420786 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98803bd1-db0c-4777-8d83-923813f7e018 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:35.421115 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98803bd1-db0c-4777-8d83-923813f7e018 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:35.421797 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98803bd1-db0c-4777-8d83-923813f7e018 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:35.422246 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98803bd1-db0c-4777-8d83-923813f7e018 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:35.422667 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98803bd1-db0c-4777-8d83-923813f7e018 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:35.551489 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-98803bd1-db0c-4777-8d83-923813f7e018 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:24:35.559634 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-98803bd1-db0c-4777-8d83-923813f7e018 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8" status: 200 len: 1266 microversion: 2.1 time: 0.150348 Aug 10 13:24:35.560205 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2041/3746] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:24:35 2022] GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:24:36.580804 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2a2bc94d-c813-4549-8b15-12883a4d4117 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:24:36.581463 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2a2bc94d-c813-4549-8b15-12883a4d4117 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3a522348-e70d-4810-91a7-cf469801dbf8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:24:36.587683 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a2bc94d-c813-4549-8b15-12883a4d4117 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:36.588163 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a2bc94d-c813-4549-8b15-12883a4d4117 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:36.588598 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a2bc94d-c813-4549-8b15-12883a4d4117 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:36.589283 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a2bc94d-c813-4549-8b15-12883a4d4117 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:36.590439 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a2bc94d-c813-4549-8b15-12883a4d4117 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:36.590863 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2a2bc94d-c813-4549-8b15-12883a4d4117 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:36.722964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-2a2bc94d-c813-4549-8b15-12883a4d4117 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:24:36.730511 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2a2bc94d-c813-4549-8b15-12883a4d4117 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8" status: 200 len: 1266 microversion: 2.1 time: 0.153591 Aug 10 13:24:36.731083 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2042/3747] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:24:36 2022] GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:24:37.751375 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a9500e71-6d29-4687-91af-10b9b268a059 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:24:37.752007 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a9500e71-6d29-4687-91af-10b9b268a059 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3a522348-e70d-4810-91a7-cf469801dbf8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:24:37.758187 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9500e71-6d29-4687-91af-10b9b268a059 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:37.759779 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9500e71-6d29-4687-91af-10b9b268a059 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:37.759779 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9500e71-6d29-4687-91af-10b9b268a059 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:37.759779 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9500e71-6d29-4687-91af-10b9b268a059 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:37.760218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9500e71-6d29-4687-91af-10b9b268a059 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:37.760638 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a9500e71-6d29-4687-91af-10b9b268a059 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:37.891564 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a9500e71-6d29-4687-91af-10b9b268a059 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:24:37.898966 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a9500e71-6d29-4687-91af-10b9b268a059 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8" status: 200 len: 1266 microversion: 2.1 time: 0.151591 Aug 10 13:24:37.899566 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2043/3748] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:24:37 2022] GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:24:38.920107 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6cc3030f-be5c-453e-93b1-b96eb11f6238 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:24:38.920752 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6cc3030f-be5c-453e-93b1-b96eb11f6238 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3a522348-e70d-4810-91a7-cf469801dbf8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:24:38.922706 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=2 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:24:38.923432 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=8 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:24:38.928589 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6cc3030f-be5c-453e-93b1-b96eb11f6238 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:38.929070 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6cc3030f-be5c-453e-93b1-b96eb11f6238 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:38.929506 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6cc3030f-be5c-453e-93b1-b96eb11f6238 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:38.930195 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6cc3030f-be5c-453e-93b1-b96eb11f6238 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:38.930652 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6cc3030f-be5c-453e-93b1-b96eb11f6238 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:38.931076 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6cc3030f-be5c-453e-93b1-b96eb11f6238 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:39.066368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6cc3030f-be5c-453e-93b1-b96eb11f6238 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:24:39.074593 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6cc3030f-be5c-453e-93b1-b96eb11f6238 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8" status: 200 len: 1266 microversion: 2.1 time: 0.157862 Aug 10 13:24:39.075162 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2044/3749] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:24:38 2022] GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:24:40.095530 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-40a47635-701e-48b6-8499-0ade3c7bc693 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:24:40.096185 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-40a47635-701e-48b6-8499-0ade3c7bc693 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3a522348-e70d-4810-91a7-cf469801dbf8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:24:40.102523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40a47635-701e-48b6-8499-0ade3c7bc693 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:40.102998 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40a47635-701e-48b6-8499-0ade3c7bc693 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:40.103455 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40a47635-701e-48b6-8499-0ade3c7bc693 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:40.104132 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40a47635-701e-48b6-8499-0ade3c7bc693 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:40.104576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40a47635-701e-48b6-8499-0ade3c7bc693 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:40.104992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40a47635-701e-48b6-8499-0ade3c7bc693 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:40.234905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-40a47635-701e-48b6-8499-0ade3c7bc693 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:24:40.242306 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-40a47635-701e-48b6-8499-0ade3c7bc693 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8" status: 200 len: 1266 microversion: 2.1 time: 0.150624 Aug 10 13:24:40.242873 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2045/3750] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:24:40 2022] GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:24:41.264876 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5bd2ea4c-59b7-4967-a15a-7eb471c91976 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:24:41.265488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5bd2ea4c-59b7-4967-a15a-7eb471c91976 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3a522348-e70d-4810-91a7-cf469801dbf8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:24:41.272030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5bd2ea4c-59b7-4967-a15a-7eb471c91976 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:41.274606 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5bd2ea4c-59b7-4967-a15a-7eb471c91976 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:41.274606 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5bd2ea4c-59b7-4967-a15a-7eb471c91976 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:41.274606 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5bd2ea4c-59b7-4967-a15a-7eb471c91976 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:41.274606 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5bd2ea4c-59b7-4967-a15a-7eb471c91976 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:41.274964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5bd2ea4c-59b7-4967-a15a-7eb471c91976 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:41.409492 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5bd2ea4c-59b7-4967-a15a-7eb471c91976 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:24:41.417045 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5bd2ea4c-59b7-4967-a15a-7eb471c91976 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8" status: 200 len: 1266 microversion: 2.1 time: 0.157591 Aug 10 13:24:41.425057 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2046/3751] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:24:41 2022] GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:24:42.438191 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6ee08439-28ee-470d-a31b-54ea612a84dc tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:24:42.438785 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6ee08439-28ee-470d-a31b-54ea612a84dc tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3a522348-e70d-4810-91a7-cf469801dbf8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:24:42.449210 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ee08439-28ee-470d-a31b-54ea612a84dc tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:42.449786 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ee08439-28ee-470d-a31b-54ea612a84dc tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:42.450478 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ee08439-28ee-470d-a31b-54ea612a84dc tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:42.451189 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ee08439-28ee-470d-a31b-54ea612a84dc tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:42.451658 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ee08439-28ee-470d-a31b-54ea612a84dc tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:42.452081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6ee08439-28ee-470d-a31b-54ea612a84dc tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:42.580889 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6ee08439-28ee-470d-a31b-54ea612a84dc tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:24:42.588301 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6ee08439-28ee-470d-a31b-54ea612a84dc tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8" status: 200 len: 1266 microversion: 2.1 time: 0.153967 Aug 10 13:24:42.588867 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2047/3752] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:24:42 2022] GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:24:43.304912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-896e16dc-bb3a-4a5b-bd0b-05dfa672472b req-39d5f2ae-7920-4002-b866-2da83ab173d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a522348-e70d-4810-91a7-cf469801dbf8", "name": "network-vif-plugged", "status": "completed", "tag": "c6b04d39-a9d3-4cb1-810a-c1e71748e204"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:24:43.314817 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-896e16dc-bb3a-4a5b-bd0b-05dfa672472b req-39d5f2ae-7920-4002-b866-2da83ab173d6 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:43.315328 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-896e16dc-bb3a-4a5b-bd0b-05dfa672472b req-39d5f2ae-7920-4002-b866-2da83ab173d6 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:43.315759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-896e16dc-bb3a-4a5b-bd0b-05dfa672472b req-39d5f2ae-7920-4002-b866-2da83ab173d6 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:43.327283 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-896e16dc-bb3a-4a5b-bd0b-05dfa672472b req-39d5f2ae-7920-4002-b866-2da83ab173d6 service nova] Creating event network-vif-plugged:c6b04d39-a9d3-4cb1-810a-c1e71748e204 for instance 3a522348-e70d-4810-91a7-cf469801dbf8 on hv-cinder-85199 Aug 10 13:24:43.332286 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-896e16dc-bb3a-4a5b-bd0b-05dfa672472b req-39d5f2ae-7920-4002-b866-2da83ab173d6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087279 Aug 10 13:24:43.332884 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2048/3753] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:24:43.609935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-859d017f-67d1-4a81-a36d-572b395e3cb8 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:24:43.610655 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-859d017f-67d1-4a81-a36d-572b395e3cb8 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3a522348-e70d-4810-91a7-cf469801dbf8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:24:43.617474 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-859d017f-67d1-4a81-a36d-572b395e3cb8 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:43.617958 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-859d017f-67d1-4a81-a36d-572b395e3cb8 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:43.618397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-859d017f-67d1-4a81-a36d-572b395e3cb8 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:43.619089 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-859d017f-67d1-4a81-a36d-572b395e3cb8 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:43.619568 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-859d017f-67d1-4a81-a36d-572b395e3cb8 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:43.619992 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-859d017f-67d1-4a81-a36d-572b395e3cb8 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:43.753044 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-859d017f-67d1-4a81-a36d-572b395e3cb8 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:24:43.760504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-859d017f-67d1-4a81-a36d-572b395e3cb8 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8" status: 200 len: 1266 microversion: 2.1 time: 0.154697 Aug 10 13:24:43.764212 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2049/3754] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:24:43 2022] GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:24:44.782231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-34f4d981-b2f1-4f69-b0a1-7203ddd4ad16 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:24:44.782882 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-34f4d981-b2f1-4f69-b0a1-7203ddd4ad16 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3a522348-e70d-4810-91a7-cf469801dbf8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:24:44.788884 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34f4d981-b2f1-4f69-b0a1-7203ddd4ad16 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:44.789369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34f4d981-b2f1-4f69-b0a1-7203ddd4ad16 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:44.789801 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34f4d981-b2f1-4f69-b0a1-7203ddd4ad16 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:44.790495 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34f4d981-b2f1-4f69-b0a1-7203ddd4ad16 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:44.790926 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34f4d981-b2f1-4f69-b0a1-7203ddd4ad16 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:44.791375 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-34f4d981-b2f1-4f69-b0a1-7203ddd4ad16 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:44.925084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-34f4d981-b2f1-4f69-b0a1-7203ddd4ad16 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:24:44.932377 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-34f4d981-b2f1-4f69-b0a1-7203ddd4ad16 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8" status: 200 len: 1266 microversion: 2.1 time: 0.154831 Aug 10 13:24:44.932930 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2050/3755] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:24:44 2022] GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:24:45.954076 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-379ae052-c2ac-4370-90e9-8132158a05e0 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:24:45.954738 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-379ae052-c2ac-4370-90e9-8132158a05e0 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3a522348-e70d-4810-91a7-cf469801dbf8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:24:45.961011 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-379ae052-c2ac-4370-90e9-8132158a05e0 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:45.961487 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-379ae052-c2ac-4370-90e9-8132158a05e0 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:45.961914 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-379ae052-c2ac-4370-90e9-8132158a05e0 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:45.962591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-379ae052-c2ac-4370-90e9-8132158a05e0 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:45.963039 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-379ae052-c2ac-4370-90e9-8132158a05e0 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:45.963486 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-379ae052-c2ac-4370-90e9-8132158a05e0 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:46.093047 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-379ae052-c2ac-4370-90e9-8132158a05e0 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:24:46.100733 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-379ae052-c2ac-4370-90e9-8132158a05e0 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8" status: 200 len: 1453 microversion: 2.1 time: 0.151449 Aug 10 13:24:46.101294 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2051/3756] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:24:45 2022] GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:24:46.120276 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-76a21b06-d8c7-4466-ba44-1b91b911d1d1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:24:46.120872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-76a21b06-d8c7-4466-ba44-1b91b911d1d1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3a522348-e70d-4810-91a7-cf469801dbf8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:24:46.126649 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76a21b06-d8c7-4466-ba44-1b91b911d1d1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:46.127150 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76a21b06-d8c7-4466-ba44-1b91b911d1d1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:46.127613 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76a21b06-d8c7-4466-ba44-1b91b911d1d1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:46.128286 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76a21b06-d8c7-4466-ba44-1b91b911d1d1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:46.128729 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76a21b06-d8c7-4466-ba44-1b91b911d1d1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:46.129147 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-76a21b06-d8c7-4466-ba44-1b91b911d1d1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:46.147684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=100 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:24:46.260291 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-76a21b06-d8c7-4466-ba44-1b91b911d1d1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:24:46.268322 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-76a21b06-d8c7-4466-ba44-1b91b911d1d1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8" status: 200 len: 1453 microversion: 2.1 time: 0.151517 Aug 10 13:24:46.268892 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2052/3757] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:24:46 2022] GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:24:48.566177 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-b5a604e1-a22c-48a5-92b7-25aa9e186891 req-bca3a432-84e2-40a8-93a7-02337d8630bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a522348-e70d-4810-91a7-cf469801dbf8", "tag": "c6b04d39-a9d3-4cb1-810a-c1e71748e204"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:24:48.575667 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-b5a604e1-a22c-48a5-92b7-25aa9e186891 req-bca3a432-84e2-40a8-93a7-02337d8630bc service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:24:48.576069 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-b5a604e1-a22c-48a5-92b7-25aa9e186891 req-bca3a432-84e2-40a8-93a7-02337d8630bc service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:24:48.576605 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-b5a604e1-a22c-48a5-92b7-25aa9e186891 req-bca3a432-84e2-40a8-93a7-02337d8630bc service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:24:48.587433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-b5a604e1-a22c-48a5-92b7-25aa9e186891 req-bca3a432-84e2-40a8-93a7-02337d8630bc service nova] Creating event network-changed:c6b04d39-a9d3-4cb1-810a-c1e71748e204 for instance 3a522348-e70d-4810-91a7-cf469801dbf8 on hv-cinder-85199 Aug 10 13:24:48.593407 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-b5a604e1-a22c-48a5-92b7-25aa9e186891 req-bca3a432-84e2-40a8-93a7-02337d8630bc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085712 Aug 10 13:24:48.594001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2053/3758] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:26:41.525695 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:26:41.526329 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Wed Aug 10 13:26:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:26:42.629601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b969d2c5-b84b-443d-9024-0907947eeb37] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 13:26:42.630204 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:26:42.630907 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=4 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:26:42.635230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-179d72a2-b086-4664-9752-98adf12da740 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:42.635819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-179d72a2-b086-4664-9752-98adf12da740 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3a522348-e70d-4810-91a7-cf469801dbf8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:42.641778 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-179d72a2-b086-4664-9752-98adf12da740 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:42.642431 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-179d72a2-b086-4664-9752-98adf12da740 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:42.642870 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-179d72a2-b086-4664-9752-98adf12da740 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:42.644228 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-179d72a2-b086-4664-9752-98adf12da740 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:42.644691 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-179d72a2-b086-4664-9752-98adf12da740 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:42.645122 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-179d72a2-b086-4664-9752-98adf12da740 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:42.670615 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-179d72a2-b086-4664-9752-98adf12da740 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3a522348-e70d-4810-91a7-cf469801dbf8] Going to try to terminate instance {{(pid=124643) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:26:42.877321 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-179d72a2-b086-4664-9752-98adf12da740 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8" status: 204 len: 0 microversion: 2.1 time: 0.249352 Aug 10 13:26:42.877938 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2054/3759] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 13:26:42 2022] DELETE /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 13:26:42.894217 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ed9f67fc-2cdf-4637-8ca4-c25834295f90 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:42.894217 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ed9f67fc-2cdf-4637-8ca4-c25834295f90 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3a522348-e70d-4810-91a7-cf469801dbf8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:42.894217 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ed9f67fc-2cdf-4637-8ca4-c25834295f90 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:42.894217 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ed9f67fc-2cdf-4637-8ca4-c25834295f90 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:42.894632 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ed9f67fc-2cdf-4637-8ca4-c25834295f90 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:42.894922 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ed9f67fc-2cdf-4637-8ca4-c25834295f90 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:42.895400 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ed9f67fc-2cdf-4637-8ca4-c25834295f90 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:42.895823 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ed9f67fc-2cdf-4637-8ca4-c25834295f90 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:43.031019 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ed9f67fc-2cdf-4637-8ca4-c25834295f90 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:43.040719 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ed9f67fc-2cdf-4637-8ca4-c25834295f90 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8" status: 200 len: 1578 microversion: 2.1 time: 0.158415 Aug 10 13:26:43.041284 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2055/3760] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:42 2022] GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:44.062031 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-98e9c7a6-8c31-44e4-8677-856ec78f5ad5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:44.080032 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-98e9c7a6-8c31-44e4-8677-856ec78f5ad5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3a522348-e70d-4810-91a7-cf469801dbf8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:44.080032 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98e9c7a6-8c31-44e4-8677-856ec78f5ad5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:44.080032 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98e9c7a6-8c31-44e4-8677-856ec78f5ad5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:44.080032 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98e9c7a6-8c31-44e4-8677-856ec78f5ad5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:44.080433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98e9c7a6-8c31-44e4-8677-856ec78f5ad5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:44.080433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98e9c7a6-8c31-44e4-8677-856ec78f5ad5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:44.080433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-98e9c7a6-8c31-44e4-8677-856ec78f5ad5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:44.080433 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [-] [b969d2c5-b84b-443d-9024-0907947eeb37] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 56632. Aug 10 13:26:44.206380 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-98e9c7a6-8c31-44e4-8677-856ec78f5ad5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:44.214197 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-98e9c7a6-8c31-44e4-8677-856ec78f5ad5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8" status: 200 len: 1578 microversion: 2.1 time: 0.156210 Aug 10 13:26:44.214776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2056/3761] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:44 2022] GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:45.235453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6b2a8d60-6055-4253-bc52-7debd57656c5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:45.236110 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6b2a8d60-6055-4253-bc52-7debd57656c5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3a522348-e70d-4810-91a7-cf469801dbf8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:45.243354 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b2a8d60-6055-4253-bc52-7debd57656c5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:45.243839 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b2a8d60-6055-4253-bc52-7debd57656c5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:45.244271 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b2a8d60-6055-4253-bc52-7debd57656c5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:45.244954 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b2a8d60-6055-4253-bc52-7debd57656c5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:45.245399 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b2a8d60-6055-4253-bc52-7debd57656c5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:45.245820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6b2a8d60-6055-4253-bc52-7debd57656c5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:45.317890 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6b2a8d60-6055-4253-bc52-7debd57656c5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:45.328819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6b2a8d60-6055-4253-bc52-7debd57656c5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8" status: 200 len: 1511 microversion: 2.1 time: 0.097200 Aug 10 13:26:45.329912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2057/3762] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:45 2022] GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8 => generated 1511 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:45.335297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-1b21ed1d-d881-4b5d-b5f3-5460085cc487 req-99927ad1-c345-483f-b405-773c36fb072b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a522348-e70d-4810-91a7-cf469801dbf8", "name": "network-vif-deleted", "tag": "c6b04d39-a9d3-4cb1-810a-c1e71748e204"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:26:45.345388 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-1b21ed1d-d881-4b5d-b5f3-5460085cc487 req-99927ad1-c345-483f-b405-773c36fb072b service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:45.350264 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-1b21ed1d-d881-4b5d-b5f3-5460085cc487 req-99927ad1-c345-483f-b405-773c36fb072b service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:45.350264 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-1b21ed1d-d881-4b5d-b5f3-5460085cc487 req-99927ad1-c345-483f-b405-773c36fb072b service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:45.358360 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-1b21ed1d-d881-4b5d-b5f3-5460085cc487 req-99927ad1-c345-483f-b405-773c36fb072b service nova] Creating event network-vif-deleted:c6b04d39-a9d3-4cb1-810a-c1e71748e204 for instance 3a522348-e70d-4810-91a7-cf469801dbf8 on hv-cinder-85199 Aug 10 13:26:45.364087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-1b21ed1d-d881-4b5d-b5f3-5460085cc487 req-99927ad1-c345-483f-b405-773c36fb072b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032817 Aug 10 13:26:45.364888 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2058/3763] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:26:46.351519 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-86ed5279-6f48-4385-a495-937c81239a5d tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:46.352219 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-86ed5279-6f48-4385-a495-937c81239a5d tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3a522348-e70d-4810-91a7-cf469801dbf8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:46.358459 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-86ed5279-6f48-4385-a495-937c81239a5d tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:46.358945 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-86ed5279-6f48-4385-a495-937c81239a5d tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:46.359419 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-86ed5279-6f48-4385-a495-937c81239a5d tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:46.360110 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-86ed5279-6f48-4385-a495-937c81239a5d tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:46.360563 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-86ed5279-6f48-4385-a495-937c81239a5d tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:46.360990 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-86ed5279-6f48-4385-a495-937c81239a5d tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:46.393141 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-86ed5279-6f48-4385-a495-937c81239a5d tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:46.394157 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-86ed5279-6f48-4385-a495-937c81239a5d tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:46.394582 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-86ed5279-6f48-4385-a495-937c81239a5d tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:46.395029 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.objects.instance [None req-86ed5279-6f48-4385-a495-937c81239a5d tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lazy-loading 'fault' on Instance uuid 3a522348-e70d-4810-91a7-cf469801dbf8 {{(pid=124643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 13:26:46.437724 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-86ed5279-6f48-4385-a495-937c81239a5d tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:46.445923 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-86ed5279-6f48-4385-a495-937c81239a5d tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8" status: 200 len: 1231 microversion: 2.1 time: 0.099644 Aug 10 13:26:46.446700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2059/3764] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:46 2022] GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8 => generated 1231 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:47.467748 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-512c5a59-8345-4910-80c6-09ebe0bca8a8 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:47.468371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-512c5a59-8345-4910-80c6-09ebe0bca8a8 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3a522348-e70d-4810-91a7-cf469801dbf8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:47.475256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-512c5a59-8345-4910-80c6-09ebe0bca8a8 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:47.475732 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-512c5a59-8345-4910-80c6-09ebe0bca8a8 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:47.476159 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-512c5a59-8345-4910-80c6-09ebe0bca8a8 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:47.476840 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-512c5a59-8345-4910-80c6-09ebe0bca8a8 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:47.477285 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-512c5a59-8345-4910-80c6-09ebe0bca8a8 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:47.477705 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-512c5a59-8345-4910-80c6-09ebe0bca8a8 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:47.490566 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-512c5a59-8345-4910-80c6-09ebe0bca8a8 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] HTTP exception thrown: Instance 3a522348-e70d-4810-91a7-cf469801dbf8 could not be found. Aug 10 13:26:47.492218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-512c5a59-8345-4910-80c6-09ebe0bca8a8 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Request method failure captured: Aug 10 13:26:47.492218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8 HTTP/1.1 Aug 10 13:26:47.492218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:26:47.492218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:26:47.492218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:26:47.492218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:26:47.492218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:26:47.492218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:26:47.492218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:26:47.492218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:26:47.492218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi87FyzhSC-EwZssdecWREHp0AdwTzglzzfFl_2pGy3gb_pFhsEKU-VWMAk5TqXIfnvxyh-6SfoUjBS7MK-N5VGSt--UyUh1RTVCXK1g2sUO8-bzn39sxvTp5pcLJ0HQJbA68OeKW-t1T_vryhCoNioSeQPS6vDLrAP96y2XflVCke-SI Aug 10 13:26:47.492218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:26:47.492218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:26:47.492218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:26:47.492218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:26:47.492218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:26:47.492218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:26:47.492218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: 2a40aefbd17f4dbc911527a917f03976 Aug 10 13:26:47.492218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-TestVolumeBootPattern-458366838 Aug 10 13:26:47.492218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:26:47.492218 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:26:47.493835 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2a40aefbd17f4dbc911527a917f03976"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2a40aefbd17f4dbc911527a917f03976", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2a40aefbd17f4dbc911527a917f03976"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2a40aefbd17f4dbc911527a917f03976"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:26:47.493835 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-TestVolumeBootPattern-458366838 Aug 10 13:26:47.493835 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: 2a40aefbd17f4dbc911527a917f03976 Aug 10 13:26:47.493835 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-TestVolumeBootPattern-458366838 Aug 10 13:26:47.493835 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-TestVolumeBootPattern-458366838-project Aug 10 13:26:47.493835 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:26:47.493835 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:26:47.493835 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: eaa1bdd8c2f34ebc90d7f5b6ec4c2d51 Aug 10 13:26:47.493835 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-TestVolumeBootPattern-458366838-project Aug 10 13:26:47.493835 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:26:47.493835 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance 3a522348-e70d-4810-91a7-cf469801dbf8 could not be found. Aug 10 13:26:47.493835 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': '3a522348-e70d-4810-91a7-cf469801dbf8'} Aug 10 13:26:47.494659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:26:47.494659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:26:47.494659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:26:47.494659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:26:47.494659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:26:47.494659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:26:47.494659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:26:47.494659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:26:47.494659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:26:47.494659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:26:47.494659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a522348-e70d-4810-91a7-cf469801dbf8 could not be found. Aug 10 13:26:47.494659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:26:47.494659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:26:47.494659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:26:47.494659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:26:47.494659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:26:47.494659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:26:47.494659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:26:47.494659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:26:47.494659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:26:47.496117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:26:47.496117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:26:47.496117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:26:47.496117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:26:47.496117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:26:47.496117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:26:47.496117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:26:47.496117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a522348-e70d-4810-91a7-cf469801dbf8 could not be found. Aug 10 13:26:47.496117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:26:47.496117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:26:47.496117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:26:47.496117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:26:47.496117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:26:47.496117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:26:47.496117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:26:47.496117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:26:47.496117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a522348-e70d-4810-91a7-cf469801dbf8 could not be found. Aug 10 13:26:47.496117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:26:47.497364 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-512c5a59-8345-4910-80c6-09ebe0bca8a8 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Returning 404 to user: Instance 3a522348-e70d-4810-91a7-cf469801dbf8 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:26:47.497364 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-512c5a59-8345-4910-80c6-09ebe0bca8a8 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8" status: 404 len: 111 microversion: 2.1 time: 0.029669 Aug 10 13:26:47.497364 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2060/3765] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:47 2022] GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:26:47.541129 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b2e87868-5dba-4abe-8c32-918e4bebab25 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-62260079", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1539369100", "security_groups": [{"name": "tempest-secgroup-smoke-625718518"}], "block_device_mapping_v2": [{"uuid": "ceee8649-2b45-4187-8c1e-f80d82b4f7a8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "906fbc8d-0bd6-4281-ad75-5028e24e27ce"}]}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:26:47.652497 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.network.neutron [None req-b2e87868-5dba-4abe-8c32-918e4bebab25 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] validate_networks() for [('906fbc8d-0bd6-4281-ad75-5028e24e27ce', None, None, None, None, None)] {{(pid=124643) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:26:48.029078 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-b2e87868-5dba-4abe-8c32-918e4bebab25 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Flavor limits 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:26:48.029502 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-b2e87868-5dba-4abe-8c32-918e4bebab25 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Image limits 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:26:48.029977 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-b2e87868-5dba-4abe-8c32-918e4bebab25 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Flavor pref 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:26:48.030397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-b2e87868-5dba-4abe-8c32-918e4bebab25 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Image pref 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:26:48.030841 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-b2e87868-5dba-4abe-8c32-918e4bebab25 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:26:48.039827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2e87868-5dba-4abe-8c32-918e4bebab25 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:48.040305 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2e87868-5dba-4abe-8c32-918e4bebab25 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:48.040743 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2e87868-5dba-4abe-8c32-918e4bebab25 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:48.041466 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2e87868-5dba-4abe-8c32-918e4bebab25 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:48.041912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2e87868-5dba-4abe-8c32-918e4bebab25 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:48.042336 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b2e87868-5dba-4abe-8c32-918e4bebab25 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:48.059300 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-b2e87868-5dba-4abe-8c32-918e4bebab25 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Getting quotas for project 2a40aefbd17f4dbc911527a917f03976. Resources: {'cores', 'ram', 'instances'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:26:48.063207 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-b2e87868-5dba-4abe-8c32-918e4bebab25 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Getting quotas for user eaa1bdd8c2f34ebc90d7f5b6ec4c2d51 and project 2a40aefbd17f4dbc911527a917f03976. Resources: {'cores', 'ram', 'instances'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:26:48.120473 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b2e87868-5dba-4abe-8c32-918e4bebab25 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Going to run 1 instances... {{(pid=124643) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:26:48.122533 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b2e87868-5dba-4abe-8c32-918e4bebab25 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 404cc144-d657-4260-a0e9-fdd708b699d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ceee8649-2b45-4187-8c1e-f80d82b4f7a8',volume_size=None,volume_type=None)] {{(pid=124643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:26:48.570126 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b2e87868-5dba-4abe-8c32-918e4bebab25 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.032680 Aug 10 13:26:48.570851 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2061/3766] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 13:26:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 1034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 13:26:48.582105 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-11ca2c86-e770-43e7-85a0-444ce3df722a tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:48.582720 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-11ca2c86-e770-43e7-85a0-444ce3df722a tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 404cc144-d657-4260-a0e9-fdd708b699d8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:48.636734 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-11ca2c86-e770-43e7-85a0-444ce3df722a tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:48.643475 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-11ca2c86-e770-43e7-85a0-444ce3df722a tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8" status: 200 len: 1093 microversion: 2.1 time: 0.065947 Aug 10 13:26:48.644050 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2062/3767] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:48 2022] GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:49.664076 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1d7a542c-9d21-400c-971f-f1b3ac27405a tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:49.664751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1d7a542c-9d21-400c-971f-f1b3ac27405a tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 404cc144-d657-4260-a0e9-fdd708b699d8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:49.671684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d7a542c-9d21-400c-971f-f1b3ac27405a tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:49.672168 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d7a542c-9d21-400c-971f-f1b3ac27405a tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:49.672602 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d7a542c-9d21-400c-971f-f1b3ac27405a tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:49.673287 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d7a542c-9d21-400c-971f-f1b3ac27405a tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:49.673731 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d7a542c-9d21-400c-971f-f1b3ac27405a tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:49.674175 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d7a542c-9d21-400c-971f-f1b3ac27405a tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:49.742881 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1d7a542c-9d21-400c-971f-f1b3ac27405a tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:49.750519 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1d7a542c-9d21-400c-971f-f1b3ac27405a tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8" status: 200 len: 1135 microversion: 2.1 time: 0.090333 Aug 10 13:26:49.751296 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2063/3768] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:49 2022] GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8 => generated 1135 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:50.772702 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-47d27dee-ff85-4751-849d-f1f81981a463 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:50.773387 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-47d27dee-ff85-4751-849d-f1f81981a463 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 404cc144-d657-4260-a0e9-fdd708b699d8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:50.780386 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-47d27dee-ff85-4751-849d-f1f81981a463 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:50.780872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-47d27dee-ff85-4751-849d-f1f81981a463 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:50.781309 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-47d27dee-ff85-4751-849d-f1f81981a463 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:50.782045 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-47d27dee-ff85-4751-849d-f1f81981a463 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:50.782491 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-47d27dee-ff85-4751-849d-f1f81981a463 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:50.782964 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-47d27dee-ff85-4751-849d-f1f81981a463 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:50.850750 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-47d27dee-ff85-4751-849d-f1f81981a463 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:50.858404 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-47d27dee-ff85-4751-849d-f1f81981a463 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8" status: 200 len: 1209 microversion: 2.1 time: 0.089686 Aug 10 13:26:50.858980 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2064/3769] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:50 2022] GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8 => generated 1209 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:51.880741 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-41b530ef-3221-4c3b-a74f-8c40e293f4d4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:51.881345 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-41b530ef-3221-4c3b-a74f-8c40e293f4d4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 404cc144-d657-4260-a0e9-fdd708b699d8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:51.887623 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41b530ef-3221-4c3b-a74f-8c40e293f4d4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:51.888163 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41b530ef-3221-4c3b-a74f-8c40e293f4d4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:51.888612 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41b530ef-3221-4c3b-a74f-8c40e293f4d4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:51.889305 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41b530ef-3221-4c3b-a74f-8c40e293f4d4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:51.889759 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41b530ef-3221-4c3b-a74f-8c40e293f4d4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:51.890187 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-41b530ef-3221-4c3b-a74f-8c40e293f4d4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:52.024984 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-41b530ef-3221-4c3b-a74f-8c40e293f4d4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:52.035440 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-41b530ef-3221-4c3b-a74f-8c40e293f4d4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8" status: 200 len: 1264 microversion: 2.1 time: 0.157389 Aug 10 13:26:52.035608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2065/3770] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:51 2022] GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:52.040510 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-b833f8c4-5a11-41ff-bf2c-df5f0111e06f req-282a707f-20fa-4142-9f17-630a5e1c8d26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "404cc144-d657-4260-a0e9-fdd708b699d8", "tag": "8c67024d-a5cc-445a-8781-3835732be0d6"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:26:52.051081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-b833f8c4-5a11-41ff-bf2c-df5f0111e06f req-282a707f-20fa-4142-9f17-630a5e1c8d26 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:52.051663 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-b833f8c4-5a11-41ff-bf2c-df5f0111e06f req-282a707f-20fa-4142-9f17-630a5e1c8d26 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:52.052143 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-b833f8c4-5a11-41ff-bf2c-df5f0111e06f req-282a707f-20fa-4142-9f17-630a5e1c8d26 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:52.065716 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-b833f8c4-5a11-41ff-bf2c-df5f0111e06f req-282a707f-20fa-4142-9f17-630a5e1c8d26 service nova] Creating event network-changed:8c67024d-a5cc-445a-8781-3835732be0d6 for instance 404cc144-d657-4260-a0e9-fdd708b699d8 on hv-cinder-85199 Aug 10 13:26:52.071168 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-b833f8c4-5a11-41ff-bf2c-df5f0111e06f req-282a707f-20fa-4142-9f17-630a5e1c8d26 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034019 Aug 10 13:26:52.071810 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2066/3771] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:26:53.056694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-99b033fb-1c31-4366-8559-469c70e34f27 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:53.057330 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-99b033fb-1c31-4366-8559-469c70e34f27 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 404cc144-d657-4260-a0e9-fdd708b699d8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:53.064050 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99b033fb-1c31-4366-8559-469c70e34f27 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:53.064537 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99b033fb-1c31-4366-8559-469c70e34f27 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:53.065522 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99b033fb-1c31-4366-8559-469c70e34f27 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:53.066323 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99b033fb-1c31-4366-8559-469c70e34f27 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:53.066787 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99b033fb-1c31-4366-8559-469c70e34f27 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:53.067275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-99b033fb-1c31-4366-8559-469c70e34f27 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:53.203425 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-99b033fb-1c31-4366-8559-469c70e34f27 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:53.211118 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-99b033fb-1c31-4366-8559-469c70e34f27 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8" status: 200 len: 1264 microversion: 2.1 time: 0.158692 Aug 10 13:26:53.211703 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2067/3772] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:53 2022] GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:54.231970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c1b04058-fa00-4aa6-a7db-77a0255ee20c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:54.232643 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c1b04058-fa00-4aa6-a7db-77a0255ee20c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 404cc144-d657-4260-a0e9-fdd708b699d8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:54.239549 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c1b04058-fa00-4aa6-a7db-77a0255ee20c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:54.240033 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c1b04058-fa00-4aa6-a7db-77a0255ee20c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:54.240468 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c1b04058-fa00-4aa6-a7db-77a0255ee20c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:54.241155 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c1b04058-fa00-4aa6-a7db-77a0255ee20c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:54.241608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c1b04058-fa00-4aa6-a7db-77a0255ee20c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:54.242030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c1b04058-fa00-4aa6-a7db-77a0255ee20c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:54.373426 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c1b04058-fa00-4aa6-a7db-77a0255ee20c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:54.380989 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c1b04058-fa00-4aa6-a7db-77a0255ee20c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8" status: 200 len: 1264 microversion: 2.1 time: 0.153249 Aug 10 13:26:54.381556 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2068/3773] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:54 2022] GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:55.401714 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e4459918-2cab-4dfe-bd48-72898948326c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:55.402344 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e4459918-2cab-4dfe-bd48-72898948326c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 404cc144-d657-4260-a0e9-fdd708b699d8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:55.409400 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e4459918-2cab-4dfe-bd48-72898948326c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:55.409881 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e4459918-2cab-4dfe-bd48-72898948326c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:55.410318 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e4459918-2cab-4dfe-bd48-72898948326c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:55.410997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e4459918-2cab-4dfe-bd48-72898948326c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:55.411551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e4459918-2cab-4dfe-bd48-72898948326c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:55.411966 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e4459918-2cab-4dfe-bd48-72898948326c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:55.544025 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e4459918-2cab-4dfe-bd48-72898948326c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:55.552083 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e4459918-2cab-4dfe-bd48-72898948326c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8" status: 200 len: 1264 microversion: 2.1 time: 0.154269 Aug 10 13:26:55.552650 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2069/3774] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:55 2022] GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:56.573607 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-e12abc5a-c4a1-450c-b124-adc52766cd6c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:56.574209 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-e12abc5a-c4a1-450c-b124-adc52766cd6c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 404cc144-d657-4260-a0e9-fdd708b699d8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:56.580500 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e12abc5a-c4a1-450c-b124-adc52766cd6c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:56.580953 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e12abc5a-c4a1-450c-b124-adc52766cd6c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:56.581382 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e12abc5a-c4a1-450c-b124-adc52766cd6c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:56.582065 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e12abc5a-c4a1-450c-b124-adc52766cd6c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:56.582513 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e12abc5a-c4a1-450c-b124-adc52766cd6c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:56.582935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-e12abc5a-c4a1-450c-b124-adc52766cd6c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:56.717281 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-e12abc5a-c4a1-450c-b124-adc52766cd6c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:56.724778 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-e12abc5a-c4a1-450c-b124-adc52766cd6c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8" status: 200 len: 1264 microversion: 2.1 time: 0.155406 Aug 10 13:26:56.725347 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2070/3775] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:56 2022] GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:26:57.745756 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bee15924-c872-4e06-ac8e-6138f83ca5ae tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:57.746378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bee15924-c872-4e06-ac8e-6138f83ca5ae tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 404cc144-d657-4260-a0e9-fdd708b699d8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:57.753235 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bee15924-c872-4e06-ac8e-6138f83ca5ae tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:57.753705 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bee15924-c872-4e06-ac8e-6138f83ca5ae tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:57.754129 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bee15924-c872-4e06-ac8e-6138f83ca5ae tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:57.754803 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bee15924-c872-4e06-ac8e-6138f83ca5ae tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:57.755274 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bee15924-c872-4e06-ac8e-6138f83ca5ae tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:57.755690 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bee15924-c872-4e06-ac8e-6138f83ca5ae tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:57.883513 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-bee15924-c872-4e06-ac8e-6138f83ca5ae tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:57.890882 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bee15924-c872-4e06-ac8e-6138f83ca5ae tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8" status: 200 len: 1264 microversion: 2.1 time: 0.149018 Aug 10 13:26:57.891499 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2071/3776] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:57 2022] GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:26:58.913609 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-06bb51b1-20d0-463e-95a9-15ad68a616a6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:26:58.914490 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-06bb51b1-20d0-463e-95a9-15ad68a616a6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 404cc144-d657-4260-a0e9-fdd708b699d8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:26:58.916452 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=2 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:26:58.917143 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=8 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:26:58.922448 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-06bb51b1-20d0-463e-95a9-15ad68a616a6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:58.922968 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-06bb51b1-20d0-463e-95a9-15ad68a616a6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:58.923464 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-06bb51b1-20d0-463e-95a9-15ad68a616a6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:58.925023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-06bb51b1-20d0-463e-95a9-15ad68a616a6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:26:58.925692 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-06bb51b1-20d0-463e-95a9-15ad68a616a6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:26:58.926148 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-06bb51b1-20d0-463e-95a9-15ad68a616a6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:26:58.930001 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:26:59.060641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-06bb51b1-20d0-463e-95a9-15ad68a616a6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:26:59.067824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-06bb51b1-20d0-463e-95a9-15ad68a616a6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8" status: 200 len: 1264 microversion: 2.1 time: 0.159313 Aug 10 13:26:59.068383 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2072/3777] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:26:58 2022] GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:27:00.088165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-72efb82d-1068-4dd1-9c80-80a663252923 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:00.088796 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-72efb82d-1068-4dd1-9c80-80a663252923 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 404cc144-d657-4260-a0e9-fdd708b699d8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:00.095063 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-72efb82d-1068-4dd1-9c80-80a663252923 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:00.095580 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-72efb82d-1068-4dd1-9c80-80a663252923 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:00.096157 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-72efb82d-1068-4dd1-9c80-80a663252923 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:00.096871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-72efb82d-1068-4dd1-9c80-80a663252923 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:00.097318 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-72efb82d-1068-4dd1-9c80-80a663252923 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:00.097736 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-72efb82d-1068-4dd1-9c80-80a663252923 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:00.229087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-72efb82d-1068-4dd1-9c80-80a663252923 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:00.236935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-72efb82d-1068-4dd1-9c80-80a663252923 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8" status: 200 len: 1264 microversion: 2.1 time: 0.152142 Aug 10 13:27:00.237575 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2073/3778] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:00 2022] GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:27:01.257705 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c2ddcf4f-1b77-4998-98ca-6978e46abf23 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:01.258322 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c2ddcf4f-1b77-4998-98ca-6978e46abf23 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 404cc144-d657-4260-a0e9-fdd708b699d8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:01.264772 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2ddcf4f-1b77-4998-98ca-6978e46abf23 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:01.265248 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2ddcf4f-1b77-4998-98ca-6978e46abf23 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:01.265679 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2ddcf4f-1b77-4998-98ca-6978e46abf23 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:01.266361 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2ddcf4f-1b77-4998-98ca-6978e46abf23 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:01.266809 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2ddcf4f-1b77-4998-98ca-6978e46abf23 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:01.267255 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c2ddcf4f-1b77-4998-98ca-6978e46abf23 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:01.467994 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c2ddcf4f-1b77-4998-98ca-6978e46abf23 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:01.476249 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c2ddcf4f-1b77-4998-98ca-6978e46abf23 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8" status: 200 len: 1264 microversion: 2.1 time: 0.222378 Aug 10 13:27:01.476749 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2074/3779] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:01 2022] GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8 => generated 1264 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:27:02.496645 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c9dca200-52d1-4643-8623-3508e95f62b5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:02.497299 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c9dca200-52d1-4643-8623-3508e95f62b5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 404cc144-d657-4260-a0e9-fdd708b699d8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:02.504498 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9dca200-52d1-4643-8623-3508e95f62b5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:02.504997 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9dca200-52d1-4643-8623-3508e95f62b5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:02.505429 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9dca200-52d1-4643-8623-3508e95f62b5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:02.506110 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9dca200-52d1-4643-8623-3508e95f62b5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:02.506558 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9dca200-52d1-4643-8623-3508e95f62b5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:02.506976 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c9dca200-52d1-4643-8623-3508e95f62b5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:02.638962 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c9dca200-52d1-4643-8623-3508e95f62b5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:02.647084 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c9dca200-52d1-4643-8623-3508e95f62b5 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8" status: 200 len: 1264 microversion: 2.1 time: 0.154369 Aug 10 13:27:02.647685 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2075/3780] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:02 2022] GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:27:03.667474 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1f45a4b3-6270-42a0-8789-8451d0e9511c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:03.668083 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1f45a4b3-6270-42a0-8789-8451d0e9511c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 404cc144-d657-4260-a0e9-fdd708b699d8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:03.674442 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1f45a4b3-6270-42a0-8789-8451d0e9511c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:03.674920 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1f45a4b3-6270-42a0-8789-8451d0e9511c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:03.675385 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1f45a4b3-6270-42a0-8789-8451d0e9511c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:03.676064 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1f45a4b3-6270-42a0-8789-8451d0e9511c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:03.676509 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1f45a4b3-6270-42a0-8789-8451d0e9511c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:03.676926 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1f45a4b3-6270-42a0-8789-8451d0e9511c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:03.808061 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-1f45a4b3-6270-42a0-8789-8451d0e9511c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:03.815556 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1f45a4b3-6270-42a0-8789-8451d0e9511c tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8" status: 200 len: 1264 microversion: 2.1 time: 0.151950 Aug 10 13:27:03.816361 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2076/3781] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:03 2022] GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:27:03.870670 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-dde53d60-2c96-4aa7-b858-9a3f7e25a337 req-db96ac9e-7038-4475-a9ed-a9fdb4cc966f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "404cc144-d657-4260-a0e9-fdd708b699d8", "name": "network-vif-plugged", "status": "completed", "tag": "8c67024d-a5cc-445a-8781-3835732be0d6"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:27:03.880412 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-dde53d60-2c96-4aa7-b858-9a3f7e25a337 req-db96ac9e-7038-4475-a9ed-a9fdb4cc966f service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:03.880891 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-dde53d60-2c96-4aa7-b858-9a3f7e25a337 req-db96ac9e-7038-4475-a9ed-a9fdb4cc966f service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:03.881326 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-dde53d60-2c96-4aa7-b858-9a3f7e25a337 req-db96ac9e-7038-4475-a9ed-a9fdb4cc966f service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:03.892242 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-dde53d60-2c96-4aa7-b858-9a3f7e25a337 req-db96ac9e-7038-4475-a9ed-a9fdb4cc966f service nova] Creating event network-vif-plugged:8c67024d-a5cc-445a-8781-3835732be0d6 for instance 404cc144-d657-4260-a0e9-fdd708b699d8 on hv-cinder-85199 Aug 10 13:27:03.897946 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-dde53d60-2c96-4aa7-b858-9a3f7e25a337 req-db96ac9e-7038-4475-a9ed-a9fdb4cc966f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031049 Aug 10 13:27:03.898521 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2077/3782] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:27:04.837970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ec409e38-9117-4d3c-ac40-79a3e417287f tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:04.838674 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ec409e38-9117-4d3c-ac40-79a3e417287f tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 404cc144-d657-4260-a0e9-fdd708b699d8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:04.844729 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec409e38-9117-4d3c-ac40-79a3e417287f tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:04.845202 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec409e38-9117-4d3c-ac40-79a3e417287f tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:04.846174 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec409e38-9117-4d3c-ac40-79a3e417287f tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:04.846855 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec409e38-9117-4d3c-ac40-79a3e417287f tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:04.847327 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec409e38-9117-4d3c-ac40-79a3e417287f tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:04.847752 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ec409e38-9117-4d3c-ac40-79a3e417287f tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:04.982466 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ec409e38-9117-4d3c-ac40-79a3e417287f tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:04.989862 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ec409e38-9117-4d3c-ac40-79a3e417287f tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8" status: 200 len: 1264 microversion: 2.1 time: 0.156888 Aug 10 13:27:04.990435 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2078/3783] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:04 2022] GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:27:06.011123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-894e8063-237f-49d0-b7fe-a13896b7e1c2 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:06.011807 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-894e8063-237f-49d0-b7fe-a13896b7e1c2 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 404cc144-d657-4260-a0e9-fdd708b699d8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:06.018050 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-894e8063-237f-49d0-b7fe-a13896b7e1c2 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:06.018520 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-894e8063-237f-49d0-b7fe-a13896b7e1c2 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:06.018951 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-894e8063-237f-49d0-b7fe-a13896b7e1c2 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:06.019669 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-894e8063-237f-49d0-b7fe-a13896b7e1c2 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:06.020116 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-894e8063-237f-49d0-b7fe-a13896b7e1c2 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:06.020545 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-894e8063-237f-49d0-b7fe-a13896b7e1c2 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:06.148985 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-894e8063-237f-49d0-b7fe-a13896b7e1c2 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:06.156483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-894e8063-237f-49d0-b7fe-a13896b7e1c2 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8" status: 200 len: 1451 microversion: 2.1 time: 0.149244 Aug 10 13:27:06.157060 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2079/3784] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:06 2022] GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:27:06.176422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-6c57b35c-1df5-4fb2-a55a-6a6bfc093758 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:27:06.177030 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-6c57b35c-1df5-4fb2-a55a-6a6bfc093758 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 404cc144-d657-4260-a0e9-fdd708b699d8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:27:06.182597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6c57b35c-1df5-4fb2-a55a-6a6bfc093758 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:06.183080 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6c57b35c-1df5-4fb2-a55a-6a6bfc093758 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:06.183549 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6c57b35c-1df5-4fb2-a55a-6a6bfc093758 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:06.184232 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6c57b35c-1df5-4fb2-a55a-6a6bfc093758 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:06.184684 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6c57b35c-1df5-4fb2-a55a-6a6bfc093758 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:06.185108 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-6c57b35c-1df5-4fb2-a55a-6a6bfc093758 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:06.317553 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-6c57b35c-1df5-4fb2-a55a-6a6bfc093758 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:27:06.324993 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-6c57b35c-1df5-4fb2-a55a-6a6bfc093758 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8" status: 200 len: 1451 microversion: 2.1 time: 0.152282 Aug 10 13:27:06.325563 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2080/3785] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:27:06 2022] GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:27:08.126081 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-836c6c53-1c12-4492-9cb0-73eb7b7ceb1b req-bd9e2c20-2940-44ca-8a42-4430863907b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "404cc144-d657-4260-a0e9-fdd708b699d8", "tag": "8c67024d-a5cc-445a-8781-3835732be0d6"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:27:08.136827 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-836c6c53-1c12-4492-9cb0-73eb7b7ceb1b req-bd9e2c20-2940-44ca-8a42-4430863907b5 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:27:08.137214 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-836c6c53-1c12-4492-9cb0-73eb7b7ceb1b req-bd9e2c20-2940-44ca-8a42-4430863907b5 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:27:08.137636 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-836c6c53-1c12-4492-9cb0-73eb7b7ceb1b req-bd9e2c20-2940-44ca-8a42-4430863907b5 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:27:08.149379 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-836c6c53-1c12-4492-9cb0-73eb7b7ceb1b req-bd9e2c20-2940-44ca-8a42-4430863907b5 service nova] Creating event network-changed:8c67024d-a5cc-445a-8781-3835732be0d6 for instance 404cc144-d657-4260-a0e9-fdd708b699d8 on hv-cinder-85199 Aug 10 13:27:08.154190 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-836c6c53-1c12-4492-9cb0-73eb7b7ceb1b req-bd9e2c20-2940-44ca-8a42-4430863907b5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031806 Aug 10 13:27:08.154990 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2081/3786] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:28:42.834341 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:28:42.835079 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=50 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:28:42.839557 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-2e67b60b-d999-49e1-8c41-1ee85c4d3b69 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-239030474", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1539369100", "security_groups": [{"name": "tempest-secgroup-smoke-625718518"}], "block_device_mapping_v2": [{"uuid": "a0e417b6-96ca-43e5-b08b-88246600ca5b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "906fbc8d-0bd6-4281-ad75-5028e24e27ce"}]}} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:28:42.955392 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.network.neutron [None req-2e67b60b-d999-49e1-8c41-1ee85c4d3b69 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] validate_networks() for [('906fbc8d-0bd6-4281-ad75-5028e24e27ce', None, None, None, None, None)] {{(pid=124643) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 13:28:43.577815 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-2e67b60b-d999-49e1-8c41-1ee85c4d3b69 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Flavor limits 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 13:28:43.578231 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-2e67b60b-d999-49e1-8c41-1ee85c4d3b69 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Image limits 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 13:28:43.578700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-2e67b60b-d999-49e1-8c41-1ee85c4d3b69 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Flavor pref 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 13:28:43.579104 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-2e67b60b-d999-49e1-8c41-1ee85c4d3b69 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Image pref 0:0:0 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 13:28:43.579541 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.virt.hardware [None req-2e67b60b-d999-49e1-8c41-1ee85c4d3b69 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 13:28:43.588543 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e67b60b-d999-49e1-8c41-1ee85c4d3b69 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:43.589015 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e67b60b-d999-49e1-8c41-1ee85c4d3b69 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:43.589441 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e67b60b-d999-49e1-8c41-1ee85c4d3b69 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:43.590154 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e67b60b-d999-49e1-8c41-1ee85c4d3b69 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:43.590597 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e67b60b-d999-49e1-8c41-1ee85c4d3b69 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:43.591016 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-2e67b60b-d999-49e1-8c41-1ee85c4d3b69 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:43.607253 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-2e67b60b-d999-49e1-8c41-1ee85c4d3b69 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Getting quotas for project 2a40aefbd17f4dbc911527a917f03976. Resources: {'cores', 'ram', 'instances'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 13:28:43.611087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.quota [None req-2e67b60b-d999-49e1-8c41-1ee85c4d3b69 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Getting quotas for user eaa1bdd8c2f34ebc90d7f5b6ec4c2d51 and project 2a40aefbd17f4dbc911527a917f03976. Resources: {'cores', 'ram', 'instances'} {{(pid=124643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 13:28:43.666782 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2e67b60b-d999-49e1-8c41-1ee85c4d3b69 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Going to run 1 instances... {{(pid=124643) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 13:28:43.669229 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-2e67b60b-d999-49e1-8c41-1ee85c4d3b69 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3d548803-e5f8-4f42-a51f-aade5f21e009] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a0e417b6-96ca-43e5-b08b-88246600ca5b',volume_size=None,volume_type=None)] {{(pid=124643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 13:28:44.069192 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-2e67b60b-d999-49e1-8c41-1ee85c4d3b69 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.237070 Aug 10 13:28:44.070246 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2082/3787] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 10 13:28:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 1239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 13:28:44.080813 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-49d3b7be-12bf-43f8-a4d1-6758315b385e tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:44.081402 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-49d3b7be-12bf-43f8-a4d1-6758315b385e tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3d548803-e5f8-4f42-a51f-aade5f21e009] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:44.135139 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-49d3b7be-12bf-43f8-a4d1-6758315b385e tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:44.142022 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-49d3b7be-12bf-43f8-a4d1-6758315b385e tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009" status: 200 len: 1094 microversion: 2.1 time: 0.065114 Aug 10 13:28:44.142591 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2083/3788] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:44 2022] GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:45.162343 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-f7770629-5b4d-49ba-b17f-32cfc36f7f5f tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:45.163117 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-f7770629-5b4d-49ba-b17f-32cfc36f7f5f tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3d548803-e5f8-4f42-a51f-aade5f21e009] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:45.170451 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f7770629-5b4d-49ba-b17f-32cfc36f7f5f tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:45.170991 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f7770629-5b4d-49ba-b17f-32cfc36f7f5f tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:45.171431 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f7770629-5b4d-49ba-b17f-32cfc36f7f5f tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:45.172422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f7770629-5b4d-49ba-b17f-32cfc36f7f5f tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:45.172871 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f7770629-5b4d-49ba-b17f-32cfc36f7f5f tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:45.176905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-f7770629-5b4d-49ba-b17f-32cfc36f7f5f tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:45.235881 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-f7770629-5b4d-49ba-b17f-32cfc36f7f5f tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:45.245864 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-f7770629-5b4d-49ba-b17f-32cfc36f7f5f tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009" status: 200 len: 1136 microversion: 2.1 time: 0.087720 Aug 10 13:28:45.246441 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2084/3789] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:45 2022] GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009 => generated 1136 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:28:46.267615 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-65442be7-8b17-4831-9b3c-fc7c7eaa3974 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:46.268256 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-65442be7-8b17-4831-9b3c-fc7c7eaa3974 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3d548803-e5f8-4f42-a51f-aade5f21e009] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:46.275069 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-65442be7-8b17-4831-9b3c-fc7c7eaa3974 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:46.275648 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-65442be7-8b17-4831-9b3c-fc7c7eaa3974 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:46.276092 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-65442be7-8b17-4831-9b3c-fc7c7eaa3974 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:46.276794 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-65442be7-8b17-4831-9b3c-fc7c7eaa3974 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:46.277247 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-65442be7-8b17-4831-9b3c-fc7c7eaa3974 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:46.277670 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-65442be7-8b17-4831-9b3c-fc7c7eaa3974 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:46.340595 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-65442be7-8b17-4831-9b3c-fc7c7eaa3974 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:46.348594 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-65442be7-8b17-4831-9b3c-fc7c7eaa3974 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009" status: 200 len: 1210 microversion: 2.1 time: 0.084852 Aug 10 13:28:46.349209 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2085/3790] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:46 2022] GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009 => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:28:47.370320 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-7dd6a71d-059d-4df3-bc7c-2a02cf5e4ef4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:47.370957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-7dd6a71d-059d-4df3-bc7c-2a02cf5e4ef4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3d548803-e5f8-4f42-a51f-aade5f21e009] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:47.377364 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7dd6a71d-059d-4df3-bc7c-2a02cf5e4ef4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:47.377840 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7dd6a71d-059d-4df3-bc7c-2a02cf5e4ef4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:47.378269 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7dd6a71d-059d-4df3-bc7c-2a02cf5e4ef4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:47.378957 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7dd6a71d-059d-4df3-bc7c-2a02cf5e4ef4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:47.379429 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7dd6a71d-059d-4df3-bc7c-2a02cf5e4ef4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:47.379849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-7dd6a71d-059d-4df3-bc7c-2a02cf5e4ef4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:47.514202 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-7dd6a71d-059d-4df3-bc7c-2a02cf5e4ef4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:47.521917 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-7dd6a71d-059d-4df3-bc7c-2a02cf5e4ef4 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009" status: 200 len: 1265 microversion: 2.1 time: 0.155690 Aug 10 13:28:47.522493 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2086/3791] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:47 2022] GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:28:47.797436 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-6ba27e4f-3b56-43a9-b521-9037edae4c54 req-35e485d9-c266-403f-8117-0d073b3bfcc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d548803-e5f8-4f42-a51f-aade5f21e009", "tag": "67869b18-4bd8-40c5-8535-f0af0d356f78"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:28:47.807309 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-6ba27e4f-3b56-43a9-b521-9037edae4c54 req-35e485d9-c266-403f-8117-0d073b3bfcc5 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:47.807786 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-6ba27e4f-3b56-43a9-b521-9037edae4c54 req-35e485d9-c266-403f-8117-0d073b3bfcc5 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:47.808213 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-6ba27e4f-3b56-43a9-b521-9037edae4c54 req-35e485d9-c266-403f-8117-0d073b3bfcc5 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:47.819106 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-6ba27e4f-3b56-43a9-b521-9037edae4c54 req-35e485d9-c266-403f-8117-0d073b3bfcc5 service nova] Creating event network-changed:67869b18-4bd8-40c5-8535-f0af0d356f78 for instance 3d548803-e5f8-4f42-a51f-aade5f21e009 on hv-cinder-85199 Aug 10 13:28:47.824644 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-6ba27e4f-3b56-43a9-b521-9037edae4c54 req-35e485d9-c266-403f-8117-0d073b3bfcc5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087484 Aug 10 13:28:47.825239 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2087/3792] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:28:48.544981 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3272dede-ef57-4c23-8604-c01b0c61c147 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:48.545611 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3272dede-ef57-4c23-8604-c01b0c61c147 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3d548803-e5f8-4f42-a51f-aade5f21e009] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:48.551737 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3272dede-ef57-4c23-8604-c01b0c61c147 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:48.552221 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3272dede-ef57-4c23-8604-c01b0c61c147 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:48.552654 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3272dede-ef57-4c23-8604-c01b0c61c147 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:48.553345 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3272dede-ef57-4c23-8604-c01b0c61c147 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:48.553793 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3272dede-ef57-4c23-8604-c01b0c61c147 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:48.554219 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3272dede-ef57-4c23-8604-c01b0c61c147 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:48.684842 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3272dede-ef57-4c23-8604-c01b0c61c147 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:48.692384 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3272dede-ef57-4c23-8604-c01b0c61c147 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009" status: 200 len: 1265 microversion: 2.1 time: 0.152461 Aug 10 13:28:48.693052 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2088/3793] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:48 2022] GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:28:49.714751 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-567b53e7-aefd-4e5d-a69c-df291867d761 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:49.715441 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-567b53e7-aefd-4e5d-a69c-df291867d761 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3d548803-e5f8-4f42-a51f-aade5f21e009] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:49.721659 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-567b53e7-aefd-4e5d-a69c-df291867d761 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:49.722132 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-567b53e7-aefd-4e5d-a69c-df291867d761 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:49.722554 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-567b53e7-aefd-4e5d-a69c-df291867d761 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:49.723258 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-567b53e7-aefd-4e5d-a69c-df291867d761 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:49.723705 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-567b53e7-aefd-4e5d-a69c-df291867d761 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:49.724123 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-567b53e7-aefd-4e5d-a69c-df291867d761 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:49.857968 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-567b53e7-aefd-4e5d-a69c-df291867d761 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:49.865360 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-567b53e7-aefd-4e5d-a69c-df291867d761 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009" status: 200 len: 1265 microversion: 2.1 time: 0.155412 Aug 10 13:28:49.865919 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2089/3794] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:49 2022] GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:28:50.886409 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b87f65a0-c6d1-4448-a7d3-7bc0ff9fc6e6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:50.886970 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b87f65a0-c6d1-4448-a7d3-7bc0ff9fc6e6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3d548803-e5f8-4f42-a51f-aade5f21e009] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:50.893278 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b87f65a0-c6d1-4448-a7d3-7bc0ff9fc6e6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:50.893749 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b87f65a0-c6d1-4448-a7d3-7bc0ff9fc6e6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:50.894207 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b87f65a0-c6d1-4448-a7d3-7bc0ff9fc6e6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:50.894884 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b87f65a0-c6d1-4448-a7d3-7bc0ff9fc6e6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:50.895356 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b87f65a0-c6d1-4448-a7d3-7bc0ff9fc6e6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:50.895772 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b87f65a0-c6d1-4448-a7d3-7bc0ff9fc6e6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:51.027959 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b87f65a0-c6d1-4448-a7d3-7bc0ff9fc6e6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:51.035482 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b87f65a0-c6d1-4448-a7d3-7bc0ff9fc6e6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009" status: 200 len: 1265 microversion: 2.1 time: 0.153575 Aug 10 13:28:51.036054 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2090/3795] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:50 2022] GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:28:52.057629 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a0c18f71-88ff-41f4-81d3-c061e266c05e tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:52.058302 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a0c18f71-88ff-41f4-81d3-c061e266c05e tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3d548803-e5f8-4f42-a51f-aade5f21e009] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:52.064681 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a0c18f71-88ff-41f4-81d3-c061e266c05e tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:52.065158 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a0c18f71-88ff-41f4-81d3-c061e266c05e tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:52.065589 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a0c18f71-88ff-41f4-81d3-c061e266c05e tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:52.066298 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a0c18f71-88ff-41f4-81d3-c061e266c05e tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:52.066745 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a0c18f71-88ff-41f4-81d3-c061e266c05e tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:52.067164 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a0c18f71-88ff-41f4-81d3-c061e266c05e tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:52.201453 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a0c18f71-88ff-41f4-81d3-c061e266c05e tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:52.209113 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a0c18f71-88ff-41f4-81d3-c061e266c05e tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009" status: 200 len: 1265 microversion: 2.1 time: 0.156033 Aug 10 13:28:52.209688 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2091/3796] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:52 2022] GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:28:53.231132 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-ff5e9244-917a-4103-a9fe-31e44c7772a2 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:53.231820 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-ff5e9244-917a-4103-a9fe-31e44c7772a2 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3d548803-e5f8-4f42-a51f-aade5f21e009] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:53.238082 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff5e9244-917a-4103-a9fe-31e44c7772a2 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:53.238559 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff5e9244-917a-4103-a9fe-31e44c7772a2 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:53.238987 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff5e9244-917a-4103-a9fe-31e44c7772a2 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:53.239690 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff5e9244-917a-4103-a9fe-31e44c7772a2 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:53.240136 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff5e9244-917a-4103-a9fe-31e44c7772a2 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:53.240554 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-ff5e9244-917a-4103-a9fe-31e44c7772a2 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:53.369696 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-ff5e9244-917a-4103-a9fe-31e44c7772a2 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:53.377100 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-ff5e9244-917a-4103-a9fe-31e44c7772a2 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009" status: 200 len: 1265 microversion: 2.1 time: 0.150778 Aug 10 13:28:53.377680 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2092/3797] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:53 2022] GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:28:54.397373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-870d8b22-91be-457f-8e66-b358150abb66 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:54.398719 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-870d8b22-91be-457f-8e66-b358150abb66 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3d548803-e5f8-4f42-a51f-aade5f21e009] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:54.408711 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=2 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:28:54.408711 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell0:SELECT=8 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:28:54.408711 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-870d8b22-91be-457f-8e66-b358150abb66 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:54.408711 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-870d8b22-91be-457f-8e66-b358150abb66 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:54.408711 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-870d8b22-91be-457f-8e66-b358150abb66 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:54.409196 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-870d8b22-91be-457f-8e66-b358150abb66 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:54.409196 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-870d8b22-91be-457f-8e66-b358150abb66 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:54.409196 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-870d8b22-91be-457f-8e66-b358150abb66 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:54.542766 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-870d8b22-91be-457f-8e66-b358150abb66 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:54.550373 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-870d8b22-91be-457f-8e66-b358150abb66 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009" status: 200 len: 1265 microversion: 2.1 time: 0.156819 Aug 10 13:28:54.551838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2093/3798] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:54 2022] GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:28:55.570995 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-4fb37e40-ddea-4679-89ab-93a22c7d33a0 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:55.571673 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-4fb37e40-ddea-4679-89ab-93a22c7d33a0 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3d548803-e5f8-4f42-a51f-aade5f21e009] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:55.577994 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4fb37e40-ddea-4679-89ab-93a22c7d33a0 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:55.578478 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4fb37e40-ddea-4679-89ab-93a22c7d33a0 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:55.578915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4fb37e40-ddea-4679-89ab-93a22c7d33a0 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:55.579899 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4fb37e40-ddea-4679-89ab-93a22c7d33a0 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:55.580354 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4fb37e40-ddea-4679-89ab-93a22c7d33a0 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:55.580781 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-4fb37e40-ddea-4679-89ab-93a22c7d33a0 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:55.713907 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-4fb37e40-ddea-4679-89ab-93a22c7d33a0 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:55.721322 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-4fb37e40-ddea-4679-89ab-93a22c7d33a0 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009" status: 200 len: 1265 microversion: 2.1 time: 0.154576 Aug 10 13:28:55.721889 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2094/3799] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:55 2022] GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:28:56.509757 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-42f3fce9-26ad-4d86-95fb-4d6d6799bb01 req-fae1fe24-9944-4ba5-9fbc-78583a1abfca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d548803-e5f8-4f42-a51f-aade5f21e009", "name": "network-vif-plugged", "status": "completed", "tag": "67869b18-4bd8-40c5-8535-f0af0d356f78"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:28:56.519138 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-42f3fce9-26ad-4d86-95fb-4d6d6799bb01 req-fae1fe24-9944-4ba5-9fbc-78583a1abfca service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:56.522575 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-42f3fce9-26ad-4d86-95fb-4d6d6799bb01 req-fae1fe24-9944-4ba5-9fbc-78583a1abfca service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:56.522575 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-42f3fce9-26ad-4d86-95fb-4d6d6799bb01 req-fae1fe24-9944-4ba5-9fbc-78583a1abfca service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:56.531637 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-42f3fce9-26ad-4d86-95fb-4d6d6799bb01 req-fae1fe24-9944-4ba5-9fbc-78583a1abfca service nova] Creating event network-vif-plugged:67869b18-4bd8-40c5-8535-f0af0d356f78 for instance 3d548803-e5f8-4f42-a51f-aade5f21e009 on hv-cinder-85199 Aug 10 13:28:56.536540 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-42f3fce9-26ad-4d86-95fb-4d6d6799bb01 req-fae1fe24-9944-4ba5-9fbc-78583a1abfca service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031221 Aug 10 13:28:56.537176 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2095/3800] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:28:56.743095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-c7c921c3-6e73-4036-8bcc-694d6a938ca3 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:56.743823 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-c7c921c3-6e73-4036-8bcc-694d6a938ca3 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3d548803-e5f8-4f42-a51f-aade5f21e009] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:56.750095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7c921c3-6e73-4036-8bcc-694d6a938ca3 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:56.750575 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7c921c3-6e73-4036-8bcc-694d6a938ca3 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:56.751005 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7c921c3-6e73-4036-8bcc-694d6a938ca3 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:56.751717 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7c921c3-6e73-4036-8bcc-694d6a938ca3 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:56.752165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7c921c3-6e73-4036-8bcc-694d6a938ca3 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:56.752585 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-c7c921c3-6e73-4036-8bcc-694d6a938ca3 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:56.889703 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-c7c921c3-6e73-4036-8bcc-694d6a938ca3 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:56.897422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-c7c921c3-6e73-4036-8bcc-694d6a938ca3 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009" status: 200 len: 1265 microversion: 2.1 time: 0.159078 Aug 10 13:28:56.902422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2096/3801] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:56 2022] GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:28:57.918458 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-3ea0e1ab-8183-4dbb-98bf-ee971dd7c290 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:57.919118 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-3ea0e1ab-8183-4dbb-98bf-ee971dd7c290 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3d548803-e5f8-4f42-a51f-aade5f21e009] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:57.925498 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ea0e1ab-8183-4dbb-98bf-ee971dd7c290 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:57.925981 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ea0e1ab-8183-4dbb-98bf-ee971dd7c290 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:57.926421 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ea0e1ab-8183-4dbb-98bf-ee971dd7c290 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:57.927168 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ea0e1ab-8183-4dbb-98bf-ee971dd7c290 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:57.927647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ea0e1ab-8183-4dbb-98bf-ee971dd7c290 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:57.929555 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-3ea0e1ab-8183-4dbb-98bf-ee971dd7c290 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:58.064693 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-3ea0e1ab-8183-4dbb-98bf-ee971dd7c290 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:58.072927 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-3ea0e1ab-8183-4dbb-98bf-ee971dd7c290 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009" status: 200 len: 1265 microversion: 2.1 time: 0.158410 Aug 10 13:28:58.073497 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2097/3802] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:57 2022] GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:28:59.093896 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-5239e3af-8236-4183-a9b8-1569dc80407b tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:59.094512 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-5239e3af-8236-4183-a9b8-1569dc80407b tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3d548803-e5f8-4f42-a51f-aade5f21e009] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:59.101454 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5239e3af-8236-4183-a9b8-1569dc80407b tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:59.101935 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5239e3af-8236-4183-a9b8-1569dc80407b tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:59.102371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5239e3af-8236-4183-a9b8-1569dc80407b tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:59.103057 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5239e3af-8236-4183-a9b8-1569dc80407b tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:59.103551 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5239e3af-8236-4183-a9b8-1569dc80407b tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:59.103974 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-5239e3af-8236-4183-a9b8-1569dc80407b tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:59.235071 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-5239e3af-8236-4183-a9b8-1569dc80407b tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:59.243303 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-5239e3af-8236-4183-a9b8-1569dc80407b tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009" status: 200 len: 1452 microversion: 2.1 time: 0.153241 Aug 10 13:28:59.243880 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2098/3803] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:59 2022] GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:28:59.263484 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-8d861c51-d3d8-4016-b0be-902a3586df7b tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:28:59.264095 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-8d861c51-d3d8-4016-b0be-902a3586df7b tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3d548803-e5f8-4f42-a51f-aade5f21e009] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:28:59.269973 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d861c51-d3d8-4016-b0be-902a3586df7b tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:59.270460 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d861c51-d3d8-4016-b0be-902a3586df7b tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:59.270901 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d861c51-d3d8-4016-b0be-902a3586df7b tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:59.271617 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d861c51-d3d8-4016-b0be-902a3586df7b tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:28:59.272072 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d861c51-d3d8-4016-b0be-902a3586df7b tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:28:59.272502 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-8d861c51-d3d8-4016-b0be-902a3586df7b tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:28:59.405519 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-8d861c51-d3d8-4016-b0be-902a3586df7b tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:28:59.412857 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-8d861c51-d3d8-4016-b0be-902a3586df7b tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009" status: 200 len: 1452 microversion: 2.1 time: 0.153137 Aug 10 13:28:59.414313 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2099/3804] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:28:59 2022] GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:29:01.293314 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-0a3ebf3e-ac1f-48b1-8e82-1da7673176b0 req-458a034c-babc-45a2-b3bb-7bea1b58c303 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d548803-e5f8-4f42-a51f-aade5f21e009", "tag": "67869b18-4bd8-40c5-8535-f0af0d356f78"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:29:01.303507 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-0a3ebf3e-ac1f-48b1-8e82-1da7673176b0 req-458a034c-babc-45a2-b3bb-7bea1b58c303 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:29:01.304215 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-0a3ebf3e-ac1f-48b1-8e82-1da7673176b0 req-458a034c-babc-45a2-b3bb-7bea1b58c303 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:29:01.304652 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-0a3ebf3e-ac1f-48b1-8e82-1da7673176b0 req-458a034c-babc-45a2-b3bb-7bea1b58c303 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:29:01.316073 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-0a3ebf3e-ac1f-48b1-8e82-1da7673176b0 req-458a034c-babc-45a2-b3bb-7bea1b58c303 service nova] Creating event network-changed:67869b18-4bd8-40c5-8535-f0af0d356f78 for instance 3d548803-e5f8-4f42-a51f-aade5f21e009 on hv-cinder-85199 Aug 10 13:29:01.321612 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-0a3ebf3e-ac1f-48b1-8e82-1da7673176b0 req-458a034c-babc-45a2-b3bb-7bea1b58c303 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032075 Aug 10 13:29:01.322472 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2100/3805] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:30:01.533743 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:30:01.534390 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Wed Aug 10 13:30:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:30:33.284776 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:30:33.285524 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG dbcounter [-] [124643] Writing DB stats nova_cell1:SELECT=92 {{(pid=124643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 13:30:33.290159 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-1d69f9ac-bff5-4022-9220-20426041717d tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:33.295391 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1d69f9ac-bff5-4022-9220-20426041717d tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3d548803-e5f8-4f42-a51f-aade5f21e009] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:33.297146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d69f9ac-bff5-4022-9220-20426041717d tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:33.297655 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d69f9ac-bff5-4022-9220-20426041717d tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:33.298230 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d69f9ac-bff5-4022-9220-20426041717d tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:33.298915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d69f9ac-bff5-4022-9220-20426041717d tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:33.299405 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d69f9ac-bff5-4022-9220-20426041717d tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:33.299895 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-1d69f9ac-bff5-4022-9220-20426041717d tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:33.325784 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-1d69f9ac-bff5-4022-9220-20426041717d tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3d548803-e5f8-4f42-a51f-aade5f21e009] Going to try to terminate instance {{(pid=124643) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:30:33.611284 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-1d69f9ac-bff5-4022-9220-20426041717d tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009" status: 204 len: 0 microversion: 2.1 time: 0.332848 Aug 10 13:30:33.611950 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2101/3806] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 13:30:33 2022] DELETE /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 13:30:33.671973 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-0597d947-cf39-4f51-8103-0bb9db471fd1 req-b88d02d3-cb4a-4708-9503-12ea43d4830e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d548803-e5f8-4f42-a51f-aade5f21e009", "tag": "67869b18-4bd8-40c5-8535-f0af0d356f78"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:33.681595 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-0597d947-cf39-4f51-8103-0bb9db471fd1 req-b88d02d3-cb4a-4708-9503-12ea43d4830e service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:33.682069 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-0597d947-cf39-4f51-8103-0bb9db471fd1 req-b88d02d3-cb4a-4708-9503-12ea43d4830e service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:33.682494 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-0597d947-cf39-4f51-8103-0bb9db471fd1 req-b88d02d3-cb4a-4708-9503-12ea43d4830e service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:33.693447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-0597d947-cf39-4f51-8103-0bb9db471fd1 req-b88d02d3-cb4a-4708-9503-12ea43d4830e service nova] Creating event network-changed:67869b18-4bd8-40c5-8535-f0af0d356f78 for instance 3d548803-e5f8-4f42-a51f-aade5f21e009 on hv-cinder-85199 Aug 10 13:30:33.698410 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-0597d947-cf39-4f51-8103-0bb9db471fd1 req-b88d02d3-cb4a-4708-9503-12ea43d4830e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085004 Aug 10 13:30:33.698990 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2102/3807] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:30:33.704144 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-b231df7b-8b7d-4744-835c-f5478d154049 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:33.704839 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-b231df7b-8b7d-4744-835c-f5478d154049 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3d548803-e5f8-4f42-a51f-aade5f21e009] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:33.711317 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b231df7b-8b7d-4744-835c-f5478d154049 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:33.711836 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b231df7b-8b7d-4744-835c-f5478d154049 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:33.712276 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b231df7b-8b7d-4744-835c-f5478d154049 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:33.712965 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b231df7b-8b7d-4744-835c-f5478d154049 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:33.713418 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b231df7b-8b7d-4744-835c-f5478d154049 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:33.713847 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-b231df7b-8b7d-4744-835c-f5478d154049 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:33.853893 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-b231df7b-8b7d-4744-835c-f5478d154049 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:33.861646 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-b231df7b-8b7d-4744-835c-f5478d154049 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009" status: 200 len: 1577 microversion: 2.1 time: 0.161515 Aug 10 13:30:33.862299 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2103/3808] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:33 2022] GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:34.884881 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-24f4702e-6124-486f-8290-be2b9d07a83e tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:34.885559 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-24f4702e-6124-486f-8290-be2b9d07a83e tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3d548803-e5f8-4f42-a51f-aade5f21e009] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:34.891881 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24f4702e-6124-486f-8290-be2b9d07a83e tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:34.892367 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24f4702e-6124-486f-8290-be2b9d07a83e tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:34.892802 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24f4702e-6124-486f-8290-be2b9d07a83e tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:34.893523 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24f4702e-6124-486f-8290-be2b9d07a83e tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:34.893978 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24f4702e-6124-486f-8290-be2b9d07a83e tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:34.894423 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-24f4702e-6124-486f-8290-be2b9d07a83e tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:35.025229 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-24f4702e-6124-486f-8290-be2b9d07a83e tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:35.032721 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-24f4702e-6124-486f-8290-be2b9d07a83e tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009" status: 200 len: 1577 microversion: 2.1 time: 0.151890 Aug 10 13:30:35.033288 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2104/3809] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:34 2022] GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:30:35.778662 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-b5b06796-279c-4c17-b373-cb7d59fcc59a req-346cfefb-48cd-48b0-b5ee-37e19b8587a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d548803-e5f8-4f42-a51f-aade5f21e009", "name": "network-vif-deleted", "tag": "67869b18-4bd8-40c5-8535-f0af0d356f78"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:35.787694 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-b5b06796-279c-4c17-b373-cb7d59fcc59a req-346cfefb-48cd-48b0-b5ee-37e19b8587a4 service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:35.788153 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-b5b06796-279c-4c17-b373-cb7d59fcc59a req-346cfefb-48cd-48b0-b5ee-37e19b8587a4 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:35.788568 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-b5b06796-279c-4c17-b373-cb7d59fcc59a req-346cfefb-48cd-48b0-b5ee-37e19b8587a4 service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:35.799423 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-b5b06796-279c-4c17-b373-cb7d59fcc59a req-346cfefb-48cd-48b0-b5ee-37e19b8587a4 service nova] Creating event network-vif-deleted:67869b18-4bd8-40c5-8535-f0af0d356f78 for instance 3d548803-e5f8-4f42-a51f-aade5f21e009 on hv-cinder-85199 Aug 10 13:30:35.804297 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-b5b06796-279c-4c17-b373-cb7d59fcc59a req-346cfefb-48cd-48b0-b5ee-37e19b8587a4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029261 Aug 10 13:30:35.805474 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2105/3810] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:30:36.055790 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-38424730-5063-4c9d-ac79-346ddaa10810 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:36.056585 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-38424730-5063-4c9d-ac79-346ddaa10810 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3d548803-e5f8-4f42-a51f-aade5f21e009] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:36.062897 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38424730-5063-4c9d-ac79-346ddaa10810 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:36.063422 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38424730-5063-4c9d-ac79-346ddaa10810 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:36.063853 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38424730-5063-4c9d-ac79-346ddaa10810 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:36.064555 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38424730-5063-4c9d-ac79-346ddaa10810 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:36.065002 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38424730-5063-4c9d-ac79-346ddaa10810 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:36.065424 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-38424730-5063-4c9d-ac79-346ddaa10810 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:36.137482 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-38424730-5063-4c9d-ac79-346ddaa10810 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:36.145492 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-38424730-5063-4c9d-ac79-346ddaa10810 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009" status: 200 len: 1225 microversion: 2.1 time: 0.095131 Aug 10 13:30:36.146250 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2106/3811] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:36 2022] GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:37.166641 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a8b8b0f5-53a8-471c-ab4b-b110a3064398 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:37.167272 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a8b8b0f5-53a8-471c-ab4b-b110a3064398 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3d548803-e5f8-4f42-a51f-aade5f21e009] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:37.173665 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a8b8b0f5-53a8-471c-ab4b-b110a3064398 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:37.174145 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a8b8b0f5-53a8-471c-ab4b-b110a3064398 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:37.174578 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a8b8b0f5-53a8-471c-ab4b-b110a3064398 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:37.175290 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a8b8b0f5-53a8-471c-ab4b-b110a3064398 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:37.175744 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a8b8b0f5-53a8-471c-ab4b-b110a3064398 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:37.176165 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a8b8b0f5-53a8-471c-ab4b-b110a3064398 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:37.189311 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-a8b8b0f5-53a8-471c-ab4b-b110a3064398 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] HTTP exception thrown: Instance 3d548803-e5f8-4f42-a51f-aade5f21e009 could not be found. Aug 10 13:30:37.190912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a8b8b0f5-53a8-471c-ab4b-b110a3064398 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Request method failure captured: Aug 10 13:30:37.190912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009 HTTP/1.1 Aug 10 13:30:37.190912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:30:37.190912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:30:37.190912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:30:37.190912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:30:37.190912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:30:37.190912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:30:37.190912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:30:37.190912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:30:37.190912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi87FyzhSC-EwZssdecWREHp0AdwTzglzzfFl_2pGy3gb_pFhsEKU-VWMAk5TqXIfnvxyh-6SfoUjBS7MK-N5VGSt--UyUh1RTVCXK1g2sUO8-bzn39sxvTp5pcLJ0HQJbA68OeKW-t1T_vryhCoNioSeQPS6vDLrAP96y2XflVCke-SI Aug 10 13:30:37.190912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:30:37.190912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:30:37.190912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:30:37.190912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:30:37.190912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:30:37.190912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:30:37.190912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: 2a40aefbd17f4dbc911527a917f03976 Aug 10 13:30:37.190912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-TestVolumeBootPattern-458366838 Aug 10 13:30:37.190912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:30:37.190912 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:30:37.192483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2a40aefbd17f4dbc911527a917f03976"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2a40aefbd17f4dbc911527a917f03976", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2a40aefbd17f4dbc911527a917f03976"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2a40aefbd17f4dbc911527a917f03976"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:30:37.192483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-TestVolumeBootPattern-458366838 Aug 10 13:30:37.192483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: 2a40aefbd17f4dbc911527a917f03976 Aug 10 13:30:37.192483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-TestVolumeBootPattern-458366838 Aug 10 13:30:37.192483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-TestVolumeBootPattern-458366838-project Aug 10 13:30:37.192483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:30:37.192483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:30:37.192483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: eaa1bdd8c2f34ebc90d7f5b6ec4c2d51 Aug 10 13:30:37.192483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-TestVolumeBootPattern-458366838-project Aug 10 13:30:37.192483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:30:37.192483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance 3d548803-e5f8-4f42-a51f-aade5f21e009 could not be found. Aug 10 13:30:37.192483 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': '3d548803-e5f8-4f42-a51f-aade5f21e009'} Aug 10 13:30:37.193351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:30:37.193351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:30:37.193351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:30:37.193351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:30:37.193351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:30:37.193351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:30:37.193351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:30:37.193351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:30:37.193351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:30:37.193351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:30:37.193351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d548803-e5f8-4f42-a51f-aade5f21e009 could not be found. Aug 10 13:30:37.193351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:30:37.193351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:30:37.193351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:30:37.193351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:30:37.193351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:30:37.193351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:30:37.193351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:30:37.193351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:30:37.193351 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:30:37.194576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:30:37.194576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:30:37.194576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:30:37.194576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:30:37.194576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:30:37.194576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:30:37.194576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:30:37.194576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d548803-e5f8-4f42-a51f-aade5f21e009 could not be found. Aug 10 13:30:37.194576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:30:37.194576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:30:37.194576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:30:37.194576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:30:37.194576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:30:37.194576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:30:37.194576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:30:37.194576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:30:37.194576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d548803-e5f8-4f42-a51f-aade5f21e009 could not be found. Aug 10 13:30:37.194576 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:30:37.196337 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a8b8b0f5-53a8-471c-ab4b-b110a3064398 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Returning 404 to user: Instance 3d548803-e5f8-4f42-a51f-aade5f21e009 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:30:37.196337 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a8b8b0f5-53a8-471c-ab4b-b110a3064398 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009" status: 404 len: 111 microversion: 2.1 time: 0.029695 Aug 10 13:30:37.196337 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2107/3812] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:37 2022] GET /compute/v2.1/servers/3d548803-e5f8-4f42-a51f-aade5f21e009 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:30:40.493770 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-207e398d-258a-4904-bcf0-0448961c2639 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:40.494738 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-207e398d-258a-4904-bcf0-0448961c2639 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 404cc144-d657-4260-a0e9-fdd708b699d8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:40.501050 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-207e398d-258a-4904-bcf0-0448961c2639 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:40.501602 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-207e398d-258a-4904-bcf0-0448961c2639 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:40.502102 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-207e398d-258a-4904-bcf0-0448961c2639 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:40.502792 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-207e398d-258a-4904-bcf0-0448961c2639 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:40.503258 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-207e398d-258a-4904-bcf0-0448961c2639 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:40.503681 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-207e398d-258a-4904-bcf0-0448961c2639 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:40.529244 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-207e398d-258a-4904-bcf0-0448961c2639 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 404cc144-d657-4260-a0e9-fdd708b699d8] Going to try to terminate instance {{(pid=124643) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 13:30:40.742383 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-207e398d-258a-4904-bcf0-0448961c2639 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "DELETE /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8" status: 204 len: 0 microversion: 2.1 time: 0.252276 Aug 10 13:30:40.743245 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2108/3813] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 13:30:40 2022] DELETE /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 13:30:40.750967 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-3f9b23bc-c037-4eec-9207-b1cbe2323276 req-e8c2f0fc-0114-435b-b6db-a239f386755a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "404cc144-d657-4260-a0e9-fdd708b699d8", "tag": "8c67024d-a5cc-445a-8781-3835732be0d6"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:40.761166 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-3f9b23bc-c037-4eec-9207-b1cbe2323276 req-e8c2f0fc-0114-435b-b6db-a239f386755a service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:40.761717 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-3f9b23bc-c037-4eec-9207-b1cbe2323276 req-e8c2f0fc-0114-435b-b6db-a239f386755a service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:40.762284 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-3f9b23bc-c037-4eec-9207-b1cbe2323276 req-e8c2f0fc-0114-435b-b6db-a239f386755a service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:40.774374 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-3f9b23bc-c037-4eec-9207-b1cbe2323276 req-e8c2f0fc-0114-435b-b6db-a239f386755a service nova] Creating event network-changed:8c67024d-a5cc-445a-8781-3835732be0d6 for instance 404cc144-d657-4260-a0e9-fdd708b699d8 on hv-cinder-85199 Aug 10 13:30:40.780000 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-3f9b23bc-c037-4eec-9207-b1cbe2323276 req-e8c2f0fc-0114-435b-b6db-a239f386755a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034188 Aug 10 13:30:40.780601 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2109/3814] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 13:30:40.788782 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-faaf020f-8b68-4236-bf9e-f7b818a435da tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:40.789485 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-faaf020f-8b68-4236-bf9e-f7b818a435da tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 404cc144-d657-4260-a0e9-fdd708b699d8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:40.795795 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-faaf020f-8b68-4236-bf9e-f7b818a435da tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:40.796277 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-faaf020f-8b68-4236-bf9e-f7b818a435da tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:40.796727 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-faaf020f-8b68-4236-bf9e-f7b818a435da tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:40.797397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-faaf020f-8b68-4236-bf9e-f7b818a435da tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:40.797849 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-faaf020f-8b68-4236-bf9e-f7b818a435da tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:40.798275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-faaf020f-8b68-4236-bf9e-f7b818a435da tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:40.931931 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-faaf020f-8b68-4236-bf9e-f7b818a435da tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:40.939756 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-faaf020f-8b68-4236-bf9e-f7b818a435da tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8" status: 200 len: 1575 microversion: 2.1 time: 0.155160 Aug 10 13:30:40.940427 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2110/3815] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:40 2022] GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 13:30:41.961907 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-71436dd1-eac7-47b9-ae5a-482cec5eaf78 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:41.963087 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-71436dd1-eac7-47b9-ae5a-482cec5eaf78 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 404cc144-d657-4260-a0e9-fdd708b699d8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:41.969715 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71436dd1-eac7-47b9-ae5a-482cec5eaf78 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:41.970206 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71436dd1-eac7-47b9-ae5a-482cec5eaf78 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:41.970648 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71436dd1-eac7-47b9-ae5a-482cec5eaf78 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:41.971386 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71436dd1-eac7-47b9-ae5a-482cec5eaf78 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:41.971844 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71436dd1-eac7-47b9-ae5a-482cec5eaf78 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:41.972305 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-71436dd1-eac7-47b9-ae5a-482cec5eaf78 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:42.112345 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-71436dd1-eac7-47b9-ae5a-482cec5eaf78 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:42.120101 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-71436dd1-eac7-47b9-ae5a-482cec5eaf78 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8" status: 200 len: 1575 microversion: 2.1 time: 0.162070 Aug 10 13:30:42.120682 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2111/3816] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:41 2022] GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:30:42.954202 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [req-db6e0db7-c8d8-423c-abbf-19228da75c7e req-7a0cf3ad-0875-4b52-a1a7-ae4e909158ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "404cc144-d657-4260-a0e9-fdd708b699d8", "name": "network-vif-deleted", "tag": "8c67024d-a5cc-445a-8781-3835732be0d6"}]} {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 13:30:42.963397 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-db6e0db7-c8d8-423c-abbf-19228da75c7e req-7a0cf3ad-0875-4b52-a1a7-ae4e909158ec service nova] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:42.963954 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-db6e0db7-c8d8-423c-abbf-19228da75c7e req-7a0cf3ad-0875-4b52-a1a7-ae4e909158ec service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:42.964273 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [req-db6e0db7-c8d8-423c-abbf-19228da75c7e req-7a0cf3ad-0875-4b52-a1a7-ae4e909158ec service nova] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:42.975228 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.compute.server_external_events [req-db6e0db7-c8d8-423c-abbf-19228da75c7e req-7a0cf3ad-0875-4b52-a1a7-ae4e909158ec service nova] Creating event network-vif-deleted:8c67024d-a5cc-445a-8781-3835732be0d6 for instance 404cc144-d657-4260-a0e9-fdd708b699d8 on hv-cinder-85199 Aug 10 13:30:42.980915 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [req-db6e0db7-c8d8-423c-abbf-19228da75c7e req-7a0cf3ad-0875-4b52-a1a7-ae4e909158ec service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030634 Aug 10 13:30:42.981518 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2112/3817] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 10 13:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 13:30:43.141721 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-a5c646d0-e41b-4347-9d0a-0c2c2590be61 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:43.142423 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-a5c646d0-e41b-4347-9d0a-0c2c2590be61 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 404cc144-d657-4260-a0e9-fdd708b699d8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:43.153409 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5c646d0-e41b-4347-9d0a-0c2c2590be61 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:43.153409 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5c646d0-e41b-4347-9d0a-0c2c2590be61 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:43.153409 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5c646d0-e41b-4347-9d0a-0c2c2590be61 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:43.153409 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5c646d0-e41b-4347-9d0a-0c2c2590be61 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:43.153950 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5c646d0-e41b-4347-9d0a-0c2c2590be61 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:43.153950 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-a5c646d0-e41b-4347-9d0a-0c2c2590be61 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:43.217832 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.policy [None req-a5c646d0-e41b-4347-9d0a-0c2c2590be61 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa1bdd8c2f34ebc90d7f5b6ec4c2d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a40aefbd17f4dbc911527a917f03976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124643) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 13:30:43.225610 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-a5c646d0-e41b-4347-9d0a-0c2c2590be61 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8" status: 200 len: 1224 microversion: 2.1 time: 0.088065 Aug 10 13:30:43.226182 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2113/3818] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:43 2022] GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 13:30:44.248542 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-40344c0b-1028-4dd5-b9d6-76f816c8f220 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:44.249146 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-40344c0b-1028-4dd5-b9d6-76f816c8f220 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 404cc144-d657-4260-a0e9-fdd708b699d8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:44.255319 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40344c0b-1028-4dd5-b9d6-76f816c8f220 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:44.255803 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40344c0b-1028-4dd5-b9d6-76f816c8f220 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:44.256243 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40344c0b-1028-4dd5-b9d6-76f816c8f220 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:44.256932 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40344c0b-1028-4dd5-b9d6-76f816c8f220 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:44.257390 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40344c0b-1028-4dd5-b9d6-76f816c8f220 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:44.257823 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-40344c0b-1028-4dd5-b9d6-76f816c8f220 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:44.272727 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-40344c0b-1028-4dd5-b9d6-76f816c8f220 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] HTTP exception thrown: Instance 404cc144-d657-4260-a0e9-fdd708b699d8 could not be found. Aug 10 13:30:44.274369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-40344c0b-1028-4dd5-b9d6-76f816c8f220 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Request method failure captured: Aug 10 13:30:44.274369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8 HTTP/1.1 Aug 10 13:30:44.274369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:30:44.274369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:30:44.274369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:30:44.274369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:30:44.274369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:30:44.274369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:30:44.274369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:30:44.274369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:30:44.274369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi87FyzhSC-EwZssdecWREHp0AdwTzglzzfFl_2pGy3gb_pFhsEKU-VWMAk5TqXIfnvxyh-6SfoUjBS7MK-N5VGSt--UyUh1RTVCXK1g2sUO8-bzn39sxvTp5pcLJ0HQJbA68OeKW-t1T_vryhCoNioSeQPS6vDLrAP96y2XflVCke-SI Aug 10 13:30:44.274369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:30:44.274369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:30:44.274369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:30:44.274369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:30:44.274369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:30:44.274369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:30:44.274369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: 2a40aefbd17f4dbc911527a917f03976 Aug 10 13:30:44.274369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-TestVolumeBootPattern-458366838 Aug 10 13:30:44.274369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:30:44.274369 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:30:44.275700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2a40aefbd17f4dbc911527a917f03976"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2a40aefbd17f4dbc911527a917f03976", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2a40aefbd17f4dbc911527a917f03976"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2a40aefbd17f4dbc911527a917f03976"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:30:44.275700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-TestVolumeBootPattern-458366838 Aug 10 13:30:44.275700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: 2a40aefbd17f4dbc911527a917f03976 Aug 10 13:30:44.275700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-TestVolumeBootPattern-458366838 Aug 10 13:30:44.275700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-TestVolumeBootPattern-458366838-project Aug 10 13:30:44.275700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:30:44.275700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:30:44.275700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: eaa1bdd8c2f34ebc90d7f5b6ec4c2d51 Aug 10 13:30:44.275700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-TestVolumeBootPattern-458366838-project Aug 10 13:30:44.275700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:30:44.275700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance 404cc144-d657-4260-a0e9-fdd708b699d8 could not be found. Aug 10 13:30:44.275700 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': '404cc144-d657-4260-a0e9-fdd708b699d8'} Aug 10 13:30:44.276504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:30:44.276504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:30:44.276504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:30:44.276504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:30:44.276504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:30:44.276504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:30:44.276504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:30:44.276504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:30:44.276504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:30:44.276504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:30:44.276504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 404cc144-d657-4260-a0e9-fdd708b699d8 could not be found. Aug 10 13:30:44.276504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:30:44.276504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:30:44.276504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:30:44.276504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:30:44.276504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:30:44.276504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:30:44.276504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:30:44.276504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:30:44.276504 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:30:44.277633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:30:44.277633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:30:44.277633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:30:44.277633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:30:44.277633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:30:44.277633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:30:44.277633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:30:44.277633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 404cc144-d657-4260-a0e9-fdd708b699d8 could not be found. Aug 10 13:30:44.277633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:30:44.277633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:30:44.277633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:30:44.277633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:30:44.277633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:30:44.277633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:30:44.277633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:30:44.277633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:30:44.277633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 404cc144-d657-4260-a0e9-fdd708b699d8 could not be found. Aug 10 13:30:44.277633 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:30:44.278647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-40344c0b-1028-4dd5-b9d6-76f816c8f220 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Returning 404 to user: Instance 404cc144-d657-4260-a0e9-fdd708b699d8 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:30:44.278647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-40344c0b-1028-4dd5-b9d6-76f816c8f220 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8" status: 404 len: 111 microversion: 2.1 time: 0.031912 Aug 10 13:30:44.278647 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2114/3819] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:44 2022] GET /compute/v2.1/servers/404cc144-d657-4260-a0e9-fdd708b699d8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:30:44.778850 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bd40f11c-3c9a-45e4-b3f2-a69e01349cf6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:44.779371 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-bd40f11c-3c9a-45e4-b3f2-a69e01349cf6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3a522348-e70d-4810-91a7-cf469801dbf8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:44.785206 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd40f11c-3c9a-45e4-b3f2-a69e01349cf6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:44.785679 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd40f11c-3c9a-45e4-b3f2-a69e01349cf6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:44.786109 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd40f11c-3c9a-45e4-b3f2-a69e01349cf6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:44.786785 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd40f11c-3c9a-45e4-b3f2-a69e01349cf6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:44.787250 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd40f11c-3c9a-45e4-b3f2-a69e01349cf6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:44.787670 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-bd40f11c-3c9a-45e4-b3f2-a69e01349cf6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:44.801099 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-bd40f11c-3c9a-45e4-b3f2-a69e01349cf6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] HTTP exception thrown: Instance 3a522348-e70d-4810-91a7-cf469801dbf8 could not be found. Aug 10 13:30:44.802608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bd40f11c-3c9a-45e4-b3f2-a69e01349cf6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Request method failure captured: Aug 10 13:30:44.802608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: DELETE /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8 HTTP/1.1 Aug 10 13:30:44.802608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:30:44.802608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:30:44.802608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:30:44.802608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:30:44.802608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:30:44.802608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:30:44.802608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:30:44.802608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:30:44.802608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi87FyzhSC-EwZssdecWREHp0AdwTzglzzfFl_2pGy3gb_pFhsEKU-VWMAk5TqXIfnvxyh-6SfoUjBS7MK-N5VGSt--UyUh1RTVCXK1g2sUO8-bzn39sxvTp5pcLJ0HQJbA68OeKW-t1T_vryhCoNioSeQPS6vDLrAP96y2XflVCke-SI Aug 10 13:30:44.802608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:30:44.802608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:30:44.802608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:30:44.802608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:30:44.802608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:30:44.802608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:30:44.802608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: 2a40aefbd17f4dbc911527a917f03976 Aug 10 13:30:44.802608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-TestVolumeBootPattern-458366838 Aug 10 13:30:44.802608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:30:44.802608 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:30:44.804074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2a40aefbd17f4dbc911527a917f03976"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2a40aefbd17f4dbc911527a917f03976", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2a40aefbd17f4dbc911527a917f03976"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2a40aefbd17f4dbc911527a917f03976"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:30:44.804074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-TestVolumeBootPattern-458366838 Aug 10 13:30:44.804074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: 2a40aefbd17f4dbc911527a917f03976 Aug 10 13:30:44.804074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-TestVolumeBootPattern-458366838 Aug 10 13:30:44.804074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-TestVolumeBootPattern-458366838-project Aug 10 13:30:44.804074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:30:44.804074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:30:44.804074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: eaa1bdd8c2f34ebc90d7f5b6ec4c2d51 Aug 10 13:30:44.804074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-TestVolumeBootPattern-458366838-project Aug 10 13:30:44.804074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:30:44.804074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance 3a522348-e70d-4810-91a7-cf469801dbf8 could not be found. Aug 10 13:30:44.804074 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': '3a522348-e70d-4810-91a7-cf469801dbf8'} Aug 10 13:30:44.804824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:30:44.804824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:30:44.804824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:30:44.804824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:30:44.804824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:30:44.804824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:30:44.804824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:30:44.804824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:30:44.804824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:30:44.804824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:30:44.804824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a522348-e70d-4810-91a7-cf469801dbf8 could not be found. Aug 10 13:30:44.804824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:30:44.804824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:30:44.804824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:30:44.804824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:30:44.804824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:30:44.804824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:30:44.804824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:30:44.804824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:30:44.804824 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:30:44.805905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:30:44.805905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 13:30:44.805905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 13:30:44.805905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 13:30:44.805905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 13:30:44.805905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:30:44.805905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:30:44.805905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:30:44.805905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:30:44.805905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a522348-e70d-4810-91a7-cf469801dbf8 could not be found. Aug 10 13:30:44.805905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:30:44.805905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:30:44.805905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:30:44.805905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:30:44.805905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:30:44.805905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:30:44.805905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:30:44.805905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:30:44.805905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a522348-e70d-4810-91a7-cf469801dbf8 could not be found. Aug 10 13:30:44.805905 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:30:44.807677 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-bd40f11c-3c9a-45e4-b3f2-a69e01349cf6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Returning 404 to user: Instance 3a522348-e70d-4810-91a7-cf469801dbf8 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:30:44.807677 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-bd40f11c-3c9a-45e4-b3f2-a69e01349cf6 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8" status: 404 len: 111 microversion: 2.1 time: 0.029119 Aug 10 13:30:44.807677 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2115/3820] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 10 13:30:44 2022] DELETE /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:30:44.812860 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-58bada25-819f-45d3-837c-c13f7b539fa1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:44.813452 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.compute.api [None req-58bada25-819f-45d3-837c-c13f7b539fa1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] [instance: 3a522348-e70d-4810-91a7-cf469801dbf8] Fetching instance by UUID {{(pid=124643) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 13:30:44.818872 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-58bada25-819f-45d3-837c-c13f7b539fa1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:44.819387 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-58bada25-819f-45d3-837c-c13f7b539fa1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:44.819819 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-58bada25-819f-45d3-837c-c13f7b539fa1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:44.820488 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-58bada25-819f-45d3-837c-c13f7b539fa1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Acquiring lock "866d7ac2-611a-49e3-ac53-852457d986fe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 13:30:44.820931 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-58bada25-819f-45d3-837c-c13f7b539fa1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 13:30:44.821348 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG oslo_concurrency.lockutils [None req-58bada25-819f-45d3-837c-c13f7b539fa1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Lock "866d7ac2-611a-49e3-ac53-852457d986fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 13:30:44.834868 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.wsgi [None req-58bada25-819f-45d3-837c-c13f7b539fa1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] HTTP exception thrown: Instance 3a522348-e70d-4810-91a7-cf469801dbf8 could not be found. Aug 10 13:30:44.836378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-58bada25-819f-45d3-837c-c13f7b539fa1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Request method failure captured: Aug 10 13:30:44.836378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: request: GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8 HTTP/1.1 Aug 10 13:30:44.836378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept: application/json Aug 10 13:30:44.836378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Accept-Encoding: identity Aug 10 13:30:44.836378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Connection: close Aug 10 13:30:44.836378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Length: 0 Aug 10 13:30:44.836378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Content-Type: application/json Aug 10 13:30:44.836378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Host: 10.222.0.49 Aug 10 13:30:44.836378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Openstack-System-Scope: None Aug 10 13:30:44.836378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: User-Agent: python-urllib3/1.26.11 Aug 10 13:30:44.836378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Auth-Token: gAAAAABi87FyzhSC-EwZssdecWREHp0AdwTzglzzfFl_2pGy3gb_pFhsEKU-VWMAk5TqXIfnvxyh-6SfoUjBS7MK-N5VGSt--UyUh1RTVCXK1g2sUO8-bzn39sxvTp5pcLJ0HQJbA68OeKW-t1T_vryhCoNioSeQPS6vDLrAP96y2XflVCke-SI Aug 10 13:30:44.836378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Id: None Aug 10 13:30:44.836378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Domain-Name: None Aug 10 13:30:44.836378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Identity-Status: Confirmed Aug 10 13:30:44.836378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Is-Admin-Project: True Aug 10 13:30:44.836378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Id: default Aug 10 13:30:44.836378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Domain-Name: Default Aug 10 13:30:44.836378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Id: 2a40aefbd17f4dbc911527a917f03976 Aug 10 13:30:44.836378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Project-Name: tempest-TestVolumeBootPattern-458366838 Aug 10 13:30:44.836378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Role: reader,member Aug 10 13:30:44.836378 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Roles: reader,member Aug 10 13:30:44.837838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2a40aefbd17f4dbc911527a917f03976"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2a40aefbd17f4dbc911527a917f03976", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2a40aefbd17f4dbc911527a917f03976"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2a40aefbd17f4dbc911527a917f03976"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 10 13:30:44.837838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant: tempest-TestVolumeBootPattern-458366838 Aug 10 13:30:44.837838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Id: 2a40aefbd17f4dbc911527a917f03976 Aug 10 13:30:44.837838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-Tenant-Name: tempest-TestVolumeBootPattern-458366838 Aug 10 13:30:44.837838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User: tempest-TestVolumeBootPattern-458366838-project Aug 10 13:30:44.837838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Id: default Aug 10 13:30:44.837838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Domain-Name: Default Aug 10 13:30:44.837838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Id: eaa1bdd8c2f34ebc90d7f5b6ec4c2d51 Aug 10 13:30:44.837838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: X-User-Name: tempest-TestVolumeBootPattern-458366838-project Aug 10 13:30:44.837838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: method: > Aug 10 13:30:44.837838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: exception: Instance 3a522348-e70d-4810-91a7-cf469801dbf8 could not be found. Aug 10 13:30:44.837838 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: action_args: {'id': '3a522348-e70d-4810-91a7-cf469801dbf8'} Aug 10 13:30:44.839316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 13:30:44.839316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:30:44.839316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 13:30:44.839316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 13:30:44.839316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 13:30:44.839316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 13:30:44.839316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 13:30:44.839316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 13:30:44.839316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 13:30:44.839316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 13:30:44.839316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a522348-e70d-4810-91a7-cf469801dbf8 could not be found. Aug 10 13:30:44.839316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:30:44.839316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:30:44.839316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:30:44.839316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:30:44.839316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:30:44.839316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:30:44.839316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 13:30:44.839316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 13:30:44.839316 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 13:30:44.840754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 13:30:44.840754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 13:30:44.840754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 13:30:44.840754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 13:30:44.840754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 13:30:44.840754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 13:30:44.840754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 13:30:44.840754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a522348-e70d-4810-91a7-cf469801dbf8 could not be found. Aug 10 13:30:44.840754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:30:44.840754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 13:30:44.840754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:30:44.840754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 13:30:44.840754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 13:30:44.840754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 13:30:44.840754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 13:30:44.840754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 13:30:44.840754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a522348-e70d-4810-91a7-cf469801dbf8 could not be found. Aug 10 13:30:44.840754 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: ERROR nova.api.openstack.wsgi Aug 10 13:30:44.841983 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-58bada25-819f-45d3-837c-c13f7b539fa1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Returning 404 to user: Instance 3a522348-e70d-4810-91a7-cf469801dbf8 could not be found. {{(pid=124643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 13:30:44.841983 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-58bada25-819f-45d3-837c-c13f7b539fa1 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8" status: 404 len: 111 microversion: 2.1 time: 0.028285 Aug 10 13:30:44.841983 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2116/3821] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 10 13:30:44 2022] GET /compute/v2.1/servers/3a522348-e70d-4810-91a7-cf469801dbf8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 13:30:46.323636 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: DEBUG nova.api.openstack.wsgi [None req-245ba090-812d-4e88-a022-b575dd864553 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] Calling method '.version_select at 0x7fb82b2ca5e0>' {{(pid=124643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 13:30:46.417447 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO nova.api.openstack.requestlog [None req-245ba090-812d-4e88-a022-b575dd864553 tempest-TestVolumeBootPattern-458366838 tempest-TestVolumeBootPattern-458366838-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1539369100" status: 202 len: 0 microversion: 2.1 time: 0.097634 Aug 10 13:30:46.418023 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: [pid: 124643|app: 0|req: 2117/3822] 10.222.0.49 () {58 vars in 1263 bytes} [Wed Aug 10 13:30:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1539369100 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 13:31:38.586295 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:31:38.587512 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Wed Aug 10 13:31:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:33:21.542634 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:33:21.543275 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Wed Aug 10 13:33:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:33:34.452777 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:33:34.453368 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Wed Aug 10 13:33:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 13:34:58.595784 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 13:34:58.596544 dv-cinder-851996-7-iscsi devstack@n-api.service[124643]: Wed Aug 10 13:34:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!